CN114463359A - Screen projection display method and device, electronic equipment and readable storage medium - Google Patents
Screen projection display method and device, electronic equipment and readable storage medium Download PDFInfo
- Publication number
- CN114463359A CN114463359A CN202210114218.4A CN202210114218A CN114463359A CN 114463359 A CN114463359 A CN 114463359A CN 202210114218 A CN202210114218 A CN 202210114218A CN 114463359 A CN114463359 A CN 114463359A
- Authority
- CN
- China
- Prior art keywords
- image data
- additional information
- screen
- picture
- projection display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000000605 extraction Methods 0.000 claims abstract description 59
- 238000012545 processing Methods 0.000 claims description 34
- 230000008859 change Effects 0.000 claims description 11
- 230000010354 integration Effects 0.000 claims description 2
- 238000004891 communication Methods 0.000 description 13
- 230000008569 process Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000003993 interaction Effects 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 230000005484 gravity Effects 0.000 description 2
- 230000000873 masking effect Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000005266 casting Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000010079 rubber tapping Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/12—Edge-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/136—Segmentation; Edge detection involving thresholding
Abstract
The invention discloses a screen projection display method, a screen projection display device, electronic equipment and a readable storage medium, and relates to the technical field of screen projection, wherein the screen projection display method comprises the following steps: acquiring screen projection data, wherein the screen projection data comprises image data; carrying out black edge recognition on the image data, and cutting the image data according to the black edge recognition result to obtain the cut image data; extracting additional information in the image data according to a preset extraction model; and integrating the additional information into the cut image data to obtain the integrated image data. The lost additional information is displayed on the display equipment again, so that the information integrity of the image data is ensured, the information loss caused by cutting is avoided, and the watching experience of a user is improved.
Description
Technical Field
The invention relates to the technical field of screen projection, in particular to a screen projection display method, screen projection display equipment and a readable storage medium.
Background
With the change of times, the demand of taking the large screen of the television end as a display or projection device is increasing. And with the continuous innovation and upgrade of the functions of the mobile terminal equipment, the requirements of users on interaction among multiple pieces of equipment are higher and higher, and the large-screen terminal of the television has better viewing experience than the mobile terminal, so that the appeal that the page of the mobile terminal can be distributed to the large-screen terminal is stronger and stronger. However, when the picture of the mobile terminal is re-laid out to the large-screen device, other information related to the picture may be lost, so that the user cannot know the core information of the picture, and the viewing experience of the user is affected.
Therefore, a method for re-laying out the screen of the mobile terminal to the large screen without losing the related information of the screen is needed.
The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.
Disclosure of Invention
The invention mainly aims to provide a screen projection display method, and aims to solve the technical problem that other information related to a picture is possibly lost when the picture of a moving end is rearranged to a large-screen device.
In order to achieve the above object, the present invention provides a screen projection display method, which comprises the following steps:
acquiring screen projection data, wherein the screen projection data comprises image data;
carrying out black edge recognition on the image data, and cutting the image data according to the black edge recognition result to obtain the cut image data;
extracting additional information in the image data according to a preset extraction model;
and integrating the additional information into the cut image data to obtain the integrated image data.
Further, the preset extraction model includes a preset extraction element, and the step of extracting the additional information in the image data according to the preset extraction model includes:
extracting elements corresponding to the preset extraction elements from the image data;
and taking the extracted element as the additional information.
Further, after the step of extracting the additional information in the image data according to a preset extraction model, the method further includes:
and performing image processing on the additional information, wherein the image processing comprises one or more of color processing, contour processing and mask processing.
Further, the step of integrating the additional information into the cropped image data to obtain the integrated image data includes:
and placing the processed additional information at a preset position of the cut image data to acquire the integrated image data.
Further, after the step of acquiring the integrated image data, the method includes:
and displaying the integrated image data, hiding the additional information after displaying the preset time length, and displaying the additional information again when triggering the awakening operation.
Further, the step of performing black edge recognition on the image data and cutting the image data according to the black edge recognition result includes:
acquiring a first picture and a second picture from the image data, respectively carrying out black edge recognition on the first picture and the second picture, and determining a first cutting position of the first picture and a second cutting position of the second picture;
and generating a target cutting position according to the first cutting position and the second cutting position, and cutting the image data according to the target cutting position.
Further, the step of performing black edge recognition on the first picture and the second picture respectively includes:
comparing the color values of the pixel points of the first picture, dividing the pixel points of the first picture into first comparison units, and identifying the position, in the first comparison units, of which the color value change degree of the pixel points exceeds a preset threshold value, as a black edge and using the black edge as the first cutting position;
comparing the color values of the pixel points of the second picture, dividing the pixel points of the second picture into second comparison units, and identifying the position, in the second comparison units, of which the color value change degree of the pixel points exceeds a preset threshold value, as a black boundary line and using the black boundary line as the second cutting position.
In addition, to achieve the above object, the present invention further provides a screen projection display device, including:
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring screen projection data which comprises image data;
the cutting module is used for carrying out black edge recognition on the image data, cutting the image data according to the black edge recognition result and obtaining the cut image data;
the extraction module is used for extracting the additional information in the image data according to a preset extraction model;
and the integration module is used for integrating the additional information into the cut image data to obtain the integrated image data.
In addition, to achieve the above object, the present invention also provides an electronic device including: the system comprises a memory, a processor and a screen projection display program stored on the memory and capable of running on the processor, wherein the screen projection display program realizes the steps of the screen projection display method when being executed by the processor.
In addition, to achieve the above object, the present invention further provides a readable storage medium, on which a screen projection display program is stored, and the screen projection display program, when executed by a processor, implements the steps of the screen projection display method as described above.
According to the screen projection display method provided by the embodiment of the invention, after the screen projection data is cut, information extraction is carried out on the image data in the screen projection data again, and the extracted additional information is integrated into the cut image data, so that the relevant information is complete when the image data is displayed, the core information is prevented from being lost, and the watching experience of a user is improved.
Drawings
FIG. 1 is a schematic view of a screen projection connection scene in the screen projection display method according to the present invention;
FIG. 2 is a schematic diagram of an electronic device in a hardware operating environment according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating a first exemplary embodiment of a screen projection display method according to the present invention;
FIG. 4 is a schematic diagram illustrating a display effect of a first frame on a display device before clipping in the screen-casting display method of the present invention;
FIG. 5 is a schematic view of a display screen of a display device displaying image data according to the screen-projection display method of the present invention;
FIG. 6 is a schematic diagram of image data after additional information is integrated in the screen-projection display method according to the present invention;
FIG. 7 is a schematic view of a screen projection display method according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a device related to the screen projection display method of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The main solution of the embodiment of the invention is as follows: and after the screen projection data are cut, extracting information from the image data in the screen projection data again, and integrating the extracted additional information into the cut image data.
When the screen projection technology re-lays the picture of the mobile terminal to the large-screen device, other information related to the picture may be lost, so that the user cannot know the core information of the picture.
The invention provides a solution, so that the related information is complete when the image data is displayed, the core information is prevented from being lost, and the watching experience of a user is improved.
Referring to fig. 1, fig. 1 is a schematic view of a screen projection connection according to an embodiment of the present invention.
As shown in fig. 1, the screen projector includes: the electronic device comprises a screen projector transmitter and a screen projector receiver, wherein the first electronic device can be a personal computer, or can be a mobile terminal device such as a smart phone, a tablet computer, an electronic book reader and a portable computer, and the second electronic device can be a television, or can be a display device such as a display and a projector with a display function.
In some embodiments, the first electronic device is connected with the screen projector transmitter or the screen projector receiver through a wired or wireless network for data transmission and interaction; the screen projector transmitter is connected with the screen projector receiver through a wireless network to perform data transmission and interaction, or the screen projector transmitter is connected with the second electronic equipment through the wireless network to perform data transmission and interaction; the screen projector receiver is connected with the second electronic equipment through a wired or wireless network to perform data transmission and interaction. In an optional implementation manner, the wired connection between the screen projector receiver and the second electronic device and the wired connection between the screen projector transmitter and the first electronic device may include wired connections based on HDMI (High Definition Multimedia Interface), USB (Universal Serial Bus), DP (display Interface), VGA (Video Graphics Array), and the like. The wireless communication modes between the first electronic device and the screen projector and between the first electronic device and the screen projector receiver and between the second electronic device and the screen projector receiver can include wireless communication such as Bluetooth (Bluetooth), wireless broadband (Wi-Fi) and infrared communication.
Therefore, the possible connection modes for realizing screen projection between the first electronic device, the screen projector transmitter, the screen projector receiver and the second electronic device at least include:
(1) the screen projector transmitter is connected with the screen projector receiver, and the first electronic equipment picture is finally projected to the second electronic equipment through the screen projector transmitter and the screen projector receiver;
(2) the screen projector transmitter is wirelessly connected with the second electronic equipment, the picture of the first electronic equipment is projected to the second electronic equipment through the screen projector transmitter, and at the moment, the screen projector transmitter is connected with a wireless communication module arranged in the second electronic equipment through a wireless network;
(3) the first electronic equipment is connected with the screen projector receiver, and the first electronic equipment picture is projected to the second electronic equipment through the screen projector receiver.
As shown in fig. 2, fig. 2 is a schematic terminal structure diagram of a hardware operating environment according to an embodiment of the present invention.
The electronic equipment in the embodiment of the invention can be a screen projector, and also can be electronic equipment with data receiving, data processing and data sending functions, such as a television, a mobile phone, a PC, a tablet personal computer, a portable computer and the like.
As shown in fig. 1, the apparatus may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory such as a disk memory. The memory 1005 may alternatively be a storage device separate from the processor 1001.
Optionally, the device may also include a camera, RF (Radio Frequency) circuitry, sensors, audio circuitry, WiFi modules, and so forth. Such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display screen according to the brightness of ambient light, and a proximity sensor that may turn off the display screen and/or the backlight when the mobile terminal is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), detect the magnitude and direction of gravity when the mobile terminal is stationary, and can be used for applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer and tapping) and the like for recognizing the attitude of the mobile terminal; of course, the mobile device may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which are not described herein again.
Those skilled in the art will appreciate that the configuration of the apparatus shown in fig. 1 is not intended to be limiting of the apparatus and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 2, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a screen projection display program.
In the terminal shown in fig. 2, the network interface 1004 is mainly used for connecting a background server and performing data communication with the background server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to call the screen projection display program stored in the memory 1005 and perform the following operations:
acquiring screen projection data, wherein the screen projection data comprises image data;
carrying out black edge recognition on the image data, and cutting the image data according to the black edge recognition result to obtain the cut image data;
extracting additional information in the image data according to a preset extraction model;
and integrating the additional information into the cut image data to obtain the integrated image data.
Further, the processor 1001 may call a screen projection display program stored in the memory 1005, and further perform the following operations:
the preset extraction model comprises a preset extraction area, and the step of extracting the additional information in the image data according to the preset extraction model comprises the following steps:
extracting a region corresponding to the preset extraction region from the image data;
and taking the extracted area as the additional information.
Further, the processor 1001 may call a screen projection display program stored in the memory 1005, and further perform the following operations:
the preset extraction model comprises preset extraction elements, and the step of extracting the additional information in the image data according to the preset extraction model comprises the following steps:
extracting elements corresponding to the preset extraction elements from the image data;
and taking the extracted element as the additional information.
Further, the processor 1001 may call a screen projection display program stored in the memory 1005, and further perform the following operations:
after the step of extracting the additional information in the image data according to a preset extraction model, the method further comprises:
and performing image processing on the additional information, wherein the image processing comprises one or more of color processing, contour processing and mask processing.
Further, the processor 1001 may call a screen projection display program stored in the memory 1005, and further perform the following operations:
the step of integrating the additional information into the cropped image data and acquiring the integrated image data includes:
and placing the processed additional information at a preset position of the cut image data to acquire the integrated image data.
Further, the processor 1001 may call a screen projection display program stored in the memory 1005, and further perform the following operations:
after the step of acquiring the integrated image data, comprising:
and displaying the integrated image data, hiding the additional information after displaying the preset time length, and displaying the additional information again when triggering the awakening operation.
Further, the processor 1001 may call a screen projection display program stored in the memory 1005, and further perform the following operations:
the step of performing black edge recognition on the image data and cutting the image data according to the black edge recognition result comprises the following steps:
acquiring a first picture and a second picture from the image data, respectively carrying out black edge recognition on the first picture and the second picture, and determining a first cutting position of the first picture and a second cutting position of the second picture;
and generating a target cutting position according to the first cutting position and the second cutting position, and cutting the image data according to the target cutting position.
Further, the processor 1001 may call a screen projection display program stored in the memory 1005, and further perform the following operations:
the step of performing black edge recognition on the first picture and the second picture respectively comprises:
comparing the color values of the pixel points of the first picture, dividing the pixel points of the first picture into first comparison units, and identifying the position, in the first comparison units, of which the color value change degree of the pixel points exceeds a preset threshold value, as a black edge and using the black edge as the first cutting position;
comparing the color values of the pixel points of the second picture, dividing the pixel points of the second picture into second comparison units, and identifying the position, in the second comparison units, of which the color value change degree of the pixel points exceeds a preset threshold value, as a black boundary line and using the black boundary line as the second cutting position.
Referring to fig. 3, a screen projection display method according to a first embodiment of the present invention includes:
step S10, screen projection data are obtained, and the screen projection data comprise image data;
in this embodiment, the implementation subject may be an intelligent electronic device participating in the screen projection process, such as a screen projector transmitter, a screen projector receiver, a television, a mobile phone, and the like. The screen projector obtains screen projection data, which may generally include video data or several consecutive pictures, and the like, and may also include audio data. The screen projector acquires image data from the screen projection data, and it can be understood that if the screen projection data is video data, an image is captured from the video data, and if the screen projection data is graphic data, the image is directly received.
Step S20, performing black edge recognition on the image data, and cutting the image data according to the black edge recognition result to obtain the cut image data;
in the actual screen projection process, if the mobile phone is used as a source device of screen projection data, large-area black edge conditions may exist in image data in the screen projection data, viewing experience is affected, and black edge identification is performed on the image data.
Further, a first picture and a second picture are obtained from the image data, black edge recognition is respectively carried out on the first picture and the second picture, and a first cutting position of the first picture and a second cutting position of the second picture are determined; and generating a target cutting position according to the first cutting position and the second cutting position, and cutting the image data according to the target cutting position.
Specifically, when the screen is projected, the screen projector acquires two pictures, namely a first picture and a second picture, from the image data in the screen projection data. The area of the black border and the area of the real-play picture in the first picture are recognized, the boundary between the area of the black border and the area of the real-play picture in the first picture is used as a first clipping position, the area of the black border and the area of the real-play picture in the second picture are recognized, and the boundary between the area of the black border and the area of the real-play picture in the second picture is used as a second clipping position. And judging whether the first cutting position and the second cutting position are the same, if so, directly taking the first cutting position or the second cutting position as the target position, and if not, combining the first cutting position and the second cutting position to generate an average cutting position. And cutting off the black edge part of the image data in the screen projection data according to the target cutting position.
Further, comparing the color values of the pixel points of the first picture, dividing the pixel points of the first picture into first comparison units, and identifying the position, in the first comparison units, of which the change degree of the color values of the pixel points exceeds a preset threshold value, as a black edge and using the black edge as the first cutting position; comparing the color values of the pixel points of the second picture, dividing the pixel points of the second picture into second comparison units, and identifying the position, in the second comparison units, of which the color value change degree of the pixel points exceeds a preset threshold value, as a black boundary line and using the black boundary line as the second cutting position.
Specifically, taking the first frame as an example for explanation, the second frame processing process is similar to the first frame, and is not repeated in the following. The first picture is composed of a large number of pixels, and in this embodiment, when color values (RGB, color values, if a white color value is (255, 255, 255)) are compared for the pixels, the pixels of the first picture are divided into different first comparison units according to different division rules (if a row of pixels is used as a comparison unit, a first row of comparison units, and a row of pixels is used as a comparison unit, then a first row of comparison units), and color values of the pixels of each comparison unit are compared, if a comparison unit and b comparison unit are compared, and if the difference between the two color values exceeds a preset threshold, then a comparison unit is used as a first clipping position, or b comparison unit is used as a first clipping position, or a position between the a comparison unit and b comparison unit is used as a first clipping position. It can be understood that, when the first comparison unit is used for comparing the first image, the first comparison unit may be the first row comparison unit, the first column comparison unit, or both the first row comparison unit and the first column comparison unit. The two comparison units are respectively compared once, so that the black edges distributed on the four sides of the picture can be identified.
Taking the case that the first picture only has upper and lower black edges as an example for explanation, and the first comparison unit is a row comparison unit, and the current comparison unit is obtained according to a first preset comparison sequence; comparing the pixel point color value of the current comparison unit with the pixel point color value of the adjacent comparison unit of the current comparison unit; if the number of the pixel point color values of the current comparison unit and the pixel point color values of the adjacent comparison unit is different from the preset threshold value, taking the position between the current comparison unit and the adjacent comparison unit as the first cutting position; if the pixel color value of the current comparison unit is different from the pixel color value of the adjacent comparison unit and does not exceed the preset threshold, the current comparison unit is obtained again until the pixel point of the first picture is traversed. Wherein the first preset comparison sequence comprises: the sequence from the upper and lower edges of the picture to the middle of the picture; or from the middle of the picture to the upper and lower edges of the picture.
If the acquired first picture includes the 1 area and the 2 area as shown in fig. 4, where fig. 4 is a display effect of the first picture on the display device before clipping, the 3 area is a black border generated by the display device for adaptive display of the first picture, the a line and the b line are boundaries of the 1 area and the 2 area, and the 1 area is the black border and the 2 area is an actual playing picture. The first comparison unit is a row comparison unit, acquires pixel points in a certain row from the first picture as a current comparison row according to a first preset comparison sequence, further extracts the color value of each pixel point in the current comparison row, and compares the color value with the color value of the pixel point in an adjacent row of the current comparison row. And when the ratio of the number of the pixels with different color values in the current comparison row to the total number of the pixels in the adjacent row exceeds a preset ratio threshold, taking the interval line between the current comparison row and the adjacent row as the cutting line. If the total amount of the pixels in one row is 100 and corresponds to 100 color values, if the preset ratio threshold is eighty percent, when the current comparison row and the adjacent row have 81 color values which are different (the preset ratio threshold can be set according to the actual situation), a first clipping position can be determined according to the position of the current comparison row and the position of the adjacent row, such as the line a and the line b in fig. 4. And if the ratio of the number of the pixels with different color values in the current comparison row to the total number of the pixels in one row does not exceed the preset ratio threshold, acquiring the current comparison row and the adjacent row of the current comparison row according to the preset first comparison sequence again to compare the color values of the pixels. Until all the pixel points of the first picture are compared in a row mode.
Correspondingly, a first cutting position is generated according to the first picture, a second cutting position is generated according to the second picture, and whether the first cutting position and the second cutting position are the same is judged, specifically, whether the positions of the line a in the first cutting position and the line a in the second cutting position are the same is judged, and whether the positions of the line b in the first cutting position and the line b in the second cutting position are the same is judged. And if the first cutting position and the second cutting position are the same, taking any one of the first cutting position and the second cutting position as a target cutting position. If the difference is not the same, an average a line of the a line in the first cutting position and the a line in the second cutting position is taken, an average b line of the b line in the first cutting position and the b line in the second cutting position is taken, the target cutting position comprises the average a line and the average b line, and the image data is cut according to the average a line and the average b line of the target cutting position, namely if the image data comprises the 1 area and the 2 area shown in fig. 4, the 1 area (black edge area) is left, and only the 2 area (actual playing area) is left. It is understood that the reserved actual playing area is the image data after being cropped.
In this embodiment, the specific number of acquired images, the classification of the comparison unit, and the comparison sequence may be set according to the actual situation, and are not described herein again.
Step S30, extracting additional information in the image data according to a preset extraction model;
optionally, the preset extraction model includes a preset extraction region, and a region corresponding to the preset extraction region is extracted from the image data; and taking the extracted area as the additional information.
It is understood that, after the above-mentioned cropping step, the portion of the image data that is actually cropped may contain information related to the image data, such as the title, author, icon, brief description, etc. of the image data, which is lost. And the preset extraction model extracts the lost information.
Specifically, the preset extraction model may be selected from the first image and the second image as an extraction object, or may be obtained from the image data again. As shown in fig. 5, the display frame of the image data on the display device includes a playing area and a black border area, the playing area displays the image data, and the preset 1 area and the preset 2 area in the playing area are the preset extraction areas in the preset extraction model. It is to be understood that the preset 1 area and the preset 2 area shown in fig. 5 are not specifically limited to the position, number, and size of the preset extraction area, and the position, number, and size of the preset extraction area may be set according to actual situations. The pictures of the preset 1 area and the preset 2 area are further extracted and used as additional information.
Optionally, the preset extraction model includes preset extraction elements, and elements corresponding to the preset extraction elements are extracted from the image data; and taking the extracted element as the additional information.
The preset extraction elements may include text elements and graphic elements, and based on the above example, the preset extraction model performs element extraction on the playing region in fig. 5, and the specific text elements and graphic elements may be extracted by using an image recognition technology, and the extracted text elements and graphic elements are used as additional information of the image data after being cropped.
Further, the additional information is subjected to image processing, and the image processing comprises one or more of color processing, contour processing and mask processing.
Specifically, the additional information may be the preset 1 and preset 2 regions, or may be text elements, graphic elements, and the like, and the image processing includes one or more of color processing, contour processing, and mask processing. For example, color processing is performed, color filling is performed on the extracted text elements and graphic elements, and the filling color can be preset and also determined according to the color values of pixel points in the preset area of the extracted text elements and graphic elements. The contour processing is that if the image recognition technology can not recognize and determine the character elements and the graphic elements, the directly recognized contour is subjected to color processing to be used as the character elements or the graphic elements. And (4) masking, namely adding a masking background for the additional information character elements and graphic elements, and if a fixed color or a transparent mask is set, avoiding that the character elements and the graphic elements cannot be distinguished from an actual playing area to influence the watching effect of a user.
And S40, integrating the additional information into the cut image data to obtain the integrated image data.
Further, the processed additional information is placed at a preset position of the cut image data to obtain the integrated image data.
Specifically, the additional information is processed in the above steps, and is to be placed at a preset position in the cut image data, as shown in fig. 6, fig. 6 is a schematic diagram of the image data after the additional information is integrated, and includes a title text area, an introduction information area, and an icon area, where the reserved screen area is an area reserved after the image data is cut, and the title text area, the introduction information area, and the icon area are preset positions of the cut image data, if the additional information is a text element and a graphic element, the text element is correspondingly placed in the title text area and the introduction information area, the graphic element is placed in the icon area, and if the additional information is the preset 1 area or the preset 2 area, the screen of the preset 1 area or the preset 2 area is directly placed at the preset position of the cut image data. It should be understood that the title text area, the brief introduction information area and the icon area shown in fig. 6 can be set according to the actual situation without limiting the size and number of the preset positions and the areas in the screen.
Further, after the step of acquiring the integrated image data, the method includes: and displaying the integrated image data, hiding the additional information after displaying the preset time length, and displaying the additional information again when triggering the awakening operation.
Specifically, when the integrated image data is displayed, the additional information may shield actually played video content to a certain extent, and especially when the video time is long, the actual viewing experience of the user may be affected. In contrast, after the additional information is displayed for a certain period of time (for example, 1 minute), the additional information is hidden, the actual playing content is completely displayed, and the viewing experience of the user is improved. And redisplaying the additional information when the user wakes up, for example, the user performs operations such as pause, fast forward, double speed play and the like on the mobile phone, the screen projector or the television, and redisplaying the additional information.
It can be understood that, in this embodiment, after the screen projection data is cut, information extraction is performed again from the image data in the screen projection data, and the extracted additional information is integrated into the cut image data, so that the relevant information of the image data is complete when displayed, core information is prevented from being lost, and the viewing experience of a user is improved.
In one practical approach, referring to fig. 7, in the actual screen projection scene, the following are included: the mobile phone 100 is in communication connection with the screen projector transmitter 200, the screen projector receiver 300 is in communication connection with the screen projector transmitter 200, and the screen projector receiver 300 is in communication connection with the television 400. When the screen is projected, the screen projector transmitter 200 acquires screen projection data pushed by the mobile phone 100, cuts image data in the screen projection data, generates attachment information based on the image data before cutting, integrates the generated attachment information into the cut image data and pushes the image data to the screen projector receiver 300, and the screen projector receiver 300 pushes the integrated image data to the television 400 for display.
In addition, this embodiment further provides a screen projection display device, as shown in fig. 8, the screen projection display device includes:
the acquisition module 10 is used for acquiring screen projection data, wherein the screen projection data comprises image data;
the cutting module 20 is configured to perform black edge recognition on the image data, cut the image data according to the black edge recognition result, and obtain the cut image data;
an extracting module 30, configured to extract additional information in the image data according to a preset extraction model;
and an integrating module 40, configured to integrate the additional information into the cropped image data, and obtain the integrated image data.
Optionally, the preset extraction model includes a preset extraction area, and the extraction module 30 is further configured to:
extracting a region corresponding to the preset extraction region from the image data;
and taking the extracted area as the additional information.
Optionally, the preset extraction model includes preset extraction elements, and the extraction module 30 is further configured to:
extracting elements corresponding to the preset extraction elements from the image data;
taking the extracted element as the additional information.
Optionally, the extracting module 30 is further configured to:
and performing image processing on the additional information, wherein the image processing comprises one or more of color processing, contour processing and mask processing.
Optionally, the integrating module 40 is further configured to:
and placing the processed additional information at a preset position of the cut image data to acquire the integrated image data.
Optionally, the integrating module 40 is further configured to:
and displaying the integrated image data, hiding the additional information after displaying the preset time length, and displaying the additional information again when triggering the awakening operation.
Optionally, the cutting module 20 is further configured to:
acquiring a first picture and a second picture from the image data, respectively carrying out black edge recognition on the first picture and the second picture, and determining a first cutting position of the first picture and a second cutting position of the second picture;
and generating a target cutting position according to the first cutting position and the second cutting position, and cutting the image data according to the target cutting position.
Optionally, the cutting module 20 is further configured to:
comparing the color values of the pixel points of the first picture, dividing the pixel points of the first picture into first comparison units, and identifying the position, in the first comparison units, of which the color value change degree of the pixel points exceeds a preset threshold value, as a black edge and using the black edge as the first cutting position;
comparing the color values of the pixel points of the second picture, dividing the pixel points of the second picture into second comparison units, and identifying the position, in the second comparison units, of which the color value change degree of the pixel points exceeds a preset threshold value, as a black boundary line and using the black boundary line as the second cutting position.
By adopting the screen projection method in the embodiment, the screen projection display device provided by the invention solves the technical problem that other information related to the picture is possibly lost when the picture of the moving end is rearranged to the large-screen equipment. Compared with the prior art, the beneficial effects of the screen projection display device provided by the embodiment of the invention are the same as the beneficial effects of the screen projection method provided by the embodiment, and other technical features of the screen projection display device are the same as the features disclosed by the embodiment method, which are not repeated herein.
In addition, this embodiment further provides an electronic device, where the electronic device includes: the system comprises a memory, a processor and a screen projection display program stored on the memory and capable of running on the processor, wherein the screen projection display program realizes the steps of the screen projection display method when being executed by the processor.
The specific implementation of the electronic device of the present invention is substantially the same as the embodiments of the screen-projecting display method described above, and is not described herein again.
In addition, the present embodiment also provides a readable storage medium, where a screen projection display program is stored, and when executed by a processor, the screen projection display program implements the steps of the screen projection display method as described above.
The specific implementation manner of the medium of the present invention is substantially the same as that of each embodiment of the screen projection display method, and is not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, a screen projector, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (11)
1. A screen projection display method is characterized by comprising the following steps:
acquiring screen projection data, wherein the screen projection data comprises image data;
carrying out black edge recognition on the image data, and cutting the image data according to the black edge recognition result to obtain the cut image data;
extracting additional information in the image data according to a preset extraction model;
and integrating the additional information into the cut image data to obtain the integrated image data.
2. The screen-projection display method of claim 1, wherein the preset extraction model includes a preset extraction area, and the extracting additional information in the image data according to the preset extraction model includes:
extracting a region corresponding to the preset extraction region from the image data;
and taking the extracted area as the additional information.
3. The screen-projection display method of claim 1, wherein the preset extraction model includes preset extraction elements, and the step of extracting the additional information in the image data according to the preset extraction model includes:
extracting elements corresponding to the preset extraction elements from the image data;
and taking the extracted element as the additional information.
4. The screen-projection display method according to claim 1, wherein after the step of extracting additional information in the image data according to a preset extraction model, the method further comprises:
and performing image processing on the additional information, wherein the image processing comprises one or more of color processing, contour processing and mask processing.
5. The screen-projection display method according to claim 4, wherein the step of integrating the additional information into the cropped image data to obtain the integrated image data comprises:
and placing the processed additional information at a preset position of the cut image data to obtain the integrated image data.
6. The screen projection display method of claim 1, wherein after the step of acquiring the integrated image data, comprising:
and displaying the integrated image data, hiding the additional information after displaying the preset time length, and displaying the additional information again when triggering the awakening operation.
7. The screen projection display method according to claim 1, wherein the step of performing black border recognition on the image data and cropping the image data according to the result of the black border recognition comprises:
acquiring a first picture and a second picture from the image data, respectively carrying out black edge recognition on the first picture and the second picture, and determining a first cutting position of the first picture and a second cutting position of the second picture;
and generating a target cutting position according to the first cutting position and the second cutting position, and cutting the image data according to the target cutting position.
8. The screen-projection display method of claim 7, wherein the step of performing black-edge recognition on the first screen and the second screen respectively comprises:
comparing the color values of the pixel points of the first picture, dividing the pixel points of the first picture into first comparison units, and identifying the position, in the first comparison units, of which the color value change degree of the pixel points exceeds a preset threshold value, as a black edge and using the black edge as the first cutting position;
comparing the color values of the pixel points of the second picture, dividing the pixel points of the second picture into second comparison units, and identifying the position, in the second comparison units, of which the color value change degree of the pixel points exceeds a preset threshold value, as a black boundary line and using the black boundary line as the second cutting position.
9. A screen projection display device, comprising:
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring screen projection data which comprises image data;
the cutting module is used for carrying out black edge recognition on the image data, cutting the image data according to the black edge recognition result and obtaining the cut image data;
the extraction module is used for extracting the additional information in the image data according to a preset extraction model;
and the integration module is used for integrating the additional information into the cut image data to obtain the integrated image data.
10. An electronic device, characterized in that the electronic device comprises: a memory, a processor and a projection display program stored on the memory and executable on the processor, the projection display program when executed by the processor implementing the steps of the projection display method as claimed in any one of claims 1 to 8.
11. A readable storage medium, on which a screen projection display program is stored, which, when executed by a processor, implements the steps of the screen projection display method according to any one of claims 1 to 8.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210114218.4A CN114463359A (en) | 2022-01-30 | 2022-01-30 | Screen projection display method and device, electronic equipment and readable storage medium |
| PCT/CN2022/102415 WO2023142370A1 (en) | 2022-01-30 | 2022-06-29 | Screen mirroring display method and apparatus, and electronic device and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210114218.4A CN114463359A (en) | 2022-01-30 | 2022-01-30 | Screen projection display method and device, electronic equipment and readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114463359A true CN114463359A (en) | 2022-05-10 |
Family
ID=81411708
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210114218.4A Pending CN114463359A (en) | 2022-01-30 | 2022-01-30 | Screen projection display method and device, electronic equipment and readable storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN114463359A (en) |
| WO (1) | WO2023142370A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023142370A1 (en) * | 2022-01-30 | 2023-08-03 | 深圳创维－Rgb电子有限公司 | Screen mirroring display method and apparatus, and electronic device and readable storage medium |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170351397A1 (en) * | 2016-06-07 | 2017-12-07 | Lg Electronics Inc. | Mobile terminal and method for controlling the same |
| CN107862312A (en) * | 2017-11-22 | 2018-03-30 | 朱秋华 | A kind of character recognition method based on tesseract engines, device, equipment and storage medium |
| CN109829068A (en) * | 2019-03-11 | 2019-05-31 | 重庆菜鸽途讯科技有限公司 | A kind of information acquisition method, terminal and computer readable storage medium |
| CN109919726A (en) * | 2019-03-11 | 2019-06-21 | 重庆菜鸽途讯科技有限公司 | A kind of business system |
| CN110232713A (en) * | 2019-06-13 | 2019-09-13 | 腾讯数码（天津）有限公司 | A kind of image object positioning correction method and relevant device |
| CN112307967A (en) * | 2020-10-30 | 2021-02-02 | 浪潮金融信息技术有限公司 | Commodity recognition model training optimization method |
| CN112351331A (en) * | 2020-10-27 | 2021-02-09 | 深圳Tcl新技术有限公司 | Message prompting method and device, display equipment and computer readable storage medium |
| CN112887781A (en) * | 2021-01-27 | 2021-06-01 | 维沃移动通信有限公司 | Subtitle processing method and device |
| CN112995535A (en) * | 2021-02-05 | 2021-06-18 | 北京百度网讯科技有限公司 | Method, apparatus, device and storage medium for processing video |
| CN113206964A (en) * | 2021-04-29 | 2021-08-03 | 深圳康佳电子科技有限公司 | Screen projection data display processing method and device, terminal equipment and storage medium |
| CN113905268A (en) * | 2021-09-28 | 2022-01-07 | 四川长虹电器股份有限公司 | Black edge removing method for screen projection display of mobile terminal |
| CN113965813A (en) * | 2021-10-21 | 2022-01-21 | 广州方硅信息技术有限公司 | Video playing method and system in live broadcast room and computer equipment |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6535633B1 (en) * | 1999-09-24 | 2003-03-18 | Bank One | Method and apparatus for re-classifying color image pixels classified by single channel segmentation |
| CN106408518B (en) * | 2015-07-30 | 2019-09-06 | 展讯通信（上海）有限公司 | Image interfusion method, device and terminal device |
| CN113221846A (en) * | 2021-06-07 | 2021-08-06 | 北京百度网讯科技有限公司 | Image recognition method, apparatus, device, storage medium, and program product |
| CN113891167B (en) * | 2021-08-27 | 2023-07-04 | 荣耀终端有限公司 | Screen projection method and electronic equipment |
| CN114463359A (en) * | 2022-01-30 | 2022-05-10 | 深圳创维－Rgb电子有限公司 | Screen projection display method and device, electronic equipment and readable storage medium |
-
2022
- 2022-01-30 CN CN202210114218.4A patent/CN114463359A/en active Pending
- 2022-06-29 WO PCT/CN2022/102415 patent/WO2023142370A1/en unknown
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170351397A1 (en) * | 2016-06-07 | 2017-12-07 | Lg Electronics Inc. | Mobile terminal and method for controlling the same |
| CN107862312A (en) * | 2017-11-22 | 2018-03-30 | 朱秋华 | A kind of character recognition method based on tesseract engines, device, equipment and storage medium |
| CN109829068A (en) * | 2019-03-11 | 2019-05-31 | 重庆菜鸽途讯科技有限公司 | A kind of information acquisition method, terminal and computer readable storage medium |
| CN109919726A (en) * | 2019-03-11 | 2019-06-21 | 重庆菜鸽途讯科技有限公司 | A kind of business system |
| CN110232713A (en) * | 2019-06-13 | 2019-09-13 | 腾讯数码（天津）有限公司 | A kind of image object positioning correction method and relevant device |
| CN112351331A (en) * | 2020-10-27 | 2021-02-09 | 深圳Tcl新技术有限公司 | Message prompting method and device, display equipment and computer readable storage medium |
| CN112307967A (en) * | 2020-10-30 | 2021-02-02 | 浪潮金融信息技术有限公司 | Commodity recognition model training optimization method |
| CN112887781A (en) * | 2021-01-27 | 2021-06-01 | 维沃移动通信有限公司 | Subtitle processing method and device |
| CN112995535A (en) * | 2021-02-05 | 2021-06-18 | 北京百度网讯科技有限公司 | Method, apparatus, device and storage medium for processing video |
| CN113206964A (en) * | 2021-04-29 | 2021-08-03 | 深圳康佳电子科技有限公司 | Screen projection data display processing method and device, terminal equipment and storage medium |
| CN113905268A (en) * | 2021-09-28 | 2022-01-07 | 四川长虹电器股份有限公司 | Black edge removing method for screen projection display of mobile terminal |
| CN113965813A (en) * | 2021-10-21 | 2022-01-21 | 广州方硅信息技术有限公司 | Video playing method and system in live broadcast room and computer equipment |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023142370A1 (en) * | 2022-01-30 | 2023-08-03 | 深圳创维－Rgb电子有限公司 | Screen mirroring display method and apparatus, and electronic device and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023142370A1 (en) | 2023-08-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9330292B2 (en) | Two-dimensional code scanning method and device | |
| CN110446097B (en) | Screen recording method and mobile terminal | |
| US20200356742A1 (en) | Image recognition method and apparatus | |
| JP7270661B2 (en) | Video processing method and apparatus, electronic equipment, storage medium and computer program | |
| WO2016192325A1 (en) | Method and device for processing logo on video file | |
| CN110572706B (en) | Video screenshot method, terminal and computer-readable storage medium | |
| EP3461136B1 (en) | Video playing method and device | |
| CN110177295B (en) | Subtitle out-of-range processing method and device and electronic equipment | |
| US20240004676A1 (en) | Screen Capture Method and Apparatus, Electronic Device, and Readable Storage Medium | |
| CN109361874B (en) | Photographing method and terminal | |
| CN108401173B (en) | Mobile live broadcast interactive terminal, method and computer readable storage medium | |
| CN111176526B (en) | Picture display method and electronic equipment | |
| CN114463359A (en) | Screen projection display method and device, electronic equipment and readable storage medium | |
| CN112333537B (en) | Video integration method, device and computer readable storage medium | |
| CN107484035B (en) | Closed caption display method, apparatus and computer readable storage medium | |
| CN114463358A (en) | Screen projection display method and device, electronic equipment and readable storage medium | |
| CN111432122A (en) | Image processing method and electronic equipment | |
| CN111443965A (en) | Picture display method and device, terminal and storage medium | |
| CN108509126B (en) | Picture processing method and mobile terminal | |
| CN107291468B (en) | Method for playing power-on/power-off animation, terminal and computer readable storage medium | |
| CN113223186B (en) | Processing method, equipment, product and device for realizing augmented reality | |
| CN114489549A (en) | Screen projection image processing method and device, electronic equipment and storage medium | |
| KR101314685B1 (en) | Display apparatus having camera, remote controller for controlling the display apparatus, and display control method thereof | |
| CN112788425A (en) | Dynamic area display method, device, equipment and computer readable storage medium | |
| CN113900609A (en) | Large-screen terminal interaction method, large-screen terminal and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |