CN116389821A - Screen projection method, device, electronic equipment and storage medium - Google Patents
Screen projection method, device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN116389821A CN116389821A CN202310323220.7A CN202310323220A CN116389821A CN 116389821 A CN116389821 A CN 116389821A CN 202310323220 A CN202310323220 A CN 202310323220A CN 116389821 A CN116389821 A CN 116389821A
- Authority
- CN
- China
- Prior art keywords
- image
- screen projection
- screen
- image enhancement
- type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 70
- 238000003860 storage Methods 0.000 title claims abstract description 14
- 230000015654 memory Effects 0.000 claims description 18
- 238000004891 communication Methods 0.000 claims description 16
- 239000011159 matrix material Substances 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 12
- 238000007499 fusion processing Methods 0.000 claims description 9
- 230000003993 interaction Effects 0.000 claims description 7
- 230000005540 biological transmission Effects 0.000 claims description 5
- 238000012216 screening Methods 0.000 claims 1
- 238000005457 optimization Methods 0.000 abstract description 6
- 238000005516 engineering process Methods 0.000 description 15
- 238000013135 deep learning Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 7
- 230000000694 effects Effects 0.000 description 5
- 230000005291 magnetic effect Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 238000003672 processing method Methods 0.000 description 4
- 238000009877 rendering Methods 0.000 description 4
- 238000013528 artificial neural network Methods 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 description 2
- KLDZYURQCUYZBL-UHFFFAOYSA-N 2-[3-[(2-hydroxyphenyl)methylideneamino]propyliminomethyl]phenol Chemical compound OC1=CC=CC=C1C=NCCCN=CC1=CC=CC=C1O KLDZYURQCUYZBL-UHFFFAOYSA-N 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 2
- 238000013527 convolutional neural network Methods 0.000 description 2
- 201000001098 delayed sleep phase syndrome Diseases 0.000 description 2
- 208000033921 delayed sleep phase type circadian rhythm sleep disease Diseases 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 238000005266 casting Methods 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000005294 ferromagnetic effect Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000009432 framing Methods 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000003062 neural network model Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Transforming Electric Information Into Light Information (AREA)
Abstract
The embodiment discloses a screen projection method, a device, an electronic device and a computer storage medium, wherein the method comprises the following steps: receiving image data sent by a screen projection transmitting device; acquiring at least two screen projection scene information, wherein the at least two screen projection scene information comprises at least two of the following items: attribute information of the screen projection transmitting device, the type of the image data and attribute information of the display device; determining at least two image enhancement algorithms corresponding to the at least two screen projection scene information according to the at least two screen projection scene information and preset image tuning strategy information; performing image enhancement processing on the image data according to the at least two image enhancement algorithms to obtain an image to be displayed; and outputting the image to be displayed to a display device. According to the embodiment of the application, the quality optimization of the screen projection images can be realized aiming at various screen projection scene information, and the embodiment of the application can be suitable for various screen projection scenes and has a wide application range.
Description
Technical Field
The application belongs to the field of screen projection technology, and particularly relates to a screen projection method, a screen projection device, electronic equipment and a storage medium.
Background
The screen projection technology refers to a technology of displaying a screen of a screen projection device to a display device of a screen projection receiving device in real time, and content transmitted to the screen projection receiving device by the screen projection device can comprise various media information and real-time operation screens. In the related art, if the display resolution of the screen projection device is not the same as that of the display device, the screen projection receiving device uses only artificial intelligence (Artificial Intelligence, AI) processing technology based on deep learning to optimize the image quality of the content to be transmitted by the screen projection device, and generally, only the content related to movies, animations, games, and videos can be optimized.
Disclosure of Invention
The embodiment of the application provides a screen projection method, a screen projection device, electronic equipment and a storage medium.
The screen projection method provided by the embodiment of the application is applied to screen projection receiving equipment, and comprises the following steps:
receiving image data sent by a screen projection transmitting device;
acquiring at least two screen projection scene information, wherein the at least two screen projection scene information comprises at least two of the following items: attribute information of the screen projection transmitting device, the type of the image data and attribute information of the display device;
Determining at least two image enhancement algorithms corresponding to the at least two screen projection scene information according to the at least two screen projection scene information and preset image tuning strategy information; the image tuning strategy information comprises the corresponding relation between various screen projection scene information and various image enhancement algorithms;
performing image enhancement processing on the image data according to the at least two image enhancement algorithms to obtain an image to be displayed;
and outputting the image to be displayed to a display device.
In some embodiments, the performing image enhancement processing on the image data according to the at least two image enhancement algorithms to obtain an image to be displayed includes: performing image enhancement processing on the image data according to the at least two image enhancement algorithms; and performing super-resolution processing on the image subjected to the image enhancement processing to obtain the image to be displayed.
It can be seen that, according to the embodiment of the application, on the basis of performing image enhancement processing on the image data, super-resolution processing is performed on the image after the image enhancement processing, so that the display quality of the projection screen image can be further improved.
In some embodiments, the at least two types of screen-cast scene information include a type of the image data, the type of the image data including a type of content of the image data; and under the condition that the type of the content of the image data is the target type, the at least two image enhancement algorithms corresponding to the at least two screen projection scene information comprise image enhancement algorithms corresponding to the target type.
It can be seen that, in the embodiment of the present application, in the case that the type of the content of the image data is the target type, the image enhancement processing may be performed on the image data of the target type more accurately according to the image enhancement algorithm corresponding to the predetermined target type, so that the display quality of the projection image may be improved.
In some embodiments, in a case where the object type is a character, the image enhancement algorithm corresponding to the object type includes: and carrying out fusion processing on the image of the target type by adopting a matrix corresponding to the character.
It can be seen that, in the embodiment of the present application, when the target type is a character, the character matrix corresponding to the character is used to perform fusion processing on the image of the target content, so that the display quality of the character in the screen projection image can be improved.
In some embodiments, the at least two kinds of screen-cast scene information include attribute information of the display device, the attribute information of the display device including a type of the display device; and under the condition that the type of the display equipment is the first type, the at least two image enhancement algorithms corresponding to the at least two screen projection scene information comprise image enhancement algorithms corresponding to the display equipment of the first type.
It can be seen that, in the case that the type of the display device is the first type, the embodiment of the application can accurately determine the screen projection image suitable for being displayed on the display device according to the predetermined image enhancement algorithm corresponding to the display device of the first type, so that the image display quality on the display device is improved.
In some embodiments, the type of display device is determined from extended display identification data Extended Display Identification Data, EDID) information of the display device.
It can be seen that the embodiment of the application can accurately determine the type of the display device according to the EDID information of the display device, so that the corresponding image enhancement algorithm can be accurately determined according to the type of the display device, and the display quality of the projection screen image is improved.
In some embodiments, the at least two kinds of screen-projection scene information include attribute information of the screen-projection transmitting device, and the attribute information of the screen-projection transmitting device includes a display resolution of the screen-projection transmitting device; under the condition that the display resolution of the screen projection transmitting equipment is the first resolution, the at least two image enhancement algorithms corresponding to the at least two screen projection scene information comprise image enhancement algorithms corresponding to the screen projection transmitting equipment with the first resolution; the aspect ratio of the pixels corresponding to the first resolution is different from each aspect ratio in the preset aspect ratio set.
It can be seen that, in the case that the display resolution of the screen projection device is the first resolution, and the aspect ratio of the pixels corresponding to the first resolution is different from each aspect ratio in the preset aspect ratio set, according to the predetermined image enhancement algorithm corresponding to the screen projection device with the first resolution, the image enhancement processing is performed on the image data sent by the screen projection device more accurately and reasonably, so that the display quality of the screen projection image can be improved.
In some embodiments, the image enhancement algorithm corresponding to the projection transmission device with the first resolution includes: obtaining an image with actual content by performing black edge removing treatment on the image data; and stretching the image with the actual content to obtain an image with the same length-width ratio as one length-width ratio in a preset length-width ratio set.
As can be seen, in the case that the display resolution of the projection display device is the first resolution, the embodiment of the application performs the black edge removing processing on the image data and stretches the image with the actual content, so that the aspect ratio of the pixels of the projection image is consistent with the aspect ratio of the preset aspect ratio set on the basis of taking out the black edge of the image data, and the projection quality on the display device can be improved.
The screen projection device provided by the embodiment of the application is applied to screen projection receiving equipment, and the device comprises:
the receiving module is used for receiving the image data sent by the screen-throwing transmitting equipment;
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring at least two screen projection scene information, and the at least two screen projection scene information comprises at least two of the following items: attribute information of the screen projection transmitting device, the type of the image data and attribute information of the display device;
the first processing module is used for determining at least two image enhancement algorithms corresponding to the at least two screen projection scene information according to the at least two screen projection scene information and preset image tuning strategy information; the image tuning strategy information comprises the corresponding relation between various screen projection scene information and various image enhancement algorithms;
the second processing module is used for carrying out image enhancement processing on the image data according to the at least two image enhancement algorithms so as to obtain an image to be displayed;
and the output module is used for outputting the image to be displayed to the display equipment.
The embodiment of the application also provides electronic equipment, which comprises a first communication interface, a second communication interface, a processor and a memory for storing a computer program capable of running on the processor; the first communication interface is used for carrying out information interaction with the screen projection transmitting equipment; the second communication interface is used for carrying out information interaction with the display equipment; the processor is configured to run the computer program to perform any one of the above-described screen projection methods.
The embodiment of the application also provides a computer storage medium, on which a computer program is stored, and when the computer program is executed by a processor, any one of the screen projection methods is realized.
It can be seen that, according to the embodiment of the application, on the basis of comprehensively considering at least two screen projection scene information, at least two image enhancement algorithms corresponding to the at least two screen projection scene information can be accurately determined, so that image enhancement processing is performed on the image data through the at least two image enhancement algorithms, and the screen projection quality of an image to be displayed can be improved.
Drawings
FIG. 1 is a flowchart of a screen projection method according to an embodiment of the present application;
fig. 2 is a schematic block diagram of implementing super-resolution processing in the embodiment of the present application;
FIG. 3 is a block diagram of a system for implementing a screen projection method according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a screen projection device according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In a screen projection application scene of the related technology, the screen projection transmitting equipment can transmit the content needing screen projection to the screen projection receiving equipment in a wireless communication mode; a common screen-launch device may be a terminal, for example, screen-launch devices including, but not limited to: notebook computers, cell phones, tablet computers, etc.; the display device of the screen-cast receiving device may be a television device. The display resolution of the screen projection device is usually different from that of the display device, for example, the display resolution of a notebook computer, a mobile phone or a tablet computer is usually 1080p, and in a standard screen projection protocol airlay or Miracast, the resolution of a picture sent to the screen projection receiving device is also usually 1080p, and the display resolution of some screen projection devices is smaller than 1080p. The display resolution of the display device is typically a 4k, 8k etc. resolution; under the condition that the display resolution of the screen-throwing transmitting equipment is different from that of the display equipment, the screen received by the screen-throwing receiving equipment is simply zoomed in the high-resolution display equipment, so that the quality of screen display cannot be improved, and better visual experience cannot be brought.
In the related art, for the case that the display Resolution of the screen projection device is different from the display Resolution of the display device, a Super Resolution (SR) processing technology may be applied to perform Super Resolution processing on a picture received by the screen projection receiving device, so as to improve the picture display quality of the display device. Here, the SR process is a technique of improving the resolution of an original image by a hardware or software method, and a process of obtaining a high resolution image from one or more low resolution images is the SR process. Illustratively, the low-resolution video can be reconstructed into the high-resolution video through the AI technology, so that the resolution of the video is improved, and the visual experience of a user is improved.
In some embodiments, for a video source that needs to be screened, it is necessary to combine the resolution of the video source and the size of the window display area to determine whether the video source needs to be displayed in an enlarged manner. Each frame of image of the video source can be amplified by adopting a super-resolution reconstruction algorithm, and the super-resolution reconstruction algorithm mainly relies on a basic digital image processing technology for reconstruction, and commonly comprises the following types: the method comprises a super-resolution reconstruction method based on interpolation, a super-resolution reconstruction method based on a degradation model and a super-resolution reconstruction method based on learning.
In some embodiments, super-resolution processing can be performed on a picture requiring screen projection in combination with an AI super-processing technology based on deep learning. The AI super processing method based on deep learning is a method with good screen throwing effect. The deep learning-based AI super-process method may include the following two processes: the method comprises the steps of establishing an algorithm model and selecting a training set. The deep learning method generally refers to a method of adopting a convolutional neural network trained by a large amount of data, and the AI oversubstance processing method based on deep learning can restore more image texture detail information. Illustratively, the neural network model employed by the deep learning-based AI super-processing method may be a super-convolution neural network (Super Resolution Convolutional Neural Networks, SRCNN), ESPCN (effect Sub-Pixel Convolution Network), VDSR (Very Deep Convolutional Networks), CARN (Cascading Residual Network), basicVSR (Basic Video Super-Resolution), or the like.
The AI super processing method based on deep learning is mainly applied to scenes such as video websites, event live broadcasting and the like, and in the scenes, detection and identification technology of a region of interest (Region Of Interest, ROI) can be adopted to detect content of interest compared with human eyes such as human bodies, human faces and the like in videos. On the basis of deep learning superdivision processing of the whole image, the face area is simply amplified, and finally, the naturally amplified face image blocks are fused back to the image after superdivision processing, so that the face area can be protected.
In scenes such as video websites, live events and the like, video content needing to be cast is usually content related to movies, animations, games and shooting; content displayed in a video website, event live, etc. scene is typically a face and associated background. For other business scenes such as video conference scenes and office scenes, the content needing to be displayed on the screen is greatly different from the content needing to be displayed on the screen in the scenes such as video websites and live event broadcasting, for example, the content needing to be displayed on the screen in the other business scenes is an interface of some office software. Because the characteristics of the contents to be displayed by the screen in different scenes are greatly different, the emphasis point and the decision basis of the image quality enhancement and tuning are different for different scenes.
In summary, in the related art, image quality optimization can be generally performed only for contents related to movies, animations, games, and videos, which reduces the quality of the screen of the image to some extent.
Aiming at the technical problems, the technical scheme of the embodiment of the application is provided. The technical scheme of the embodiment of the application can be applied to the screen projection receiving equipment. The screen projection receiving device can control the display device to display the picture after the picture quality optimization processing is performed on the content sent by the screen projection transmitting device. In some embodiments, the display device is a device in a projection screen receiving device, and in other embodiments, the display device and the projection screen receiving device are two independent devices, and the projection screen receiving device may be connected to the display device through a display interface or the like.
The embodiments of the present application will be described in further detail below with reference to the accompanying drawings and examples. It should be understood that the examples provided herein are merely illustrative of the present application examples and are not intended to limit the present application examples. In addition, the embodiments provided below are some of the embodiments for implementing the present application, and not all of the embodiments for implementing the present application, and the technical solutions described in the embodiments of the present application may be implemented in any combination without conflict.
It should be noted that, in the embodiments of the present application, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a method or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such method or apparatus. Without further limitation, an element defined by the phrase "comprising one does not exclude the presence of other related elements in a method or apparatus comprising the element (e.g., a step in a method or an element in an apparatus, e.g., an element may be part of a circuit, part of a processor, part of a program or software, etc.).
The screen projection method provided by the embodiment of the application includes a series of steps, but the screen projection method provided by the embodiment of the application is not limited to the described steps, and similarly, the screen projection device provided by the embodiment of the application includes a series of modules, but the device provided by the embodiment of the application is not limited to the modules explicitly described, and may also include modules required to be set when acquiring related information or processing based on the information.
Fig. 1 is a flowchart of a screen projection method according to an embodiment of the present application, as shown in fig. 1, the flowchart may include:
step 101: and receiving the image data sent by the screen-throwing transmitting equipment.
In some embodiments, the image data sent by the screen-throwing transmitting device may be an image of a classical office scene, which may be an interface image of office software such as excel, ppt, word, or may be an interface image such as a web page or windows.
In some embodiments, the image data sent by the projection screen transmitting device may also be an image in an atypical scene such as a video conference, and the image in the atypical scene may be an image such as a video image or a vscode viewing code; the video image may be a video image of a video website, an event image in an event live scene, or other video image.
Step 102: acquiring at least two screen projection scene information, wherein the at least two screen projection scene information comprises at least two of the following: attribute information of the projection screen transmitting device, type of image data, attribute information of the display device.
In some embodiments, the attribute information of the projection screen transmitting device represents a display attribute among inherent attributes of the projection screen transmitting device; in a first example, the attribute information of the screen-launch device may include a display resolution of the screen-launch device, in a second example, the attribute information of the screen-launch device may include a display mode of the screen-launch device, and in a third example, the attribute information of the screen-launch device may include a manufacturer of the screen-launch device. A step of
In the embodiment of the application, the attribute information of the screen projection equipment can be acquired from the screen projection equipment through interaction with the screen projection equipment, or the attribute information of the screen projection equipment input by a user can be received.
In some embodiments, the type of image data is determined according to a preset classification scheme of the image data; in a first example, the type of image data may include a type of content of the image data, and in a second example, the type of image data may include a format type of the image data.
In the embodiment of the application, the type of the image data can be determined by analyzing the received image data; the type of content of the image data may be determined by identifying the content of the received image data using AI technology, for example.
In some embodiments, the attribute information of the display device is an attribute representing reflection of display performance in an inherent attribute of the display device, and in a first example, the attribute information of the display device may include a type of the display device, for example, the type of the display device may be a type of a display mode of the display device, a model number of the display device, or the like; in a second example, the attribute information of the display device may include a date of manufacture of the display device.
In the embodiment of the application, the attribute information of the projection transmitting device can be acquired from the display device through interaction with the display device, or the attribute information of the display device input by a user can be received.
Step 103: determining at least two image enhancement algorithms corresponding to the at least two screen projection scene information according to the at least two screen projection scene information and preset image tuning strategy information; the image tuning strategy information comprises the corresponding relation between various screen projection scene information and various image enhancement algorithms.
Here, the image tuning policy information is predetermined information. In the image tuning strategy information, each of the plurality of screen projection scene information may correspond to one image enhancement algorithm or may correspond to at least two image enhancement algorithms.
In one example, the plurality of image enhancement algorithms may include algorithms that perform at least two of the following: scaling (Rescale), random cropping and resizing (Random resizing), flipping (Padding), rotation (Rotation), random Affine transformation (Random Affine), gaussian filtering (Gaussian blue), gray scale processing (gray scale), altering image Brightness (Brightness), altering image Contrast (Contrast), altering image Saturation (Saturation), or altering image chroma (Hue).
Step 104: and carrying out image enhancement processing on the image data according to at least two image enhancement algorithms so as to obtain an image to be displayed.
Step 105: and outputting the image to be displayed to a display device.
In practical applications, steps 101 to 105 may be implemented based on a processor of the screen-projection receiving apparatus, where the processor may be at least one of an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a digital signal processor (Digital Signal Processor, DSP), a digital signal processing device (Digital Signal Processing Device, DSPD), a programmable logic device (Programmable Logic Device, PLD), a field programmable gate array (Field Programmable Gate Array, FPGA), a central processing unit (Central Processing Unit, CPU), a controller, a microcontroller, and a microprocessor.
It can be seen that, according to the embodiment of the application, on the basis of comprehensively considering at least two screen projection scene information, at least two image enhancement algorithms corresponding to the at least two screen projection scene information can be accurately determined, so that the screen projection quality of an image to be displayed can be improved by performing image enhancement processing on the image data through the at least two image enhancement algorithms; further, the embodiment of the application can realize quality optimization of the screen projection images aiming at various screen projection scene information, and is applicable to various screen projection scenes and wide in application range; in addition, aiming at actual screen projection scene information, the quality of the image can be improved.
In some embodiments of the present application, the process of performing image enhancement processing on image data according to at least two image enhancement algorithms to obtain an image to be displayed may include: performing image enhancement processing on the image data according to at least two image enhancement algorithms; and performing super-resolution processing on the image subjected to the image enhancement processing to obtain an image to be displayed.
In the embodiment of the application, the image after the image enhancement processing can be processed in super resolution by adopting an AI technology, so as to obtain the image to be displayed. In some embodiments, referring to fig. 2, the optimized image may be super-resolution processed in a neural network processor (Neural network Processing, NPU) module of the screen-cast receiving device by using an SR algorithm based on deep learning, so as to obtain an image with 4K resolution or 8K resolution; the SR algorithm based on the deep learning can recover more and richer image detail information by continuous deep learning.
It can be seen that, according to the embodiment of the application, on the basis of performing image enhancement processing on the image data, super-resolution processing is performed on the image after the image enhancement processing, so that the display quality of the projection screen image can be further improved.
In some embodiments of the present application, the at least two types of screen-cast scene information include a type of image data, the type of image data including a type of content of the image data; in the case that the type of the content of the image data is the target type, at least two image enhancement algorithms corresponding to at least two screen projection scene information include an image enhancement algorithm corresponding to the target type.
In the embodiment of the application, corresponding image enhancement algorithms can be respectively determined for various types of predetermined content of image data; for example, when the content of the image data is a character, an image enhancement algorithm corresponding to the character is predetermined; when the content of the image data is a human face, an image enhancement algorithm corresponding to the human face is predetermined.
Here, on the basis of the image enhancement algorithm corresponding to the predetermined target type, if the type of the content of the image data is determined to be the target type, the image enhancement algorithm corresponding to the screen shot scene information may be directly determined.
It can be seen that, in the embodiment of the present application, in the case that the type of the content of the image data is the target type, the image enhancement processing may be performed on the image data of the target type more accurately according to the image enhancement algorithm corresponding to the predetermined target type, so that the display quality of the projection image may be improved.
In some embodiments of the present application, in a case where the object type is a character, the image enhancement algorithm corresponding to the object type includes: and carrying out fusion processing on the image of the target type by adopting a matrix corresponding to the character.
In the embodiment of the present application, since the image enhancement algorithm corresponding to the target type is: and carrying out fusion processing on the image of the target content by adopting the matrix corresponding to the character, so that after the image data is acquired, the matrix corresponding to each character in the image data can be acquired, and then, carrying out fusion processing on the image by utilizing the matrix corresponding to each character in the image data. Here, the matrix corresponding to the character is an image; in one example, for any one character in the image data, the manner of fusing the image with the matrix is: replacing the image of the original character by using a matrix; in another example, for any one character in the image data, the manner of fusing the image with the matrix is: and superposing the matrix on the image of the original character.
In some embodiments, size information for each character in the image data may be obtained, and a matrix corresponding to each character may be determined according to the size information. In some embodiments, the word patterns corresponding to the characters may be extracted from a pre-established library of vector words.
In some embodiments, after the received image data is decoded, the content of the decoded image may be identified by using AI technology, for example, in an office scenario, image enhancement processing may be performed on specific areas such as characters, lines, and the like in the image data according to a corresponding image enhancement algorithm. For example, when the decoded image identifies a specific character, a word pattern corresponding to the specific character may be directly extracted from the vector word library, and the image of the original specific character in the decoded image is fused by using the word pattern corresponding to the specific character, so that the quality of the image may be enhanced.
It can be seen that, in the embodiment of the present application, when the target type is a character, the character matrix corresponding to the character is used to perform fusion processing on the image of the target content, so that the display quality of the character in the screen projection image can be improved.
In some embodiments of the present application, the at least two types of screen-cast scene information include attribute information of a display device, the attribute information of the display device including a type of the display device; and under the condition that the type of the display equipment is the first type, at least two image enhancement algorithms corresponding to the at least two screen projection scene information comprise image enhancement algorithms corresponding to the display equipment of the first type.
In the embodiment of the application, the image enhancement algorithms corresponding to various types of display devices can be predetermined. The first type is one of the above-mentioned various types. The image enhancement algorithms corresponding to each type of display device may include color enhancement algorithms, sharpening algorithms, high dynamic range imaging (High Dynamic Range Imaging, HDR) algorithms, and the like.
Here, on the basis of determining in advance an image enhancement algorithm corresponding to the first type of display device, if the type of display device is determined to be the first type, the image enhancement algorithm corresponding to the screen-casting scene information may be directly determined.
It can be seen that, in the case that the type of the display device is the first type, the embodiment of the application can accurately determine the screen projection image suitable for being displayed on the display device according to the predetermined image enhancement algorithm corresponding to the display device of the first type, so that the image display quality on the display device is improved.
In some embodiments of the present application, the type of display device is determined from EDID information of the display device.
In this embodiment of the present application, when the screen-cast receiving device is connected to a display device such as a television device, EDID information of the display device may be obtained through a high-definition multimedia interface (High Definition Multimedia Interface, HDMI) interface or other interfaces.
For example, in order to achieve a better screen display effect as possible, display characteristics of display devices of various models may be accumulated in advance, and different image enhancement algorithms may be determined for different models of display devices.
It can be seen that the embodiment of the application can accurately determine the type of the display device according to the EDID information of the display device, so that the corresponding image enhancement algorithm can be accurately determined according to the type of the display device, and the display quality of the projection screen image is improved.
In some embodiments of the present application, the at least two types of screen projection scene information include attribute information of a screen projection device, and the attribute information of the screen projection device includes a display resolution of the screen projection device; under the condition that the display resolution of the screen projection transmitting equipment is the first resolution, at least two image enhancement algorithms corresponding to at least two screen projection scene information comprise image enhancement algorithms corresponding to the screen projection transmitting equipment with the first resolution; the aspect ratio of the pixels corresponding to the first resolution is different from each aspect ratio in the preset aspect ratio set.
In this embodiment of the present application, an image enhancement algorithm may be predetermined for a projection device having a first resolution, so that after image data sent by the projection device having the first resolution is acquired, the image data may be optimized according to the predetermined image enhancement algorithm.
It can be seen that, in the case that the display resolution of the screen projection device is the first resolution, and the aspect ratio of the pixels corresponding to the first resolution is different from each aspect ratio in the preset aspect ratio set, according to the predetermined image enhancement algorithm corresponding to the screen projection device with the first resolution, the image enhancement processing is performed on the image data sent by the screen projection device more accurately and reasonably, so that the display quality of the screen projection image can be improved.
In some embodiments of the present application, an image enhancement algorithm corresponding to a projection-transmission device having a first resolution includes: obtaining an image with actual content by performing black edge removing treatment on the image data; and stretching the image with the actual content to obtain an image with the same length-width ratio as one length-width ratio in the preset length-width ratio set.
It will be appreciated that there is a corresponding pixel aspect ratio for each display resolution, for example, when the display resolution is 1600 x 900, the pixel aspect ratio for the display resolution is 16:9. each aspect ratio in the preset aspect ratio set may be an aspect ratio corresponding to a display resolution of the display device, and if a pixel aspect ratio corresponding to the display resolution of the projection display device is an aspect ratio in the preset aspect ratio set, it may be considered that black edges and the like will not occur when image data sent by the projection display device is projected to the display device; if the display resolution of the screen projection device is the first resolution, it can be considered that black edges and other phenomena can be generated when the image data sent by the screen projection device is projected to the display device, and here, the first resolution can also be called as irregular resolution; illustratively, the aspect ratios in the set of preset aspect ratios include 16:9 and 4: and 3, the first resolution is 1366 x 768, or the first resolution is 1440 x 900, or the first resolution is the display resolution of the mobile phone adopting the standard screen projection protocol Miracast for screen projection.
For example, an AI image processing technique may be used to identify and remove black edges in image data, and an AI image processing technique may be used to stretch an image having actual content.
As can be seen, in the case that the display resolution of the projection display device is the first resolution, the embodiment of the application performs the black edge removing processing on the image data and stretches the image with the actual content, so that the aspect ratio of the pixels of the projection image is consistent with the aspect ratio of the preset aspect ratio set on the basis of taking out the black edge of the image data, and the projection quality on the display device can be improved.
FIG. 3 is a schematic diagram of a system for implementing a screen projection method in an embodiment of the present application, where, as shown in FIG. 3, the system for implementing a screen projection method may include a screen projection transmitting device, a screen projection receiving device, and a display device; the screen projection transmitting device can be a mobile terminal, and the screen projection transmitting device transmits video data to the screen projection receiving device through a network by using a standard screen projection protocol (such as AirPlay or Miracast) or a private screen projection protocol, and the screen projection receiving device firstly performs video decoding on the video data after receiving the video data to obtain decoded video; performing video analysis on the decoded video, and determining the type of the content of each frame of image in the decoded video; after video analysis is performed on the decoded video, it can be seen from the determined image enhancement algorithm in combination with the above description that, when the image enhancement algorithm is determined, the factors of the screen projection content, the factors of the display device and the factors of the screen projection transmitting device need to be considered. After determining the image enhancement algorithm, image enhancement can be performed on each frame of image in the decoded video, the image subjected to the image enhancement processing can be subjected to super resolution processing by adopting an AI technology, then video rendering is performed on the image subjected to the super resolution processing, video data subjected to the video rendering is output to a display device through an HDMI (high-definition multimedia interface) interface or a VGA (video graphics array) interface, namely, the video data subjected to the video rendering is used as an input source of the display device, the display device can display the video data subjected to the video rendering, and the display device can be a television screen with 4K resolution or 8K resolution. In some embodiments, after performing the image quality optimization strategy, AI framing may also be performed based on the optimized image.
The effect of the screen projection method in the embodiment of the application is described below through an application scene.
In the application scene, the screen projection transmitting device is a mobile terminal, the display resolution of the screen projection transmitting device is 1080p, the display device is a television screen, and the resolution of the display device is 4k. When the screen projection device performs office content display through screen projection, full screen projection display is usually performed on the display device, that is, in the case that the resolution of the display device is 4k, the original 1080p image needs to be twice amplified in the horizontal direction and the vertical direction, that is, the total pixels of the original 1080p image are amplified by 4. When the 4K display screen is used for screen projection display, if the related technical scheme is adopted to simply amplify the original image, the phenomena of obvious saw teeth, insufficient definition and the like can occur in some original smaller details such as some text contents in the image contents. Aiming at the problem, by adopting the technical scheme of the embodiment of the application, the image enhancement algorithm can be reasonably determined according to the screen projection scene information, and the display quality of the screen projection image is improved.
In summary, the embodiment of the application can enhance the display quality of the screen projection image through an AI technology, and can perform targeted super-division processing and image quality enhancement processing on the content area according to the picture content characteristics of the screen projection scene; different image enhancement algorithms can be selected according to the service characteristics of different screen projection scenes, so that image quality enhancement is realized; the image enhancement algorithm can be reasonably determined under the condition of considering the difference of the screen-throwing content, the difference of the screen-throwing transmitting equipment and the difference of the display equipment.
Further, the embodiment of the application can perform image quality optimization and super-resolution processing on the image with small resolution (such as 1080 p), so that the display quality of the projection image is improved on an ultra-high definition television display screen (for example, a television display screen with resolution of 4k or 8 k), and the visual experience of a user is enhanced. In the screen projection application scene, the image enhancement processing and the super-resolution processing can be performed based on the screen projection scene information, and the screen projection transmitting device does not need to transmit high-resolution image data to the screen projection receiving device, but can transmit low-resolution data to the screen projection receiving device, so that bandwidth resources of network transmission can be saved.
It will be appreciated by those skilled in the art that in the above-described method of the specific embodiments, the written order of steps is not meant to imply a strict order of execution but rather should be construed according to the function and possibly inherent logic of the steps.
On the basis of the screen projection method provided by the embodiment, the embodiment of the application also provides a screen projection device which is applied to the screen projection receiving equipment.
Fig. 4 is a schematic structural diagram of a screen projection device according to an embodiment of the present application, as shown in fig. 4, the device may include:
A receiving module 400, configured to receive image data sent by the screen-projection transmitting device;
the obtaining module 401 is configured to obtain at least two types of screen scene information, where the at least two types of screen scene information include at least two items of: attribute information of the screen projection transmitting device, the type of the image data and attribute information of the display device;
a first processing module 402, configured to determine at least two image enhancement algorithms corresponding to the at least two screen scene information according to the at least two screen scene information and preset image tuning policy information; the image tuning strategy information comprises the corresponding relation between various screen projection scene information and various image enhancement algorithms;
a second processing module 403, configured to perform image enhancement processing on the image data according to the at least two image enhancement algorithms, so as to obtain an image to be displayed;
and the output module 404 is used for outputting the image to be displayed to a display device.
In some embodiments, the second processing module 403, configured to perform image enhancement processing on the image data according to the at least two image enhancement algorithms, so as to obtain an image to be displayed includes:
performing image enhancement processing on the image data according to the at least two image enhancement algorithms;
And performing super-resolution processing on the image subjected to the image enhancement processing to obtain the image to be displayed.
In some embodiments, the at least two types of screen-cast scene information include a type of the image data, the type of the image data including a type of content of the image data; and under the condition that the type of the content of the image data is the target type, the at least two image enhancement algorithms corresponding to the at least two screen projection scene information comprise image enhancement algorithms corresponding to the target type.
In some embodiments, in a case where the object type is a character, the image enhancement algorithm corresponding to the object type includes: and carrying out fusion processing on the image of the target type by adopting a matrix corresponding to the character.
In some embodiments, the at least two kinds of screen-cast scene information include attribute information of the display device, the attribute information of the display device including a type of the display device; and under the condition that the type of the display equipment is the first type, the at least two image enhancement algorithms corresponding to the at least two screen projection scene information comprise image enhancement algorithms corresponding to the display equipment of the first type.
In some embodiments, the type of the display device is determined according to EDID information of the display device.
In some embodiments, the at least two kinds of screen-projection scene information include attribute information of the screen-projection transmitting device, and the attribute information of the screen-projection transmitting device includes a display resolution of the screen-projection transmitting device; under the condition that the display resolution of the screen projection transmitting equipment is the first resolution, the at least two image enhancement algorithms corresponding to the at least two screen projection scene information comprise image enhancement algorithms corresponding to the screen projection transmitting equipment with the first resolution; the aspect ratio of the pixels corresponding to the first resolution is different from each aspect ratio in the preset aspect ratio set.
In some embodiments, the image enhancement algorithm corresponding to the projection transmission device with the first resolution includes: obtaining an image with actual content by performing black edge removing treatment on the image data; and stretching the image with the actual content to obtain an image with the same length-width ratio as one length-width ratio in a preset length-width ratio set.
In practical applications, the receiving module 400, the obtaining module 401, the first processing module 402, the second processing module 403, and the output module 404 may be implemented based on a processor of an electronic device.
It should be noted that the description of the above device embodiments is similar to the description of the method embodiments described above, with similar advantageous effects as the method embodiments. For technical details not disclosed in the device embodiments of the present application, please refer to the description of the method embodiments of the present application for understanding.
It should be noted that, in the embodiment of the present application, if the method is implemented in the form of a software functional module, and sold or used as a separate product, the method may also be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially or portions contributing to the prior art may be embodied in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a terminal, a server, etc.) to execute all or part of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read Only Memory (ROM), a magnetic disk, an optical disk, or other various media capable of storing program codes. Thus, embodiments of the present application are not limited to any specific combination of hardware and software.
Correspondingly, the embodiment of the application further provides a computer program product, which comprises computer executable instructions for implementing any one of the screen projection methods provided by the embodiment of the application.
Accordingly, an embodiment of the present application further provides a computer storage medium, where computer executable instructions are stored on the computer storage medium, where the computer executable instructions are configured to implement any one of the screen projection methods provided in the foregoing embodiments.
The embodiment of the present application further provides an electronic device, fig. 5 is a schematic diagram of a composition structure of the electronic device provided in the embodiment of the present application, as shown in fig. 5, the electronic device 50 may include:
a first communication interface 501, configured to interact with a projection screen transmitting device;
a second communication interface 502, configured to interact with a display device;
a memory 503 for storing a computer program;
the processor 504 is respectively connected with the first communication interface 501 and the second communication interface 502 to realize information interaction with the projection display device and the projection display device; the processor 504 is configured to receive, via the first communication interface 501, image data sent by the projection device, and when configured to run a computer program, perform the following steps:
Acquiring at least two screen projection scene information, wherein the at least two screen projection scene information comprises at least two of the following items: attribute information of the screen projection transmitting device, the type of the image data and attribute information of the display device;
determining at least two image enhancement algorithms corresponding to the at least two screen projection scene information according to the at least two screen projection scene information and preset image tuning strategy information; the image tuning strategy information comprises the corresponding relation between various screen projection scene information and various image enhancement algorithms;
performing image enhancement processing on the image data according to the at least two image enhancement algorithms to obtain an image to be displayed;
the processor 504 is further configured to output the image to be displayed to a display device through the second communication interface 502.
Of course, in actual practice, the various components in electronic device 50 are coupled together via bus system 505. It is understood that bus system 505 is used to enable connected communications between these components. The bus system 505 includes a power bus, a control bus, and a status signal bus in addition to a data bus. But for clarity of illustration the various buses are labeled as bus system 505 in fig. 5.
The memory 503 in the present embodiment is used to store various types of data to support the operation of the electronic device 50. Examples of such data include: any computer program for operation on the electronic device 50.
In some embodiments, the processor 504 is configured to execute the following steps when executing the computer program:
performing image enhancement processing on the image data according to the at least two image enhancement algorithms;
and performing super-resolution processing on the image subjected to the image enhancement processing to obtain the image to be displayed.
In some embodiments, the at least two types of screen-cast scene information include a type of the image data, the type of the image data including a type of content of the image data; and under the condition that the type of the content of the image data is the target type, the at least two image enhancement algorithms corresponding to the at least two screen projection scene information comprise image enhancement algorithms corresponding to the target type.
In some embodiments, in a case where the object type is a character, the image enhancement algorithm corresponding to the object type includes: and carrying out fusion processing on the image of the target type by adopting a matrix corresponding to the character.
In some embodiments, the at least two kinds of screen-cast scene information include attribute information of the display device, the attribute information of the display device including a type of the display device; and under the condition that the type of the display equipment is the first type, the at least two image enhancement algorithms corresponding to the at least two screen projection scene information comprise image enhancement algorithms corresponding to the display equipment of the first type.
In some embodiments, the type of display device is determined from extended display identification data EDID information of the display device.
In some embodiments, the at least two kinds of screen-projection scene information include attribute information of the screen-projection transmitting device, and the attribute information of the screen-projection transmitting device includes a display resolution of the screen-projection transmitting device; under the condition that the display resolution of the screen projection transmitting equipment is the first resolution, the at least two image enhancement algorithms corresponding to the at least two screen projection scene information comprise image enhancement algorithms corresponding to the screen projection transmitting equipment with the first resolution; the aspect ratio of the pixels corresponding to the first resolution is different from each aspect ratio in the preset aspect ratio set.
In some embodiments, the image enhancement algorithm corresponding to the projection transmission device with the first resolution includes: obtaining an image with actual content by performing black edge removing treatment on the image data; and stretching the image with the actual content to obtain an image with the same length-width ratio as one length-width ratio in a preset length-width ratio set.
The processor 504 may be at least one of ASIC, DSP, DSPD, PLD, FPGA, CPU, a controller, a microcontroller, and a microprocessor.
The computer readable storage medium/Memory may be a Read Only Memory (ROM), a programmable Read Only Memory (Programmable Read-Only Memory, PROM), an erasable programmable Read Only Memory (Erasable Programmable Read-Only Memory, EPROM), an electrically erasable programmable Read Only Memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), a magnetic random access Memory (Ferromagnetic Random Access Memory, FRAM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical disk, or a Read Only optical disk (Compact Disc Read-Only Memory, CD-ROM); but may also be various terminals such as mobile phones, computers, tablet devices, personal digital assistants, etc., that include one or any combination of the above-mentioned memories.
In some embodiments, functions or modules included in the apparatus provided in the embodiments of the present application may be used to perform the methods described in the foregoing method embodiments, and specific implementations thereof may refer to descriptions of the foregoing method embodiments, which are not repeated herein for brevity.
The foregoing description of various embodiments is intended to highlight differences between the various embodiments, which may be the same or similar to each other by reference, and is not repeated herein for the sake of brevity.
The methods disclosed in the method embodiments provided by the application can be arbitrarily combined under the condition of no conflict to obtain a new method embodiment.
The features disclosed in the embodiments of the products provided by the application can be arbitrarily combined under the condition of no conflict, so as to obtain new embodiments of the products.
The features disclosed in the embodiments of the method or the apparatus provided in the application may be arbitrarily combined without conflict to obtain a new embodiment of the method or the apparatus.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), including several instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method described in the embodiments of the present application.
The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those of ordinary skill in the art without departing from the spirit of the present application and the scope of the protection of the claims, which fall within the protection of the present application.
Claims (11)
1. A screen projection method, characterized by being applied to a screen projection receiving device, the method comprising:
receiving image data sent by a screen projection transmitting device;
acquiring at least two screen projection scene information, wherein the at least two screen projection scene information comprises at least two of the following items: attribute information of the screen projection transmitting device, the type of the image data and attribute information of the display device;
determining at least two image enhancement algorithms corresponding to the at least two screen projection scene information according to the at least two screen projection scene information and preset image tuning strategy information; the image tuning strategy information comprises the corresponding relation between various screen projection scene information and various image enhancement algorithms;
performing image enhancement processing on the image data according to the at least two image enhancement algorithms to obtain an image to be displayed;
And outputting the image to be displayed to a display device.
2. The method of claim 1, wherein performing image enhancement processing on the image data according to the at least two image enhancement algorithms to obtain an image to be displayed comprises:
performing image enhancement processing on the image data according to the at least two image enhancement algorithms;
and performing super-resolution processing on the image subjected to the image enhancement processing to obtain the image to be displayed.
3. The method according to claim 1 or 2, wherein the at least two kinds of screen-cast scene information include a type of the image data including a type of content of the image data; and under the condition that the type of the content of the image data is the target type, the at least two image enhancement algorithms corresponding to the at least two screen projection scene information comprise image enhancement algorithms corresponding to the target type.
4. A method according to claim 3, wherein in the case where the object type is a character, the image enhancement algorithm corresponding to the object type comprises: and carrying out fusion processing on the image of the target type by adopting a matrix corresponding to the character.
5. The method according to claim 1 or 2, wherein the at least two kinds of screen-cast scene information include attribute information of the display device, the attribute information of the display device including a type of the display device; and under the condition that the type of the display equipment is the first type, the at least two image enhancement algorithms corresponding to the at least two screen projection scene information comprise image enhancement algorithms corresponding to the display equipment of the first type.
6. The method of claim 5, wherein the type of display device is determined based on extended display identification data EDID information of the display device.
7. The method according to claim 1 or 2, wherein the at least two kinds of screen-projection scene information include attribute information of the screen-projection transmitting device, the attribute information of the screen-projection transmitting device including a display resolution of the screen-projection transmitting device; under the condition that the display resolution of the screen projection transmitting equipment is the first resolution, the at least two image enhancement algorithms corresponding to the at least two screen projection scene information comprise image enhancement algorithms corresponding to the screen projection transmitting equipment with the first resolution; the aspect ratio of the pixels corresponding to the first resolution is different from each aspect ratio in the preset aspect ratio set.
8. The method of claim 7, wherein the image enhancement algorithm corresponding to the projection transmission device having the first resolution comprises: obtaining an image with actual content by performing black edge removing treatment on the image data; and stretching the image with the actual content to obtain an image with the same length-width ratio as one length-width ratio in a preset length-width ratio set.
9. A screen projection device, characterized in that it is applied to a screen projection receiving apparatus, the device comprising:
the receiving module is used for receiving the image data sent by the screen-throwing transmitting equipment;
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring at least two screen projection scene information, and the at least two screen projection scene information comprises at least two of the following items: attribute information of the screen projection transmitting device, the type of the image data and attribute information of the display device;
the first processing module is used for determining at least two image enhancement algorithms corresponding to the at least two screen projection scene information according to the at least two screen projection scene information and preset image tuning strategy information; the image tuning strategy information comprises the corresponding relation between various screen projection scene information and various image enhancement algorithms;
The second processing module is used for carrying out image enhancement processing on the image data according to the at least two image enhancement algorithms so as to obtain an image to be displayed;
and the output module is used for outputting the image to be displayed to the display equipment.
10. An electronic device comprising a first communication interface, a second communication interface, a processor and a memory for storing a computer program capable of running on the processor; wherein,,
the first communication interface is used for carrying out information interaction with the screen projection transmitting equipment;
the second communication interface is used for carrying out information interaction with the display equipment;
the processor is configured to run the computer program to perform the screen projection method of any one of claims 1 to 8.
11. A computer storage medium having stored thereon a computer program, which when executed by a processor implements the method of screening according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310323220.7A CN116389821A (en) | 2023-03-23 | 2023-03-23 | Screen projection method, device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310323220.7A CN116389821A (en) | 2023-03-23 | 2023-03-23 | Screen projection method, device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116389821A true CN116389821A (en) | 2023-07-04 |
Family
ID=86974456
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310323220.7A Pending CN116389821A (en) | 2023-03-23 | 2023-03-23 | Screen projection method, device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116389821A (en) |
-
2023
- 2023-03-23 CN CN202310323220.7A patent/CN116389821A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR20170031033A (en) | Methods, systems and apparatus for over-exposure correction | |
| CN107948733B (en) | Video image processing method and device and electronic equipment | |
| US11062430B2 (en) | Display apparatus and image processing method thereof | |
| US11960996B2 (en) | Video quality assessment method and apparatus | |
| CN111079864A (en) | Short video classification method and system based on optimized video key frame extraction | |
| CN112399120A (en) | Electronic device and control method thereof | |
| CN116744056A (en) | Electronic device and control method thereof | |
| CN113556582A (en) | Video data processing method, device, equipment and storage medium | |
| CN106603885B (en) | Method of video image processing and device | |
| CN112819699A (en) | Video processing method and device and electronic equipment | |
| Zhang et al. | Multi-scale-based joint super-resolution and inverse tone-mapping with data synthesis for UHD HDR video | |
| US20160330400A1 (en) | Method, apparatus, and computer program product for optimising the upscaling to ultrahigh definition resolution when rendering video content | |
| CN113822803A (en) | Image super-resolution processing method, device, equipment and computer readable storage medium | |
| CN109120979B (en) | Video enhancement control method and device and electronic equipment | |
| CN114363697B (en) | Video file generation and playing method and device | |
| CN116389821A (en) | Screen projection method, device, electronic equipment and storage medium | |
| CN114245027B (en) | Video data hybrid processing method, system, electronic equipment and storage medium | |
| CN108933945B (en) | GIF picture compression method, device and storage medium | |
| CN114584831A (en) | Video optimization processing method, device, equipment and storage medium for improving video definition | |
| CN113689333A (en) | Image enhancement method and device | |
| WO2022070163A1 (en) | Enhancing image data for different types of displays | |
| CN113613024A (en) | Video preprocessing method and device | |
| EP3139341A1 (en) | Methods, systems and apparatus for specular highlight reconstruction | |
| CN115147314B (en) | Image processing method, device, equipment and storage medium | |
| Piniarski et al. | Efficient HDR tone-mapping for ADAS applications |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |