CN116456137A - Screen projection method and electronic equipment - Google Patents

Screen projection method and electronic equipment Download PDF

Info

Publication number
CN116456137A
CN116456137A CN202310484616.XA CN202310484616A CN116456137A CN 116456137 A CN116456137 A CN 116456137A CN 202310484616 A CN202310484616 A CN 202310484616A CN 116456137 A CN116456137 A CN 116456137A
Authority
CN
China
Prior art keywords
code stream
data code
network
target content
screen projection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310484616.XA
Other languages
Chinese (zh)
Inventor
陈铁砺
张阳阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BOE Technology Group Co Ltd
Original Assignee
BOE Technology Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BOE Technology Group Co Ltd filed Critical BOE Technology Group Co Ltd
Priority to CN202310484616.XA priority Critical patent/CN116456137A/en
Publication of CN116456137A publication Critical patent/CN116456137A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43076Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43078Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen for seamlessly watching content streams when changing device, e.g. when watching the same program sequentially on a TV and then on a tablet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43637Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The disclosure provides a screen projection method and electronic equipment, wherein the method comprises the following steps: accessing a first network; and delivering target content to at least one second device in a preset screen-throwing mode through the first network, wherein the second device is accessed to the first network. According to the method and the device, the first equipment serving as the sending end and the second equipment serving as the receiving end are improved at the same time, so that the display effect of target content is optimized and the operability is expanded in the screen throwing process, and the use experience of a user in the screen throwing process is improved.

Description

Screen projection method and electronic equipment
Technical Field
The disclosure relates to the technical field of electronic communication, and in particular relates to a screen projection method and electronic equipment.
Background
With the popularization of networks and various electronic devices, the screen projection technology is increasingly applied to meeting scenes, teaching scenes and even household scenes, for example, display contents on a small-size screen are projected onto a large-size screen in a screen projection mode, or the display contents are projected onto screens of a plurality of other devices from a single device, and content sharing is realized through the projection of the screen contents among different devices, so that a user can conveniently view the display contents and have better experience.
The traditional screen throwing mode is wired connection, has a certain limit on the connection distance, has insufficient functions, and mainly takes screen copying and expansion as main. The conventional wireless screen-throwing mode can be used for content delivery without being limited by connecting wires, is particularly suitable for meeting scenes, but the meeting content recording mode involved in the screen-throwing process is a participant manual recording mode, so that the loss of meeting information is easy to cause, and in the case of poor network condition, the delivered target content is poor in quality, low in transmission efficiency and seriously affects the meeting effect.
Disclosure of Invention
An objective of the disclosed embodiments is to provide a screen projection method and an electronic device, which are used for solving the above problems existing in the prior art.
The embodiment of the disclosure adopts the following technical scheme: a screen projection method is applied to a first device and comprises the following steps: accessing a first network; and delivering target content to at least one second device through the first network in a preset screen-throwing mode, wherein the second device is accessed to the first network.
In some embodiments, the preset screen projection mode includes: at least one of a mirror image screen-throwing mode and a file screen-throwing mode.
In some embodiments, in a case that the preset screen projection mode is a mirror image screen projection mode, the delivering, by the first network, the target content to at least one second device in the preset screen projection mode includes: detecting whether the current display content of the first device is a document file and/or a picture file; generating a first data code stream in real time according to the current display content of first equipment under the condition that the current display content is a document file and/or a picture file, wherein the first data code stream at least comprises a first mark, so that the second equipment performs noise reduction processing and/or sharpening processing on a first display picture formed by analyzing the first data code stream under the condition that the second equipment receives the first data code stream comprising the first mark; generating a second data code stream in real time according to the current display content of the first device under the condition that the current display content is not a document file and/or a picture file; and sending the first data code stream or the second data code stream generated in real time to the second equipment through the first network.
In some embodiments, after the first data code stream or the second data code stream generated in real time is sent to the second device through the first network, the method further includes: detecting a network state of the first network; and reducing the resolution of the first data code stream or the second data code stream generated in real time from a first resolution to a second resolution under the condition that the first network is in a network congestion state.
In some embodiments, after the first data code stream generated in real time is sent to the second device through the first network, the method further includes: and under the condition that the network congestion information fed back by the second equipment is received, reducing the resolution of the first data code stream or the second data code stream generated in real time from the first resolution to the second resolution.
In some embodiments, the delivering, by the first network, the target content to at least one second device in a preset screen-throwing manner includes: placing at least one of the target content in a delivery list and delivering the target content to the second device in the order in the delivery list.
In some embodiments, after placing at least one of the target content in a delivery list and delivering the target content to the second device in the order in the delivery list, further comprising: under the condition that a switching instruction is received, delivering the next target content of the current target content in the delivery list to the second equipment; the switching instruction is generated based on switching operation of a user on the first device, or the switching instruction is sent to the first device for the second device.
The embodiment of the disclosure also provides a screen projection method applied to the second device, comprising the following steps: accessing a first network; and receiving and displaying target content which is delivered by the first equipment through the first network in a preset screen-throwing mode through the first network, wherein the first equipment is accessed to the first network.
In some embodiments, after receiving and displaying, by the first network, the target content delivered by the first device in a preset screen-throwing manner through the first network, the method further includes: under the condition that an extraction instruction is received, extracting characters or pictures from currently displayed target content; and carrying out preset operation on the extracted text or picture, wherein the preset operation at least comprises any one of copying, pasting and storing.
In some embodiments, in a case that the preset screen projection mode is a mirror image screen projection mode, the receiving and displaying, by the first network, the target content that is delivered by the first device in the preset screen projection mode through the first network includes: receiving a data code stream sent by the first equipment; detecting whether the data code stream comprises a first mark or not; under the condition that the data code stream does not comprise the first mark, the data code stream is a second data code stream, and the second data code stream is analyzed to form a second display picture; and under the condition that the data code stream comprises a first mark, the data code stream is a first data code stream, the first data code stream is analyzed to form a first display picture, and under the condition that an enhancement instruction is received, noise reduction processing and/or sharpening processing is carried out on the first display picture.
In some embodiments, after receiving the data code stream sent by the first device, the method further includes: detecting a network state of the first network; and feeding back network congestion information to the first equipment under the condition that the first network is in a network congestion state.
In some embodiments, after feeding back the network congestion information to the first device, the method further includes: receiving a data code stream with a second resolution sent by the first device; detecting whether the data code stream comprises a first mark or not; under the condition that the data code stream does not comprise the first mark, the data code stream is a second data code stream, and the second data code stream is analyzed to form a second display picture; and under the condition that the data code stream comprises a first mark, the data code stream is a first data code stream, the first data code stream is analyzed to form a first display picture, and noise reduction processing and/or sharpening processing is carried out on the first display picture.
In some embodiments, after receiving and displaying, through the first network, the target content delivered by the first device through the first network in a preset screen-throwing manner, the method further includes: generating a switching instruction according to switching operation of a user on the second device; and sending the switching instruction to the first device, and receiving the next target content of the current target content in the delivery list delivered by the first device according to the switching instruction.
The embodiment of the disclosure further provides an electronic device, at least comprising a memory and a processor, wherein the memory stores a computer program, and the method is characterized in that the processor realizes the steps of the screen projection method according to the previous claim when executing the computer program on the memory.
The beneficial effects of the embodiment of the disclosure are that: the first equipment serving as the sending end and the second equipment serving as the receiving end are improved at the same time, so that the display effect of target content is optimized and the operability is expanded in the screen throwing process, and the use experience of a user in the screen throwing process is improved.
Drawings
In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings that are required to be used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments described in the present disclosure, and other drawings may be obtained according to these drawings without inventive effort to a person of ordinary skill in the art.
FIG. 1 is a flowchart of a screen projection method according to a first embodiment of the present disclosure;
FIG. 2 is a flowchart showing the steps performed in step S12 in the first embodiment of the present disclosure;
FIG. 3 is another flowchart of a screen projection method according to a first embodiment of the present disclosure;
FIG. 4 is a flowchart of a screen projection method according to a second embodiment of the present disclosure;
FIG. 5 is another flow chart of a screen projection method according to a second embodiment of the present disclosure;
FIG. 6 is a flowchart illustrating the steps performed in step S42 in a second embodiment of the present disclosure;
FIG. 7 is another flow chart of a screen projection method according to a second embodiment of the present disclosure;
fig. 8 is a schematic structural diagram of an electronic device according to a third embodiment of the present disclosure.
Detailed Description
Various aspects and features of the disclosure are described herein with reference to the drawings.
It should be understood that various modifications may be made to the embodiments of the application herein. Therefore, the above description should not be taken as limiting, but merely as exemplification of the embodiments. Other modifications within the scope and spirit of this disclosure will occur to persons of ordinary skill in the art.
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and, together with a general description of the disclosure given above and the detailed description of the embodiments given below, serve to explain the principles of the disclosure.
These and other characteristics of the present disclosure will become apparent from the following description of a preferred form of embodiment, given as a non-limiting example, with reference to the accompanying drawings.
It is also to be understood that, although the disclosure has been described with reference to some specific examples, a person skilled in the art will certainly be able to achieve many other equivalent forms of the disclosure, having the characteristics as set forth in the claims and hence all coming within the field of protection defined thereby.
The above and other aspects, features and advantages of the present disclosure will become more apparent in light of the following detailed description when taken in conjunction with the accompanying drawings.
Specific embodiments of the present disclosure will be described hereinafter with reference to the accompanying drawings; however, it is to be understood that the disclosed embodiments are merely examples of the disclosure, which may be embodied in various forms. Well-known and/or repeated functions and constructions are not described in detail to avoid obscuring the disclosure in unnecessary or unnecessary detail. Therefore, specific structural and functional details disclosed herein are not intended to be limiting, but merely serve as a basis for the claims and as a representative basis for teaching one skilled in the art to variously employ the present disclosure in virtually any appropriately detailed structure.
The specification may use the word "in one embodiment," "in another embodiment," "in yet another embodiment," or "in other embodiments," which may each refer to one or more of the same or different embodiments in accordance with the disclosure.
In order to solve the problems in the prior art, a first embodiment of the present disclosure provides a screen projection method applied to a first device, where the first device mainly refers to a device for sending target content, and is generally small-sized devices such as a mobile phone, a tablet computer, a notebook computer, or devices used by a conference host, and a flowchart of the screen projection method is shown in fig. 1, and mainly includes steps S11 and S12:
s11, accessing a first network;
s12, delivering target content to at least one second device in a preset screen-throwing mode through the first network.
The first network in this embodiment is mainly a wireless network, after the first device is connected to the wireless network, the first device can send the target content to at least one second device belonging to the first network through the first network, and the second device is a device for receiving the target content, which may be a device with a large-size screen such as a television, a projector, or various electronic devices held by a participant in a conference, as long as the first device can be connected. When the screen is actually thrown, the first device can realize one-to-one delivery, and can also simultaneously deliver target content to a plurality of second devices, when the second devices are arranged, the picture presented by each second device is synchronous with the first device, but other operations executed by each second device on the second device do not influence the picture display of other second devices.
The preset screen projection mode at present mainly comprises a mirror image screen projection mode and a file screen projection mode. The mirror image screen-throwing mode mainly refers to mirror image of the current display content on the screen of the first equipment to the screen of the second equipment, namely, whatever content is presented on the first equipment is delivered on the screen of the second equipment in real time for presentation, so that the sharing on the second equipment can be realized by opening files such as documents, pictures or audios and videos to be presented on the first equipment; the file screen-throwing mode is to singly throw the content which is wanted to be thrown, the target content which is shown on the second device and is just the currently thrown target content, at the moment, the target content comprises at least one of a document file, a picture file and an audio/video file, and particularly when the target content is thrown, if the target content is the document file, the first device can generally send the document file to the second device directly to enable the document file to be displayed, if the target content is the picture file and/or the audio/video file, a playing address (URL address) of the target content can be formed through a DLNA protocol, a HTTP server is used for acquiring specific data of the picture file and/or the audio/video file, and the playing address is sent to the second device through a network, so that the second device downloads and plays corresponding data through the address, and the effect of playing the second device is achieved.
Specifically, corresponding to the screen projection method implemented using the mirror image screen projection method, the first device mainly performs the steps shown in fig. 2 when performing step S12:
s21, detecting whether the current display content of the first device is a document file and/or a picture file; executing step S22 in case the currently displayed content is a document file and/or a picture file, otherwise executing step S23;
s22, generating a first data code stream in real time according to the current display content of the first device, wherein the first data code stream at least comprises a first mark;
s23, generating a second data code stream in real time according to the current display content of the first device;
and S24, transmitting the first data code stream or the second data code stream generated in real time to the second equipment through the first network.
The implementation principle corresponding to the mirror image screen-throwing mode is substantially equivalent to that of sending the content currently displayed by the first device into a data code stream, which is similar to that of sending a video or audio data stream to the second device, and after receiving the data code stream, the second device parses or recombines the data code stream to form a video-like picture and plays the video-like picture on a screen. The target content that the first device needs to deliver (i.e., the content that is opened on the first device) is typically a document file, a picture file, or an audio/video file, although other content that is presented on the screen when the first device is operated is also transmitted together. In general, in a conference scenario, a document file and a picture file are used as contents frequently displayed in the conference, and a good screen throwing effect needs to be ensured on a second device, in this embodiment, when a data code stream is formed, the content currently displayed by the first device is detected and identified, when the document file and/or the picture file is mainly delivered, a first mark is added in the first data code stream to distinguish from a second data code stream formed when the audio and video file is delivered, so that the second device can conveniently and quickly judge the type of target content when the data code stream is received, and further, the second device can perform other processes on the document file and/or the picture file, such as operations of extracting, copying, pasting, and the like, or realize optimization operations on presentation effects such as noise reduction processing or sharpening processing on the text content and the picture content formed by analyzing the first data code stream.
In the actual use process, the resolution of the data code stream formed by the first device may also be different due to the influence of the network state of the first network, if the network is smooth, the first data code stream or the second data code stream formed by the first device has higher first resolution, if the network is congested, the first data code stream or the second data code stream formed by the first device has lower second resolution, and the stability of the transmission process of the data code stream is ensured by reducing the resolution. In some embodiments, the first device adjusts the resolution of the data code stream according to the network condition during the transmission of the first data code stream or the second data code stream, as shown in fig. 3, in step S31, the first device may perform network status detection of the first network in real time, if it is detected that the first device is in a network congestion state, perform step S32 to reduce the resolution of the first device from the first resolution to the second resolution when the first data code stream or the second data code stream is generated in real time, and if it is detected that the first network is not in a network congestion state, perform step S33 to continuously perform real-time generation of the first data code stream or the second data code stream according to the first resolution, and step S31 is actually continuously performed to perform network status detection in real time. In some embodiments, if the network state of the first network is recovered from the network congestion state to the non-congestion state, the resolution of the first data code stream or the second data code stream may be correspondingly increased from the second resolution to the first resolution. In addition, the specific determination conditions of the network congestion state or the non-congestion state of the first network may be set autonomously according to the actual requirement, and the values of the first resolution and the second resolution may be adjusted according to the situation, so long as the second resolution is ensured to be lower than the first resolution, preferably, the first resolution may be defined as 1080PPI, and the second resolution may be defined as 480PPI, which is of course only an example, and should not limit the disclosure.
In some embodiments, any device in the first network should have a function of detecting a network state, and a feedback mechanism should also be provided between devices to perform information circulation, so that the second device also has a network state detection function, when detecting that the network state of the first network is a network congestion state, the second device can feed back the network congestion information to the first device, and when receiving the network congestion information, the first device can know that the first network is in the network congestion state, and at this time, when generating the first data code stream or the second data code stream in real time, the resolution of the first device can be reduced from the first resolution to the second resolution.
In an actual conference scenario, there are often multiple reporters in a conference, and the material for each reporter needs to be delivered. The current common mode is that meeting organizer manually gathers materials of all reporters to form a delivery file, or the first equipment is operated for a plurality of times in the reporting process to realize the switching operation of the delivery file, and no matter what mode needs to spend a great deal of time and energy of the meeting organizer, and the meeting process can be interrupted. In this embodiment, when the first device performs file screen projection, a projection list is established, at least one target content to be delivered is placed in the projection list, and delivery of the target content is performed in combination with the order in the projection list during delivery. In the process of delivering the target content by using the delivery list, the first device can also detect whether a switching instruction is received or not in real time, and when the switching instruction is received, that is, the switching of the target content is required currently, the next target content of the target content currently being delivered in the delivery list can be delivered to the second device for display. In this embodiment, the switching instruction may be generated when the user performs a switching operation on the first device, that is, when the user clicks a switching button (e.g., a page turn, a next key, etc.) on the first device; the switching instruction may also be fed back to the first device by the second device, where the user may directly perform the switching operation on the second device, for example, click a switching button on the second device, and when the second device obtains the switching operation of the user, the second device generates the switching instruction and feeds back the switching instruction to the first device, so as to inform the first device that the user has a current switching intention.
According to the embodiment, the switching control of the target content is realized through the detection of the switching instruction of the first device, and the switching instruction can come from the second device, so that the second device also has the switching function of the target content. In the conference process, the reporter can directly operate the large-screen equipment serving as the receiving end, and the small-screen equipment serving as the sending end does not need to be frequently reciprocated to switch target contents, so that better use experience is achieved.
According to the method, the first equipment serving as the sending end is improved, and the first equipment correspondingly has different improvements according to different screen throwing modes, so that the display effect of target content is optimized and the operability is expanded in the screen throwing process, and the use experience of a user in the screen throwing process is improved.
The second embodiment of the present disclosure provides a screen projection method applied to a second device, where the second device is mainly used as a receiving end, and mainly refers to devices with large-size screens, such as televisions and projectors, and may also be various electronic devices held by participants in a conference, where the number of the second devices in the same network is not limited, and in a state where network conditions allow, all devices held by the participants in a conference may be used as the second devices, so that each participant may view conference content through its own device, which is more beneficial to improving the participant experience. Fig. 4 shows a flowchart of the screen projection method in this embodiment, which mainly includes steps S41 and S42:
s41, accessing a first network;
s42, receiving and displaying target content which is delivered by the first equipment through the first network in a preset screen-throwing mode through the first network.
The first network in this embodiment is mainly a wireless network, and after the second device accesses to the wireless network, the second device can receive the target content delivered by the first device belonging to the first network through the first network and present the target content on its own screen. When the screen is actually thrown, the first device can realize one-to-one delivery, and can also simultaneously deliver target content to a plurality of second devices, when the second devices are arranged, the picture presented by each second device is synchronous with the first device, but other operations executed by each second device on the second device do not influence the picture display of other second devices.
Corresponding to a mirror image screen projection mode and a file screen projection mode which are included in the preset screen projection mode at present, the second device performs target content presentation in a video-like mode after receiving the data code stream sent by the first device and analyzing and recombining the data code stream in the mirror image screen projection mode, and performs corresponding document presentation in a local mode directly by receiving a document file in the file screen projection mode or performs simultaneous playing of a picture or an audio/video file in a mode of receiving a playing address.
Further, fig. 5 shows another implementation flowchart of the screen-casting manner in this embodiment, which may further perform the following operations after receiving the target content delivered by the first device:
s51, under the condition that an extraction instruction is received, extracting characters or pictures from currently displayed target content;
s52, performing preset operation on the extracted characters or pictures.
In the process of presenting the target content by the second device, especially in a conference or teaching scene, the user of the second device can only watch the target content, or simply play, pause and other operations, and cannot directly use the specific text or picture and other information contained in the target content, so that the user also needs to record the note manually, or edit the target content after one-to-one transmission by other modes, the conference or teaching efficiency is low, and the participation degree of the participants is low. In the process of presenting the target content by the second device, the user of the second device may send an extraction instruction to the second device, so that the second device extracts text or picture of the currently displayed target content when receiving the extraction instruction, and may copy, paste, save and other preset operations on the extracted question or picture.
Specifically, the second device is used as a controllable device, and generally has an external control device such as a remote controller, a mouse, a handwriting pen, or the second device is a device with a touch function, so that a user can control the second device through the control device or a touch operation on a screen. The extraction instruction is an instruction generated by a control device or a touch operation when a user wants to extract the text or the picture of the current display content in the screen throwing process, the second device can correspondingly extract the text or the picture of the current display target content when receiving the extraction instruction, and the extracted text is copied, pasted, saved and the like according to the actual requirement of the user. In some embodiments, when text extraction is correspondingly performed, all the text displayed at present can be extracted first, and then, according to the selection condition of some text by a user, the preset operation is performed on the selected text; if the current display content comprises a picture which the user wants to extract, the picture can be separated from the whole currently displayed picture, so that other processing is facilitated.
Specifically, corresponding to the screen projection method implemented using the mirror image screen projection method, the second device mainly performs the steps as shown in fig. 6 when performing step S42:
s61, receiving a data code stream sent by first equipment;
s62, detecting whether the first mark is included in the data code stream, executing step S63 when the first mark is not included, and executing step S64 when the first mark is included;
s63, the data code stream is a second data code stream, and the second data code stream is analyzed to form a second display picture;
s64, the data code stream is a first data code stream, and the first data code stream is analyzed to form a first display picture;
s65, noise reduction processing and/or sharpening processing is performed on the first display picture under the condition that the enhancement instruction is received.
The first device forms a first data code stream with a first mark and a second data code stream without the first mark according to the content currently displayed by the first device, and the first device is mainly used for distinguishing a document file and a picture file, and the content mainly displayed by the first device is in the form of characters or pictures, and is usually the main content of a conference, corresponding to the first data code stream with the first mark. In the screen projection process, the original text or the original picture may be poor in definition in the first device, or the image quality is reduced in the transmission process, or the text or the picture is often blurred when presented on the second device due to the difference between the resolutions of the first device and the second device, so that the user cannot clearly know the content of the text or the picture when viewing the text or the picture.
It should be noted that, in this embodiment, only the text content and the picture content are enhanced, but not all types of received data code streams are enhanced, mainly because in the scene used by the user, not all the screen contents need to be enhanced, the global enhancement brings more delay, and in the case of an unfavorable refresh rate such as documents and pictures, the selective enhancement is faster, the delay is lower, and the enhancement effect is better.
In the actual use process, the first equipment is matched with a mode of delivering to a plurality of second equipment at the same time, any one of the plurality of second equipment can perform the operations of content extraction, enhancement processing and the like, and the first equipment is not affected in delivering subsequent content and displaying pictures of other second equipment. In addition, aiming at the conditions of image delay or asynchronism and the like possibly caused by the second equipment which performs the content extraction or enhancement processing, after the content extraction or enhancement processing is finished, the display image of the second equipment can be quickly consistent with other equipment, and the screen throwing effect is ensured.
In the actual use process of the mirror image screen projection, the resolution of the data code stream formed by the first device may also be different due to the influence of the network state of the first network, if the network is smooth, the first data code stream or the second data code stream formed by the first device has higher first resolution, if the network is congested, the first data code stream or the second data code stream formed by the first device has lower second resolution, and the stability of the transmission process of the data code stream is ensured by reducing the resolution. In some embodiments, the second device may detect the network state of the first network in real time, and when the network is congested, feed back the network congestion information to the first device to inform the first device to ensure smooth transmission by adjusting the resolution of the data code stream.
Further, unlike the manner in which the second device performs the corresponding processing under the control of the enhancement command shown in fig. 6, the step flowchart shown in fig. 7 may automatically perform the enhancement processing on the received data code stream when the second device determines that the first network is in the congestion state, and specifically, the method shown in fig. 7 mainly includes:
s71, receiving a data code stream with a second resolution sent by first equipment;
s72, detecting whether a first mark is included in the data code stream; step S73 is performed in the case where the first flag is not included in the data code stream, and step S74 is performed in the case where the first flag is included in the data code stream;
s73, the data code stream is a second data code stream, and the second data code stream is analyzed to form a second display picture;
s74, the data code stream is a first data code stream, the first data code stream is analyzed to form a first display picture, and noise reduction processing and/or sharpening processing are performed on the first display picture.
The data code stream received by the second device after the network congestion information is fed back to the first device is the data code stream after resolution reduction, then whether the data code stream comprises a first mark is detected, namely whether the data code stream is the data code stream for displaying characters or pictures is judged, the data code stream corresponding to the first mark can be identified as the first data code stream, and at the moment, the definition of the content such as the characters or the pictures is greatly influenced when the content such as the characters or the pictures is displayed on the second device after the resolution reduction processing due to the network state, so that the second device can automatically start enhancement processing under the condition that no user controls, and the purpose of improving the display effect of the characters or the pictures is achieved.
In some embodiments, a second device serving as the receiving end may be provided with a switching button, where the second device correspondingly generates a switching instruction when the user performs a switching operation on the second device, or the user may indicate, by using some preset modes such as gestures, voices, actions, and the like, an intention of desiring to switch the delivered target content. After the second device generates the switching instruction, the switching instruction can be fed back to the first device through the first network so as to inform the first device of the switching intention of the user, when the first device receives the switching instruction, the first device indicates that the switching of the target content is required currently, at this time, the first device delivers the next target content of the target content currently being delivered in the delivery list to the second device, and the second device correspondingly displays the target content according to the delivered target content. According to the embodiment, the second device feeds back the switching instruction to the first device, so that the switching control of the target content is realized, and the second device also has the switching function of the target content. In the conference process, the reporter can directly operate the large-screen equipment serving as the receiving end, and the small-screen equipment serving as the sending end does not need to be frequently reciprocated to switch target contents, so that better use experience is achieved.
According to the method, the second equipment serving as the receiving end is improved, and the second equipment correspondingly has different improvements according to different screen throwing modes, so that the display effect of target content is optimized and the operability is expanded in the screen throwing process, and the use experience of a user in the screen throwing process is improved.
The third embodiment of the present disclosure provides an electronic device, which may be any device for sending a target content for screen projection, or a device for receiving a target content for screen projection, and its schematic structural diagram is shown in fig. 8, and includes at least a memory 100 and a processor 200, where the memory 100 stores a computer program, and the processor 200 correspondingly implements the method provided in the first embodiment or the second embodiment of the present disclosure according to the purpose when executing the computer program on the memory 100.
While various embodiments of the present disclosure have been described in detail, the present disclosure is not limited to these specific embodiments, and various modifications and embodiments can be made by those skilled in the art on the basis of the concepts of the present disclosure, and these modifications and modifications should be within the scope of the present disclosure as claimed.

Claims (14)

1. A screen projection method applied to a first device, comprising:
accessing a first network;
and delivering target content to at least one second device through the first network in a preset screen-throwing mode, wherein the second device is accessed to the first network.
2. The screen projection method according to claim 1, wherein the preset screen projection mode comprises: at least one of a mirror image screen-throwing mode and a file screen-throwing mode.
3. The method according to claim 2, wherein, in the case that the preset screen projection mode is a mirror image screen projection mode, the delivering, by the first network, the target content to the at least one second device in the preset screen projection mode includes:
detecting whether the current display content of the first device is a document file and/or a picture file;
generating a first data code stream in real time according to the current display content of first equipment under the condition that the current display content is a document file and/or a picture file, wherein the first data code stream at least comprises a first mark, so that the second equipment performs noise reduction processing and/or sharpening processing on a first display picture formed by analyzing the first data code stream under the condition that the second equipment receives the first data code stream comprising the first mark;
generating a second data code stream in real time according to the current display content of the first device under the condition that the current display content is not a document file and/or a picture file;
and sending the first data code stream or the second data code stream generated in real time to the second equipment through the first network.
4. The screen projection method according to claim 3, further comprising, after transmitting the first data code stream or the second data code stream generated in real time to the second device through the first network:
detecting a network state of the first network;
and reducing the resolution of the first data code stream or the second data code stream generated in real time from a first resolution to a second resolution under the condition that the first network is in a network congestion state.
5. The screen projection method according to claim 3, wherein after the first data code stream generated in real time is transmitted to the second device through the first network, further comprising:
and under the condition that the network congestion information fed back by the second equipment is received, reducing the resolution of the first data code stream or the second data code stream generated in real time from the first resolution to the second resolution.
6. The method according to any one of claims 1 to 7, wherein the delivering, through the first network, the target content to the at least one second device in a preset screen-throwing manner includes:
placing at least one of the target content in a delivery list and delivering the target content to the second device in the order in the delivery list.
7. The method of screening according to claim 6, further comprising, after placing at least one of the target content in a delivery list and delivering the target content to the second device in the order in the delivery list:
under the condition that a switching instruction is received, delivering the next target content of the current target content in the delivery list to the second equipment; the switching instruction is generated based on switching operation of a user on the first device, or the switching instruction is sent to the first device for the second device.
8. A screen projection method applied to a second device, comprising:
accessing a first network;
and receiving and displaying target content which is delivered by the first equipment through the first network in a preset screen-throwing mode through the first network, wherein the first equipment is accessed to the first network.
9. The method for projecting a screen according to claim 8, wherein after receiving and displaying, through the first network, the target content that the first device projects in a preset projecting manner through the first network, the method further comprises:
under the condition that an extraction instruction is received, extracting characters or pictures from currently displayed target content;
and carrying out preset operation on the extracted text or picture, wherein the preset operation at least comprises any one of copying, pasting and storing.
10. The method of claim 8, wherein, in the case that the preset screen projection mode is a mirror image screen projection mode, the receiving and displaying, by the first network, the target content that is delivered by the first device in the preset screen projection mode by the first network includes:
receiving a data code stream sent by the first equipment;
detecting whether the data code stream comprises a first mark or not;
under the condition that the data code stream does not comprise the first mark, the data code stream is a second data code stream, and the second data code stream is analyzed to form a second display picture;
and under the condition that the data code stream comprises a first mark, the data code stream is a first data code stream, the first data code stream is analyzed to form a first display picture, and under the condition that an enhancement instruction is received, noise reduction processing and/or sharpening processing is carried out on the first display picture.
11. The screen projection method according to claim 10, further comprising, after receiving the data code stream transmitted by the first device:
detecting a network state of the first network;
and feeding back network congestion information to the first equipment under the condition that the first network is in a network congestion state.
12. The screen projection method of claim 11, further comprising, after feeding back network congestion information to the first device:
receiving a data code stream with a second resolution sent by the first device;
detecting whether the data code stream comprises a first mark or not;
under the condition that the data code stream does not comprise the first mark, the data code stream is a second data code stream, and the second data code stream is analyzed to form a second display picture;
and under the condition that the data code stream comprises a first mark, the data code stream is a first data code stream, the first data code stream is analyzed to form a first display picture, and noise reduction processing and/or sharpening processing is carried out on the first display picture.
13. The method according to any one of claims 8 to 12, further comprising, after receiving and displaying, via the first network, target content delivered by a first device via the first network in a preset screen-casting manner:
generating a switching instruction according to switching operation of a user on the second device;
and sending the switching instruction to the first device, and receiving the next target content of the current target content in the delivery list delivered by the first device according to the switching instruction.
14. An electronic device comprising at least a memory, a processor, the memory having stored thereon a computer program, characterized in that the processor, when executing the computer program on the memory, implements the steps of the screen projection method of any of claims 1 to 13.
CN202310484616.XA 2023-04-28 2023-04-28 Screen projection method and electronic equipment Pending CN116456137A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310484616.XA CN116456137A (en) 2023-04-28 2023-04-28 Screen projection method and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310484616.XA CN116456137A (en) 2023-04-28 2023-04-28 Screen projection method and electronic equipment

Publications (1)

Publication Number Publication Date
CN116456137A true CN116456137A (en) 2023-07-18

Family

ID=87123748

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310484616.XA Pending CN116456137A (en) 2023-04-28 2023-04-28 Screen projection method and electronic equipment

Country Status (1)

Country Link
CN (1) CN116456137A (en)

Similar Documents

Publication Publication Date Title
CN108012161B (en) Video live broadcast method, system and terminal equipment
US11962858B2 (en) Video playback method, video playback terminal, and non-volatile computer-readable storage medium
CN107682714B (en) Method and device for acquiring online video screenshot
US10375438B2 (en) Method for content projection and mobile terminal
WO2017181599A1 (en) Method and device for displaying videos
WO2014169796A1 (en) Method, device, and display device for switching video source
CN103037244B (en) The method of handover network video, system and intelligent terminal between multiple intelligent terminal
US11551723B2 (en) Computing system with DVE template selection and video content item generation feature
US20130242189A1 (en) Method and system for providing synchronized playback of media streams and corresponding closed captions
JP2020527883A5 (en)
CN109803151A (en) Multi-medium data stream switching method, device, storage medium and electronic device
CN110737638A (en) data sharing method, device, electronic equipment and storage medium
WO2017181603A1 (en) Video display method and device
CN109640136B (en) Method and device for controlling television, electronic equipment and readable medium
CN115379277B (en) VR panoramic video playing method and system based on IPTV service
US10347295B1 (en) Computing system with video content generation feature
CN116456137A (en) Screen projection method and electronic equipment
CN113938742B (en) Control method, system, equipment and storage medium for automatic screen-throwing content playing
WO2023284498A1 (en) Video playing method and apparatus, and storage medium
CN107333172B (en) Broadcasting method and device of broadcasting system and electronic equipment
US20220083306A1 (en) Information processing device, non-transitory recording medium, and information processing system
JP2022145503A (en) Live distribution information processing method, apparatus, electronic device, storage medium, and program
CN114866835A (en) Bullet screen display method, bullet screen display device and electronic equipment
CN112565807A (en) Method, device, medium and computer program product for live broadcast in local area network
EP3386203A1 (en) Signalling of auxiliary content for a broadcast signal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination