CN116347141A

CN116347141A - Screen projection processing, screen projection information configuration method, storage medium and electronic equipment

Info

Publication number: CN116347141A
Application number: CN202310184999.9A
Authority: CN
Inventors: 胡飞阳; 付长伟; 唐小军; 罗炜儒
Original assignee: Alibaba China Co Ltd
Current assignee: Alibaba China Co Ltd
Priority date: 2023-02-23
Filing date: 2023-02-23
Publication date: 2023-06-27

Abstract

The embodiment of the application discloses a screen projection processing method and device, a screen projection information configuration method and device, a computer readable storage medium and electronic equipment. The method comprises the following steps: determining identification information of a target process corresponding to a target file to be screened from terminal equipment associated with a presenter; according to the identification information of the target process, when the target process is included in the application program process running on the terminal equipment, an application program window associated with the target process is obtained; and when the application program window is determined to be a slide window, obtaining image data of the slide window and sending the image data to a screen-throwing display screen. Therefore, the single-screen projection function in the presenter mode can be realized, the compatibility problem and the delay problem do not exist, and the improvement of the watching experience of a viewer is facilitated.

Description

Screen projection processing, screen projection information configuration method, storage medium and electronic equipment

Technical Field

The present disclosure relates to the field of information processing technologies, and in particular, to a method and an apparatus for processing screen projection, a method and an apparatus for configuring screen projection information, a computer readable storage medium, and an electronic device.

Background

To improve the presentation effect, PPT (PowerPoint) provides a presenter mode in which the PPT application will generate 2 windows for the PPT file: a presenter window for a presenter to view, the window including slide content and annotation information added by the presenter; a slide window for viewing by a viewer, the window including only slide content.

If the screen projection processing is performed on the PPT file in the presenter mode, the presenter needs to configure 2 screens: the display screen comprises a main screen for displaying a presenter window, and an extension screen for displaying a slide window, wherein in the screen throwing process, image data of the slide window displayed on the extension screen can be grabbed and sent to a screen throwing box, and the slide window is displayed on a display screen of the screen throwing box.

Currently, 2 screens are mainly realized by connecting an HDMI (High Definition Multimedia Interface ) line to a display externally to terminal equipment used by a presenter. However, in some use cases, only a single screen may be used, for example, when a user is in a meeting room, it is often inconvenient to carry an extended screen, and it is desirable to implement a PPT presenter mode by using the single screen.

In the prior art, a single-screen projection is realized by adopting a scheme of a virtual expansion screen. Specifically, after a presenter clicks a "presenter mode" button in the PPT file, the operating system may generate a virtual extension screen in the terminal device, cast a presenter window to the main screen, that is, the display of the terminal device, cast a slide window to the virtual extension screen, collect a window image displayed on the virtual extension screen, and send the window image to a projection box.

The scheme for realizing single-screen projection through the virtual extension screen is only suitable for partial operating systems at present, the function of creating the virtual extension screen is adapted, and not all the operating systems are compatible to realize the single-screen projection scheme. In addition, the performance of the virtual expansion screen is inferior to that of an external physical expansion screen, the efficiency of collecting image data from the virtual expansion screen is relatively low, and particularly when the terminal equipment has a clamping phenomenon, the delay of image collection and screen throwing playing is more serious.

Disclosure of Invention

The application provides a screen projection processing method and device, a screen projection information configuration method and device, a computer readable storage medium and electronic equipment, which can realize a single screen projection function in a presenter mode, have no compatibility problem and delay problem and are beneficial to improving the watching experience of viewers.

The application provides the following scheme:

a screen projection processing method comprises the following steps:

determining identification information of a target process corresponding to a target file to be screened from terminal equipment associated with a presenter;

according to the identification information of the target process, when the target process is included in the application program process running on the terminal equipment, an application program window associated with the target process is obtained;

and when the application program window is determined to be a slide window, obtaining image data of the slide window and sending the image data to a screen-throwing display screen.

When the application program process running on the terminal device is determined to include the target process according to the identification information of the target process, an application program window associated with the target process is obtained, including:

obtaining a window of an application program to be selected, which runs on the terminal equipment;

comparing the identification information of the process to which the application program window to be selected belongs with the identification information of the target process;

and if the identification information is consistent, determining that the target process is included in the application program process running on the terminal equipment, and the application program window to be selected, which is consistent with the identification information, is the application program window associated with the target process.

Wherein the slide window comprises preset attribute information, the preset attribute information is a naming rule of the slide window,

the determining that the application window is a slide window includes: obtaining a window name of the application program window; and if the window name accords with the naming rule, determining that the application program window is the slide window.

The determining, from terminal equipment associated with a presenter, identification information of a target process corresponding to a target file to be screened includes:

obtaining a window of an application program to be selected, which is operated on the terminal equipment, and providing the window of the application program to be selected for the lecturer to view;

and obtaining a target application program window determined by the presenter from the application program windows to be selected, and determining a file corresponding to the target application program window as the target file.

A screen projection processing method comprises the following steps:

determining a target video playing application program corresponding to a target video file being played on terminal equipment associated with a user;

and if the screen-throwing triggering action associated with the target video playing application program is detected, and the attribute information of the target video file accords with the preset attribute information associated with the target video playing application program, sending the target video file to the screen-throwing display screen associated with the terminal equipment.

And the screen touching start is used as the user to request the target video playing application program to carry out full-screen playing on the target video file.

The screen-throwing triggering action is determined to start playing the content which the user wants to watch, and is detected according to the following mode:

obtaining a video window of the target video file, and detecting a video picture included in the video window;

and if the video picture represents that the content which the user wants to watch starts to play, determining that the screen throwing trigger action is detected.

The preset attribute information is preset resolution and/or preset content.

Wherein if the user is associated with at least one available display screen, and the at least one available display screen is deployed in different spaces respectively,

the sending the target video file to the screen-throwing display screen associated with the terminal equipment comprises the following steps:

when the terminal equipment is determined to not establish screen connection, obtaining a target space where the terminal equipment is located;

and determining an available display screen deployed in the target space as the screen-throwing display screen, establishing screen-throwing connection between the terminal equipment and the screen-throwing display screen, and sending the target video file to the screen-throwing display screen through the screen-throwing connection.

A screen projection processing method comprises the following steps:

when detecting the operation action of full screen playing, the video file played on the terminal equipment is projected to the display equipment through a transmission link between the terminal equipment and the display equipment.

A screen projection processing method comprises the following steps:

acquiring a screen projection configuration information base, wherein screen projection triggering actions and preset attribute information respectively associated with different types of files are stored in the information base;

obtaining a target file type corresponding to a target file displayed on terminal equipment associated with a user;

and if the screen-throwing triggering action associated with the target file type is detected, and the attribute information of the target file accords with the preset attribute information associated with the target file type, sending the target file to a screen-throwing display screen associated with the terminal equipment.

A screen projection information configuration method comprises the following steps:

when the type of a file to be configured submitted by a user is obtained, providing operation options for submitting a screen triggering action associated with the type of the file to be configured and presetting attribute information;

after the screen-throwing triggering action and the preset attribute information are obtained through the operation options, an association relation between the type of the file to be configured, the screen-throwing triggering action and the preset attribute information is established, so that screen-throwing processing is conducted on the file of the type of the file to be configured according to the association relation.

A screen projection processing apparatus comprising:

the process identification information obtaining unit is used for determining the identification information of the target process corresponding to the target file to be screened from terminal equipment associated with the presenter;

an application program window obtaining unit, configured to obtain an application program window associated with the target process when determining that the target process is included in an application program process running on the terminal device according to the identification information of the target process;

and the slide window determining unit is used for obtaining the image data of the slide window and sending the image data to a screen-throwing display screen when the application program window is determined to be the slide window.

A screen projection processing apparatus comprising:

the application program determining unit is used for determining a target video playing application program corresponding to a target video file being played on the terminal equipment associated with the user;

the screen triggering action detection unit is used for detecting the screen triggering action associated with the target video playing application program;

the attribute information comparison unit is used for comparing the attribute information of the target video file with preset attribute information associated with the target video playing application program;

and the video file sending unit is used for sending the target video file to the screen-throwing display screen associated with the terminal equipment when the screen-throwing triggering action associated with the target video playing application program is detected and the attribute information of the target video file accords with the preset attribute information associated with the target video playing application program.

A screen projection processing apparatus comprising:

an operation action detection unit for detecting an operation action of full-screen playing;

and the screen throwing unit is used for throwing the video file played on the terminal equipment to the display equipment through a transmission link between the terminal equipment and the display equipment when the operation action of full-screen playing is detected.

A screen projection processing apparatus comprising:

the information base obtaining unit is used for obtaining a screen projection configuration information base, and screen projection triggering actions and preset attribute information respectively associated with different types of files are stored in the information base;

the file type determining unit is used for obtaining the target file type corresponding to the target file displayed on the terminal equipment associated with the user;

the screen triggering action detection unit is used for detecting the screen triggering action associated with the target file type;

the attribute information comparison unit is used for comparing the attribute information of the target file with preset attribute information associated with the type of the target file;

and the file sending unit is used for sending the target file to the screen-throwing display screen associated with the terminal equipment when the screen-throwing triggering action associated with the target file type is detected and the attribute information of the target file accords with the preset attribute information associated with the target file type.

A screen information configuration apparatus comprising:

the operation option providing unit is used for providing operation options for submitting a screen triggering action associated with the type of the file to be configured and preset attribute information when the type of the file to be configured submitted by a user is obtained;

and the association relation establishing unit is used for establishing the association relation between the type of the file to be configured and the screen-throwing trigger action and the preset attribute information after the screen-throwing trigger action and the preset attribute information are obtained through the operation options, so that the screen-throwing processing is carried out on the file of the type of the file to be configured according to the association relation.

According to a specific embodiment provided by the application, the application discloses the following technical effects:

in the embodiment of the application, after the target file to be screened and the target process corresponding to the target file are determined, the application program window associated with the target process can be obtained first, then the application program window is detected, the slide window in the presenter mode is identified, and the screen-screening display is performed.

According to the scheme, the single-screen-projection function in the presenter mode can be realized, an external physical extension screen is not required, a virtual extension screen is not required to be created in an operating system, and the problem of system compatibility does not exist, so that additional development configuration is not required for adapting to the operating system, and the single-screen-projection realization process is facilitated. In addition, compared with the scheme of collecting image data from the virtual expansion screen, the method and the device for detecting and identifying the slide window and capturing the image data of the slide window are high in efficiency, are beneficial to solving the problem of screen throwing delay, and improve the watching experience of a viewer.

Of course, not all of the above-described advantages need be achieved at the same time in practicing any one of the products of the present application.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic diagram of a system for screen projection processing according to an embodiment of the present application;

FIG. 2 is a flowchart of a method for processing a screen according to an embodiment of the present application;

FIG. 3 is a schematic diagram of a presenter window provided by an embodiment of the present application;

FIG. 4 is a schematic diagram of a slide window provided by an embodiment of the present application;

FIG. 5 is another flowchart of a screen-drop processing method according to an embodiment of the present disclosure;

FIG. 6 is a schematic diagram of a configuration interface provided by an embodiment of the present application;

FIG. 7 is a flowchart of a screen shot processing method according to an embodiment of the present disclosure;

fig. 8 is a schematic diagram of a screen projection processing device according to an embodiment of the present application;

Fig. 9 is a schematic diagram of a screen projection processing device according to an embodiment of the present application;

fig. 10 is a schematic diagram of a screen projection processing device according to an embodiment of the present application;

FIG. 11 is a schematic diagram of a screen projection processing device according to an embodiment of the present disclosure;

fig. 12 is a schematic diagram of a screen information configuration device provided in an embodiment of the present application;

fig. 13 is a schematic diagram of an electronic device provided in an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application are within the scope of the protection of the present application.

When a conference lecture is carried out under a line, a lecturer can carry out screen projection processing on a target PPT file through a screen projection application program, and if no external physical expansion screen is connected at this time, a screen projection processing client can be used for realizing single-screen projection in a lecturer mode.

Referring to the system schematic diagram shown in fig. 1, the screen-projection processing client in the embodiment of the present application may be deployed on a terminal device associated with a presenter, and exist in the form of a web page or an independent application program. Or, the method can be integrated in the screen-throwing application program, and the screen-throwing application program is optimized to have the function of single-screen throwing according to the scheme provided by the embodiment of the application.

The following describes in detail a specific implementation process of the screen-projection processing scheme provided in the embodiment of the present application, and referring to a flowchart shown in fig. 2, the method may include:

s201: and determining the identification information of the target process corresponding to the target file to be screened from terminal equipment associated with the presenter.

As an example, the embodiment of the application may determine the target file to be screened by means of screening an application window. Specifically, according to a preset triggering mode, all running application programs on the terminal device can be requested to be checked, for example, a Windows operating system is taken as an example, a presenter can trigger the operating system to generate a window thumbnail of the running application program through a combination of a menu key and a Tab key, and the presenter can determine a target file window which is wanted to be screened from the window thumbnail. Therefore, the screen projection processing client can clearly acquire the target file to be projected, and further acquire the identification information of the target process corresponding to the target file.

Or, the screen-throwing processing client can provide an operation option for submitting the identification information of the target file, and the presenter can submit the file type and the file name of the target file through the operation option so as to determine the target file and further obtain the identification information of the target process corresponding to the target file.

The action of determining the target file to be projected can be regarded as a projection triggering action of projecting the target file, and the slide window detection can be triggered to start after the action is detected.

It will be appreciated that the target file may be a PPT file generated by the PPT application. In the practical application process, if files generated by other application programs also have a presenter mode, that is, a window for a presenter to view and a window for a viewer to view can be generated for a specific file, and when the display contents of 2 windows are different, the scheme provided by the embodiment of the application can be adopted to carry out single-screen projection processing.

S202: and when the application program process running on the terminal equipment comprises the target process, according to the identification information of the target process, acquiring an application program window associated with the target process.

It will be appreciated that different files of the same type, for example, PPT file 1 and PPT file 2, may be simultaneously run on the terminal device, and the presenter may determine PPT file 1 as the target file and perform single-screen projection.

When the presenter initiates the presenter mode, for example, by clicking on the "presenter mode" button in PPT File 1, the PPT application will generate 2 windows. The slide window is equivalent to a supporting body, and the presenter window put on the main screen plays which slide, and the slide window can bear the corresponding slide.

As shown in fig. 3, a presenter window 2 presented to a presenter by the home screen is page 2 of PPT file 1, and may include: page 2 slide, comment point 1, comment point 2, comment point 3. Depending on the use requirements, thumbnail images of the next slide may also be included. Correspondingly, the slide window to be put to the viewer for viewing may carry a slide corresponding to the presenter window, in this example, slide window 2 includes the slide of page 2 shown in fig. 4.

In the actual application process, the application program for realizing the screen throwing function and the application program for generating the target file are generally independent and are not communicated, so that the operation of a presenter in the target file, for example, whether to click a "presenter mode" button, enters a presenter mode, and the screen throwing application program cannot be captured.

Once the presenter initiates the presenter mode, the PPT application will generate the 2 windows described above, which are visible to the presenter window and hidden in the system for the slide window, and invisible to the presenter, so how to determine whether the presenter enters the presenter mode and how to capture the image data of the slide window hidden in the system becomes an important basis for implementing a single screen projection.

Specifically, an application program process running on the terminal device can be obtained, and whether the target process is included or not is judged. For example, an application window running on the terminal device may be obtained as a candidate application window, and all candidate application windows are traversed to perform identification information comparison: if the identification information of the process to which the window of the application program to be selected belongs is not consistent with the identification information of the target process, discarding the window; if so, the candidate application window can be determined to belong to the target process, and the candidate application window is determined to be the application window associated with the target process.

In the above example, through application window detection, the presenter window 2 and slide window 2 can be identified as application windows associated with PPT file 1.

S203: and when the application program window is determined to be a slide window, obtaining image data of the slide window and sending the image data to a screen-throwing display screen.

The embodiment of the application can detect and identify the slide window and grasp the slide window image data, thereby realizing single-screen projection. As an example, the slide window and the presenter window each have different preset properties, e.g., they are window named using different naming rules, so that the slide window can be identified according to its naming rules. Specifically, an application window associated with the target process may be traversed, and if the window name of the application window does not conform to a preset naming rule, the window may be discarded; if the window is matched with the slide window, the window can be determined to be the slide window, the image data of the slide window can be acquired, and the image data is sent to a screen-throwing display screen for displaying.

In the practical application process, after the image data of the slide window is obtained, the image data can be sent to a screen box, and the image data is forwarded to a screen display screen by the screen box for display. As an example, the projection box may be a separate hardware device, enabling interaction between the terminal device and the projection display. Alternatively, if the screen-throwing display screen has a data receiving transfer function, for example, when the screen throwing is performed by a device having a large screen display screen such as a television, the screen-throwing box may be embodied as a data receiving processing module of the screen-throwing device.

In summary, the single-screen-projection function of the embodiment of the application in the presenter mode can be realized, an external physical extension screen is not required, a virtual extension screen is not required to be created in an operating system, and the problem of system compatibility is avoided, so that additional development configuration is not required for adapting the operating system, and the single-screen-projection realization process is facilitated. In addition, compared with the collection of image data from the virtual expansion screen, the detection and identification of the slide window and the capture of the slide window image data are high in efficiency, so that the problem of screen throwing delay is solved, and the watching experience of a viewer is improved.

In the above example, after detecting the screen-throwing trigger action, the slide window in the presenter mode may be detected and identified according to the attribute information of the slide window, and then the image data of the slide window may be obtained and sent to the screen-throwing display screen for display.

The window detection and identification scheme can be applied to video window detection and can realize the screen projection playing of video files. For example, when a user views a video through a mobile phone, a PAD, a computer, etc., the overall viewing experience is poor due to the limitations of the size of a display screen, the resolution of the screen, etc. According to the embodiment of the application, the attribute information of the video file capable of being displayed can be preset, the attribute information is used as the detection rule of the video window, and after the screen-display triggering action is detected, the video file meeting the detection rule is displayed on a large display screen. For example, a screen may be projected onto a television, or a projector may be projected onto a projection screen, etc., and a screen display screen on which video projection may be performed may be predetermined according to a large screen configured in a space where a user is located.

The following describes in detail a specific implementation process of the video projection processing scheme provided in the embodiment of the present application, and referring to a flowchart shown in fig. 5, the method may include:

S501: and obtaining a screen projection configuration information base, wherein screen projection triggering actions and preset attribute information respectively associated with different video playing application programs are stored in the information base.

In this embodiment of the present application, a screen-throwing configuration information base may be preset, where the information base may include screen-throwing triggering actions and preset attribute information associated with different video playing applications. Thus, after the target video playing application program is determined, the associated screen throwing trigger action can be clarified, and action detection can be performed.

As an example, the screen-cast trigger action may be embodied in at least two types:

1. the screen shot triggering action may be embodied as a user operated action. For example, the user clicks an operation button of "full-screen play" provided by the target video application program, and requests the target video play application program to perform full-screen play on the target video file.

When a user requests full screen playing, the user usually hopes to watch the target video file through a large screen, so that the embodiment of the application can determine the target video file as a screen-throwing triggering action to throw the target video file on the large screen-throwing display screen. For example, when the user clicks to play the target video file through the target video playing application program, a "full screen play" button is provided on the playing interface, and the user can click on the button to request full screen play. Correspondingly, the action of clicking the full-screen play button by the user can be captured as a screen-throwing trigger action.

It will be appreciated that the user may click on a button to request full screen play at any time during video play.

2. The screen shot triggering action may be embodied as a content-detected action. For example, when it is determined that playing of the content that the user wants to watch is started through video picture recognition, a screen-throwing trigger action can be obtained to perform video screen-throwing processing.

In the embodiment of the application, content detection can be performed through different dimensions. For example, if the user wishes to perform screen-casting playing on the video exceeding the preset playing time, the dimension of content detection may be represented as the playing time of the target video file, and correspondingly, the screen-casting triggering action may be set to trigger screen casting when the playing time of the target video file is detected to exceed the preset playing time.

For another example, the video playing application may provide a video file with higher definition for a member user, and the dimension of content detection may be represented as member identity information of the user, and the corresponding screen-throwing trigger action may be set to trigger screen throwing when the user is detected as the member user.

For another example, the dimension of content detection may be the video content of the video file itself. For example, the video content may be feature content of a video file.

In the practical application process, some advertisement segments may be inserted before the feature content, that is, the target video file in the embodiment of the application may include at least the feature content and the advertisement segments. If the user does not want to play the advertisement segment, the screen-throwing triggering action can be correspondingly set to trigger the screen throwing when the completion of the advertisement segment playing is detected.

Specifically, a play content check may be performed to determine whether to start playing the content that the user wants to view currently. For example, a video window of the target video file may be obtained, and a video frame included in the video window is detected; if the video frame indicates that playing of the content that the user wants to view is started, it may be determined that a screen-cast trigger action is detected.

For example, an advertisement countdown included in a video frame may be obtained, and if the countdown reaches a preset time, the video frame may indicate that the advertisement clip is played, and content that the user wants to watch begins to be played, and a screen-throwing trigger action may be detected.

In the actual application process, different preset times can be respectively set according to the conditions of whether the screen display screen is started, whether the terminal equipment is connected with the screen display screen, and the like, and aiming at the scenes of connection establishment after the screen display screen is started, connection failure after the screen display screen is not started, and the like.

In addition, taking a movie play as an example, the feature content may include a top song, a tail song, and a scenario content. In response thereto, the video content may be scenario content of a video file.

Under the condition, if the user sets the function of skipping the film clip in the video playing application program, the scenario content can be played after the advertisement clip is completely played, and at the moment, the screen triggering action can be correspondingly set to be that the advertisement clip is completely played. In another case, the user wishes to listen to the film song, and does not set the function of skipping the film song, but does not necessarily need to throw a screen to watch the video picture played by the film song corresponding to the film song at this time, so the screen throwing trigger action can be correspondingly set to trigger the screen throwing when the film song is detected to be played completely.

When the video picture is detected, the progress bar time included in the picture can be obtained, if the progress bar time reaches the film head song playing time, the video picture can represent that the film head song is completely played and the content which the user wants to watch is started to be played, and the screen throwing triggering action can be detected.

In addition, taking a television play as an example, when the episode is completely played, i.e. the episode content is about to be played, there is a picture for displaying the number of television episodes, so when the video picture is detected, if the picture including the number of television episodes is detected in the video picture, the video picture can also indicate that the episode is completely played, and the screen-throwing trigger action can also be detected.

In addition, in the practical application process, in order to continue the content of the previous episode, the content of the current episode may include a part of repeated content, and the user may not perform screen-casting playing on the part of repeated content according to the use requirement, so the screen-casting triggering action may be correspondingly set to trigger screen-casting when the end of the repeated content playing is detected.

When the video picture detection is carried out, a final picture of the content playing of the previous episode can be obtained, if the final picture is detected in the video picture corresponding to the content of the current episode, the video picture can represent that the repeated content is completely played and the content which the user wants to watch is started to be played, and the screen throwing triggering action can be detected.

It can be understood that in the scheme that the film song playing is completed and the repeated content playing is completed as the screen throwing triggering action, the situations of whether the screen throwing display screen is started, whether the terminal equipment is connected with the screen throwing display screen and the like can be combined, and the independent setting can be performed aiming at the scenes of starting up and establishing connection, starting up and not establishing connection and the like. In particular, the processing time for starting up and establishing connection can be reserved on the basis of finishing playing the film head music and finishing playing the repeated content aiming at the conditions of not establishing connection after starting up and not establishing connection, so that the screen throwing playing can be started from the content which is interested by the user and is wanted to be watched.

In addition, when the requirements of the user on advertisement fragments, film songs, repeated contents and the like are not high, the action of clicking the target video file to be played can be set as a screen throwing triggering action. The method and the device can be specifically set according to the use requirement of the user, and the embodiment of the application is not limited to the method and the device.

As an example, the preset attribute information may be embodied as at least one of the following two types of information:

1. the preset attribute information may be a preset resolution.

According to the method, if the video resolution of the target video file is high, the picture display effect is good when the target video file is put on a large display screen for playing, and the watching experience of a user is improved; otherwise, if the video resolution of the target video file is low, the definition is poor when the target video file is put on a large display screen for playing. Therefore, the preset attribute information can be set as the preset resolution, and the screen projection processing can be carried out on the target video file with the video resolution not lower than the preset resolution. That is, the attribute information of the target video file matches the preset attribute information, and it can be understood that the video resolution of the target video file is not lower than the preset resolution.

2. The preset attribute information may be preset contents.

As one example, the preset content may be video content of interest to the user.

For example, the user can specify a preset video type, such as a popular science documentary, especially some natural scenery and wild animal documentaries, usually with very good image quality, and the video type is put on a large display screen to be played, so that the visual experience is improved; or, the cartoon which is frequently watched by children is put on a large display screen to be played, thereby being beneficial to protecting eyesight. Or, the user can designate a preset participant, and screen projection processing is performed on the video content containing the preset participant.

Correspondingly, the attribute information of the target video file accords with the preset attribute information, and the video content of the target video file can be understood as the preset content interested by the user.

As another example, the preset content may be video content with low screen drop requirements.

For example, for some lecture and interview videos, such as video bloggers sharing their life experiences and analyzing event views, only one person usually speaks, and the user watching the video focuses on listening to the video content and not watching the video picture, and may not perform the screen-casting process.

In response to this, the attribute information of the target video file matches the preset attribute information, and it can be understood that the video content of the target video file is not only one person speaking or a multi-person talking, but includes many video frames with a screen throwing requirement.

In the actual application process, the preset resolution and preset content can be synthesized, and whether the screen projection processing is performed on the target video file or not can be determined.

As an example, the embodiment of the application may provide a client for performing video screen-casting configuration, where the client may provide an operation option for submitting a screen-casting triggering action and preset attribute information, and when the screen-casting triggering action and the preset attribute information associated with the target video playing application program are obtained through the operation option, an association relationship between the target video playing application program and the screen-casting triggering action and the preset attribute information may be established and added to the configuration information base.

In the actual application process, the client can provide a configuration interface and corresponding operation options in the configuration interface. The operation options for submitting the screen triggering action and the operation options for submitting the preset attribute information can be located on the same interface or different interfaces.

Referring to the configuration interface provided by the terminal devices such as the mobile phone shown in fig. 6, a selection frame of the screen triggering action can be provided for a user to select and determine the screen triggering action corresponding to the video playing application program. The user can select the preset screen triggering action provided by the terminal, or can select other options according to the use requirement, and provide the self-defined screen triggering action, so that the configuration implementation process is simple and easy to operate, and the method is more friendly to the user.

S502: and determining a target video playing application program corresponding to the target video file being played on the terminal equipment associated with the user.

The method has the advantages that the target video file and the corresponding target video playing application program which are being played are determined, preparation can be made for screen projection processing, screen projection triggering action detection is conducted in a targeted mode, once the screen projection triggering action associated with the target video playing application program is detected, video window detection can be conducted, and the screen projection processing speed is improved.

S503: and if the screen-throwing triggering action associated with the target video playing application program is detected, and the attribute information of the target video file accords with the preset attribute information associated with the target video playing application program, sending the target video file to the screen-throwing display screen associated with the terminal equipment.

If the preset attribute information associated with the target video playing application program is the preset resolution, the attribute information of the target video file can be obtained in the following manner: the video resolution of the target video file may be obtained from the video parameters of the target video file.

If the preset attribute information associated with the target video playing application program is preset content, the attribute information of the target video file can be obtained in the following manner: and detecting the playing content of the target video file to obtain the video content of the target video file. For example, a video window of the target video file may be obtained, video pictures included in the video window detected, and video content of the target video file determined by analyzing the video pictures.

Or, the video title of the target video file can be obtained, and the keyword analysis is performed on the video title to determine the video content of the target video file.

The implementation process of the steps of detecting the screen triggering action, comparing the attribute information of the target video file and the like can be described in S201, and is not illustrated here.

As an example, sending the target video file to the projection display screen associated with the terminal device for video playing may include: when the connection between the terminal equipment and the screen-throwing display screen is established, the target video file is directly thrown to the screen-throwing display screen. That is, the screen connection between the terminal device and the screen display screen may be established in advance, and when the screen triggering action is detected and the attribute information of the target video file is determined to be consistent with the preset attribute information, the screen display may be directly performed.

In addition, the embodiment of the application can also provide a scheme for automatically establishing connection between the terminal equipment and the screen display. In particular, at least one available display screen associated with a user and a space in which the at least one available display screen is each deployed may be obtained. For example, in the example of video projection screen playing in a home scene, a television is installed and deployed in a bedroom, a projector and a projection curtain are installed and deployed in a living room, and 2 available display screens are respectively deployed in different spaces.

In this way, when the screen-throwing triggering action is detected and the attribute information of the target video file is determined to be consistent with the preset attribute information and screen throwing playing is required, if the terminal equipment does not establish screen throwing connection, the target space where the terminal equipment is located can be obtained; and determining an available display screen deployed in the target space as a screen-throwing display screen, establishing screen-throwing connection between the terminal equipment and the screen-throwing display screen, and sending the target video file to the screen-throwing display screen through the screen-throwing connection.

Taking video screen-casting playing from a mobile phone to a television in a home scene as an example, the conventional operation at present is as follows: firstly, ensuring that a mobile phone and a television are connected to the same network; secondly, when a user watches the video through the mobile phone, the user can click a screen throwing button provided on a watching interface, and the mobile phone starts searching connectable screen throwing equipment and displays the connectable screen throwing equipment for the user to watch; then, clicking and selecting the screen throwing equipment by the user, and setting up screen throwing connection between the mobile phone and the television when the user selects the television in the example; and finally, putting the video played on the mobile phone on a television for playing.

The screen throwing playing process requires a user to perform a series of operations, and is complex in operation, long in path, long in waiting time of the user, poor in screen throwing experience, and even possible to give up using a screen throwing function, so that equipment such as a television is idle.

In contrast, in the embodiment of the present application, when no connection is established between the terminal device and the screen-throwing display screen, according to the target space where the terminal device is located, the available display screen deployed in the target space is determined as the screen-throwing display screen, and the screen-throwing connection is automatically established with the available display screen. The method is beneficial to simplifying the screen throwing operation of the user, improving the use experience of the user, maximally utilizing the screen throwing function and improving the use rate of equipment such as televisions and the like.

Taking the example that the television is not started and connection is not established with the mobile phone, the user clicks the "full screen play" button on the mobile phone, which may implicitly trigger the following operation actions: controlling the television to start up, wherein the mobile phone plays a role of a remote controller; controlling the mobile phone and the television to automatically establish screen connection; and pushing the target video file to a projection display screen for playing. The operation actions do not need manual operation of a user, so that a screen-throwing operation path is simplified, and the requirement on the user using the screen-throwing function is reduced.

In addition, the embodiment of the application can also provide a video screen-throwing processing scheme when the terminal equipment such as a mobile phone, a PAD, a computer and the like performs full-screen playing. Specifically, when detecting an operation action of full-screen playing, a video file played on a terminal device is projected to a display device through a transmission link between the terminal device and the display device. The method is beneficial to simplifying the screen-throwing operation of the user to the greatest extent and improving the screen-throwing experience of the user.

The transmission link between the terminal equipment and the display equipment can be pre-established before screen projection; or, when detecting the operation action of full-screen playing, the connection may be established according to the history connection record, which is not limited in the embodiment of the present application.

In the description, when the PPT screen projection is needed, the application program window detection can be performed according to the preset attribute information of the slide window, the slide window in the presenter mode is identified, and the slide window is projected to the screen projection display screen; when video projection is needed, video window detection can be performed according to preset attribute information of the video file, and the video file conforming to the preset attribute information is projected to a projection display screen.

In addition, some other types of files, such as office files such as word, excel, etc., web page files viewed through a browser, program page files viewed through an application program, etc., may also have a screen-drop requirement in some specific use scenarios. For example, when the Excel table has more text and is more dense, if the file privacy requirement is not high, the Excel table can be put on a large display screen for viewing. For another example, when the user views commodity information through shopping software, the commodity detail page can be put on a large display screen for viewing. That is, for different types of files, the user may have a screen-drop requirement.

According to the screen projection processing scheme for the universal file, the screen projection requirements of users under different use scenes can be met, and the user experience can be improved.

The following details of the specific implementation process of the screen-projection processing scheme provided in the embodiment of the present application, referring to the flowchart shown in fig. 7, may include:

s701: and obtaining a screen projection configuration information base, wherein screen projection triggering actions and preset attribute information respectively associated with different types of files are stored in the information base.

S702: and obtaining the type of the target file corresponding to the target file displayed on the terminal equipment associated with the user.

S703: and if the screen-throwing triggering action associated with the target file type is detected, and the attribute information of the target file accords with the preset attribute information associated with the target file type, sending the target file to a screen-throwing display screen associated with the terminal equipment.

That is, after the target file type corresponding to the target file is obtained, determining a target screen-throwing trigger action and target preset attribute information associated with the target file type from an information base, and further obtaining the attribute information of the target file when the target screen-throwing trigger action is detected; and if the attribute information of the target file accords with the target preset attribute information, the target file can be sent to a screen display screen associated with the terminal equipment for display. Or judging the attribute information first, and when the attribute information of the target file is determined to be consistent with the target preset attribute information, if the target screen-throwing triggering action is detected, throwing the target file to the display screen.

As an example, the preset attribute information associated with the file may be a keyword preset for the file name. Taking a word file formed in the development process of the project a as an example, the file names may all include keywords a related to the project a, for example, the keywords a are project names. If the user needs to display the word files in a screen, the keyword A can be set as preset attribute information associated with the word files.

In this way, when a user opens a certain file on the associated terminal device, the target file type of the file can be clarified, and if the file is a word file, the screen triggering action associated with the word file (which can be flexibly set according to actual requirements and is not limited in the embodiment of the application) and preset attribute information can be matched from the information base. If the file name of the currently opened word file comprises the keyword A, the attribute information of the word file can be determined to be consistent with the preset attribute information, and the word file can be put on a screen display screen for display.

As an example, the embodiment of the application may provide a client for performing screen-casting information configuration. Specifically, when the type of the file to be configured submitted by the user is obtained, providing operation options for submitting a screen triggering action associated with the type of the file to be configured and presetting attribute information; after the screen-throwing triggering action and the preset attribute information are obtained through the operation options, an association relation between the type of the file to be configured, the screen-throwing triggering action and the preset attribute information is established, so that screen-throwing processing is conducted on the file of the type of the file to be configured according to the association relation. The configuration implementation process is simple and easy to operate, and is more friendly to users.

It should be noted that, the user information (including but not limited to user equipment information, user personal information, etc.) and the data (including but not limited to data for analysis, stored data, presented data, etc.) related to the present application are information and data authorized by the user or fully authorized by each party, and the collection, use and processing of the related data need to comply with the related laws and regulations and standards of the related country and region, and provide corresponding operation entries for the user to select authorization or rejection.

Corresponding to the method embodiment shown in fig. 2, the embodiment of the present application further provides a screen projection processing device, referring to fig. 8, where the device may include:

a process identification information obtaining unit 801, configured to determine a target file to be screened from terminal equipment associated with a presenter, and obtain identification information of a target process corresponding to the target file;

an application window obtaining unit 802, configured to obtain an application window associated with the target process when determining that the target process is included in the application processes running on the terminal device according to the identification information of the target process;

and a slide window determining unit 803, configured to obtain image data of the slide window and send the image data to a projection display screen when the application window is determined to be the slide window.

Wherein, the application program window obtaining unit may be specifically configured to:

the slide window determination unit may be specifically configured to: obtaining a window name of the application program window; and if the window name accords with the naming rule, determining that the application program window is the slide window.

Wherein the process identification information obtaining unit may specifically be configured to: obtaining a window of an application program to be selected, which is operated on the terminal equipment, and providing the window of the application program to be selected for the lecturer to view; and obtaining a target application program window determined by the presenter from the application program windows to be selected, and determining a file corresponding to the target application program window as the target file.

Corresponding to the method embodiment shown in fig. 5, the embodiment of the present application further provides a screen projection processing device, referring to fig. 9, where the device may include:

an application determining unit 901, configured to determine a target video playing application corresponding to a target video file being played on a terminal device associated with a user;

a screen triggering action detection unit 902, configured to detect a screen triggering action associated with the target video playing application program;

an attribute information comparing unit 903, configured to compare attribute information of the target video file with preset attribute information associated with the target video playing application program;

the video file sending unit 904 is configured to send the target video file to a screen-throwing display screen associated with the terminal device when a screen-throwing trigger action associated with the target video playing application program is detected and attribute information of the target video file matches preset attribute information associated with the target video playing application program.

The screen-throwing trigger action is to determine to start playing the content that the user wants to watch, and the screen-throwing trigger action detection unit may be specifically configured to:

The preset attribute information is preset resolution and/or preset content.

the video file transmitting unit may specifically be configured to:

Corresponding to the method embodiment shown above, the embodiment of the present application further provides a screen projection processing device, see fig. 10, where the device may include:

an operation action detection unit 1001 for detecting an operation action of full-screen playback;

and a screen throwing unit 1002, configured to throw, when detecting the operation action of full-screen playing, a video file played on the terminal device to the display device through a transmission link between the terminal device and the display device.

Corresponding to the method embodiment shown in fig. 7, the embodiment of the present application further provides a screen projection processing device, referring to fig. 11, where the device may include:

a file type determining unit 1101, configured to obtain a target file type corresponding to a target file displayed on a terminal device associated with a user;

the screen-throwing trigger action detection unit 1102 is configured to detect a screen-throwing trigger action associated with the target file type;

an attribute information comparison unit 1103, configured to compare attribute information of the target file with preset attribute information associated with the type of the target file;

and a file sending unit 1104, configured to send the target file to a screen-throwing display screen associated with the terminal device when a screen-throwing trigger action associated with the target file type is detected and attribute information of the target file matches preset attribute information associated with the target file type.

Corresponding to the method embodiment shown above, the embodiment of the present application further provides a device for configuring screen-projection information, see fig. 12, where the device may include:

an operation option providing unit 1201, configured to provide, when obtaining a type of a to-be-configured file submitted by a user, operation options for submitting a screen-throwing trigger action associated with the type of the to-be-configured file and preset attribute information;

And an association relationship establishing unit 1202, configured to establish an association relationship between the type of the file to be configured and the screen-throwing trigger action and the preset attribute information after the screen-throwing trigger action and the preset attribute information are obtained through the operation options, so as to perform screen-throwing processing on the file of the type of the file to be configured according to the association relationship.

In addition, the embodiment of the application further provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor, implements the steps of the method of any one of the foregoing method embodiments.

And an electronic device comprising:

one or more processors; and

a memory associated with the one or more processors for storing program instructions that, when read for execution by the one or more processors, perform the steps of the method of any of the preceding method embodiments.

In which fig. 13 illustrates an architecture of an electronic device, for example, device 1300 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, an aircraft, and so forth.

Referring to fig. 13, a device 1300 may include one or more of the following components: a processing component 1302, a memory 1304, a power component 1306, a multimedia component 1308, an audio component 1310, an input/output (I/O) interface 1312, a sensor component 1314, and a communication component 1316.

The processing component 1302 generally controls overall operation of the device 1300, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 1302 may include one or more processors 1320 to execute instructions to perform all or part of the steps of the methods provided by the disclosed subject matter. Further, the processing component 1302 can include one or more modules that facilitate interactions between the processing component 1302 and other components. For example, the processing component 1302 may include a multimedia module to facilitate interaction between the multimedia component 1308 and the processing component 1302.

The memory 1304 is configured to store various types of data to support operations at the device 1300. Examples of such data include instructions for any application or method operating on device 1300, contact data, phonebook data, messages, pictures, video, and the like. The memory 1304 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

The power supply assembly 1306 provides power to the various components of the device 1300. The power components 1306 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 1300.

The multimedia component 1308 includes a screen between the device 1300 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or sliding action, but also the duration and pressure associated with the touch or sliding operation. In some embodiments, the multimedia component 1308 includes a front-facing camera and/or a rear-facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 1300 is in an operational mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

The audio component 1310 is configured to output and/or input audio signals. For example, the audio component 1310 includes a Microphone (MIC) configured to receive external audio signals when the device 1300 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 1304 or transmitted via the communication component 1316. In some embodiments, the audio component 1310 also includes a speaker for outputting audio signals.

Input/output (I/O) interface 1312 provides an interface between processing component 1302 and peripheral interface modules, which may be a keyboard, click wheel, buttons, etc. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.

The sensor assembly 1314 includes one or more sensors for providing status assessment of various aspects of the device 1300. For example, the sensor assembly 1314 may detect the on/off state of the device 1300, the relative positioning of the components, such as the display and keypad of the device 1300, the sensor assembly 1314 may also detect a change in position of the device 1300 or a component of the device 1300, the presence or absence of user contact with the device 1300, the orientation or acceleration/deceleration of the device 1300, and a change in temperature of the device 1300. The sensor assembly 1314 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. The sensor assembly 1314 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1314 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 1316 is configured to facilitate communication between the device 1300 and other devices, either wired or wireless. The device 1300 may access a wireless network based on a communication standard, such as WiFi, or a mobile communication network of 2G, 3G, 4G/LTE, 13G, etc. In one exemplary embodiment, the communication component 1316 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1316 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the apparatus 1300 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for executing the methods described above.

In an exemplary embodiment, a non-transitory computer-readable storage medium is also provided, such as memory 1304 including instructions executable by processor 1320 of device 1300 to perform the methods provided by the disclosed subject matter. For example, the non-transitory computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

From the above description of embodiments, it will be apparent to those skilled in the art that the present application may be implemented in software plus a necessary general purpose hardware platform. Based on such understanding, the technical solutions of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to perform the methods described in the embodiments or some parts of the embodiments of the present application.

In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for a system or system embodiment, since it is substantially similar to a method embodiment, the description is relatively simple, with reference to the description of the method embodiment being made in part. The systems and system embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.

The above details of the screen projection processing scheme provided in the present application, and specific examples are applied to illustrate the principles and embodiments of the present application, where the above examples are only used to help understand the method and core ideas of the present application; also, as will occur to those of ordinary skill in the art, many modifications are possible in view of the teachings of the present application, both in the detailed description and the scope of its applications. In view of the foregoing, this description should not be construed as limiting the application.

Claims

1. The screen projection processing method is characterized by comprising the following steps of:

2. The method according to claim 1, wherein when determining that the target process is included in the application processes running on the terminal device according to the identification information of the target process, obtaining an application window associated with the target process includes:

3. The method of claim 1 or 2, wherein the slide window includes preset attribute information, the preset attribute information being a naming convention for the slide window,

4. The method according to claim 1 or 2, wherein the determining, from the terminal device associated with the presenter, identification information of the target process corresponding to the target file to be screened includes:

5. The screen projection processing method is characterized by comprising the following steps of:

6. The method of claim 5, wherein the step of determining the position of the probe is performed,

and the screen touching and starting is used as the user to request the target video playing application program to carry out full-screen playing on the target video file.

7. The method of claim 5, wherein the screen shot triggering action is a determination to begin playing the content that the user wants to view, and the screen shot triggering action is detected as follows:

8. The method of claim 5, wherein the step of determining the position of the probe is performed,

the preset attribute information is preset resolution and/or preset content.

9. The method according to any one of claims 5 to 8, wherein if at least one available display is associated with the user and the at least one available display is deployed in a different space,

10. The screen projection processing method is characterized by comprising the following steps of:

11. The screen projection processing method is characterized by comprising the following steps of:

12. The screen projection information configuration method is characterized by comprising the following steps of:

13. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the steps of the method of any of claims 1 to 12.

14. An electronic device, comprising:

one or more processors; and

a memory associated with the one or more processors for storing program instructions that, when read for execution by the one or more processors, perform the steps of the method of any of claims 1 to 12.