CN111736785B - Method, device, equipment and computer storage medium for controlling screen throwing playing - Google Patents
Method, device, equipment and computer storage medium for controlling screen throwing playing Download PDFInfo
- Publication number
- CN111736785B CN111736785B CN202010479587.4A CN202010479587A CN111736785B CN 111736785 B CN111736785 B CN 111736785B CN 202010479587 A CN202010479587 A CN 202010479587A CN 111736785 B CN111736785 B CN 111736785B
- Authority
- CN
- China
- Prior art keywords
- application
- monitored
- screen
- event
- prompt information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 66
- 238000012544 monitoring process Methods 0.000 claims abstract description 58
- 230000015654 memory Effects 0.000 claims description 19
- 230000003993 interaction Effects 0.000 claims description 9
- 230000004044 response Effects 0.000 claims description 6
- 230000007474 system interaction Effects 0.000 claims description 4
- 230000006870 function Effects 0.000 description 16
- 238000005266 casting Methods 0.000 description 10
- 230000008569 process Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 7
- 238000004590 computer program Methods 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 239000008186 active pharmaceutical agent Substances 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 230000008676 import Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 239000000470 constituent Substances 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000004883 computer application Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001151 other effect Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
Abstract
The application discloses a control method, a device, equipment and a computer storage medium for screen projection playing. The specific implementation scheme is as follows: the method comprises the steps that a system module of the intelligent terminal registers a monitored application, a monitored application and a monitored event in advance, wherein the monitored application integrates a screen-casting Software Development Kit (SDK); and the system module responds to the monitored event of the monitored application and sends an event message to the monitoring application so that the monitoring application can generate prompt information by using the event message and screen the prompt information to a display device. According to the method and the device, when the monitored application generates the monitored event, the monitored application integrated with the screen-throwing SDK throws the prompt information corresponding to the monitored event to the display device, so that a user can timely acquire the event information through the display device.
Description
Technical Field
The present disclosure relates to the field of computer application technologies, and in particular, to a method, an apparatus, a device, and a computer storage medium for controlling screen-casting playback related to artificial intelligence.
Background
In the running process of the automobile, a driver can effectively judge the distance between the rear automobile and the central rearview mirror of the automobile. With the improvement of the technology level, people have put higher demands on the safety and entertainment of driving automobiles. The central rearview mirror of an automobile is derivatized to integrate an operating system and an intelligent rearview mirror with multiple functions. Besides the system-level application of the operating system of the intelligent rearview mirror, a user can install various third-party applications such as games, navigation, media playing and the like in the intelligent rearview mirror by himself.
When the intelligent rearview mirror plays media, a sound box of the intelligent rearview mirror is usually used for audio or the audio is sent to a sound box at the vehicle end for playing. For the media such as images, videos or texts, the media can be displayed by throwing a screen to a vehicle-mounted display device. At present, when the intelligent rearview mirror plays media, resources are mainly acquired and play control is performed through a third-party media playing application. In many cases, however, the third party application is not integrated with the drop-in SDK (Software Development Kit ), and the loss of the API (Application Programming Interface ) interface of the third party application will seriously affect the media playback control logic.
Content of the application
In view of the foregoing, the present application provides a method, apparatus, device, and computer storage medium for controlling screen-projection playing, so as to solve the above technical problems in the prior art.
In a first aspect, the present application provides a method for controlling a screen-casting playing, where the method includes:
the system module of the intelligent terminal registers a monitored application, a monitoring application and a monitored event in advance, wherein the monitoring application integrates a screen-throwing Software Development Kit (SDK);
the system module responds to the monitored event of the monitored application, and sends an event message to the monitoring application, so that the monitoring application can generate prompt information by using the event message and screen the prompt information to a display device.
According to a preferred embodiment of the present application, the system module of the intelligent terminal pre-registers the monitored application, and the monitored event includes:
the system module of the intelligent terminal receives a monitored application and a registration request of the monitored application for the monitored event through a registration interface in advance;
and storing the registration information of the monitored application, the monitored application and the monitored event.
According to a preferred embodiment of the present application, the method comprises:
the monitored application sends the media data stream to the monitoring application, and the monitoring application screens the media data stream to a display device or sends the media data stream to a playing device.
According to a preferred embodiment of the application, the intelligent terminal comprises an intelligent rearview mirror, and the display device comprises a vehicle-mounted display screen.
In a second aspect, the present application provides a method for controlling a screen-casting playing, where the method includes:
the intelligent terminal integrates the application of the screen-throwing SDK and registers the application as a monitoring application to a system module in advance;
the monitoring application receives event messages sent by the system module in response to the monitored events of the monitored application;
and generating prompt information by using the event message, and projecting the prompt information to display equipment.
According to a preferred embodiment of the present application, the method further comprises:
and the monitoring application receives the media data stream sent by the monitored application, and screens the media data stream to display equipment or sends the media data stream to playing equipment.
According to a preferred embodiment of the present application, generating the prompt information using the event message includes:
and generating a dialog box by using the event message.
According to a preferred embodiment of the present application, the method further comprises:
the monitoring application acquires the operation information of the user aiming at the prompt information and sends a control instruction corresponding to the operation information to the monitored application.
According to a preferred embodiment of the application, the intelligent terminal comprises an intelligent rearview mirror, and the display device comprises a vehicle-mounted display screen.
In a third aspect, the present application further provides a control device for screen-casting playing, which is set in an operating system of an intelligent terminal, and the device includes:
a registration unit, configured to register a monitored application, a listening application, and a monitored event in advance, where the listening application integrates a screen-drop SDK;
and the control unit is used for responding to the monitored event of the monitored application, sending an event message to the monitoring application so that the monitoring application can generate prompt information by using the event message and screen the prompt information to a display device.
According to a preferred embodiment of the present application, the registration unit is specifically configured to receive, in advance, a monitored application and a registration request of the monitored application for the monitored event through a registration interface; and storing the registration information of the monitored application, the monitored application and the monitored event.
In a fourth aspect, the present application further provides a control device for screen-casting playing, which is set in an intelligent terminal and integrates an application of a screen-casting SDK, where the device includes:
a registration unit, configured to register in advance with the system module as a listening application;
the system interaction unit is used for receiving event messages sent by the system module in response to the monitored events of the monitored application;
the generating unit is used for generating prompt information by utilizing the event message;
and the screen throwing unit is used for throwing the prompt information to the display equipment.
According to a preferred embodiment of the present application, the device further comprises:
and the application interaction unit is used for receiving the media data stream sent by the monitored application, and providing the media data stream for the screen projection unit to project the screen to the display equipment or sending the screen to the playing equipment.
According to a preferred embodiment of the present application, the generating unit is specifically configured to generate a dialog box using the event message.
According to a preferred embodiment of the present application, the application interaction unit is further configured to send a control instruction corresponding to the operation information to the monitored application after the monitoring application obtains the operation information of the user for the prompt information.
In a fifth aspect, the present application provides an intelligent terminal, including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of the preceding claims.
In a sixth aspect, the present application provides a non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of any one of the above.
In a seventh aspect, the present application also provides a computer program product comprising a computer program which, when executed by a processor, implements a method according to any of the preceding claims.
According to the technical scheme, when the monitored application generates the monitored event, the monitored event corresponding prompt information is projected to the display device through the monitoring application integrated with the screen projection SDK, so that a user can know the event information in time through the display device.
Furthermore, the user can operate according to the event information in time, and the monitoring application sends a control instruction corresponding to the operation information to the monitored application, so that play control is realized, the situation of being blocked and motionless due to the event is avoided, and the play fluency is improved.
Other effects of the above alternative will be described below in connection with specific embodiments.
Drawings
The drawings are for better understanding of the present solution and do not constitute a limitation of the present application. Wherein:
FIG. 1 illustrates an exemplary system architecture to which a method for controlling a cast-in-screen playback or a device for controlling a cast-in-screen playback according to an embodiment of the present application may be applied;
fig. 2 is a schematic diagram of a system scenario provided in an embodiment of the present application;
FIG. 3 is a flow chart of a main method provided in an embodiment of the present application;
fig. 4 is a flowchart of a method performed by the intelligent terminal according to the embodiment of the present application;
fig. 5 is a flowchart of a method for executing an application in an intelligent terminal according to an embodiment of the present application;
fig. 6 is a structural diagram of a control device for screen-casting playing according to an embodiment of the present application;
fig. 7 is a block diagram of another control device for screen-casting playing according to the embodiment of the present application;
fig. 8 is a block diagram of an electronic device used to implement an embodiment of the present application.
Detailed Description
Exemplary embodiments of the present application are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present application to facilitate understanding, and should be considered as merely exemplary. Accordingly, one of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Fig. 1 illustrates an exemplary system architecture to which the method for controlling the on-screen playback or the apparatus for controlling the on-screen playback according to the embodiments of the present application may be applied.
As shown in fig. 1, the system architecture may include a smart terminal and a display device. The intelligent terminal can be an electronic device which is provided with an operating system and can install and run various applications, and can be a screen device or a non-screen device. Including but not limited to smart mobile phone, panel computer, intelligent audio amplifier, wearable equipment etc. as a typical application scenario, intelligent terminal in this application can be the intelligent rear-view mirror of car, and display device can be the display of car machine end. In the application, the intelligent terminal can throw some pictures, videos, texts, prompt messages and the like to the display equipment for display. In addition, other playing devices may be included in the system, for example, the intelligent terminal may send a data stream, such as a media stream, to the speaker for playing.
The intelligent terminal and the display device, and the intelligent terminal and the playing device can be connected in a wired or wireless mode, so that data flow and information transmission can be performed.
The control device for screen-casting playing provided in the present application may be implemented in an intelligent terminal, and may be implemented as a plurality of software or software modules (for example, for providing a distributed service), or may be implemented as a single software or software module, which is not specifically limited herein.
It should be understood that the number of intelligent terminals, display devices and playback devices in fig. 1 is merely illustrative. There may be any number of intelligent terminals, display devices, and playback devices, as desired for implementation.
For the convenience of understanding the present application, the cause of the defects existing in the prior art will be explained first. As shown in fig. 2, for the intelligent terminal, it has its own operating system in which some system modules exist to perform different functions, respectively. There are some pre-customized and installed system level applications based on the operating system, and third party applications may also be installed and run. There are often cases where some applications integrate with the drop SDK, while others do not. For example, some system level applications may integrate the drop SDK, while third party applications may not integrate the drop SDK, although this is not a limitation. As shown in fig. 2, it is assumed that the first application is integrated with the drop SDK and the second application is not integrated with the drop SDK. When the second application needs to screen the data stream to the display device, the data stream is transferred to the first application, and the first application screens the data stream to the display device and/or transmits the data stream to the playing device. However, due to the consideration of safety and other factors, only the data stream can be transferred between the second application and the first application, and when the transmission of the data stream is interrupted due to some special events in the second application, the first application does not sense the occurrence of the events, but the second application cannot directly screen, so that the data stream is interrupted for screen display or playing, but a user cannot learn about the specific situation.
Fig. 3 is a flowchart of a main method provided in an embodiment of the present application, as shown in fig. 3, the method may include:
in 301, a system module of the intelligent terminal registers a monitored application, a listening application, and a monitored event in advance.
The monitoring application is an application integrated with a screen-throwing SDK. The monitored application is an application which does not integrate the screen-throwing SDK, and certainly if an application is integrated with the screen-throwing SDK, the monitored application can be registered if the screen-throwing is realized through other applications. The monitored event refers to an event which is expected to be displayed on screen when relevant information occurs in the monitored operation, and can be some notification event, warning event and the like.
The SDK is a software development kit, and refers to a kit provided by a third party service provider for realizing a function of a software product. In the embodiment of the application, the screen projection SDK refers to a tool kit for realizing the screen projection function on the intelligent terminal, and is equivalent to a tool environment integrated with the screen projection function on the intelligent terminal. The SDK may include APIs, declarations of APIs, collections of functions and files such as import libraries, and the like. In the embodiment of the application, the screen-throwing SDK comprises a screen-throwing API, a statement of the screen-throwing API, an import warehouse file and the like. Only applications integrated with the screen-throwing SDK have the function of screen throwing.
In particular, still taking the example shown in FIG. 2, a module in the operating system (i.e., a system module) may open a registration interface. The first application and the second application send a registration request to the system module at the time of installation or after installation, and the registration request may include identity information (i.e. whether the monitored application or the monitored application) requesting registration and monitored event information. Wherein the first application requests registration as a monitored application and registers for a monitored event, the system module is able to monitor the event when the event occurs. The second application requests to register as a monitoring application and to register a monitored event, and when the event occurs, the second application can acquire information of the event in time.
After registration is completed, the system module stores registration information of the monitored application, the monitored application and the monitored event, and in fact, maintains corresponding relations among the monitored application, the monitored application and the monitored event.
In 302, the system module listens for a monitored event for a monitored application.
When the monitored application generates the monitored event in the running process, a monitoring interface of the system module is called to transmit the event message to the system module, so that the system module monitors the event.
In 303, the monitored event message is sent to the listening application.
The system module transmits the monitored event message to the monitoring application according to the stored registration information.
In 304, the listening application generates a hint using the event message.
The manner of prompting the information can adopt various implementation manners, such as a dialog box, a prompt box and the like. Since user feedback is required for certain event-specific occurrence scenarios, a modal pop-up such as dialog box is preferred.
In 305, the listening application screens the prompt to the display device.
The monitoring application screens the generated prompt information to the display equipment through the screen-on SDK, so that the prompt information can be displayed on the display equipment to inform a user what event occurs.
It should be noted that, the flow in this embodiment may be executed during the process that the listening application sends the data stream to the listening application.
The prompt information can be in the form of a modeless popup window, such as a prompt box, and the user does not need to feed back the prompt information. For example, the prompt box automatically disappears after being displayed for a certain period of time, and the data flow between the monitored application and the monitoring application continues to be transmitted. The prompt information may also be in the form of a modal popup, for example, in the form of a dialog box. The user needs to feed back this. After the user operates on the dialog box, the following steps are continued.
In 306, the listening application obtains the operation information of the user for the prompt information.
The actions that the user can do with respect to the reminder information are related to the specific type of event being monitored. Taking the example of playing out the prompt information of the paid media during the media playing process, the dialog box on the screen to the display device may also include some option buttons, such as pay-play, skip-play, stop-play, etc. The user can select one of these option buttons to operate. When the operation occurs, the display device feeds the operation information back to the monitoring application, and the monitoring application acquires the operation information.
In 307, the listening application sends a control instruction corresponding to the operation information to the listening application.
The monitoring application can convert the operation information into a control instruction and send the control instruction to the monitored application, so that the control of the monitored application according to the user operation is realized.
The above method is described below by taking a specific application scenario as an example.
For an intelligent rearview mirror in an automobile, the third party music playing application does not have an integrated screen throwing SDK, and transmits a music data stream to a system-level music playing application of the intelligent rearview mirror, and the system-level music playing application transmits the music data stream to an automobile terminal device for playing. It is assumed that the vehicle-side equipment is a multimedia playing equipment integrating a display and a sound box.
According to the method provided by the application, the third-party music playing application and the system-level music playing application are registered in the system module in advance as a monitored application and a monitoring application, and the monitored event comprises a prompt event sent by the third-party music playing application.
If the third party music playing application plays a pay song in the transmission process of the music data stream, the transmission of the music data stream is stopped, and the prompt event is sent out.
And after the system module monitors the prompt event, the event information is sent to the system-level music playing application according to the registration information.
The system-level music playing application generates a dialog box by using the event information, and screens the dialog box to the vehicle-mounted equipment through the screen-mounted SDK.
The car end device can display the dialog box, and the subsequent user can control music playing through some feedback operations. For example, the user may press a skip play button in the dialog box, and the vehicle-side device feeds back the operation information to the system-level music playing application in the intelligent rear mirror.
The system-level music playing application converts the operation information into a control instruction and sends the control instruction to the third-party music playing application, and controls the third-party music playing application to skip the pay song so as to continue the transmission of the music data stream.
Obviously, through the process, the user can know that the music stops playing because of paying songs in time, so that the music playing can be controlled by adopting corresponding feedback operation, unknown music is prevented from being blocked, the fluency of the music playing is improved, and the user experience is better.
Fig. 4 is a flowchart of a method performed by an intelligent terminal according to an embodiment of the present application, where, as shown in fig. 4, the method may include:
in 401, a system module of the intelligent terminal registers a monitored application, a listening application, and a monitored event in advance.
The system module of the intelligent terminal receives the monitored application and the registration request of the monitored application for the monitored event through the registration interface in advance. After the monitored application registers the identity and the event, when the event of the monitored application occurs, the system module can monitor the event. After the monitoring application registers identity and event, when the event occurs, the system module can send the event message to the monitoring application.
After registration is completed, the system module stores registration information of the monitored application, the monitored application and the monitored event, and in fact, maintains corresponding relations among the monitored application, the monitored application and the monitored event.
In 402, a system module listens for a monitored event of a monitored application.
In 403, the system module sends an event message to the listening application in response to listening for the above-mentioned monitored event of the monitored application, so that the listening application generates a hint information using the event message and screens the hint information to the display device.
The system module transmits the monitored event message to the monitoring application according to the stored registration information.
In addition, the flow of this embodiment may be executed during the process of the monitored application sending the data stream to the monitoring application, that is, the monitored application sending the media stream to the monitoring application, and the monitoring application projecting the media data stream to the display device or sending the media data stream to the playing device.
Fig. 5 is a flowchart of a method for executing an application in an intelligent terminal according to an embodiment of the present application, where, as shown in fig. 5, the method may include:
in 501, an application integrated with a screen-drop SDK in the intelligent terminal is registered in advance as a listening application with the system module.
In the embodiment of the application, the screen projection SDK refers to a tool kit for realizing the screen projection function on the intelligent terminal, and is equivalent to a tool environment integrated with the screen projection function on the intelligent terminal. The SDK may include APIs, declarations of APIs, collections of functions and files such as import libraries, and the like. In the embodiment of the application, the screen-throwing SDK comprises a screen-throwing API, a statement of the screen-throwing API, an import warehouse file and the like. Only applications integrated with the screen-throwing SDK have the function of screen throwing.
After the monitoring application registers identity and event, when the event occurs, the system module can send the event message to the monitoring application.
In 502, a listening application receiving system module receives an event message sent in response to listening for a monitored event of a monitored application.
In 503, the listening application generates a prompt using the event message and screens the prompt to the display device.
The manner of prompting the information can adopt various implementation manners, such as a dialog box, a prompt box and the like. Since user feedback is required for certain event-specific occurrence scenarios, a modal pop-up such as dialog box is preferred.
The monitoring application screens the generated prompt information to the display equipment through the screen-on SDK, so that the prompt information can be displayed on the display equipment to inform a user what event occurs.
It should be noted that, the flow in this embodiment may be executed during the process that the listening application sends the data stream to the listening application. I.e. the listening application receives the media data stream sent by the listening application, drops the media data stream to the display device or sends it to the playback device.
The prompt information can be in the form of a modeless popup window, such as a prompt box, and the user does not need to feed back the prompt information. For example, the prompt box automatically disappears after being displayed for a certain period of time, and the data flow between the monitored application and the monitoring application continues to be transmitted. The prompt information may also be in the form of a modal popup, for example, in the form of a dialog box. The user needs to feed back this. After the user operates on the dialog box, the following steps are continued.
In 504, the listening application obtains the operation information of the user for the prompt information, and sends the control instruction corresponding to the operation information to the listening application.
The actions that the user can do with respect to the reminder information are related to the specific type of event being monitored. Taking the example of playing out the prompt information of the paid media during the media playing process, the dialog box on the screen to the display device may also include some option buttons, such as pay-play, skip-play, stop-play, etc. The user can select one of these option buttons to operate. When the operation occurs, the display device feeds the operation information back to the monitoring application, and the monitoring application acquires the operation information.
The monitoring application can convert the operation information into a control instruction and send the control instruction to the monitored application, so that the control of the monitored application according to the user operation is realized.
The foregoing is a detailed description of the methods provided herein, and the apparatus provided herein is described in detail with reference to the examples.
Fig. 6 is a block diagram of a control device for screen-casting playing, where the device 00 is disposed in an operating system of an intelligent terminal, and is configured to execute operations of a system module in the method. As shown in fig. 6, the apparatus 00 may include a registration unit 01 and a control unit 02, wherein the main functions of the respective constituent units are as follows:
a registration unit 01, configured to register, in advance, a monitored application, a listening application, and a monitored event, where the listening application integrates a screen-drop SDK.
Specifically, the registration unit 01 may pre-open a registration interface, and receive, through the registration interface, a monitored application and a registration request of the monitored application for a monitored event; registration information of the monitored application, the listening application, and the monitored event is stored. The registration request may include identity information (i.e., whether the monitored application or the listening application) requesting registration and monitored event information.
And the control unit 02 is used for sending the event message to the monitoring application when the monitored event of the monitored application is monitored, so that the monitoring application can generate prompt information by using the event message and screen the prompt information to the display device.
Specifically, when the control unit 02 monitors the monitored event through the monitoring interface, the monitored event information is transferred to the monitoring application according to the stored registration information.
Fig. 7 is a block diagram of another control device for screen-throwing playing according to an embodiment of the present application, where the device 10 is set in an intelligent terminal and an application of a screen-throwing SDK is integrated. As shown in fig. 7, the apparatus 10 may include: the registering unit 11, the system interaction unit 12, the generating unit 13 and the screen throwing unit 14 may further comprise an application interaction unit 15. Wherein the main functions of each constituent unit are as follows:
a registration unit 11, configured to register in advance with the system module as a listening application. Specifically, the registration unit may request registration as a listening application by sending a registration request to a registration interface provided by the system interface, and may further register the event type of the listening, and the corresponding listened application.
And the system interaction unit 12 is used for receiving event messages sent by the system module when the monitored event of the monitored application is monitored.
A generating unit 13 for generating a prompt message using the event message. The manner of prompting the information can adopt various implementation manners, such as a dialog box, a prompt box and the like. Since user feedback is required for certain event-specific occurrence scenarios, a modal pop-up such as dialog box is preferred.
And a screen projection unit 14 for projecting the prompt information to the display device.
The application interaction unit 15 is configured to receive a media data stream sent by the monitored application, and provide the media data stream to the screen projection unit for projection to the display device or send the media data stream to the playing device.
If the user operates the prompt information on the display device, the monitoring application can acquire the operation information of the user for the prompt information. The application interaction unit 15 sends the control instruction corresponding to the operation information to the monitored application.
According to embodiments of the present application, an electronic device and a readable storage medium are also provided.
Fig. 8 is a block diagram of an electronic device according to a method for controlling on-screen playback according to an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the application described and/or claimed herein.
As shown in fig. 8, the electronic device includes: one or more processors 801, memory 802, and interfaces for connecting the components, including high-speed interfaces and low-speed interfaces. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions executing within the electronic device, including instructions stored in or on memory to display graphical information of the GUI on an external input/output device, such as a display device coupled to the interface. In other embodiments, multiple processors and/or multiple buses may be used, if desired, along with multiple memories and multiple memories. Also, multiple electronic devices may be connected, each providing a portion of the necessary operations (e.g., as a server array, a set of blade servers, or a multiprocessor system). One processor 801 is illustrated in fig. 8.
Memory 802 is a non-transitory computer-readable storage medium provided herein. The memory stores instructions executable by the at least one processor to cause the at least one processor to execute the method for controlling the on-screen playback provided by the present application. The non-transitory computer readable storage medium of the present application stores computer instructions for causing a computer to execute the control method of the on-screen playback provided by the present application.
The memory 802 is used as a non-transitory computer readable storage medium, and can be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules corresponding to the method for controlling the on-screen playback in the embodiments of the present application. The processor 801 executes various functional applications of the server and data processing, that is, implements the control method of the on-screen playback in the above-described method embodiment, by running non-transitory software programs, instructions, and modules stored in the memory 802.
Memory 802 may include a storage program area that may store an operating system, at least one application program required for functionality, and a storage data area; the storage data area may store data created according to the use of the electronic device of the control method of the cast-in-screen play, and the like. In addition, memory 802 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, memory 802 may optionally include memory located remotely from processor 801, which may be connected to the electronic device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device of the control method of the screen-throwing playing can further comprise: an input device 803 and an output device 804. The processor 801, memory 802, input devices 803, and output devices 804 may be connected by a bus or other means, for example in fig. 8.
The input device 803 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device, such as a touch screen, keypad, mouse, trackpad, touchpad, pointer stick, one or more mouse buttons, trackball, joystick, and like input devices. The output device 804 may include a display apparatus, auxiliary lighting devices (e.g., LEDs), and haptic feedback devices (e.g., vibration motors), among others. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device may be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASIC (application specific integrated circuit), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
These computing programs (also referred to as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented in a high-level procedural and/or object-oriented programming language, and/or in assembly/machine language. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the internet.
The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present application may be performed in parallel, sequentially, or in a different order, provided that the desired results of the technical solutions disclosed in the present application can be achieved, and are not limited herein.
The above embodiments do not limit the scope of the application. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application are intended to be included within the scope of the present application.
Claims (17)
1. The control method of the screen throwing playing is characterized by comprising the following steps:
the method comprises the steps that a system module of the intelligent terminal registers a monitored application, a monitoring application and a monitored event in advance, wherein the monitoring application integrates a screen-throwing Software Development Kit (SDK);
the system module responds to the monitored event of the monitored application, and sends an event message to the monitoring application, so that the monitoring application can generate prompt information by using the event message and screen the prompt information to a display device.
2. The method of claim 1, wherein the system module of the intelligent terminal pre-registering the monitored application, the listening application, and the monitored event comprises:
the system module of the intelligent terminal receives a monitored application and a registration request of the monitored application for the monitored event through a registration interface in advance;
and storing the registration information of the monitored application, the monitored application and the monitored event.
3. The method according to claim 1, characterized in that the method comprises:
the monitored application sends the media data stream to the monitoring application, and the monitoring application screens the media data stream to a display device or sends the media data stream to a playing device.
4. The method of claim 1, wherein the intelligent terminal comprises an intelligent rearview mirror and the display device comprises a vehicle-side display screen.
5. The control method of the screen throwing playing is characterized by comprising the following steps:
the intelligent terminal integrates the application of the screen-throwing SDK and registers the application as a monitoring application in advance to a system module;
the monitoring application receives event messages sent by the system module in response to the monitored events of the monitored application;
and generating prompt information by using the event message, and projecting the prompt information to display equipment.
6. The method of claim 5, further comprising:
and the monitoring application receives the media data stream sent by the monitored application, and screens the media data stream to display equipment or sends the media data stream to playing equipment.
7. The method of claim 6, wherein generating hint information using the event message comprises:
and generating a dialog box by using the event message.
8. The method of claim 5, further comprising:
the monitoring application acquires the operation information of the user aiming at the prompt information and sends a control instruction corresponding to the operation information to the monitored application.
9. The method of claim 5, wherein the intelligent terminal comprises an intelligent rearview mirror and the display device comprises a vehicle-side display screen.
10. The utility model provides a throw controlling means of screen broadcast, sets up in intelligent terminal's operating system, its characterized in that, this device includes:
a registration unit, configured to register a monitored application, a listening application, and a monitored event in advance, where the listening application integrates a screen-drop SDK;
and the control unit is used for responding to the monitored event of the monitored application, sending an event message to the monitoring application so that the monitoring application can generate prompt information by using the event message and screen the prompt information to a display device.
11. The apparatus according to claim 10, wherein the registration unit is configured to receive, in advance, a monitored application and a registration request of the monitored application for the monitored event through a registration interface; and storing the registration information of the monitored application, the monitored application and the monitored event.
12. The utility model provides a throw screen play's controlling means, has set up the application of throwing screen SDK in intelligent terminal, its characterized in that, this device includes:
a registration unit, configured to register in advance with the system module as a listening application;
the system interaction unit is used for receiving event messages sent by the system module in response to the monitored events of the monitored application;
the generating unit is used for generating prompt information by utilizing the event message;
and the screen throwing unit is used for throwing the prompt information to the display equipment.
13. The apparatus of claim 12, wherein the apparatus further comprises:
and the application interaction unit is used for receiving the media data stream sent by the monitored application, and providing the media data stream for the screen projection unit to project the screen to the display equipment or sending the screen to the playing equipment.
14. The apparatus according to claim 12, wherein the generating unit is specifically configured to generate a dialog box using the event message.
15. The apparatus of claim 13, wherein the application interaction unit is further configured to send a control instruction corresponding to the operation information to the monitored application after the monitoring application obtains the operation information of the user for the prompt information.
16. An intelligent terminal, characterized by comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-9.
17. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of any one of claims 1-9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010479587.4A CN111736785B (en) | 2020-05-29 | 2020-05-29 | Method, device, equipment and computer storage medium for controlling screen throwing playing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010479587.4A CN111736785B (en) | 2020-05-29 | 2020-05-29 | Method, device, equipment and computer storage medium for controlling screen throwing playing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111736785A CN111736785A (en) | 2020-10-02 |
| CN111736785B true CN111736785B (en) | 2023-12-22 |
Family
ID=72646596
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010479587.4A Active CN111736785B (en) | 2020-05-29 | 2020-05-29 | Method, device, equipment and computer storage medium for controlling screen throwing playing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111736785B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113138737B (en) * | 2021-04-16 | 2023-11-03 | 阿波罗智联(北京)科技有限公司 | Display control method, device, equipment, medium and program product for screen-throwing scene |
| CN115599566A (en) * | 2021-06-25 | 2023-01-13 | 荣耀终端有限公司（Cn） | Notification message processing method, device, system and computer readable storage medium |
| CN113727180B (en) * | 2021-08-31 | 2024-01-19 | 广州方硅信息技术有限公司 | Screen throwing play control method and device, equipment and medium thereof |
| CN114035973A (en) * | 2021-10-08 | 2022-02-11 | 阿波罗智联(北京)科技有限公司 | Screen projection method and device of application program, electronic equipment and storage medium |
| CN114979756B (en) * | 2022-05-13 | 2024-05-07 | 北京字跳网络技术有限公司 | Method, device and equipment for realizing one-to-many screen-throwing independent display and interaction |
| CN115550498B (en) * | 2022-08-03 | 2024-04-02 | 阿波罗智联(北京)科技有限公司 | Screen projection method, device, equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103780702A (en) * | 2014-02-17 | 2014-05-07 | 重庆长安汽车股份有限公司 | Vehicle-mounted amusement device and mobile phone interactive system and method |
| JP2018060373A (en) * | 2016-10-05 | 2018-04-12 | キヤノン株式会社 | Information processing device, information processing method and program |
| CN108243201A (en) * | 2016-12-23 | 2018-07-03 | 乐视汽车（北京）有限公司 | A kind of system and method for the interconnection of vehicle device and realization vehicle device and mobile terminal |
| WO2019036942A1 (en) * | 2017-08-23 | 2019-02-28 | 华为技术有限公司 | Display method and device |
| CN110248022A (en) * | 2019-06-06 | 2019-09-17 | 武汉卡比特信息有限公司 | A kind of throwing screen method of tripartite's application based on mobile phone interconnection |
| CN110347445A (en) * | 2019-07-12 | 2019-10-18 | 财付通支付科技有限公司 | SDK call method, device, server and storage medium |
-
2020
- 2020-05-29 CN CN202010479587.4A patent/CN111736785B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103780702A (en) * | 2014-02-17 | 2014-05-07 | 重庆长安汽车股份有限公司 | Vehicle-mounted amusement device and mobile phone interactive system and method |
| JP2018060373A (en) * | 2016-10-05 | 2018-04-12 | キヤノン株式会社 | Information processing device, information processing method and program |
| CN108243201A (en) * | 2016-12-23 | 2018-07-03 | 乐视汽车（北京）有限公司 | A kind of system and method for the interconnection of vehicle device and realization vehicle device and mobile terminal |
| WO2019036942A1 (en) * | 2017-08-23 | 2019-02-28 | 华为技术有限公司 | Display method and device |
| CN110248022A (en) * | 2019-06-06 | 2019-09-17 | 武汉卡比特信息有限公司 | A kind of throwing screen method of tripartite's application based on mobile phone interconnection |
| CN110347445A (en) * | 2019-07-12 | 2019-10-18 | 财付通支付科技有限公司 | SDK call method, device, server and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111736785A (en) | 2020-10-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111736785B (en) | Method, device, equipment and computer storage medium for controlling screen throwing playing | |
| CN111666056B (en) | Screen switching display method and device, intelligent rearview mirror and readable storage medium | |
| US8266314B2 (en) | Automated audio or video subset network load reduction | |
| WO2021169809A1 (en) | Widget display method and apparatus | |
| CN111541919B (en) | Video frame transmission method and device, electronic equipment and readable storage medium | |
| US20140207469A1 (en) | Reducing speech session resource use in a speech assistant | |
| CN111645521B (en) | Control method and device for intelligent rearview mirror, electronic equipment and storage medium | |
| KR102358831B1 (en) | Speech recognition control method, apparatus, electronic device and readable storage medium | |
| CN110139118B (en) | Function running method and device of application program, electronic equipment and storage medium | |
| CN114519928B (en) | Method, device, vehicle, electronic device and medium for controlling vehicle | |
| EP3916727A1 (en) | Voice pickup method and apparatus for intelligent rearview mirror | |
| US20210097991A1 (en) | Speech control method and apparatus, electronic device, and readable storage medium | |
| CN114035973A (en) | Screen projection method and device of application program, electronic equipment and storage medium | |
| CN110704012B (en) | Audio data processing method and device, electronic equipment and medium | |
| CN111881005A (en) | Information display method, device, equipment and storage medium | |
| WO2023051315A1 (en) | Application control method and apparatus, electronic device, and storage medium | |
| CN111723343B (en) | Interactive control method and device of electronic equipment and electronic equipment | |
| CN114153542A (en) | Screen projection method and device, electronic equipment and computer readable storage medium | |
| CN113793625A (en) | Audio playing method and device | |
| JP7298089B2 (en) | AUDIO PLAY PROCESSING METHOD, DEVICE, ELECTRONIC DEVICE AND STORAGE MEDIUM | |
| EP4056424B1 (en) | Audio signal playback delay estimation for smart rearview mirror | |
| CN112578713B (en) | Vehicle information processing method, device, equipment and storage medium | |
| US20230291778A1 (en) | Media sharing system | |
| CN115766807A (en) | Vehicle simulation method and device and vehicle | |
| CN114356161A (en) | Page display method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20211021 Address after: 100176 101, floor 1, building 1, yard 7, Ruihe West 2nd Road, Beijing Economic and Technological Development Zone, Daxing District, Beijing Applicant after: Apollo Zhilian (Beijing) Technology Co.,Ltd. Address before: 2 / F, baidu building, 10 Shangdi 10th Street, Haidian District, Beijing 100085 Applicant before: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |