CN108259665B - In-vehicle interactive display method and mobile communication terminal - Google Patents
In-vehicle interactive display method and mobile communication terminal Download PDFInfo
- Publication number
- CN108259665B CN108259665B CN201711477459.0A CN201711477459A CN108259665B CN 108259665 B CN108259665 B CN 108259665B CN 201711477459 A CN201711477459 A CN 201711477459A CN 108259665 B CN108259665 B CN 108259665B
- Authority
- CN
- China
- Prior art keywords
- terminal
- display
- interactive display
- interactive
- application
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72469—User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
Abstract
The application discloses an in-vehicle interactive display method and a mobile communication terminal. The method comprises the following steps: monitoring whether the interactive display application installed at the first terminal exits from front-end display or not and operates in a background; and if the interactive display application installed on the first terminal is monitored to exit from front-end display and run in a background, controlling the second terminal to continue to display the display content sent by the interactive display application. The application solves the technical problem that visual help cannot be provided for a driver when the mobile communication terminal operates in a screen-off mode, exits from a desktop or operates other applications.
Description
Technical Field
The application relates to the field of vehicle-mounted terminals and in-vehicle projection, in particular to an in-vehicle interactive display method, a mobile communication terminal and a vehicle-mounted terminal.
Background
The interactive display refers to that screens of several different devices can be mutually connected and converted through special connecting devices. However, the existing screen projection technology for interactive display, such as the screen projection of the android operating system and the Air Play mirror image of the mobile operating system of apple inc, can only mirror the display content of the mobile phone in the bright screen state of the mobile communication terminal. Under the vehicle-mounted scene, when the mobile communication terminal operates by turning the screen, quits the desktop or operates other applications, visual help can not be provided for the driver, and the driver is easily distracted, so that driving danger is caused.
Aiming at the problem that visual help cannot be provided for a driver when a mobile communication terminal runs on a screen, exits from a desktop or runs other applications in the related art, an effective solution is not provided at present.
Disclosure of Invention
The main purpose of the application is to provide an in-vehicle interactive display method, so as to solve the problem that visual help cannot be provided for a driver when a mobile communication terminal runs on a screen, quits to a desktop or runs other applications.
In order to achieve the above object, according to one aspect of the present application, an in-vehicle interactive display method is provided.
The in-vehicle interactive display method comprises the following steps: the method comprises the following steps that in-vehicle interactive display is executed through a first terminal and a second terminal, the first terminal is used for controlling the second terminal to execute interactive display through a pre-installed interactive display application, and the second terminal is used for displaying display contents sent by the interactive display application, and the method comprises the following steps: monitoring whether the interactive display application installed at the first terminal exits from front-end display or not and operates in a background; and if the interactive display application installed on the first terminal is monitored to exit from front-end display and run in a background, controlling the second terminal to continue to display the display content sent by the interactive display application.
Further, monitoring whether the interactive display application installed at the first terminal exits from front-end display and runs in a background includes: monitoring whether the interactive display application installed on the first terminal exits from front-end display due to the screen locking state of the first terminal and continues to run in a background after the screen locking operation,
if it is monitored that the interactive display application installed on the first terminal exits front-end display and runs in a background, controlling the second terminal to continuously display the display content sent by the interactive display application comprises: if it is monitored that the interactive display application installed on the first terminal exits front-end display due to the screen locking state of the first terminal and continues to run in a background after the screen locking operation, the interactive display application controls the second terminal to continue to execute the display content on the interactive display application.
Further, monitoring whether the interactive display application installed at the first terminal exits from front-end display and runs in a background includes: monitoring that the interactive display application installed on the first terminal exits from front-end display due to screen-off operation of the first terminal, and continues to run in a background after the screen-off operation,
if it is monitored that the interactive display application installed on the first terminal exits front-end display and runs in a background, controlling the second terminal to continuously display the display content sent by the interactive display application comprises:
if it is monitored that the interactive display application installed on the first terminal exits front-end display due to the screen-off state of the first terminal and continues to run in the background after the screen-off operation,
the interactive display application controls the second terminal to continue executing the display content on the interactive display application.
Further, the controlling, by the interactive display application, the second terminal, and continuing to execute the display content on the interactive display application further includes:
if the interactive display application is positioned on a navigation page for a map navigation display interface, the interactive display application controls the second terminal to continuously display the navigation page,
and if the interactive display application is not positioned on the navigation page for the map navigation display interface, the interactive display application controls the second terminal to continuously display the instrument information page in the vehicle, and the instrument information page is obtained from the vehicle through the OBD interface.
Further, if it is monitored that the interactive display application installed on the first terminal does not exit from the front-end display and runs in the background, the second terminal is configured to display the display content sent by the interactive display application in a copy and/or extended display mode,
if the interactive display application installed on the first terminal is monitored to exit from front-end display and run in a background, the second terminal is used for displaying the display content sent by the interactive display application through a copying and/or expanding display mode,
the duplicate display mode is used for displaying the same display content at the first terminal and the second terminal using a video transmission protocol,
the extended display mode is used for packaging data to be displayed by the first terminal and the second terminal through an interactive display application pre-installed in the first terminal, then sending the packaged data to the second terminal, and displaying different display contents on the second terminal.
Further, monitoring whether the interactive display application installed at the first terminal exits from front-end display and runs in a background includes: monitoring that the interactive display application installed on the first terminal exits front-end display due to a return operation of the first terminal and continues to run in a background after the return operation,
if it is monitored that the interactive display application installed on the first terminal exits front-end display and runs in a background, controlling the second terminal to continuously display the display content sent by the interactive display application comprises:
if it is monitored that the interactive display application installed on the first terminal exits front-end display due to a return operation of the first terminal and continues to run in the background after the return operation,
the interactive display application controls the second terminal to continue executing the display content on the interactive display application.
Further, monitoring whether the interactive display application installed at the first terminal exits from front-end display and runs in a background includes: monitoring that the interactive display application installed on the first terminal exits front-end display due to switching operation of the first terminal and continues to run in a background after the switching operation,
if it is monitored that the interactive display application installed on the first terminal exits front-end display and runs in a background, controlling the second terminal to continuously display the display content sent by the interactive display application comprises:
if it is monitored that the interactive display application installed on the first terminal exits front-end display due to the switching operation of the first terminal and continues to run in the background after the switching operation,
the interactive display application controls the second terminal to continue executing the display content on the interactive display application.
Further, the controlling, by the interactive display application, the second terminal, and continuing to execute the display content on the interactive display application further includes:
prompting, by the interactive display application, the first terminal whether to start a split-screen display mode,
and if the first terminal starts a split-screen display mode, controlling the second terminal to correspondingly display the content being displayed in the interactive display application after monitoring that the first terminal exits from the front-end display and runs in a background.
In order to achieve the above object, according to another aspect of the present application, there is provided a mobile communication terminal.
A mobile communication terminal according to the present application includes: the mobile communication terminal is pre-installed with an interactive display application for executing in-vehicle interactive display, and comprises: the mobile communication terminal comprises a monitoring unit and a display unit, wherein the monitoring unit is used for monitoring whether the interactive display application installed on the mobile communication terminal exits from the front-end display or not and runs at the background, and the display unit is used for monitoring that the interactive display application installed on the mobile communication terminal exits from the front-end display and runs at the background, and then controlling the vehicle-mounted terminal to continue to display the display content sent by the interactive display application.
In the embodiment of the application, whether the interactive display application installed at the first terminal exits from the front-end display or not is monitored, and the display content sent by the interactive display application is continuously displayed at the second terminal in a background running mode, so that the mobile communication terminal can still project necessary auxiliary information in screen-off and screen-locking states, and in addition, the purpose of screen-projecting content in background application running can be supported, so that the technical effect of providing visual auxiliary information is realized, and the technical problem that visual help cannot be provided for a driver when the mobile communication terminal runs off the screen, exits from a desktop or runs other applications is solved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this application, serve to provide a further understanding of the application and to enable other features, objects, and advantages of the application to be more apparent. The drawings and their description illustrate the embodiments of the invention and do not limit it. In the drawings:
FIG. 1 is a schematic diagram of an in-vehicle interactive display method according to a first embodiment of the present application;
FIG. 2 is a schematic diagram of an in-vehicle interactive display method according to a second embodiment of the present application;
FIG. 3 is a schematic diagram of an in-vehicle interactive display method according to a third embodiment of the present application;
FIG. 4 is a schematic diagram of an in-vehicle interactive display method according to a fourth embodiment of the present application;
FIG. 5 is a schematic diagram of an in-vehicle interactive display method according to a fifth embodiment of the present application;
FIG. 6 is a diagram illustrating an in-vehicle interactive display method according to a sixth embodiment of the present application;
FIG. 7 is a diagram illustrating an in-vehicle interactive display method according to a seventh embodiment of the present application;
FIG. 8 is a diagram illustrating an in-vehicle interactive display method according to an eighth embodiment of the present application;
fig. 9 is a schematic diagram of a mobile communication terminal according to a first embodiment of the present application;
FIG. 10 is a schematic diagram illustrating an exemplary in-vehicle interactive display method according to a preferred embodiment of the present application; and
fig. 11 is a schematic diagram illustrating an in-vehicle interactive display method according to another preferred embodiment of the present application.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It should be understood that the data so used may be interchanged under appropriate circumstances such that embodiments of the application described herein may be used. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In this application, the terms "upper", "lower", "left", "right", "front", "rear", "top", "bottom", "inner", "outer", "middle", "vertical", "horizontal", "lateral", "longitudinal", and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings. These terms are used primarily to better describe the present application and its embodiments, and are not used to limit the indicated devices, elements or components to a particular orientation or to be constructed and operated in a particular orientation.
Moreover, some of the above terms may be used to indicate other meanings besides the orientation or positional relationship, for example, the term "on" may also be used to indicate some kind of attachment or connection relationship in some cases. The specific meaning of these terms in this application will be understood by those of ordinary skill in the art as appropriate.
Furthermore, the terms "mounted," "disposed," "provided," "connected," and "sleeved" are to be construed broadly. For example, it may be a fixed connection, a removable connection, or a unitary construction; can be a mechanical connection, or an electrical connection; may be directly connected, or indirectly connected through intervening media, or may be in internal communication between two devices, elements or components. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art as appropriate.
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.
As shown in fig. 1, the method includes steps S102 to S104 as follows:
step S102, monitoring whether the interactive display application installed on the first terminal exits from the front-end display or not, and running in the background
The method comprises the steps that in-vehicle interactive display is executed through a first terminal and a second terminal, the first terminal is used for controlling the second terminal to execute interactive display through a pre-installed interactive display application, and the second terminal is used for displaying display contents sent by the interactive display application.
Exiting the front-end display may be, for example, initiating a lock screen or background running of the auxiliary application,
and step S104, if it is monitored that the interactive display application installed on the first terminal exits from front-end display and runs in a background, controlling the second terminal to continue to display the display content sent by the interactive display application.
The interactive display application exits the front-end display and can continue to display the current/skipped content of the interactive display application after running in the background.
From the above description, it can be seen that the present invention achieves the following technical effects:
in the embodiment of the application, whether the interactive display application installed at the first terminal exits from the front-end display or not is monitored, and the display content sent by the interactive display application is continuously displayed at the second terminal in a background running mode, so that the mobile communication terminal can still project necessary auxiliary information in screen-off and screen-locking states, and in addition, the purpose of screen-projecting content in background application running can be supported, so that the technical effect of providing visual auxiliary information is realized, and the technical problem that visual help cannot be provided for a driver when the mobile communication terminal runs off the screen, exits from a desktop or runs other applications is solved.
According to an embodiment of the present invention, as a preference in the embodiment, as shown in fig. 2, the method includes:
monitoring whether the interactive display application installed at the first terminal exits from front-end display or not, and running at a background comprises:
step S202, monitoring whether the interactive display application installed on the first terminal exits from the front-end display due to the screen locking state of the first terminal, and continuously running in the background after the screen locking operation,
if it is monitored that the interactive display application installed on the first terminal exits front-end display and runs in a background, controlling the second terminal to continuously display the display content sent by the interactive display application comprises:
step S204, if it is monitored that the interactive display application installed on the first terminal exits from front-end display due to the screen locking state of the first terminal and continues to run in the background after the screen locking operation, the interactive display application controls the second terminal to continue to execute the display content on the interactive display application.
The screen locking state of the first terminal and the exiting of the front-end display mean that the first terminal performs a screen locking operation of the terminal.
And exiting front-end display in the screen locking state of the first terminal, and continuing to run in the background after the screen locking operation, so that the interactive display application controls the second terminal to continue to execute the display content on the interactive display application.
For example, when the screen of the mobile phone is locked, the corresponding page information is projected on the vehicle-mounted terminal according to the page where the mobile phone application is located before the screen is locked. Meanwhile, the mobile phone application is positioned on the navigation page before the screen is locked, and the vehicle-mounted terminal displays the navigation page after the screen is locked; and when the mobile phone application is not in the navigation page before the screen is locked, the vehicle-mounted terminal displays the instrument information in the vehicle after the screen is turned off. And effective driving display information is provided for a driver.
According to an embodiment of the present invention, as a preference in the embodiment, as shown in fig. 3, the method includes:
monitoring whether the interactive display application installed at the first terminal exits from front-end display or not, and running at a background comprises:
step S302, when it is monitored that the interactive display application installed on the first terminal exits from front-end display due to the screen-off operation of the first terminal, and continues to run in the background after the screen-off operation,
if it is monitored that the interactive display application installed on the first terminal exits front-end display and runs in a background, controlling the second terminal to continuously display the display content sent by the interactive display application comprises:
step S304, if it is monitored that the interactive display application installed on the first terminal exits from front-end display due to the screen-off state of the first terminal and continues to run in the background after the screen-off operation,
the interactive display application controls the second terminal to continue executing the display content on the interactive display application.
The screen-off state of the first terminal and the exiting of the front-end display refer to a screen-off operation of the terminal executed by the first terminal.
For example, when the mobile phone turns off the screen, the corresponding page information is projected on the vehicle-mounted terminal according to the page where the mobile phone application is located before the screen is locked. Meanwhile, before turning off the screen, the mobile phone application is on a navigation page, and after turning off the screen, the vehicle-mounted terminal displays the navigation page; and when the mobile phone application is not in the navigation page before the screen is turned off, the vehicle-mounted terminal displays the instrument information in the vehicle after the screen is turned off. And effective driving display information is provided for a driver.
According to the embodiment of the present invention, as a preference in the embodiment, as shown in fig. 4, the method includes: the controlling, by the interactive display application, the second terminal, and continuing to execute the display content on the interactive display application further includes:
step S402, if the interactive display application is located on a navigation page of a map navigation display interface, the interactive display application controls the second terminal to continue displaying the navigation page,
step S404, if the interactive display application is not located on the navigation page used for the map navigation display interface, the interactive display application controls the second terminal to continue displaying the meter information page in the vehicle, and the meter information page is obtained from the vehicle through the OBD interface.
The navigation page of the interactive display application adopts a concise navigation mode, and the concise navigation mode is different from the traditional navigation information display in that the navigation information is designed and accessed, displayed, arranged and drawn according to screen projection hardware and display characteristics. The display characteristics include, but are not limited to, content reduction processing, displaying only the current vehicle speed, distance to destination, estimated time. In addition, the display features also include: a prompt when turning and a distance to the next intersection outside the turn.
According to the embodiment of the present invention, as a preference in the embodiment, as shown in fig. 5, the method includes:
step S502, if it is monitored that the interactive display application installed on the first terminal does not exit from the front-end display and runs in the background, the second terminal is used for displaying the display content sent by the interactive display application in a copy and/or extended display mode,
step S504, if it is monitored that the interactive display application installed in the first terminal exits from front-end display and runs in the background, the second terminal is configured to display the display content sent by the interactive display application in a copy and/or extended display mode.
The duplicate display mode is used for displaying the same display content at the first terminal and the second terminal using a video transmission protocol,
the extended display mode is used for packaging data to be displayed by the first terminal and the second terminal through an interactive display application pre-installed in the first terminal, then sending the packaged data to the second terminal, and displaying different display contents on the second terminal.
In some embodiments, the second terminal and the first terminal, if in the copy display mode, transmit screen video (including but not limited to images and sound) between the devices via a video transmission protocol. Video transmission protocols include, but are not limited to: rtp/rtcp/rtsp/rtmp/mms/hls transport protocol.
In some embodiments, the second terminal and the first terminal, if the extended display mode is adopted, transmit data, including but not limited to text data or picture data or sound data, between the devices through the custom data, and the second terminal display device displays the received data.
According to the embodiment of the present invention, as a preferred embodiment in the present invention, as shown in fig. 6, monitoring whether the interactive display application installed in the first terminal exits from a front-end display, and running in a background includes:
step S602, it is monitored that the interactive display application installed on the first terminal exits front-end display due to the return operation of the first terminal, and continues to run in the background after the return operation,
the returning operation of the first terminal refers to returning to the upper level or returning to the main menu interface.
If it is monitored that the interactive display application installed on the first terminal exits front-end display and runs in a background, controlling the second terminal to continuously display the display content sent by the interactive display application comprises:
step S604, if it is monitored that the interactive display application installed on the first terminal exits from front-end display due to the return operation of the first terminal and continues to run in the background after the return operation,
the interactive display application controls the second terminal to continue executing the display content on the interactive display application.
In this step, it is required to monitor that the mobile terminal continues to operate in the background after the return operation, and then the interactive display application continues to control the display content on the interactive display application to continue to be executed on the second terminal.
According to the embodiment of the present invention, as a preferred embodiment in the present invention, as shown in fig. 7, monitoring whether the interactive display application installed in the first terminal exits from a front-end display, and running in a background includes:
step S702, it is monitored that the interactive display application installed on the first terminal exits from the front-end display due to the switching operation of the first terminal, and continues to run in the background after the returning operation,
the switching operation may be an operation of switching different applications between applications executed by the first terminal, a return operation executed by the first terminal, or a page switching operation executed by the first terminal.
If it is monitored that the interactive display application installed on the first terminal exits front-end display and runs in a background, controlling the second terminal to continuously display the display content sent by the interactive display application comprises:
step S704, if it is monitored that the interactive display application installed on the first terminal exits front-end display due to the switching operation of the first terminal, and continues to run in the background after the switching operation,
the interactive display application controls the second terminal to continue executing the display content on the interactive display application.
In the specific operation, the step can monitor the event that the auxiliary application program enters the background by adding one, and the auxiliary application program can enter different pages according to corresponding service logic or requirements each time the auxiliary application program enters the background.
According to the embodiment of the present invention, as shown in fig. 8, as a preferable option in the embodiment, the controlling, by the interactive display application, the second terminal to continue executing the display content on the interactive display application further includes:
step S802, the first terminal is prompted by the interactive display application whether to start a split screen display mode,
step S804, if the first terminal starts the split-screen display mode, after it is monitored that the first terminal exits from the front-end display and operates in the background, controlling the second terminal to correspondingly display the content being displayed in the interactive display application.
The method comprises the steps that two devices are required to be under the same WI-FI, the IP and PORT of the device of the opposite side are firstly obtained through a UDP (user datagram protocol) broadcast mode, then after verification, a TCP point-to-point connection mode is started to serve as a transmission path, the authority of an iOS background is required to be started when a screen is locked or a home is started, the authority of the iOS background is required to be defaulted for 180 seconds, and the background is required to reside.
It should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowcharts, in some cases, the steps illustrated or described may be performed in an order different than presented herein.
According to an embodiment of the present invention, there is also provided a mobile communication terminal for implementing the in-vehicle interactive display method, as shown in fig. 9, where an interactive display application for performing in-vehicle interactive display is installed in the mobile communication terminal in advance, the mobile communication terminal includes: the mobile communication terminal comprises a monitoring unit and a display unit, wherein the monitoring unit 10 is used for monitoring whether the interactive display application installed on the mobile communication terminal exits from the front-end display or not and runs at the background, and the display unit 20 is used for monitoring that the interactive display application installed on the mobile communication terminal exits from the front-end display and runs at the background, and then controlling the vehicle-mounted terminal to continue to display the display content sent by the interactive display application.
Monitoring whether the interactive display application installed in the first terminal exits from front-end display due to the screen locking state of the first terminal in a monitoring unit 10 of the embodiment of the application, and continuing to run in a background after the screen locking operation.
In the display unit 20 of the embodiment of the present application, if it is monitored that the interactive display application installed in the first terminal exits from the front-end display due to the screen locking state of the first terminal and continues to run in the background after the screen locking operation, the interactive display application controls the second terminal to continue to execute the display content on the interactive display application.
In the monitoring unit 10 of the embodiment of the present application, it is monitored that the interactive display application installed in the first terminal exits from the front-end display due to the screen-off operation of the first terminal, and continues to run in the background after the screen-off operation.
In the display unit 20 of the embodiment of the present application, if it is monitored that the interactive display application installed in the first terminal exits from the front-end display due to the screen-off state of the first terminal, and continues to run in the background after the screen-off operation, the interactive display application controls the second terminal to continue to execute the display content on the interactive display application.
In the monitoring unit 10 of the embodiment of the present application, if the interactive display application is located on a navigation page for a map navigation display interface, the interactive display application controls the second terminal to continue displaying the navigation page.
If the interactive display application is not located in the navigation page for the map navigation display interface in the display unit 20 of the embodiment of the application, the interactive display application controls the second terminal to continue displaying the meter information page in the vehicle, and the meter information page is obtained from the vehicle through the OBD interface.
In the monitoring unit 10 of the embodiment of the present application, if it is monitored that the interactive display application installed in the first terminal does not exit from the front-end display and runs in the background, the second terminal is configured to display the display content sent by the interactive display application in the copy and/or extended display mode. And if the interactive display application installed on the first terminal is monitored to exit from front-end display and run in a background, the second terminal is used for displaying the display content sent by the interactive display application in a copying and/or expanding display mode.
In the monitoring unit 10 of the embodiment of the present application, it is monitored that the interactive display application installed in the first terminal exits from the front-end display due to the returning operation of the first terminal, and continues to run in the background after the returning operation.
In the display unit 20 of the embodiment of the present application, if it is detected that the interactive display application installed in the first terminal exits from the front-end display due to the returning operation of the first terminal, and continues to run in the background after the returning operation,
the interactive display application controls the second terminal to continue executing the display content on the interactive display application.
Specifically, for example, please refer to fig. 10, which is a specific usage scenario in the above embodiment: firstly, for an android mobile phone, the screen of the mobile phone is locked, and corresponding page information is projected on a head-up display according to a page where an auxiliary application program is located before the screen is locked: the auxiliary application program is positioned on the navigation page before the screen is locked/turned off, and the head-up display displays the navigation page after the screen is locked/turned off; the auxiliary application program is not in the navigation page before locking/screen-off, and the head-up display displays the first page instrument information after locking the screen. Specifically, if the android mobile phone performs wired screen projection and the screen is not locked, the android mobile phone is connected through an HDMI or VGA interface, and the screen is projected through a normal mirror image. If the mobile phone locks the screen (including but not limited to automatic screen locking or power key screen locking), first determining a page where the auxiliary application program is located before the screen locking: the page at this time includes but is not limited to: a page with built-in navigation function or a process page, and other application pages. By projecting different information on the head-up display at this time. And if the page is the page with the built-in navigation function, entering a concise navigation mode on the head-up display. If the page is a process page or other application page, the head-up display fixedly displays the home page. The auxiliary application program is connected with the head-up display, the auxiliary application program generates a view for screen projection (including but not limited to a concise navigation mode page/an auxiliary application program home page) according to a screen projection protocol and the state of the auxiliary application program used by a user, the view is sent to the head-up display of the screen projection equipment in a wired or wireless mode, and after the head-up display receives data, the content needing to be projected is analyzed according to the protocol and displayed on the equipment. Specifically, the secondary application includes: a concise navigation mode, a home page mode. The concise navigation mode of the auxiliary application program is different from the traditional navigation information display in that the navigation information is designed and the access, display, arrangement and drawing work of the navigation information is realized according to the screen projection hardware and the display characteristics. Specifically, a Goodpasture map API custom function interface is invoked.
The navigation page is realized through an android navigation SDK. The android navigation SDK is a product aiming at online navigation, and the product functions include path planning, simulated navigation, GPS positioning, user-defined navigation interface, navigation broadcast information acquisition and the like.
In some embodiments, as a content source device, such as a cell phone/smart car/smart rearview mirror and a heads-up display device, if a duplicate display mode is used, screen video (including but not limited to images and sound) is transmitted between the devices via a video transport protocol.
In some embodiments, as a content source device, for example, between a mobile phone/smart car/smart rearview mirror and a head-up display device, if an extended display mode is adopted, data is transmitted between the devices through custom data, which may be text data or picture data or sound data, and the head-up display device displays the received data.
Specifically, for example, please refer to fig. 11, which is a specific usage scenario in the above embodiment: for an iPhone mobile phone, a split screen display component in a mobile phone application program is set, split screen display is started, and if the mobile phone locks a screen, presses a home key or leaves a mobile phone application to enter other applications, mobile phone application content is displayed on a head-up display. After the split screen display is started, the mobile phone locks the screen, presses the home key, leaves the auxiliary application program, enters other applications, and the head-up display displays the content of the auxiliary application program. Firstly, split screen display starting needs to be set, the default of the IOS version is mirror image screen projection, split screen display is not started, the default selected is mirror image screen projection, and the mirror image screen projection is the AirPlay function of the iOS. The split-screen display function requires that two devices acquire the IP and PORT of the device of the other party in the same wifi mode through a UDP (user datagram protocol) broadcast mode, then after verification, the TCP point-to-point connection mode is started to serve as a transmission path, the screen is locked or the home needs to start the authority of the iOS background, the authority of the iOS background is defaulted for 180 seconds, and the iOS background needs to reside in the background. And finally, judging whether the screen is locked in the foreground or through the HOME key according to the running state of the auxiliary application program, and displaying the content of the current auxiliary application program. Specifically, by adding an event for monitoring the auxiliary application program entering the background, the auxiliary application program can enter different pages according to corresponding service logic or requirements each time the auxiliary application program enters the background.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and they may alternatively be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, or fabricated separately as individual integrated circuit modules, or fabricated as a single integrated circuit module from multiple modules or steps. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (9)
1. An in-vehicle interactive display method is characterized in that in-vehicle interactive display is executed through a first terminal and a second terminal, the first terminal is used for controlling the second terminal to execute interactive display through a pre-installed interactive display application, and the second terminal is used for displaying display contents sent by the interactive display application, and the method comprises the following steps:
monitoring whether the interactive display application installed at the first terminal exits from front-end display or not and operates in a background; and
if the interactive display application installed on the first terminal is monitored to exit from front-end display and run in a background, controlling the second terminal to continue to display the display content sent by the interactive display application;
if the interactive display application is positioned on a navigation page for a map navigation display interface, the interactive display application controls the second terminal to continuously display the navigation page,
and if the interactive display application is not positioned on the navigation page for the map navigation display interface, the interactive display application controls the second terminal to continuously display the instrument information page in the vehicle, and the instrument information page is obtained from the vehicle through the OBD interface.
2. The in-vehicle interactive display method according to claim 1,
monitoring whether the interactive display application installed at the first terminal exits from front-end display or not, and running at a background comprises: monitoring whether the interactive display application installed on the first terminal exits from front-end display due to the screen locking state of the first terminal and continues to run in a background after screen locking operation,
if it is monitored that the interactive display application installed on the first terminal exits front-end display and runs in a background, controlling the second terminal to continuously display the display content sent by the interactive display application comprises: and if the interactive display application installed on the first terminal is monitored to exit from front-end display due to the screen locking state of the first terminal and continue to run in a background after screen locking operation, the interactive display application controls the second terminal to continue to execute the display content on the interactive display application.
3. The in-vehicle interactive display method according to claim 1,
monitoring whether the interactive display application installed at the first terminal exits from front-end display or not, and running at a background comprises: monitoring that the interactive display application installed on the first terminal exits from front-end display due to screen-off operation of the first terminal, and continues to run in a background after the screen-off operation,
if it is monitored that the interactive display application installed on the first terminal exits front-end display and runs in a background, controlling the second terminal to continuously display the display content sent by the interactive display application comprises:
if it is monitored that the interactive display application installed on the first terminal exits from the front-end display due to the screen-off state of the first terminal and continues to run in the background after the screen-off operation,
the interactive display application controls the second terminal to continue executing the display content on the interactive display application.
4. The in-vehicle interactive display method according to claim 1,
if the interactive display application installed on the first terminal is monitored not to exit from the front-end display and run in the background, the second terminal is used for displaying the display content sent by the interactive display application through a copying and/or expanding display mode,
if the interactive display application installed on the first terminal is monitored to exit from front-end display and run in a background, the second terminal is used for displaying the display content sent by the interactive display application through a copying and/or expanding display mode,
the duplicate display mode is used for displaying the same display content at the first terminal and the second terminal using a video transmission protocol,
the extended display mode is used for packaging data to be displayed by the first terminal and the second terminal through an interactive display application pre-installed in the first terminal, then sending the packaged data to the second terminal, and displaying different display contents on the second terminal.
5. The in-vehicle interactive display method according to claim 1,
monitoring whether the interactive display application installed at the first terminal exits from front-end display or not, and running at a background comprises: monitoring that the interactive display application installed on the first terminal exits front-end display due to a return operation of the first terminal and continues to run in a background after the return operation,
if it is monitored that the interactive display application installed on the first terminal exits front-end display and runs in a background, controlling the second terminal to continuously display the display content sent by the interactive display application comprises:
if it is monitored that the interactive display application installed on the first terminal exits front-end display due to a return operation of the first terminal and continues to run in the background after the return operation,
the interactive display application controls the second terminal to continue executing the display content on the interactive display application.
6. The in-vehicle interactive display method according to claim 1, wherein monitoring whether the interactive display application installed on the first terminal exits front-end display and runs in the background comprises: monitoring that the interactive display application installed on the first terminal exits front-end display due to switching operation of the first terminal and continues to run in a background after the switching operation,
if it is monitored that the interactive display application installed on the first terminal exits front-end display and runs in a background, controlling the second terminal to continuously display the display content sent by the interactive display application comprises:
if it is monitored that the interactive display application installed on the first terminal exits front-end display due to the switching operation of the first terminal and continues to run in the background after the switching operation,
the interactive display application controls the second terminal to continue executing the display content on the interactive display application.
7. The in-vehicle interactive display method according to claim 5 or 6, wherein the controlling of the second terminal by the interactive display application and the continuing of the display content on the interactive display application further comprises:
prompting, by the interactive display application, the first terminal whether to start a split-screen display mode,
and if the first terminal starts a split-screen display mode, controlling the second terminal to correspondingly display the content being displayed in the interactive display application after monitoring that the first terminal exits from the front-end display and runs in a background.
8. An in-vehicle interactive display method is characterized in that in-vehicle interactive display is executed through a first terminal and a second terminal, the first terminal is used for controlling the second terminal to execute interactive display through a pre-installed interactive display application, and the second terminal is used for displaying display contents sent by the interactive display application, and the method comprises the following steps:
monitoring whether the interactive display application installed at the first terminal exits from front-end display or not and operates in a background; the exiting front-end display and the background operation at least comprise: the first terminal locks the screen, the first terminal screens off, the first terminal leaves the interactive display application or the first terminal returns to a main interface; and the number of the first and second groups,
if the situation that the interactive display application installed on the first terminal exits front-end display and runs in a background is monitored, the second terminal is controlled to continue to display the display content sent by the interactive display application, the display content sent by the interactive display application is displayed in a copy and/or extended display mode on the second terminal, the copy display mode is used for displaying the same display content on the first terminal and the second terminal by adopting a video transmission protocol, the extended display mode is used for packaging data to be displayed on the first terminal and the second terminal through the interactive display application pre-installed on the first terminal, then sending the packaged data to the second terminal, and displaying different display contents on the second terminal;
controlling the second terminal to continue displaying the display content sent by the interactive display application at least comprises: if the interactive display application is positioned on a navigation page for a map navigation display interface, the interactive display application controls the second terminal to continuously display the navigation page,
and if the interactive display application is not positioned on the navigation page for the map navigation display interface, the interactive display application controls the second terminal to continuously display the instrument information page in the vehicle, and the instrument information page is obtained from the vehicle through the OBD interface.
9. A mobile communication terminal, wherein an interactive display application for performing in-vehicle interactive display is pre-installed at the mobile communication terminal, the mobile communication terminal comprising: a monitoring unit and a display unit, wherein,
the monitoring unit is used for monitoring whether the interactive display application installed on the mobile communication terminal exits from the front-end display or not and runs in the background;
the display unit is used for controlling the vehicle-mounted terminal to continue to display the display content sent by the interactive display application when the monitoring unit monitors that the interactive display application installed on the mobile communication terminal exits from the front-end display and runs in the background; if the interactive display application is positioned on a navigation page for a map navigation display interface, the interactive display application controls the vehicle-mounted terminal to continue displaying the navigation page; and if the interactive display application is not positioned on the navigation page for the map navigation display interface, the interactive display application controls the vehicle-mounted terminal to continuously display the meter information page in the vehicle, and the meter information page is obtained from the vehicle through the OBD interface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711477459.0A CN108259665B (en) | 2017-12-29 | 2017-12-29 | In-vehicle interactive display method and mobile communication terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711477459.0A CN108259665B (en) | 2017-12-29 | 2017-12-29 | In-vehicle interactive display method and mobile communication terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108259665A CN108259665A (en) | 2018-07-06 |
| CN108259665B true CN108259665B (en) | 2021-05-28 |
Family
ID=62724733
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711477459.0A Active CN108259665B (en) | 2017-12-29 | 2017-12-29 | In-vehicle interactive display method and mobile communication terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108259665B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111107523A (en) * | 2018-10-25 | 2020-05-05 | 上海博泰悦臻电子设备制造有限公司 | Display method, display system, vehicle-mounted terminal and computer-readable storage medium |
| CN109889885A (en) * | 2019-02-27 | 2019-06-14 | 努比亚技术有限公司 | A kind of throwing screen control method, terminal and computer readable storage medium |
| CN110708086B (en) * | 2019-08-26 | 2021-09-14 | 华为技术有限公司 | Split-screen display method and electronic equipment |
| CN111314768A (en) * | 2020-02-24 | 2020-06-19 | 北京小米移动软件有限公司 | Screen projection method, screen projection device, electronic equipment and computer readable storage medium |
| CN111447323B (en) * | 2020-03-20 | 2021-07-09 | 华为技术有限公司 | Application display continuing method and device |
| CN111988463B (en) * | 2020-07-10 | 2021-10-19 | 未来穿戴技术有限公司 | Massage device control method, massage device control system, massage device, mobile terminal, and computer-readable storage medium |
| CN113114840A (en) * | 2021-03-28 | 2021-07-13 | 武汉卡比特信息有限公司 | Power-saving screen locking method based on Android mobile phone interconnection |
| CN113138737B (en) * | 2021-04-16 | 2023-11-03 | 阿波罗智联(北京)科技有限公司 | Display control method, device, equipment, medium and program product for screen-throwing scene |
| CN117908814A (en) * | 2022-10-19 | 2024-04-19 | 荣耀终端有限公司 | Screen throwing system and electronic equipment |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009214681A (en) * | 2008-03-10 | 2009-09-24 | Tokai Rika Co Ltd | Remote control system |
| KR20120086578A (en) * | 2011-01-26 | 2012-08-03 | 현대모비스 주식회사 | AVN Using Vehicle And Method Displaying Map and Image Thereof |
| CN104374399A (en) * | 2014-10-31 | 2015-02-25 | 北京搜狗科技发展有限公司 | Method and device for display of navigation information |
| CN104977018B (en) * | 2015-07-10 | 2018-12-07 | 钛马信息网络技术有限公司 | In-vehicle navigation apparatus and mobile device and its air navigation aid, navigation system |
| CN105426145B (en) * | 2015-11-06 | 2019-04-23 | 武汉卡比特信息有限公司 | A kind of method that mobile phone screen projects computer terminal |
| CN105516460A (en) * | 2015-11-25 | 2016-04-20 | 奇瑞汽车股份有限公司 | Method for realizing full-screen projection of single application function of mobile phone to vehicle-mounted display screen |
| CN106643695A (en) * | 2016-11-17 | 2017-05-10 | 珠海市魅族科技有限公司 | Navigation method and navigation device |
-
2017
- 2017-12-29 CN CN201711477459.0A patent/CN108259665B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN108259665A (en) | 2018-07-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108259665B (en) | In-vehicle interactive display method and mobile communication terminal | |
| US11594131B2 (en) | Method and apparatus for enhancing driver situational awareness | |
| US9049564B2 (en) | Vehicle broadcasting system | |
| US20200050492A1 (en) | Device, System and Method for Processing Data | |
| US9294798B2 (en) | System and method for controlling a mirror link of a multimedia system and portable terminal | |
| CN112214186B (en) | Information sharing method and vehicle-mounted terminal | |
| US10938963B2 (en) | Electronic device for performing communication with external electronic device | |
| US20160012795A1 (en) | Mobile Electronic Device Integration with In-Vehicle Information Systems | |
| RU2652452C2 (en) | Device and method for network status information representation | |
| CN107835398B (en) | Customized navigation information display method and device based on screen projection | |
| US20160255521A1 (en) | Method and apparatus for testing a smart device | |
| CN109429096B (en) | Sound main unit for vehicle, vehicle having the same, and vehicle control method | |
| US9514406B2 (en) | Device for analyzing and classifying a mobile terminal application for a docking station of a motor vehicle | |
| US20170068527A1 (en) | Device control method and apparatus | |
| US20150334191A1 (en) | Method and device for transmitting image | |
| US9813675B2 (en) | Semiconductor device, video display system, and method of processing signal | |
| US20130169670A1 (en) | Electronic device and method for transmitting slide file during slide file presentation | |
| CN105516460A (en) | Method for realizing full-screen projection of single application function of mobile phone to vehicle-mounted display screen | |
| CN111694625A (en) | Method and equipment for projecting screen to vehicle machine by vehicle box | |
| KR20130113283A (en) | Acquiring method vehicle contents, displaying method vehicle contents, displaying system for vehicle contents and automotive electronic device | |
| US20180087913A1 (en) | An apparatus and associated methods for use in live navigation | |
| WO2018193439A1 (en) | Device, system and method for processing data | |
| CN110949290B (en) | Method for setting display of vehicle infotainment system and vehicle infotainment system using the same | |
| KR20150095290A (en) | Linking system and method for mobile phone and vehicle display device | |
| KR101308019B1 (en) | Dual-monitor device for vehicle using ear-mic jack of mobile communication device which transceives data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: 215000 4th floor, building 14, Tengfei Innovation Park, 388 Xinping street, Suzhou Industrial Park, Suzhou City, Jiangsu Province Patentee after: Suzhou turnip Electronic Technology Co.,Ltd. Address before: 215123 unit 4-b202, creative industry park, 328 Xinghu street, Suzhou Industrial Park, Jiangsu Province Patentee before: SUZHOU CARROBOT AUTOMOTIVE ELECTRONICS TECHNOLOGY Co.,Ltd. |
|
| CP03 | Change of name, title or address |