JP6033186B2 - Mobile terminal device - Google Patents

Description

  The present invention relates to an information display system in which an information display device and a mobile terminal device operate in cooperation, and more particularly to a mobile terminal device capable of executing a plurality of application programs simultaneously.

  As an in-vehicle information display device, there is an information display device that includes a display for a driver's seat and a display for a passenger's seat, and can display different images on these displays. In such an information display device, for example, a map for route guidance (navigation) can be displayed on a display for a driver's seat, and an image such as a television broadcast can be displayed on a display for a passenger's seat. In addition, in the driver's seat display, inadvertent driving (driver distraction) can be prevented by restricting the display of images such as television broadcasts while the vehicle is running. In addition, by using a split view display device that allows different images to be seen when viewing the screen from the driver's seat and when viewing the screen from the passenger seat, the driver's seat indicator and the passenger seat indicator can be physically connected. Realization with one screen is also proposed (for example, Patent Document 1 below).

  In addition, information display devices having a communication function with mobile terminal devices such as smartphones and mobile phones have been put into practical use. As such an information display device, an image or sound output from an application program (hereinafter referred to as “application” or “application”) running on a portable terminal device is acquired and output from its own display or speaker. Link function (for example, MirrorLink (registered trademark) that enables cooperative operation with a mobile terminal device, such as controlling applications running on the mobile terminal device according to user operations based on acquired images and sounds) ) Function) (for example, Patent Document 2).

International Publication No. 2006/100904 JP 2003-244343 A

  From the background as described above, it is considered that the development of a portable terminal device that appropriately performs a cooperative operation with an information display device having a plurality of displays will be a future problem. In particular, due to the recent high performance of mobile terminal devices, mobile terminal devices capable of executing a plurality of applications at the same time have been put into practical use, and images of a plurality of applications being executed on the mobile terminal device are displayed on the information display device. It is desirable to have a technique for displaying properly using a display.

  The present invention has been made to solve the above-described problems, and in a portable terminal device capable of simultaneously executing a plurality of applications, it is possible to perform an appropriate cooperative operation with an information display device having one or more displays. The purpose is to.

Mobile terminal device according to the present onset Ming, a display unit capable of displaying an image, a communication unit for communicating with an external information display device having one or more indicators is capable of executing a plurality of applications simultaneously, A control unit that simultaneously or selectively displays an image of each application being executed on the display unit, and transmits the image to the information display device via the communication unit. Information specifying which display unit of the information display device displays an image or information specifying a layout for displaying an image of each application being executed on the display unit of the information display device to the information display device transmitted, the control unit is information indicating the degree of operation and display limitations required for each running application, and transmitted to the information display device, the operation and display restriction Degree, three stages or more levels that have been defined.

  ADVANTAGE OF THE INVENTION According to this invention, the portable terminal device which can perform suitable cooperation operation | movement with the information display apparatus which has one or more displays is obtained.

1 is a configuration diagram of an information display system according to Embodiment 1. FIG. It is a figure which shows the example of a display of the image of the application in the display part of a portable terminal device. It is a figure which shows the example of a display of the image of the application in the display part of a portable terminal device. 3 is a flowchart illustrating an operation of the information display device according to the first embodiment. It is a flowchart of the operation / display restriction information transmission processing performed by the information display device. It is a flowchart of the application image display process which an information display apparatus performs. It is a flowchart of the operation corresponding | compatible process which an information display apparatus performs. 3 is a flowchart showing an operation of the mobile terminal device according to the first embodiment. It is a flowchart of the application control signal corresponding | compatible process which a portable terminal device performs. It is a flowchart of the operation corresponding | compatible process which a portable terminal device performs. It is a flowchart of the application image display / transmission process which a portable terminal device performs. It is a figure which shows the example of a display of the image of the driver application on the display part of a portable terminal device, and the image of a passenger application. It is a figure which shows the example of a display of the image of the driver application on the display part of a portable terminal device, and the image of a passenger application. It is a figure which shows the example of a connection of an information display apparatus and a portable terminal device. It is a figure which shows the example of a connection of an information display apparatus and a portable terminal device. It is a figure which shows the example of a connection of an information display apparatus and a portable terminal device. It is a figure which shows the example of a display of the image of the driver application on the display part of a portable terminal device, and the image of a passenger application.

<Embodiment 1>
FIG. 1 is a configuration diagram of an information display system according to Embodiment 1 of the present invention. The information display system includes an information display device 10 and a mobile terminal device 20 that can operate in cooperation with each other. Specific examples of the information display device 10 include a car navigation device and a display audio device. Specific examples of the mobile terminal device 20 include a smartphone and a mobile phone.

  The information display device 10 includes a control unit 11, a storage unit 12, a first image generation unit 13a, a second image generation unit 13b, a communication unit 16, and an interface unit 17, and includes a split view display device 14, a touch panel device 15, and an in-vehicle LAN 18. The speaker 19 is connected. The information display device 10 is configured using a computer, and the control unit 11, the first image generation unit 13a, and the second image generation unit 13b are realized by the computer operating according to a program.

  The control unit 11 performs overall control of the information display device 10, control of devices connected to the information display device 10, execution of applications, and the like. The storage unit 12 is configured by a storage medium such as a hard disk, a removable disk, or a memory, and stores an application program executed by the control unit 11.

  The split view display device 14 connected to the information display device 10 can display the first screen 14a and the second screen 14b in different directions, and functions as two displays. The control unit 11 can execute a plurality of applications at the same time, and can display images of the plurality of applications on the first screen 14a and the second screen 14b.

  In the first embodiment, it is assumed that the information display device 10 is mounted on a vehicle and the split view display device 14 is installed on the center panel of the vehicle. In the split view display device 14, the first screen 14a is a screen (display) that can be seen from the driver's seat side, and the second screen 14b is a screen (display) that can be seen from the passenger seat side. In the following description, the first screen 14a is referred to as “driver's seat side screen”, and the second screen 14b is referred to as “passenger seat side screen”. The driver's seat side screen 14a is a display that needs to be restricted for operation and display (operation / display restriction) while the vehicle is traveling in order to prevent driver distraction. Since the passenger side screen 14b is not visible to the driver, it is a display that does not require any operation / display restrictions.

  The first image generation unit 13 a and the second image generation unit 13 b generate image data to be displayed on the split view display device 14 (driver seat side screen 14 a and passenger seat side screen 14 b) under the control of the control unit 11. It is means to do. Image data to be displayed on the driver's seat screen 14a is generated by the first image generator 13a, and image data to be displayed on the passenger seat screen 14b is generated by the second image generator 13b.

  The touch panel device 15 is provided on the screen of the split view display device 14, and is an operation input unit that receives a user operation on the driver's seat side screen 14a and the passenger seat side screen 14b. In the split view display device 14, since the driver's seat side screen 14a and the passenger seat side screen 14b are physically realized by one screen, the touch panel device 15 includes the driver seat side screen 14a and the passenger seat side screen 14b. It will be shared. In this case, it is necessary to identify whether the operation performed on the touch panel device 15 is an operation on the driver seat side screen 14a or an operation on the passenger seat side screen 14b. As the identification method, for example, a method of detecting whether the operation is performed from the driver seat side or the passenger seat side using a camera or a sensor (not shown) can be considered.

  In addition, individual operation input means may be provided on each of the driver's seat side screen 14a and the passenger seat side screen 14b. For example, the touch panel device 15 may be configured as an operation input unit dedicated to the driver's seat screen 14a, and the operation on the passenger seat screen 14b may be performed using a remote controller (not shown). Here, an example in which the split view display device 14 and the touch panel device 15 are externally attached to the information display device 10 has been shown, but they may be incorporated in the information display device 10.

  The communication unit 16 has a function of performing communication necessary for the information display device 10 to link (link) with the mobile terminal device 20, and image data, audio data, control signals, and the like with the mobile terminal device 20. Exchange various information.

  The information display device 10 has two operation modes: a “normal mode” that operates independently and a “link mode” that operates in cooperation with the mobile terminal device 20. In the normal mode, the control unit 11 executes the application stored in the storage unit 12, and distributes and displays the images of each application being executed on the driver seat side screen 14a and the passenger seat side screen 14b. In the link mode, the control unit 11 acquires images of each application being executed on the mobile terminal device 20 via the communication unit 16, and distributes and displays the images on the driver side screen 14a and the passenger side screen 14b. Let

  Note that the communication method between the communication unit 16 and the mobile terminal device 20 may be wired communication using, for example, a USB (Universal Serial Bus) cable or a LAN (Local Area Network) cable, or may be a wireless LAN or Bluetooth (registered trademark). ) Or the like.

  The interface unit 17 is a connection unit between the information display device 10 and an external device. Here, an example in which an in-vehicle LAN 18 and a speaker 19 are connected to the interface unit 17 is shown. The information display device 10 can acquire information (vehicle information) indicating the state of the vehicle, such as vehicle speed and position information acquired by a GPS (Global Positioning System) receiver, from the in-vehicle LAN 18 connected to the interface unit 17. . The information display device 10 can also output sound from the speaker 19 connected to the interface unit 17.

  On the other hand, the mobile terminal device 20 includes a control unit 21, a storage unit 22, an image generation unit 23, a display unit 24, a touch panel unit 25, and a communication unit 26. The portable terminal device 20 is configured using a computer, and the control unit 21 and the image generation unit 23 are realized by the computer operating according to a program.

  The control unit 21 performs overall control of the mobile terminal device 20 and execution of an application. The storage unit 22 is configured by a storage medium such as a hard disk, a removable disk, or a memory, and stores an application program executed by the control unit 21.

  In the first embodiment, the applications stored in the storage unit 22 are “an application having an operation / display restriction function”, “an application that requires an operation / display restriction”, and “an application that does not require an operation / display restriction”. "are categorized.

  The “app with operation / display restriction function” itself has an operation / display restriction function, and performs an operation / display restriction process that disables the operation or hides the execution screen while the vehicle is running. You can do it yourself. The application having the operation / display restriction function includes an application having only the operation restriction function and an application having only the display restriction function.

  The “app that requires operation / display restriction” does not have an operation / display restriction function, but it is preferable to restrict the operation and display while the vehicle is running. Specific examples thereof include video applications such as an image viewer and a video playback application. Note that applications that require operation / display restrictions include those that require only operation restrictions and those that require only display restrictions.

  The “app that does not require operation / display restriction” preferably does not restrict the operation and display even while the vehicle is running. Specific examples thereof include a navigation application that supports driving.

  Information on which application belongs to an application having an operation / display restriction function, an application requiring an operation / display restriction, or an application not requiring an operation / display restriction is stored in the storage unit 22 as attached information of each application. It is remembered. The attached information may be described in the program file of the application itself, or may be described in an attached file associated therewith.

  The display unit 24 is an image display unit. The control unit 21 can execute a plurality of applications at the same time, and can display images of the plurality of applications simultaneously or selectively on the screen of the display unit 24.

  As a method for simultaneously displaying images of a plurality of applications on the display unit 24, there is a method of displaying images of a plurality of applications side by side as shown in FIG. As a method for selectively displaying images of a plurality of applications on the display unit 24, there is a method in which images of a plurality of applications are overlapped as shown in FIG. 3 so that only the uppermost image is displayed on the screen. is there. When the user changes the overlapping order, the images of each application are selectively displayed. 2 and 3 show an example in which images of two applications are displayed. However, these methods are effective even when there are three or more images of applications.

  The image generation unit 23 is a unit that generates image data to be displayed on the display unit 24. The touch panel unit 25 is an operation input unit that is provided on the screen of the display unit 24 and receives an operation by the user.

  The communication unit 26 has a function of performing communication necessary for the mobile terminal device 20 to link with the information display device 10, and various information such as image data, audio data, and control signals with the information display device 10. Communicate.

  The mobile terminal device 20 also has two operation modes, a “normal mode” that operates independently and a “link mode” that operates in cooperation with the information display device 10. Switching of the operation mode is performed by a user operation. Done. In the normal mode, the control unit 21 executes the application stored in the storage unit 22 and displays an image of each application being executed on the screen of the display unit 24.

  In the link mode, the control unit 21 transmits an image of each application being executed to the information display device 10 via the communication unit 26. At that time, the control unit 21 uses an identifier for designating whether to display an image of each application being executed on the driver side screen 14a or the passenger side screen 14b of the information display device 10 as image data of each application. Attached. Hereinafter, an application designated to be displayed on the driver's seat screen 14a is referred to as “driver application”, and an application designated to be displayed on the passenger seat screen 14b is referred to as “passenger application”. Whether each application executed on the mobile terminal device 20 is a “driver application” or a “passenger application” may be determined in advance, and either one of the users is activated when starting the application. May be specified.

  Hereinafter, operations of the information display device 10 and the mobile terminal device 20 in the information display system according to Embodiment 1 will be described.

  FIG. 4 is a flowchart showing the operation of the information display device 10. When the information display device 10 is activated, the control unit 11 confirms whether the link mode has been started (step S11). If the link mode has not been started (NO in step S11), the control unit 11 operates in the normal mode (step S11). S12).

  In the normal mode, the control unit 11 executes an application stored in the storage unit 12, controls the first image generation unit 13a and the second image generation unit 13b, and displays an image of each application being executed in the driver's seat. It is displayed on the side screen 14a and the passenger seat side screen 14b. The operation of the information display device 10 in the normal mode is the same as the operation of a general information display device, and is not related to the present invention, so that detailed description is omitted.

  On the other hand, when the link mode is started (YES in step S <b> 11), the control unit 11 controls the communication unit 16 to communicate with the mobile terminal device 20 and requests the mobile terminal device 20 for a link. At this time, if there is a response from the mobile terminal device 20, a link between the information display device 10 and the mobile terminal device 20 is established (step S13).

  When the link with the mobile terminal device 20 is established, the control unit 11 receives an image and attached information of each application being executed on the mobile terminal device 20 via the communication unit 16 (step S14). In the image of the application sent from the mobile terminal device 20, an identifier indicating whether the application is a driver application or a passenger application (whether to be displayed on the driver side screen 14a or the passenger side screen 14b). (Identifier to be specified) is attached. In addition, in the attached information of an application, the application corresponds to any one of “an application having an operation / display restriction function”, “an application that requires an operation / display restriction”, and “an application that does not require an operation / display restriction”. Contains information that indicates whether to do it.

  Next, the control unit 11 acquires vehicle information (speed and position information) from the in-vehicle LAN 18 via the interface unit 17, and based on the vehicle information, the state of the vehicle is determined by operating the driver's seat side screen 14 a. It is determined whether or not display restriction is necessary. For example, if the vehicle is running, it is determined that the limitation of operation and display is necessary, and if the vehicle is stopped, it is determined that the limitation of operation and display is unnecessary. In addition, the state of the vehicle may be further subdivided, and the determination result may include a state where only operation restriction is required or a state where only display restriction is required. Then, information (operation / display restriction information) for instructing operation / display restriction is generated according to the determination result (step S15). Furthermore, the control part 11 performs the process (operation / display restriction information transmission process) which transmits the produced | generated operation / display restriction information to the portable terminal device 20 (step S16). The operation / display restriction information includes information for instructing only operation restrictions and information for instructing only display restrictions.

  FIG. 5 is a flowchart of the operation / display restriction information transmission process. In the operation / display restriction information transmission process, the information display device 10 first checks whether or not the driver application is being executed on the mobile terminal device 20 (step S21). This confirmation can be made by referring to the identifier attached to the image of each application being executed on the mobile terminal device 20 acquired in step S14. If the driver application is not executed on the mobile terminal device 20 (NO in step S21), the control unit 11 does not transmit the operation / display restriction information.

  If a driver application is being executed on the mobile terminal device 20 (YES in step S21), the control unit 11 includes an application having an operation / display restriction function or an application requiring operation / display restriction. Is included (steps S22 and S23). This confirmation can be made by referring to the attached information of each application being executed in the mobile terminal device 20 acquired in step S14. If the driver application being executed on the mobile terminal device 20 includes an application having an operation / display restriction function or an application requiring operation / display restriction (YES in step S22, or step S23). The control unit 11 transmits the operation / display restriction information to the mobile terminal device 20 via the communication unit 16 (step S24). Otherwise (NO in step S22 and NO in step S23), control unit 11 does not transmit operation / display restriction information.

  Returning to FIG. 4, when the control unit 11 finishes the operation / display restriction information transmission process (step S <b> 16), the image of each application received from the mobile terminal device 20 is displayed on the driver seat side screen 14 a and the passenger seat side screen 14 b. Processing for displaying (application image display processing) is performed (step S17).

  FIG. 6 is a flowchart of the application image display process. In the application image display process, the control unit 11 first confirms whether or not the driver application image has been received in step S14 (step S31). If the image of the driver application is received (YES in step S31), the control unit 11 displays the image of the driver application on the driver seat side screen 14a (step S32).

  Then, the control part 11 confirms whether the image of the passenger application was received by step S14 (step S33). If an image of the passenger application is received (YES in step S33), the control unit 11 displays the image of the passenger application on the passenger seat side screen 14b (step S34).

  Returning to FIG. 4, after completing the application image display process (step S <b> 17), the control unit 11 performs a process (operation corresponding process) corresponding to the user operation performed on the touch panel device 15 (step S <b> 18).

  FIG. 7 is a flowchart of the operation handling process. In the operation handling process, the control unit 11 first checks whether or not an operation on the driver application (operation on the driver's seat side screen 14a) has been performed on the touch panel device 15 (step S41). If the operation of the driver application is performed (YES in step S41), the control unit 11 transmits a control signal for the driver application corresponding to the operation of the touch panel device 15 to the mobile terminal device 20 (step S42). ). In addition, when the control unit 11 transmits a control signal for the driver application to the mobile terminal device 20, the identifier indicating that the control signal is for the driver application displayed on the driver's seat screen 14a ( Send the driver identifier).

  Then, the control part 11 confirms whether operation with respect to the passenger application was performed in the touch panel apparatus 15 (step S43). If the operation for the passenger application is performed (YES in step S43), the control unit 11 transmits a control signal for the passenger application corresponding to the operation to the mobile terminal device 20 (step S44). In addition, when the control unit 11 transmits the control signal for the passenger application to the mobile terminal device 20, the control unit 11 indicates that the control signal is for the passenger application displayed on the passenger side screen 14b ( (Passenger seat identifier) is sent.

  Returning to FIG. 4, the control unit 11 repeatedly executes Steps S14 to S18 until the link mode is terminated (Step S19). Note that steps S14 to S18 may not be performed in the order shown in FIG. 4. For example, steps S14 to S18 may be performed in parallel. Moreover, the end of the link mode does not necessarily have to be performed according to an instruction from the user. For example, the link mode may be automatically ended when execution of all applications is completed on the mobile terminal device 20 side. Good.

  Next, the operation of the mobile terminal device 20 will be described. FIG. 8 is a flowchart showing the operation of the mobile terminal device 20 according to the first embodiment. When the mobile terminal device 20 is activated, the control unit 21 confirms whether the link mode has been started (step S51). If the link mode has not been started (NO in step S51), the control unit 21 performs the normal mode operation (step S51). S52).

  In the normal mode, the control unit 21 executes an application stored in the storage unit 22, controls the image generation unit 23, and causes the display unit 24 to display an image of each application being executed. The operation of the mobile terminal device 20 in the normal mode is the same as that of a general mobile terminal device, and is not related to the present invention.

  On the other hand, when the link mode of the mobile terminal device 20 is started (YES in step S51), the control unit 21 waits for a link request from the information display device 10 (step S53). When there is a link request from the information display device 10 (YES in step S53), the control unit 21 controls the communication unit 26 to communicate with the information display device 10 and responds to the link request. Thereby, the link of the information display apparatus 10 and the portable terminal device 20 is established (step S54).

  When the link with the information display device 10 is established, the control unit 21 confirms whether or not the attached information of all the applications being executed has been transmitted to the information display device 10 (step S55). If there is a running application that does not transmit the attached information (NO in step S55), the control unit 21 transmits the attached information to the information display device 10 via the communication unit 26 (step S56).

  After transmitting the attached information of all the applications being executed to the information display device 10 (YES in step S55), the control unit 21 receives the operation / display restriction information sent from the information display device 10 (step S57). ). Then, the received operation / display restriction information is reflected on the operation of the application having the operation / display restriction function being executed as the driver application (step S58).

  In this step S58, the operation / display restriction information is delivered to the application having the operation / display restriction function being executed as the driver application, and the operation / display restriction function is exhibited. For example, when an operation restriction instruction is included in the operation / display restriction information, the driver application disables the operation or hides the operation screen so that the user cannot operate the driver application. Put it in a state. In addition, when a display restriction instruction is included in the operation / display restriction information, the driver application darkens the execution screen or replaces it with another image, and the user images the driver application. Is not visible. By these processes, driver distraction is prevented.

  As described with reference to FIG. 5, the operation / display restriction information is executed by the mobile terminal device 20 executing an application having an operation / display restriction function or an application requiring operation / display restriction as a driver application. The information is displayed from the information display device 10. If the condition is not met and the operation / display restriction information is not transmitted from the information display device 10, steps S57 and S58 are skipped.

  Thereafter, the control unit 21 performs processing (application control signal corresponding processing) for controlling the application being executed in accordance with the application control signal transmitted from the information display device 10 (step S59).

  FIG. 9 is a flowchart of the application control signal handling process. In the application control signal handling process, the control unit 21 first confirms whether a control signal for the driver application has been received (step S71). Whether the received control signal is for the driver application or the passenger application can be determined from the identifier attached thereto.

  If the control signal for the driver application is received (YES in step S71), the driver application is an application having an operation restriction function, an application requiring an operation restriction, or an application not requiring an operation restriction. Which one corresponds is confirmed (steps S72 and S73).

  If the driver application is an application having an operation restriction function (YES in step S72), the driver application is controlled in accordance with the received control signal (step S75). As a result, the operation for the driver application performed on the information display device 10 is reflected in the operation of the driver application being executed on the mobile terminal device 20. Since an application having an operation restriction function can perform an operation restriction process according to the operation / display restriction information, it is not necessary to perform a special process relating to the operation restriction.

  Further, when the driver application is an application that does not require operation restriction (NO in step S73), the control unit 21 controls the driver application in accordance with the received control signal (step S75). This is because an image of an application that does not require operation restriction need not be restricted regardless of the state of the vehicle.

  When the driver application is an application that requires operation restriction (YES in step S73), the control unit 21 determines that the vehicle state is operation restriction based on the operation / display restriction information received in step S55 of FIG. Is determined (step S74). If the operation is not limited (NO in step S74), the driver application is controlled in accordance with the received control signal (step S74). S75). At this time, if it is a state that requires operation restriction (YES in step S74), the driver application is not controlled in accordance with the control signal of the driver application. That is, the operation for the driver application performed on the information display device 10 is invalid. If the driver application cannot be operated, the driver does not try to operate, so driver distraction is prevented. In cases where only the operation is restricted without restricting the display (for example, the case where only the operation is restricted while the map is displayed in the navigation application), in order to prevent the driver from trying the operation in advance, It is preferable to display that on the driver's seat screen 14a of the information display device 10.

  Then, the control part 21 confirms whether the control signal of the passenger application was received from the information display apparatus 10 (step S76). Since the passenger application does not require any operation restriction, if the control signal for the passenger application is received (YES in step S76), the control unit 21 controls the passenger application according to the control signal. This is performed (step S77). As a result, the operation for the passenger application performed on the information display device 10 is reflected in the operation of the passenger application being executed on the mobile terminal device 20.

  As described with reference to FIG. 7, when the user performs an operation on the driver application or the passenger application using the touch panel device 15, the information display device 10 transmits a control signal of the application. To do. If no application control signal is transmitted from the information display device 10, nothing is performed in the application control signal handling process.

  Returning to FIG. 8, when the application control signal handling process (step S59) is completed, the control unit 21 performs a process (operation handling process) according to the user operation performed on the touch panel unit 25 (step S60). .

  FIG. 10 is a flowchart of the operation handling process. In the operation handling process, the control unit 21 first confirms whether or not an operation for the driver application is performed on the touch panel unit 25 (step S81). If the driver application is operated (YES in step S81), the driver application is any of an application having an operation restriction function, an application requiring an operation restriction, and an application not requiring an operation restriction. (Steps S82 and S83).

  When the driver application is an application having an operation restriction function (YES in step S82), the control unit 21 controls the driver application according to the operation content of the touch panel unit 25 (step S85). Since an application having an operation restriction function can perform an operation restriction process according to the operation / display restriction information, it is not necessary to perform a special process relating to the operation restriction.

  Also, when the driver application is an application that does not require operation restriction (NO in step S83), the control unit 21 controls the driver application according to the operation content of the touch panel unit 25 (step S85). ). This is because an image of an application that does not require operation restriction need not be restricted regardless of the state of the vehicle.

  When the driver application is an application that requires operation restriction (YES in step S83), the control unit 21 determines whether or not the vehicle state requires operation restriction based on the operation / display restriction information. Is determined (step S84), and if the operation is not limited (NO in step S84), the driver application is controlled according to the operation content of the touch panel unit 25 (step S85). At this time, if it is a state that requires operation restriction (YES in step S84), the driver application is not controlled according to the operation of the touch panel unit 25. That is, the operation for the driver application is invalid. If the driver application cannot be operated, the driver does not try to operate, so driver distraction is prevented. In the case where only the operation restriction is performed without the display restriction, it is preferable to display the fact on the display unit 24 in order to prevent the driver from attempting the operation.

  Then, the control part 21 confirms whether operation with respect to the passenger application was performed in the touch panel part 25 (step S86). Since the passenger application does not require any operation restriction, the control unit 21 controls the passenger application according to the control signal when an operation is performed on the passenger application (YES in step S86). (Step S87).

  Returning to FIG. 8, after completing the operation handling process (step S <b> 60), the control unit 21 displays a process (application image display / transmission process) for displaying the application image on the display unit 24 and transmitting the image to the information display device 10. This is performed (step S61).

  FIG. 11 is a flowchart of the application image display / transmission process. In the application image display / transmission process, the control unit 21 first checks whether or not the driver application is being executed (step S91). If the driver application is being executed (YES in step S91), the driver application corresponds to an application having a display restriction function, an application requiring display restriction, or an application not requiring display restriction. It is confirmed whether to do (steps S92, S93).

  When the driver application is an application having a display restriction function (YES in Step S92), the control unit 21 causes the image generation unit 23 to generate an image of the driver application (Step S95), and the driver application. Are transmitted to the information display device 10 (step S96). Since an application image having a display restriction function is subjected to display restriction processing according to operation / display restriction information by the application itself, it is not necessary to perform special processing relating to display restriction. In addition, when the control part 21 transmits the image of the driver application to the information display device 10, an identifier (driver seat identifier) that specifies that the image is displayed on the driver side screen 14 a of the information display device 10 is displayed. Attach and send.

  Even when the driver application is an application that does not require display restriction (NO in step S93), the control unit 21 causes the image generation unit 23 to generate an image of the driver application (step S95), and the driver The application image is transmitted to the information display device 10 (step S96). This is because it is not necessary to restrict the display of an image of an application that does not require display restriction regardless of the state of the vehicle.

  When the driver application is an application that requires display restriction (YES in step S93), the control unit 21 determines whether or not the vehicle is in a state that requires display restriction based on the operation / display restriction information. If the determination is made (step S94) and the display restriction is not required (NO in step S94), the image generation unit 23 generates an image of the driver application (step S95), and the image of the driver application is displayed. Is transmitted to the information display device 10 (step S96). At this time, if the display restriction is required (YES in step S94), neither generation of the driver application image nor transmission to the information display device 10 is performed. As a result, an image of the driver application is not displayed on the driver's seat side screen 14a of the information display device 10 and the display unit 24 of the mobile terminal device 20, so that driver distraction is prevented.

  Subsequently, the control unit 21 confirms whether or not the passenger application is being executed (step S97). Since the passenger application does not require display restrictions, the control unit 21 causes the image generation unit 23 to generate an image of the passenger application if the passenger application is executed (YES in step S97) (step S97). (S98), the image of the passenger application is transmitted to the information display device 10 (step S99). The control unit 21 transmits an identifier (passenger seat identifier) that designates that when the image of the passenger application is transmitted to the information display device 10 to be displayed on the passenger seat side screen 14b of the information display device 10. Attach and send.

  And the control part 21 displays the image of a driver's application, and the image of a passenger's application on the screen of the display part 24 (step S100). For example, when the driver application image and the passenger application image are displayed side by side on the display unit 24 as shown in FIG. 2, in step S <b> 100, the images are combined. If the image of the driver application being executed is not generated (YES in step S94), the alternative image is used in step S100.

  When only one of the driver application and the passenger application is being executed, a process of displaying only the application being executed is performed in step S100. If neither the driver application nor the passenger application is executed, step S100 is skipped.

  Returning to FIG. 8, the portable terminal device 20 repeatedly executes steps S <b> 55 to S <b> 61 until a link release request is received from the information display device 10 (step S <b> 62). If there is a request for releasing the link (YES in step S62), the link with the information display device 10 is released and the link mode is terminated (step S63). Note that steps S57 to S61 are not necessarily performed in the order shown in FIG. 8, and for example, steps S57 to S61 may be executed in parallel.

  In the above description, the information display device 10 generates the operation / display restriction information and the mobile terminal device 20 receives the information. However, the mobile terminal device 20 may generate the operation / display restriction information. For example, when the mobile terminal device 20 includes a GPS receiver, it can be determined whether or not the vehicle in which the mobile terminal device 20 is brought is running from the change in the current position. Display restriction information can be generated.

  Even if a plurality of applications are executed on the mobile terminal device 20, one of the applications that transmits an image to the information display device 10 may be used. For example, only an image of an application designated by the user among a plurality of applications being executed at the same time may be transmitted to the information display device 10. Further, for example, only images of applications designated by the user may be transmitted to the information display device 10 from a plurality of applications being displayed on the display unit 24 simultaneously as shown in FIG.

  In the first embodiment, the mobile terminal device 20 is premised on that one driver application and one passenger application are executed. However, a plurality of driver applications and passenger applications are executed. May be. For example, when a plurality of driver applications are executed, these images may be displayed side by side on the driver's seat screen 14a or selectively displayed in a superimposed manner. The layout for displaying the image of each driver application on the driver's seat side screen 14a may be set on the information display device 10 side, or information for specifying the layout from the mobile terminal device 20 You may make it transmit to the terminal device 20. FIG.

<Embodiment 2>
Embodiment 2 demonstrates the variation of the display aspect of the driver application and the passenger application in the display part 24 of the portable terminal device 20. FIG.

  For example, when the driver app image and the passenger app image are selectively displayed as shown in FIG. 3 on the display unit 24 of the mobile terminal device 20, whether the displayed image is that of the driver app or not. It ’s hard to tell at a glance whether it ’s for a consumer app. Therefore, when selectively displaying the driver app image and the passenger app image, each image may include an identification display indicating whether the driver app image or the passenger app image.

  For example, as shown in FIG. 12, it is conceivable that an identification display of “D” is attached to the image of the driver application, and an identification display of “P” is attached to the image of the passenger application. It is more effective to change the position of the identification display between the driver application image and the passenger application image. In the example of FIG. 12, the identification display “D” indicating the driver application is displayed on the upper left of the image, and the identification display “P” indicating the passenger application is displayed on the upper right of the image. For example, as shown in FIG. 13, frames of different colors may be attached to the driver app image and the passenger app image as identification displays.

  The design, position, size, and the like of the identification display may be arbitrary, and may be set according to user preferences, for example. Further, the identification display of the driver application and the passenger application is not only displayed on the display unit 24 of the mobile terminal device 20, but also on the split view display device 14 (driver seat screen 14a and passenger seat screen 14b) of the information display device 10. ) May also be displayed.

<Embodiment 3>
In the third embodiment, a variation of the display connected to the information display device 10 will be described.

  In the first embodiment, the two display units connected to the information display device 10 are of the split view type realized by a single screen, but may have independent screens. When the information display device 10 is mounted on a vehicle, the installation location of the display device is not limited to the center panel. For example, the display device for the driver's seat of the vehicle may be disposed in the instrument panel of the vehicle, or may be a head-up display that projects a screen on the windshield.

  Furthermore, three or more displays may be connected to the mobile terminal device 20. For example, it is conceivable to connect an indicator for the rear seat in addition to the indicator for the driver's seat and the indicator for the passenger seat. Conversely, the present invention is also applicable when only one display device (for example, only a display device for the driver's seat) is connected to the mobile terminal device 20.

<Embodiment 4>
In the fourth embodiment, a variation of a communication method between the information display device 10 and the mobile terminal device 20 will be described.

  As in the information display system of the first embodiment, the data (image data and control signal) transferred between the information display device 10 and the mobile terminal device 20 is the driver app or the passenger app. If an identifier for discriminating between the two is attached, it is possible to have one communication path as shown in FIG. 14 and to transmit the data to the information display apparatus through the same communication path. When three or more indicators are connected to the mobile terminal device 20, the number of identifiers may be increased in accordance with the number.

  Further, as shown in FIG. 15, two communication paths may be provided, one of which is used for passing data for the driver application, and the other is used for passing data for the passenger application. In this case, since it is possible to distinguish whether the data is for the driver application or the passenger application from the communication path used for delivery, it is not necessary to attach an identifier to the data. The communication standards of the two communication paths may not be the same. For example, as shown in FIG. 16, one may be a communication path using USB, and the other may be a communication path using a wireless LAN (W-LAN). Further, when three or more displays are connected to the mobile terminal device 20, the number of communication paths may be increased according to the number.

<Embodiment 5>
In the fifth embodiment, the driver application and the passenger application designation method for the application executed on the mobile terminal device 20, that is, the image of the application executed on the mobile terminal device 20 is displayed on the information display device 10. A variation of the method for designating which of the seat side screen 14a and the passenger side screen 14b is displayed will be described.

  Whether an application executed on the mobile terminal device 20 is a driver application or a passenger application may be set in advance for each application, or may be specified by the user when starting the application. May be.

  The designation of the driver application or the passenger application for each application may be automatically performed based on a predetermined rule. For example, an application having an operation / display restriction function may be automatically designated as a driver application and displayed on the driver's seat screen 14a (display that requires operation / display restriction). Conversely, an image of an application that does not have an operation / display restriction function is automatically designated as a passenger application, and is displayed on the passenger side screen 14b (display that does not require operation / display restrictions). May be.

  Further, depending on which display unit of the mobile terminal device 20 displays the application image, the driver application or the passenger application may be automatically specified. For example, in the case of the configuration shown in FIG. 1, the application displayed on the first screen 24a of the mobile terminal device 20 is automatically designated as the driver application, and the application displayed on the second screen 24b is automatically used for the passenger. You may make it designate as an application.

  In addition, for example, when the mobile terminal device 20 has a display unit that is always visible to the operator and a display unit that is not always visible, the application displayed on the display unit that is always visible is automatically set as a driver application. An application that is designated and displayed on a display unit that is not always visible may be automatically designated as a passenger application.

  Further, the application being executed in the foreground in the mobile terminal device 20 may be automatically designated as a driver application, and the application being executed in the background may be automatically designated as a passenger application. In this case, if the foreground and the background are switched by the operation of the mobile terminal device 20, the driver app and the passenger app are switched and the convenience is lowered. Therefore, the foreground and the background are preferably fixed. In that case, the display mode of the driver application and the passenger application on the display unit 24 of the mobile terminal device 20 may be as shown in FIG.

  That is, as shown in FIG. 17, a drag bar 30 is provided at the end of the image of the driver application being executed in the foreground, and when the drag bar 30 is slid with a finger, the passenger application operating in the background from below is provided. Make the image appear. Further, when the finger is released while the drag bar 30 is slid, the original state (a state where the image of the driver application is displayed on the entire screen) may be restored after a certain period of time.

  Contrary to the above description, the application running in the foreground in the mobile terminal device 20 is designated as the passenger application, and the application running in the background is designated as the driver application. Good.

  In the mobile terminal device 20 in which the display mode of FIG. 17 is implemented, only the image of the application being executed in the background may be transmitted to the information display device 10. In this case, the user can display an image of the application being executed in the background that cannot be seen without operating the drag bar 30 on the display (driver's seat side screen 14a or passenger's seat side screen 14b) of the information display device 10. Can see. That is, both the image of the application running in the foreground and the image of the application running in the background can be visually recognized without operating the drag bar 30.

<Embodiment 6>
In the first embodiment, the application executed by the mobile terminal device 20 is any of an application having an operation / display restriction function, an application requiring an operation / display restriction, and an application not requiring an operation / display restriction. However, it may be changeable, for example, the user may arbitrarily set it.

  In addition, for example, when the mobile terminal device 20 has a display unit that is always visible to the operator and a display unit that is not always visible, the application displayed on the display unit that is always visible to the operator requires operation / display restrictions. The image may be transmitted to the information display device by assuming that the application is not to be performed (even if the application has an operation / display restriction function, the function is not exhibited).

  Further, the mobile terminal device 20 may set whether or not the application requires operation / display restriction based on the type of application. For example, a navigation application may be set as an application that does not require operation / display restrictions, and a video application (image viewer or video playback application) may be set as an application that requires operation / display restrictions.

  Furthermore, in the mobile terminal device 20 in which the display mode of FIG. 17 is implemented, the application being executed in the foreground is regarded as an application that does not require operation / display restrictions, and the image is transmitted to the information display device. Also good. Conversely, an image of an application being executed in the background may be regarded as an application that requires operation / display restrictions, and the image may be transmitted to the information display device.

<Embodiment 7>
In the first embodiment, the driver application operating on the mobile terminal device 20 is “an app having an operation / display restriction function”, “an app that requires operation / display restriction”, and “no operation / display restriction”. However, instead of this, for example, the degree of operation / display restriction (operation / display restriction level) required for each application may be defined. For example, the following levels can be considered.
・ Level 0: Permits operation only when parked (parking brake on) ・ Level 1: Permits operation only when parked or below a certain speed ・ Level 2: Restricted operation / display for general roads ・ Level 3: For expressways Operation / display restrictions ・ Level 10: No operation / display restrictions (apps that do not require operation / display restrictions)
The operation / display restriction level of each application is stored in the storage unit 22 as attached information of the application.

  In this case, the operation / display restriction information transmitted from the information display device 10 to the mobile terminal device 20 includes more detailed information on the vehicle state (such as parking brake on / off and the type of road that is running). Must be included. Based on the received operation / display restriction information, the control unit 21 of the mobile terminal device 20 performs the operation / display restriction on the content corresponding to the operation / display restriction level for the driver application.

  It should be noted that the present invention can be freely combined with each other within the scope of the invention, and each embodiment can be appropriately modified or omitted.

  DESCRIPTION OF SYMBOLS 10 Information display apparatus, 11 Control part, 12 Storage part, 13a 1st image generation part, 13b 2nd image generation part, 14 Split view display apparatus, 14a 1st screen (driver's seat side screen), 14b 2nd screen (assistant) Seat side screen), 15 touch panel device, 16 communication unit, 17 interface unit, 18 in-vehicle LAN, 19 speaker, 20 mobile terminal device, 21 control unit, 22 storage unit, image generation unit, 24 display unit, 25 touch panel unit, 26 Communication department.

Claims (13)

A display unit capable of displaying an image;
A communication unit for communicating with an external information display device having one or more displays;
A control unit capable of simultaneously executing a plurality of applications, causing an image of each application being executed to be displayed simultaneously or selectively on the display unit, and transmitting to the information display device via the communication unit; Prepared,
The control unit further displays on the display of the information display device information specifying which display on the information display device the image of each application being executed is displayed on, or on the display of the information display device. Sending information specifying the layout when the information is displayed to the information display device ;
The control unit transmits information indicating a degree of operation / display restriction required for each application being executed to the information display device,
The level of the operation / display restriction is defined by three or more levels . A display unit capable of displaying an image;
A communication unit for communicating with an external information display device having one or more displays;
A control unit capable of simultaneously executing a plurality of applications, causing an image of each application being executed to be displayed simultaneously or selectively on the display unit, and transmitting to the information display device via the communication unit; Prepared,
The control unit further displays on the display of the information display device information specifying which display on the information display device the image of each application being executed is displayed on, or on the display of the information display device. Sending information specifying the layout when the information is displayed to the information display device;
The control unit regards an application running in the foreground as an application that does not require operation / display restrictions.
The portable terminal device characterized by the above-mentioned. A display unit capable of displaying an image;
A communication unit for communicating with an external information display device having one or more displays;
A control unit capable of simultaneously executing a plurality of applications, causing an image of each application being executed to be displayed simultaneously or selectively on the display unit, and transmitting to the information display device via the communication unit; Prepared,
The control unit further displays on the display of the information display device information specifying which display on the information display device the image of each application being executed is displayed on, or on the display of the information display device. Sending information specifying the layout when the information is displayed to the information display device;
The control unit regards an image of an application running in the background as an application that requires operation / display restrictions.
The portable terminal device characterized by the above-mentioned. A display unit capable of displaying an image;
A communication unit for communicating with an external information display device having one or more displays;
A control unit capable of simultaneously executing a plurality of applications, causing an image of each application being executed to be displayed simultaneously or selectively on the display unit, and transmitting to the information display device via the communication unit; Prepared,
The control unit further displays on the display of the information display device information specifying which display on the information display device the image of each application being executed is displayed on, or on the display of the information display device. Sending information specifying the layout when the information is displayed to the information display device;
The control unit transmits only an image of an application being executed in the background among a plurality of applications being simultaneously executed to the information display device.
The portable terminal device characterized by the above-mentioned. 5. The mobile terminal device according to claim 1 , wherein the control unit transmits an image of each application being executed to the information display device through the same communication path. 6. Wherein the control unit receives a control signal for each running application from the information display apparatus, according to any one of claims 1 to 4 for controlling each running application on the basis of the control signal Mobile terminal device. The mobile terminal device according to any one of claims 1 to 4, wherein the plurality of applications that can be executed by the mobile terminal device include an application / operation limiting function. The control unit transmits to the information display device a signal designating to display an image of an application that does not have an operation / display restriction function on a display device that does not require operation / display restriction of the information display device. The portable terminal device as described in any one of Claims 1-4 . The portable control device according to any one of claims 1 to 4, wherein the control unit transmits only an image of an application designated by a user among a plurality of applications being executed simultaneously to the information display device. The portable terminal according to any one of claims 1 to 4, wherein the control unit transmits only an image of an application designated by a user from a plurality of applications being displayed simultaneously on the display unit to the information display device. apparatus. The plurality of display units are configured by a split view display device,
The information display device has a display composed of a split view display device,
The control unit designates that an image of an application to be displayed on each screen of the split view display device that is the plurality of display units is displayed on each screen of the split view display device that is a display of the information display device. The mobile terminal device according to any one of claims 1 to 4 , wherein information is transmitted to the information display device. The mobile terminal device according to any one of claims 1 to 4, wherein the control unit controls operation / display restrictions of each application being executed based on information acquired from the information display device. Wherein the control unit, the portable terminal device determines the running state of the vehicle brought, based on the running condition of the vehicle, claims 1 to 4 for controlling the operation and display limitations of each running application The mobile terminal device according to any one of the above.

Images