JPWO2015029130A1 - Information display device - Google Patents

Abstract

The information display device 10 displays different images on the first screen 14a and the second screen 14b of the communication unit 16 that communicates with the mobile terminal device 20 and the split view display device 14 that functions as two displays. The control part 11 which can do is provided. The control unit 11 acquires images of each application being executed on the mobile terminal device 20 via the communication unit 16, and distributes and displays the images on the first screen 14a and the second screen 14b of the split view display device 14. Let

Description

  The present invention relates to an information display system in which an information display device and a mobile terminal device operate in cooperation with each other, and more particularly to an information display device that performs an operation in cooperation with a mobile terminal device capable of executing a plurality of application programs at the same time.

  As an in-vehicle information display device, there is an information display device that includes a display for a driver's seat and a display for a passenger's seat, and can display different images on these displays. In such an information display device, for example, a map for route guidance (navigation) can be displayed on a display for a driver's seat, and an image such as a television broadcast can be displayed on a display for a passenger's seat. In addition, in the driver's seat display, inadvertent driving (driver distraction) can be prevented by restricting the display of images such as television broadcasts while the vehicle is running. In addition, by using a split view display device that allows different images to be seen when viewing the screen from the driver's seat and when viewing the screen from the passenger seat, the driver's seat indicator and the passenger seat indicator can be physically connected. Realization with one screen is also proposed (for example, Patent Document 1 below).

  In addition, information display devices having a communication function with mobile terminal devices such as smartphones and mobile phones have been put into practical use. As such an information display device, an image or sound output from an application program (hereinafter referred to as “application” or “application”) running on a portable terminal device is acquired and output from its own display or speaker. Link function (for example, MirrorLink (registered trademark) that enables cooperative operation with a mobile terminal device, such as controlling applications running on the mobile terminal device according to user operations based on acquired images and sounds) ) Function) (for example, Patent Document 2).

International Publication No. 2006/100904 JP 2003-244343 A

  From the background as described above, it is considered that development of a technology for appropriately performing a cooperative operation with a mobile terminal device in an information display device having a plurality of displays will be a future problem. In particular, with the recent improvement in performance of mobile terminal devices, mobile terminal devices capable of executing a plurality of applications simultaneously have been put into practical use, and images of a plurality of applications being executed on the mobile terminal device can be displayed on a plurality of displays. It is desired to develop an information display device that can display appropriately.

  The present invention has been made to solve the above-described problems, and an object thereof is to enable an appropriate cooperative operation with a mobile terminal device in an information display device having a plurality of displays.

  The information display device according to the present invention can display different images on a communication unit that communicates with an external mobile terminal device and a plurality of displays, and each application running on the mobile terminal device. A control unit that acquires an image via a communication unit and distributes and displays the image on a plurality of displays.

  ADVANTAGE OF THE INVENTION According to this invention, the information display apparatus which can control a some indicator and can perform suitable cooperation operation | movement with a portable terminal device can be obtained.

  Objects, features, aspects, and advantages of the present invention will become more apparent from the following detailed description and the accompanying drawings.

1 is a configuration diagram of an information display system according to Embodiment 1. FIG. 3 is a flowchart illustrating an operation of the information display device according to the first embodiment. It is a flowchart of the operation / display restriction information transmission processing performed by the information display device. It is a flowchart of the application image display process which an information display apparatus performs. It is a flowchart of the operation corresponding | compatible process which an information display apparatus performs. 3 is a flowchart showing an operation of the mobile terminal device according to the first embodiment. It is a flowchart of the application control signal corresponding | compatible process which a portable terminal device performs. It is a flowchart of the operation corresponding | compatible process which a portable terminal device performs. It is a flowchart of the application image display / transmission process which a portable terminal device performs. It is a figure which shows the example of a connection of an information display apparatus and a portable terminal device. It is a figure which shows the example of a connection of an information display apparatus and a portable terminal device. It is a figure which shows the example of a connection of an information display apparatus and a portable terminal device. It is a figure which shows the example of a connection of an information display apparatus and a portable terminal device. It is a figure which shows the example of a connection of an information display apparatus and a portable terminal device.

<Embodiment 1>
FIG. 1 is a configuration diagram of an information display system according to Embodiment 1 of the present invention. The information display system includes an information display device 10 and a mobile terminal device 20 that can operate in cooperation with each other. Specific examples of the information display device 10 include a car navigation device and a display audio device. Specific examples of the mobile terminal device 20 include a smartphone and a mobile phone.

  The information display device 10 includes a control unit 11, a storage unit 12, a first image generation unit 13a, a second image generation unit 13b, a communication unit 16, and an interface unit 17, and includes a split view display device 14, a touch panel device 15, and an in-vehicle LAN 18. The speaker 19 is connected. The information display device 10 is configured using a computer, and the control unit 11, the first image generation unit 13a, and the second image generation unit 13b are realized by the computer operating according to a program.

  The control unit 11 performs overall control of the information display device 10, control of devices connected to the information display device 10, execution of applications, and the like. The storage unit 12 is configured by a storage medium such as a hard disk, a removable disk, or a memory, and stores an application program executed by the control unit 11.

  The split view display device 14 connected to the information display device 10 can display the first screen 14a and the second screen 14b in different directions, and functions as two displays. The control unit 11 can execute a plurality of applications at the same time, and can display images of the plurality of applications on the first screen 14a and the second screen 14b.

  In the first embodiment, it is assumed that the information display device 10 is mounted on a vehicle and the split view display device 14 is installed on the center panel of the vehicle. In the split view display device 14, the first screen 14a is a screen (display) that can be seen from the driver's seat side, and the second screen 14b is a screen (display) that can be seen from the passenger seat side. In the following description, the first screen 14a is referred to as “driver's seat side screen”, and the second screen 14b is referred to as “passenger seat side screen”. The driver's seat side screen 14a is a display that needs to be restricted for operation and display (operation / display restriction) while the vehicle is traveling in order to prevent driver distraction. Since the passenger side screen 14b is not visible to the driver, it is a display that does not require any operation / display restrictions.

  The first image generation unit 13 a and the second image generation unit 13 b generate image data to be displayed on the split view display device 14 (driver seat side screen 14 a and passenger seat side screen 14 b) under the control of the control unit 11. It is means to do. Image data to be displayed on the driver's seat screen 14a is generated by the first image generator 13a, and image data to be displayed on the passenger seat screen 14b is generated by the second image generator 13b.

  The touch panel device 15 is provided on the screen of the split view display device 14 and is an operation input unit that receives a user operation based on images displayed on the driver's seat screen 14a and the passenger seat screen 14b. In the split view display device 14, since the driver's seat side screen 14a and the passenger seat side screen 14b are physically realized by one screen, the touch panel device 15 includes the driver seat side screen 14a and the passenger seat side screen 14b. It will be shared. In this case, it is necessary to identify whether the operation performed on the touch panel device 15 is an operation on the driver seat side screen 14a or an operation on the passenger seat side screen 14b. As the identification method, for example, a method of detecting whether the operation is performed from the driver seat side or the passenger seat side using a camera or a sensor (not shown) can be considered.

  In addition, individual operation input means may be provided on each of the driver's seat side screen 14a and the passenger seat side screen 14b. For example, the touch panel device 15 may be configured as an operation input unit dedicated to the driver's seat screen 14a, and the operation on the passenger seat screen 14b may be performed using a remote controller (not shown). Here, an example in which the split view display device 14 and the touch panel device 15 are externally attached to the information display device 10 has been shown, but they may be incorporated in the information display device 10.

  The communication unit 16 has a function of performing communication necessary for the information display device 10 to link (link) with the mobile terminal device 20, and image data, audio data, control signals, and the like with the mobile terminal device 20. Exchange various information.

  The information display device 10 has two operation modes: a “normal mode” that operates independently and a “link mode” that operates in cooperation with the mobile terminal device 20. In the normal mode, the control unit 11 executes the application stored in the storage unit 12, and distributes and displays the images of each application being executed on the driver seat side screen 14a and the passenger seat side screen 14b. In the link mode, the control unit 11 acquires images of each application being executed on the mobile terminal device 20 via the communication unit 16, and distributes and displays the images on the driver side screen 14a and the passenger side screen 14b. Let

  Note that the communication method between the communication unit 16 and the mobile terminal device 20 may be wired communication using, for example, a USB (Universal Serial Bus) cable or a LAN (Local Area Network) cable, or may be a wireless LAN or Bluetooth (registered trademark). ) Or the like.

  The interface unit 17 is a connection unit between the information display device 10 and an external device. Here, an example in which an in-vehicle LAN 18 and a speaker 19 are connected to the interface unit 17 is shown. The information display device 10 can acquire information (vehicle information) indicating the state of the vehicle, such as vehicle speed and position information acquired by a GPS (Global Positioning System) receiver, from the in-vehicle LAN 18 connected to the interface unit 17. . The information display device 10 can also output sound from the speaker 19 connected to the interface unit 17.

  On the other hand, the mobile terminal device 20 includes a control unit 21, a storage unit 22, a first image generation unit 23a, a second image generation unit 23b, a split view display unit 24, a touch panel unit 25, and a communication unit 26. The mobile terminal device 20 is configured using a computer, and the control unit 21, the first image generation unit 23a, and the second image generation unit 23b are realized by the computer operating according to a program.

  The control unit 21 performs overall control of the mobile terminal device 20 and execution of an application. The storage unit 22 is configured by a storage medium such as a hard disk, a removable disk, or a memory, and stores an application program executed by the control unit 21.

  In the first embodiment, the applications stored in the storage unit 22 are “an application having an operation / display restriction function”, “an application that requires an operation / display restriction”, and “an application that does not require an operation / display restriction”. "are categorized.

  The “app with operation / display restriction function” itself has an operation / display restriction function, and performs an operation / display restriction process that disables the operation or hides the execution screen while the vehicle is running. You can do it yourself. The application having the operation / display restriction function includes an application having only the operation restriction function and an application having only the display restriction function.

  The “app that requires operation / display restriction” does not have an operation / display restriction function, but it is preferable to restrict the operation and display while the vehicle is running. Specific examples thereof include video applications such as an image viewer and a video playback application. Note that applications that require operation / display restrictions include those that require only operation restrictions and those that require only display restrictions.

  The “app that does not require operation / display restriction” preferably does not restrict the operation and display even while the vehicle is running. Specific examples thereof include a navigation application that supports driving.

  Information on which application belongs to an application having an operation / display restriction function, an application requiring an operation / display restriction, or an application not requiring an operation / display restriction is stored in the storage unit 22 as attached information of each application. It is remembered. The attached information may be described in the program file of the application itself, or may be described in an attached file associated therewith.

  The split view display unit 24 functions as two display units by displaying the first screen 24a and the second screen 24b in different directions. The control unit 21 can execute a plurality of applications at the same time, and can display the images of the plurality of applications in a divided manner on the first screen 24a and the second screen 24b.

  The first image generation unit 23a and the second image generation unit 23b are means for generating image data to be displayed on the split view display unit 24 (first screen 24a and second screen 24b). The image data to be displayed on the first screen 24a is generated by the first image generation unit 23a, and the image data to be displayed on the second screen 24b is generated by the second image generation unit 23b.

  The touch panel unit 25 is an operation input unit that is provided on the screen of the split view display unit 24 and receives user operations on the first screen 24a and the second screen 24b. Since the split view display unit 24 has one physical screen, the touch panel unit 25 is shared by the first screen 24a and the second screen 24b. Therefore, it is necessary to identify whether the operation performed on the touch panel unit 25 is an operation on the first screen 24a or an operation on the second screen 24b using a camera or a sensor (not shown). Moreover, you may provide a separate operation input means in each of the 1st screen 24a and the 2nd screen 24b.

  The communication unit 26 has a function of performing communication necessary for the mobile terminal device 20 to link with the information display device 10, and various information such as image data, audio data, and control signals with the information display device 10. Communicate.

  The mobile terminal device 20 also has two operation modes, a “normal mode” that operates independently and a “link mode” that operates in cooperation with the information display device 10. Switching of the operation mode is performed by a user operation. Done. In the normal mode, the control unit 21 executes the application stored in the storage unit 22, and distributes and displays the images of each application being executed on the first screen 24a and the second screen 24b.

  In the link mode, the control unit 21 transmits an image of each application being executed to the information display device 10 via the communication unit 26. At that time, the control unit 21 uses an identifier for designating whether to display an image of each application being executed on the driver side screen 14a or the passenger side screen 14b of the information display device 10 as image data of each application. Attached. Hereinafter, an application designated to be displayed on the driver's seat screen 14a is referred to as “driver application”, and an application designated to be displayed on the passenger seat screen 14b is referred to as “passenger application”. Whether each application executed on the mobile terminal device 20 is a “driver application” or a “passenger application” may be determined in advance, and either one of the users is activated when starting the application. May be specified.

  Hereinafter, operations of the information display device 10 and the mobile terminal device 20 in the information display system according to Embodiment 1 will be described.

  FIG. 2 is a flowchart showing the operation of the information display apparatus 10. When the information display device 10 is activated, the control unit 11 confirms whether the link mode has been started (step S11). If the link mode has not been started (NO in step S11), the control unit 11 operates in the normal mode (step S11). S12).

  In the normal mode, the control unit 11 executes an application stored in the storage unit 12, controls the first image generation unit 13a and the second image generation unit 13b, and displays an image of each application being executed in the driver's seat. It is displayed on the side screen 14a and the passenger seat side screen 14b. The operation of the information display device 10 in the normal mode is the same as the operation of a general information display device, and is not related to the present invention, so that detailed description is omitted.

  On the other hand, when the link mode is started (YES in step S <b> 11), the control unit 11 controls the communication unit 16 to communicate with the mobile terminal device 20 and requests the mobile terminal device 20 for a link. At this time, if there is a response from the mobile terminal device 20, a link between the information display device 10 and the mobile terminal device 20 is established (step S13).

  When the link with the mobile terminal device 20 is established, the control unit 11 receives an image and attached information of each application being executed on the mobile terminal device 20 via the communication unit 16 (step S14). In the image of the application sent from the mobile terminal device 20, an identifier indicating whether the application is a driver application or a passenger application (whether to be displayed on the driver side screen 14a or the passenger side screen 14b). (Identifier to be specified) is attached. In addition, in the attached information of an application, the application corresponds to any one of “an application having an operation / display restriction function”, “an application that requires an operation / display restriction”, and “an application that does not require an operation / display restriction”. Contains information that indicates whether to do it.

  Next, the control unit 11 acquires vehicle information (speed and position information) from the in-vehicle LAN 18 via the interface unit 17, and based on the vehicle information, the state of the vehicle is determined by operating the driver's seat side screen 14 a. It is determined whether or not display restriction is necessary. For example, if the vehicle is running, it is determined that the limitation of operation and display is necessary, and if the vehicle is stopped, it is determined that the limitation of operation and display is unnecessary. In addition, the state of the vehicle may be further subdivided, and the determination result may include a state where only operation restriction is required or a state where only display restriction is required. Then, information (operation / display restriction information) for instructing operation / display restriction is generated according to the determination result (step S15). Furthermore, the control part 11 performs the process (operation / display restriction information transmission process) which transmits the produced | generated operation / display restriction information to the portable terminal device 20 (step S16). The operation / display restriction information includes information for instructing only operation restrictions and information for instructing only display restrictions. The operation / display restriction information transmitted to the mobile terminal device 20 is used for controlling the operation / display restriction of the application executed on the mobile terminal device 20.

  FIG. 3 is a flowchart of the operation / display restriction information transmission process. In the operation / display restriction information transmission process, the information display device 10 first checks whether or not the driver application is being executed on the mobile terminal device 20 (step S21). This confirmation can be made by referring to the identifier attached to the image of each application being executed in the mobile terminal device 20 received in step S14 of FIG. If the driver application is not executed on the mobile terminal device 20 (NO in step S21), the control unit 11 does not transmit the operation / display restriction information.

  If a driver application is being executed on the mobile terminal device 20 (YES in step S21), the control unit 11 includes an application having an operation / display restriction function or an application requiring operation / display restriction. Is included (steps S22 and S23). This confirmation can be made by referring to the attached information of each application being executed in the mobile terminal device 20 received in step S14 of FIG. If the driver application being executed on the mobile terminal device 20 includes an application having an operation / display restriction function or an application requiring operation / display restriction (YES in step S22, or step S23). The control unit 11 transmits the operation / display restriction information to the mobile terminal device 20 via the communication unit 16 (step S24). Otherwise (NO in step S22 and NO in step S23), control unit 11 does not transmit operation / display restriction information.

  Returning to FIG. 2, when the operation / display restriction information transmission process (step S <b> 16) is completed, the control unit 11 displays the image of each application received from the mobile terminal device 20 on the driver seat side screen 14 a and the passenger seat side screen 14 b. Processing for displaying (application image display processing) is performed (step S17).

  FIG. 4 is a flowchart of the application image display process. In the application image display process, first, the control unit 11 confirms whether or not an image of the driver application is received in step S14 of FIG. 2 (step S31). If an image of the driver application is received (YES in step S31), the driver application is any of an application having a display restriction function, an application that requires display restriction, and an application that does not require display restriction. It is confirmed whether it is applicable (steps S32 and S33).

  When the driver application is an application having a display restriction function (YES in step S32), the control unit 11 displays an image of the driver application on the driver seat side screen 14a (step S35). The image of the application having the display restriction function is subjected to display restriction processing according to the operation / display restriction information by the application itself. is there.

  Even when the driver application does not require display restriction (NO in step S33), the control unit 11 displays an image of the driver application on the driver's seat side screen 14a (step S35). This is because it is not necessary to restrict the display of an image of an application that does not require display restriction regardless of the state of the vehicle.

  When the driver application is not an application having a display restriction function (NO in step S32) but an application that requires display restriction (YES in step S33), the control unit 11 generates in step S15 of FIG. Based on the operated / display restriction information, it is determined whether or not the vehicle is in a state requiring display restriction (step S34). If the display restriction is not required (NO in step S34), the driving is performed. The image of the user application is displayed on the driver side screen 14a (step S35). At this time, if the display restriction is required (YES in step S34), the control unit 11 prevents driver distraction without displaying an image of the driver application on the driver seat side screen 14a. .

  Subsequently, the control unit 11 confirms whether or not the passenger app image has been received in step S14 of FIG. 2 (step S36). Since the passenger application does not require display restrictions, if the passenger application is received (YES in step S36), the control unit 11 displays an image of the passenger application on the passenger side screen 14b. (Step S37).

  Returning to FIG. 2, when the application image display process (step S <b> 17) is completed, the control unit 11 performs a process according to the operation of the touch panel device 15 performed by the user based on the application image displayed on the split view display device 14. (Operation handling process) is performed (step S18).

  FIG. 5 is a flowchart of the operation handling process. In the operation handling process, the control unit 11 first checks whether or not an operation on the driver application (operation on the driver's seat side screen 14a) has been performed on the touch panel device 15 (step S41). If the driver application is operated (YES in step S41), the control unit 11 requires the driver application to have an operation restriction function, an application that requires operation restriction, and an operation restriction. Which application is not applicable is confirmed (steps S42 and S43).

  When the driver application is an application having an operation restriction function (YES in step S42), the control unit 11 transmits a control signal of the driver application corresponding to the operation of the touch panel device 15 to the mobile terminal device 20 ( Step S45). This is because an application having an operation restriction function can perform an operation restriction process according to the operation / display restriction information by itself, so that it is not necessary to perform a special process relating to the operation restriction on the information display device 10 side. In addition, when the control unit 11 transmits a control signal for the driver application to the mobile terminal device 20, the identifier indicating that the control signal is for the driver application displayed on the driver's seat screen 14a ( Send the driver identifier).

  Also, when the driver application is an application that does not require operation restriction (NO in step S43), the control unit 11 sends a control signal for the driver application according to the operation of the touch panel device 15 to the mobile terminal device 20. (Step S45). This is because an image of an application that does not require operation restriction need not be restricted regardless of the state of the vehicle.

  When the driver application is not an application having an operation restriction function (NO in step S42) but an application that requires operation restriction (YES in step S43), the control unit 11 performs the operation / operation generated in step S15. Based on the display restriction information, it is determined whether or not the vehicle is in a state that requires operation restriction (step S44). A control signal for the driver application corresponding to the operation is transmitted to the mobile terminal device 20 (step S45). At this time, if it is in a state that requires operation restriction (YES in step S44), the control signal for the driver application is not transmitted. That is, the operation for the driver application performed on the touch panel device 15 is invalid. If the driver application cannot be operated, the driver does not try to operate, so driver distraction is prevented. In the case where only the operation restriction is performed without the display restriction, it is preferable to display the fact on the driver's seat side screen 14a in order to prevent the driver from attempting the operation.

  Then, the control part 11 confirms whether operation with respect to the passenger application was performed in the touch panel apparatus 15 (step S46). Since the operation restriction is not required for the passenger application, the control unit 11 controls the passenger application according to the operation of the touch panel device 15 when the operation for the passenger application is performed (YES in step S46). A signal is transmitted to the portable terminal device 20 (step S47). In addition, when the control unit 11 transmits the control signal for the passenger application to the mobile terminal device 20, the control unit 11 indicates that the control signal is for the passenger application displayed on the passenger side screen 14b ( (Passenger seat identifier) is sent.

  Returning to FIG. 2, the control unit 11 repeatedly executes steps S14 to S18 until the link mode is terminated (step S19). Note that steps S14 to S18 may not be performed in the order shown in FIG. 2, and for example, steps S14 to S18 may be performed in parallel. Moreover, the end of the link mode does not necessarily have to be performed according to an instruction from the user. For example, the link mode may be automatically ended when execution of all applications is completed on the mobile terminal device 20 side. Good.

  Next, the operation of the mobile terminal device 20 will be described. FIG. 6 is a flowchart showing the operation of the mobile terminal device 20 according to the first embodiment. When the mobile terminal device 20 is activated, the control unit 21 confirms whether the link mode has been started (step S51). If the link mode has not been started (NO in step S51), the control unit 21 performs the normal mode operation (step S51). S52).

  In the normal mode, the control unit 21 executes the application stored in the storage unit 22, controls the first image generation unit 23a and the second image generation unit 23b, and displays the image of each application being executed in the first mode. It is displayed on the screen 24a and the second screen 24b. The operation of the mobile terminal device 20 in the normal mode is the same as that of a general mobile terminal device, and is not related to the present invention.

  On the other hand, when the link mode of the mobile terminal device 20 is started (YES in step S51), the control unit 21 waits for a link request from the information display device 10 (step S53). When there is a link request from the information display device 10 (YES in step S53), the control unit 21 controls the communication unit 26 to communicate with the information display device 10 and responds to the link request. Thereby, the link of the information display apparatus 10 and the portable terminal device 20 is established (step S54).

  When the link with the information display device 10 is established, the control unit 21 confirms whether or not the attached information of all the applications being executed has been transmitted to the information display device 10 (step S55). If there is a running application that does not transmit the attached information (NO in step S55), the control unit 21 transmits the attached information to the information display device 10 via the communication unit 26 (step S56).

  After transmitting the attached information of all the applications being executed to the information display device 10 (YES in step S55), the control unit 21 receives the operation / display restriction information sent from the information display device 10 (step S57). ). Then, the received operation / display restriction information is reflected on the operation of the application having the operation / display restriction function being executed as the driver application (step S58).

  In this step S58, the operation / display restriction information is delivered to the application having the operation / display restriction function being executed as the driver application, and the operation / display restriction function is exhibited. For example, when an operation restriction instruction is included in the operation / display restriction information, the driver application disables the operation or hides the operation screen so that the user cannot operate the driver application. Put it in a state. In addition, when a display restriction instruction is included in the operation / display restriction information, the driver application darkens the execution screen or replaces it with another image, and the user images the driver application. Is not visible. By these processes, driver distraction is prevented.

  As described with reference to FIG. 3, the operation / display restriction information is executed by the mobile terminal device 20 executing an application having an operation / display restriction function or an application requiring operation / display restriction as a driver application. The information is displayed from the information display device 10. If the condition is not met and the operation / display restriction information is not transmitted from the information display device 10, steps S57 and S58 are skipped.

  Thereafter, the control unit 21 performs processing (application control signal corresponding processing) for controlling the application being executed in accordance with the application control signal transmitted from the information display device 10 (step S59).

  FIG. 7 is a flowchart of the application control signal handling process. In the application control signal handling process, the control unit 21 first confirms whether a control signal for the driver application has been received (step S71). Whether the received control signal is for the driver application or the passenger application can be determined from the identifier attached thereto.

  If the control signal for the driver application is received (YES in step S71), the control unit 21 controls the driver application in accordance with the received control signal (step S72). As a result, the operation for the driver application performed on the information display device 10 is reflected in the operation of the driver application being executed on the mobile terminal device 20.

  Then, the control part 21 confirms whether the control signal of the passenger application was received from the information display apparatus 10 (step S73). If the control signal for the passenger application is received (YES in step S73), the control unit 21 controls the passenger application in accordance with the control signal (step S74). As a result, the operation for the passenger application performed on the information display device 10 is reflected in the operation of the passenger application being executed on the mobile terminal device 20.

  As described with reference to FIG. 5, the information display device 10 operates when the user performs an operation on the driver application or the passenger application using the touch panel device 15 and satisfies a certain condition. , Send control signals for that application. If no application control signal is transmitted from the information display device 10, nothing is performed in the application control signal handling process.

  Returning to FIG. 6, after completing the application control signal handling process (step S59), the control unit 21 performs a process (operation handling process) corresponding to the user operation performed on the touch panel unit 25 (step S60). .

  FIG. 8 is a flowchart of the operation handling process. In the operation handling process, the control unit 21 first confirms whether or not an operation for the driver application is performed on the touch panel unit 25 (step S81). If the driver application is operated (YES in step S81), the driver application is any of an application having an operation restriction function, an application requiring an operation restriction, and an application not requiring an operation restriction. (Steps S82 and S83).

  When the driver application is an application having an operation restriction function (YES in step S82), the control unit 21 controls the driver application according to the operation content of the touch panel unit 25 (step S85). Since an application having an operation restriction function can perform an operation restriction process according to the operation / display restriction information, it is not necessary to perform a special process relating to the operation restriction.

  Also, when the driver application is an application that does not require operation restriction (NO in step S83), the control unit 21 controls the driver application according to the operation content of the touch panel unit 25 (step S85). ). This is because an image of an application that does not require operation restriction need not be restricted regardless of the state of the vehicle.

  When the driver application is not an application having an operation restriction function (NO in step S82) but an application that requires operation restriction (YES in step S83), the control unit 21 is based on the operation / display restriction information. Then, it is determined whether or not the state of the vehicle requires the operation restriction (step S84). If the state does not require the operation restriction (NO in step S84), the operation state of the touch panel unit 25 is determined. The driver application is controlled (step S85). At this time, if it is a state that requires operation restriction (YES in step S84), the driver application is not controlled according to the operation of the touch panel unit 25. That is, the operation for the driver application is invalid. If the driver application cannot be operated, the driver does not try to operate, so driver distraction is prevented. In the case where only the operation restriction is performed without restricting the display, it is preferable to display the fact on the first screen 24a in order to prevent the driver from attempting the operation.

  Then, the control part 21 confirms whether operation with respect to the passenger application was performed in the touch panel part 25 (step S86). Since the passenger application does not require any operation restriction, the control unit 21 controls the passenger application according to the control signal when an operation is performed on the passenger application (YES in step S86). (Step S87).

  Returning to FIG. 6, when the operation corresponding process (step S <b> 60) is finished, the control unit 21 displays an application image on the first screen 24 a and the second screen 24 b and transmits to the information display device 10 (application). Image display / transmission processing) is performed (step S61). Which application image is displayed on each of the first screen 24a and the second screen 24b is specified by the user, but here, the image of the driver application is displayed on the first screen 24a, and the passenger application It is assumed that the user designates the image to be displayed on the second screen 24b.

  FIG. 9 is a flowchart of the application image display / transmission process. In the application image display / transmission process, the control unit 21 first checks whether or not the driver application is being executed (step S91). If the driver application is being executed (YES in step S91), the control unit 21 displays an image of the driver application on the first screen 24a and transmits it to the information display device 10 (step S92, S93). In addition, when the control part 21 transmits the image of the driver application to the information display device 10, an identifier (driver seat identifier) that specifies that the image is displayed on the driver side screen 14 a of the information display device 10 is displayed. Attach and send.

  Subsequently, the control unit 21 confirms whether or not the passenger application is being executed (step S94). If the passenger application is being executed (YES in step S94), the control unit 21 displays an image of the passenger application on the second screen 24b and transmits it to the information display device 10 (step S95, S96). The control unit 21 transmits an identifier (passenger seat identifier) that designates that when the image of the passenger application is transmitted to the information display device 10 to be displayed on the passenger seat side screen 14b of the information display device 10. Attach and send.

  Returning to FIG. 6, the portable terminal device 20 repeatedly executes Steps S <b> 55 to S <b> 61 until there is a link release request from the information display device 10 (Step S <b> 62). If there is a request for releasing the link (YES in step S62), the link with the information display device 10 is released and the link mode is terminated (step S63). Note that steps S57 to S61 do not necessarily have to be performed in the order shown in FIG. 6, and for example, steps S57 to S61 may be executed in parallel.

  In the above description, the information display device 10 generates the operation / display restriction information and the mobile terminal device 20 receives the operation / display restriction information. Conversely, the mobile terminal device 20 generates the operation / display restriction information. It may be transmitted to the information display device 10. For example, when the mobile terminal device 20 includes a GPS receiver, it can be determined whether or not the vehicle in which the mobile terminal device 20 is brought is running from the change in the current position. Display restriction information can be generated.

  Even if a plurality of applications are executed on the mobile terminal device 20, one of the applications that transmits an image to the information display device 10 may be used. For example, of the two screens of the split view display unit 24 of the mobile terminal device 20, the first screen 24a is a display unit that is always visible to the operator of the mobile terminal device 20, and the second screen 24b is always visible from the operator. In the case of a display unit that cannot be seen (it cannot be seen unless the orientation of the mobile terminal device 20 is changed), only the application image displayed on the second screen 24 b may be transmitted to the information display device 10. In this case, the user can see the image displayed on the second screen 24b that is not always visible on the display device (the driver seat side screen 14a or the passenger seat side screen 14b) of the information display device 10. That is, both the application image displayed on the first screen 24a and the application image displayed on the second screen 24b can be visually recognized without changing the orientation of the mobile terminal device 20.

  In addition to the above example, the “display unit that is always visible to the operator” of the mobile terminal device 20 includes a lower screen in the sliding two-screen display unit described in the second embodiment.

  In the first embodiment, the mobile terminal device 20 is premised on that one driver application and one passenger application are executed. However, a plurality of driver applications and passenger applications are executed. May be. For example, when a plurality of driver applications are executed, these images may be displayed side by side on the driver's seat side screen 14a or displayed in a superimposed manner. The layout for displaying the image of each driver application on the driver's seat side screen 14a may be set on the information display device 10 side, or information for specifying the layout from the mobile terminal device 20 You may make it transmit to the terminal device 20. FIG.

<Embodiment 2>
In the second embodiment, variations of the display unit of the mobile terminal device 20 will be described.

  In the first embodiment, the two display units included in the mobile terminal device 20 are of the split view type realized by one screen, but may have independent screens. For example, the two screens are folded so that the two screens face each other in the closed state, and the two screens can be seen when opened. Although the side screen is not visible (that is, the lower screen is not always visible to the operator), a slide-type two-screen display unit in which the lower screen appears when the upper screen is slid can be considered. Moreover, the portable terminal device 20 may include three or more display units.

<Embodiment 3>
In the third embodiment, a variation of the display connected to the information display device 10 will be described.

  In the first embodiment, the two display units connected to the information display device 10 are of the split view type realized by a single screen, but may have independent screens. When the information display device 10 is mounted on a vehicle, the installation location of the display device is not limited to the center panel. For example, the display device for the driver's seat of the vehicle may be disposed in the instrument panel of the vehicle, or may be a head-up display that projects a screen on the windshield.

  In the first embodiment, the display that requires operation / display restriction has been described as a display for the driver's seat (driver's seat side screen 14a). However, the display is a display that provides information to the driver of the vehicle. If it exists, it is not necessary for the driver's seat. For example, a display device that is arranged on the center panel and can be seen by both the driver and the passenger may be defined as a display device that requires operation / display restrictions.

  Furthermore, three or more displays may be connected to the mobile terminal device 20. For example, it is conceivable to connect an indicator for the rear seat in addition to the indicator for the driver's seat and the indicator for the passenger seat. Conversely, the present invention is also applicable when only one display device (for example, only a display device for the driver's seat) is connected to the mobile terminal device 20.

<Embodiment 4>
In the fourth embodiment, a variation of a communication method between the information display device 10 and the mobile terminal device 20 will be described.

  As in the information display system of the first embodiment, the data (image data and control signal) transferred between the information display device 10 and the mobile terminal device 20 is the driver app or the passenger app. If an identifier for discriminating between the two is attached, it is possible to have one communication path as shown in FIG. 10 and to transmit the data to the information display apparatus through the same communication path. When three or more indicators are connected to the mobile terminal device 20, the number of identifiers may be increased in accordance with the number.

  In addition, a plurality of communication paths may be established between the information display device 10 and the mobile terminal device 20, and the correspondence between each communication path and each display may be defined. For example, as shown in FIG. 11, the number of communication paths may be two, and one may be used for passing data for the driver application and the other may be used for passing data for the passenger application. In this case, since it is possible to distinguish whether the data is for the driver application or the passenger application from the communication path used for delivery, it is not necessary to attach an identifier to the data. The communication standards of the two communication paths may not be the same. For example, as shown in FIG. 12, one may be a communication path using USB, and the other may be a communication path using a wireless LAN (W-LAN). Further, when three or more displays are connected to the mobile terminal device 20, the number of communication paths may be increased according to the number.

  Further, when the information display device 10 can establish a plurality of communication paths, it simultaneously establishes a communication path with a plurality of mobile terminal devices and receives images of applications being executed from the respective mobile terminal devices. These images may be displayed separately on the driver side screen 14a and the passenger side screen 14b. For example, as shown in FIG. 13, there are two communication paths, the first communication path is used to link to the first mobile terminal device 20a, and the second communication path is used to link the second mobile terminal device 20b. You may link. Also in this case, the communication standards of the two communication paths may not be the same. For example, as shown in FIG. 14, one may be a communication path using USB, and the other may be a communication path using a wireless LAN.

  Even when the information display device 10 is linked to a plurality of portable terminal devices at the same time, the correspondence between each communication path and each display device may be defined. For example, in the configuration of FIG. 13 or FIG. 14, the application being executed on the first mobile terminal device 20a linked via the first communication path is displayed on the driver's seat side screen 14a as the driver application, and the second The application being executed on the second portable terminal device 20b linked via the communication path may be displayed on the passenger side screen 14b as a passenger application.

<Embodiment 5>
In the fifth embodiment, the driver application and the passenger application designation method for the application executed on the mobile terminal device 20, that is, the image of the application executed on the mobile terminal device 20 is displayed on the information display device 10. A variation of the method of designating which of the seat side screen 14a and the passenger side screen 14b is displayed will be described.

  Whether an application executed on the mobile terminal device 20 is a driver application or a passenger application may be set in advance for each application, or may be specified by the user when starting the application. May be. The designation by the user may be performed by the user using the touch panel device 15 on the information display device 10 side.

  The designation of the driver application or the passenger application for each application may be automatically performed based on a predetermined rule. For example, an application having an operation / display restriction function may be automatically designated as a driver application and displayed on the driver's seat screen 14a (display that requires operation / display restriction). Conversely, an image of an application that does not have an operation / display restriction function is automatically designated as a passenger application, and is displayed on the passenger side screen 14b (display that does not require operation / display restrictions). May be.

  Further, for example, the information display device 10 acquires information on the type of application being executed on the mobile terminal device 20, and automatically designates a driver application or a passenger application depending on the type. May be. For example, a navigation application that supports driving by the information display device 10 is designated as a driver application, and a video application (an image viewer or a video playback application) that requires operation and display restrictions while the vehicle is running is a passenger. It can be considered to be specified as an application for use.

  Furthermore, the information display device 10 may be configured to acquire information for specifying a driver application or a passenger application for each application from an external server (for example, an application provider server). In that case, the information display device 10 designates the driver application or the passenger application for each application being executed in the mobile terminal device 20 based on the information acquired from the server, and drives those images. The seat side screen 14a and the passenger seat side screen 14b can be sorted and displayed. Information for specifying the driver application or passenger application information includes information indicating the type of application, whether the application has an operation / display restriction function, and the type of display that displays the application image. For example, information for specifying (for driver seat, passenger seat, rear seat, etc.) may be considered.

  Further, depending on which display unit of the mobile terminal device 20 displays the application image, the driver application or the passenger application may be automatically specified. For example, in the case of the configuration shown in FIG. 1, the application displayed on the first screen 24a of the mobile terminal device 20 is automatically designated as the driver application, and the application displayed on the second screen 24b is automatically used for the passenger. You may make it designate as an application.

  In addition, for example, when the mobile terminal device 20 has a display unit that is always visible to the operator and a display unit that is not always visible, the application displayed on the display unit that is always visible is automatically set as a driver application. An application that is designated and displayed on a display unit that is not always visible may be automatically designated as a passenger application.

<Embodiment 6>
In the first embodiment, the application executed by the mobile terminal device 20 is any of an application having an operation / display restriction function, an application requiring an operation / display restriction, and an application not requiring an operation / display restriction. However, it may be changeable, for example, the user may arbitrarily set it.

  In addition, for example, when the mobile terminal device 20 has a display unit that is always visible to the operator and a display unit that is not always visible, the application displayed on the display unit that is always visible to the operator requires operation / display restrictions. The image may be transmitted to the information display device by assuming that the application is not to be performed (even if the application has an operation / display restriction function, the function is not exhibited).

  Further, the mobile terminal device 20 may set whether or not the application requires operation / display restriction based on the type of application. For example, a navigation application may be set as an application that does not require operation / display restrictions, and a video application (image viewer or video playback application) may be set as an application that requires operation / display restrictions.

<Embodiment 7>
In order to prevent driver distraction more reliably, the mobile terminal device 20 may limit an application that permits display on the driver's seat side screen 14a (display that requires operation / display limitation). For example, the information display device 10 determines whether or not each application being executed on the mobile terminal device 20 has an operation / display restriction function, and only the image of the application having the operation / display restriction function is displayed on the driver's seat side screen 14a. May be allowed to be displayed. In addition, display of an image of an application that does not have an operation / display restriction function on the driver's seat screen 14a may not be permitted. The display on the seat side screen 14a may not be permitted.

<Eighth embodiment>
In the first embodiment, the driver application operating on the mobile terminal device 20 is “an app having an operation / display restriction function”, “an app that requires operation / display restriction”, and “no operation / display restriction”. However, instead of this, for example, the degree of operation / display restriction (operation / display restriction level) required for each application may be defined. For example, the following levels can be considered.

・ Level 0: Permits operation only when parked (parking brake on) ・ Level 1: Permits operation only when parked or below a certain speed ・ Level 2: Restricted operation / display for general roads ・ Level 3: For expressways Operation / display restrictions ・ Level 10: No operation / display restrictions (apps that do not require operation / display restrictions)
The operation / display restriction level of each application is stored in the storage unit 22 as attached information of the application.

  In this case, the operation / display restriction information transmitted from the information display device 10 to the mobile terminal device 20 includes more detailed information on the vehicle state (such as parking brake on / off and the type of road that is running). Must be included. Based on the received operation / display restriction information, the control unit 21 of the mobile terminal device 20 performs the operation / display restriction on the content corresponding to the operation / display restriction level for the driver application.

  It should be noted that the present invention can be freely combined with each other within the scope of the invention, and each embodiment can be appropriately modified or omitted.

  Although the present invention has been described in detail, the above description is illustrative in all aspects, and the present invention is not limited thereto. It is understood that countless variations that are not illustrated can be envisaged without departing from the scope of the present invention.

  DESCRIPTION OF SYMBOLS 10 Information display apparatus, 11 Control part, 12 Storage part, 13a 1st image generation part, 13b 2nd image generation part, 14 Split view display apparatus, 14a 1st screen (driver's seat side screen), 14b 2nd screen (assistant) Seat side screen), 15 touch panel device, 16 communication unit, 17 interface unit, 18 in-vehicle LAN, 19 speaker, 20 mobile terminal device, 21 control unit, 22 storage unit, 23a first image generation unit, 23b second image generation unit 24 split view display section, 24a first screen, 24b second screen, 25 touch panel section, 26 communication section.

The information display device according to the present invention can display different images on a communication unit that communicates with an external mobile terminal device and a plurality of displays, and each application running on the mobile terminal device. A control unit that acquires images via a communication unit and distributes and displays the images on a plurality of display units. The plurality of display units include a display unit that requires operation / display limitation. The display that requires information is a display that provides information to the driver of the vehicle, and the control unit is an application that requires operation / display restrictions on images of multiple applications being executed on the mobile terminal device. It is determined whether or not to distribute to a plurality of displays .

Claims (17)

A communication unit that communicates with an external mobile terminal device;
Different images can be displayed on a plurality of display devices, and images of each application being executed on the mobile terminal device are acquired via the communication unit, and are distributed and displayed on the plurality of display devices. An information display device comprising: a control unit; The information display device according to claim 1, wherein the plurality of indicators include indicators that require operation / display restrictions. The information display device according to claim 2, wherein the display that requires operation / display restriction is a display that provides information to a driver of the vehicle. The control unit receives information designating a display for displaying an image of each application being executed on the mobile terminal device from the mobile terminal device, and based on the information, each control being executed on the mobile terminal device The information display apparatus according to claim 1, wherein an application image is distributed to the plurality of display devices. The control unit displays information indicating a type of each application being executed on the mobile terminal device, or information indicating whether each application being executed on the mobile terminal device has an operation / display restriction function. The information display device according to claim 2, wherein an image of each application received from the device and distributed on the mobile terminal device is distributed to the plurality of display devices based on the information. The control unit includes information indicating a type of each application being executed on the mobile terminal device, information on whether each application being executed on the mobile terminal device has an operation / display restriction function, or the mobile terminal device The information specifying the type of the display device that displays the image of each application being executed in is acquired from an external server, and the images of each application being executed on the portable terminal device are displayed on the basis of the information. The information display device according to claim 1, wherein the information display device is assigned to a container. The information display device according to claim 1, wherein a user can specify which of the plurality of display devices displays an image of each application being executed on the mobile terminal device. In response to a user operation based on an image of each application being executed on the mobile terminal device displayed on the plurality of display units, the control unit is configured to output a control signal for each application being executed on the mobile terminal device, The information display device according to claim 1, wherein the information display device transmits the information to the mobile terminal device. The information display device according to claim 2, wherein the control unit transmits a signal for controlling operation / display restriction of each application being executed on the mobile terminal device to the mobile terminal device. The control unit determines whether each application being executed on the mobile terminal device has an operation / display restriction function, and only requires an operation / display restriction for an image of the application having the operation / display restriction function. The information display device according to claim 2, wherein display on a display device is permitted. The control unit determines whether or not each application being executed on the mobile terminal device has an operation / display restriction function, and an image of an application that does not have or is not known to have an operation / display restriction function is The information display apparatus according to claim 2, wherein display on a display device that requires display restriction is not permitted. The information display device according to claim 2, wherein the control unit acquires information indicating a traveling state of a vehicle on which the information display device is mounted, and controls operation / display restriction of each display unit based on the information. The communication unit can establish a plurality of communication paths with the mobile terminal device,
The information display device according to claim 1, wherein a correspondence relationship between each of the plurality of communication paths and each of the plurality of indicators is defined. The communication unit can establish a plurality of communication paths with a single mobile terminal device, and receive images of each application being executed on the single mobile terminal device through individual communication paths. The information display device described. The information display device according to claim 1, wherein the control unit receives an image of each application being executed on the mobile terminal device through a single communication path. The information display device according to claim 1, wherein the communication unit can simultaneously establish communication paths with a plurality of portable terminal devices and can receive an image of an application being executed from each of the plurality of portable terminal devices. The plurality of indicators are composed of split view display devices,
The information display device according to claim 1, wherein the control unit causes an image of an application displayed on each screen of the split view display device of the mobile terminal device to be displayed on a split view display device as a display of the information display device. .

Images