JP2018042260A - Communication connection system and program for communication connection system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a communication connection system and a program for the communication connection system, capable of providing a user with a user interface according to configuration information when connecting a mobile communication terminal, an external display device, and an external input device, while the mobile communication terminal recognizes an optimal user interface by a combination of the external display device and the external input device.SOLUTION: In a smartphone 200 of a communication connection system 100, when an input signal is received from a keyboard 300, a transmitter unit 250 transmits a user interface type request signal to a display 400. A receiver unit 260 receives a user interface type configuration signal from the display 400. According to the user interface type configuration signal, a display control unit 270 selects an interface mode recorded in advance in the smartphone 200, to supply to a selected display 400 to display.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a communication connection system and a program for a communication connection system in an external display device, an external input device, and a mobile communication terminal.

  Conventionally, various research and development have been conducted on communication connection systems for portable communication terminals. For example, Patent Document 1 (Japanese Translation of PCT International Application No. 2012-517188) describes a TV-based advertisement and a TV widget for a mobile phone that are used by mobile phones and other devices to complement the enjoyment of television or other video media. Distribution is disclosed.

  The TV-based advertisement and the mobile phone TV widget described in Patent Document 1 (Japanese translations of PCT publication No. 2012-517188) are (a) displayed on a TV screen and content or interactivity related to a video program displayed on the screen. Indicating the user's interest in the software widget that provides the mobile phone using a mobile phone, and (b) transferring a version of the software widget to the mobile phone in response to the indicated interest. It is a feature.

Patent Document 2 (Japanese Patent Laid-Open No. 2009-016967) discloses an information processing apparatus and information capable of displaying a video obtained by reproducing content data received from an external device on a display device with a simple operation. A control method for a processing apparatus and a display system are disclosed.

  The information processing apparatus, the control method for the information processing apparatus, and the display system described in Patent Document 2 (Japanese Patent Application Laid-Open No. 2009-016967) have a first connection for outputting a video signal to the display apparatus and communicating the control signal with the display apparatus. Means, a second connection means different from the first connection means for receiving the content data reproduction request signal from the external terminal and receiving the content data, and reproduction of the content data stored in the external terminal Upon receipt of the request signal, an activation means for transmitting a control signal for activating the display device from the first connection means, and after the display device is activated by the activation means, the content data received by the second connection means from the external terminal is decoded. And decoding means for converting the output data from the first connecting means to output the video signal of the content data decoded by the decoding means. It is an butterfly.

  Patent Document 3 (Japanese Patent Application Laid-Open No. 2008-103868) discloses a mobile phone that allows remote control of an external receiving device and allows the user to check the contents of the data broadcast while viewing a television broadcast with the external receiving device. A terminal device and a program are disclosed.

  A portable terminal device and a program described in Patent Document 3 (Japanese Patent Laid-Open No. 2008-103868) are portable terminal devices having a broadcast receiving function for receiving and outputting a digital television broadcast in which a data broadcast is multiplexed. A remote control mode for remotely controlling an external receiving device that receives and outputs a broadcast, and when a channel selection instruction is given under the remote control mode, the selected channel is transmitted to the external receiving device. In addition, there is provided output control means for acquiring the data broadcast content of the selected channel from the broadcast receiving function and outputting the content on the mobile terminal side.

  Further, Patent Document 4 (Japanese Patent Laid-Open No. 2007-179210) makes it possible to easily switch a service provided on a system by linking a video display device and a portable terminal, and efficiently using information on the usage status thereof. In addition, a service providing system, an interactive display apparatus, and a service providing method that collect data in a form that maintains reliability and storage and perform pay-per-use according to the usage rate are disclosed.

  A service providing system, an interactive display device, and a service providing method described in Patent Document 4 (Japanese Patent Laid-Open No. 2007-179210) include a display for displaying a screen and a user in a service providing system that switches and provides a service provided to a user. Interactive display device that is an information providing device having an interactive function that operates in cooperation with a mobile phone, a PC, etc. of the user's hand, an application execution function that incorporates a plurality of applications when installed in advance, and the communication line with the interactive display device And a management server that manages applications executed on the interactive display device, and a memory card that records information about the applications to be executed. The play device provides a service by selecting, changing, and executing one of a plurality of applications according to information in the memory card when the memory card is inserted. When log information output by a running application is stored in a memory card or interactive display device with a predetermined weight, stored in the management server via the network, and stored in the management server via the network The network status is monitored, and all or part of log information or a hash value created from the log information is transmitted according to the status.

  Further, Patent Document 5 (Japanese Patent Application Laid-Open No. 2002-318755) discloses that information distribution data received by a mobile communication terminal from an information distribution source via a public communication line network is separated under an arbitrary separation condition and an arbitrary storage condition. The information distribution method using PDA and the information distribution proposal for storing the information distribution data to a plurality of display control devices via the information distribution network are disclosed.

  An information distribution method and information distribution system using a PDA described in Patent Document 5 (Japanese Patent Laid-Open No. 2002-318755) distributes distribution information data of distribution information such as personal calls from various information distribution apparatuses and various information services via a public communication line network. Data for performing an interface (hereinafter abbreviated as I / F) between a PDA and distribution information data with a portable communication terminal (hereinafter abbreviated as PDA) such as a personal call pocket terminal or a handheld terminal for personal information transmission I / F means, program distribution control means for creating distribution program data of a distribution program based on the distribution information data received by the data I / F means and storing it in a predetermined storage section, distribution information data and distribution program data Information receiving / distributing comprising data storing means for storing and communication control means for communicating and outputting distribution information data or distribution program data A terminal, an information distribution network for distributing distribution information data or distribution program data, a data transmission / reception means for performing communication connection control with the information distribution network, receiving distribution information data or distribution program data, and storing it in a predetermined location; An information distribution system comprising display control means for generating display program data based on distribution program data, data storage means for storing and storing distribution program data, and a display control apparatus having a display unit for displaying and outputting display program data The data I / F means of the information receiving / delivery terminal receives the delivery information data via the PDA, and the program delivery control means converts the received delivery information data into program information data for each program ID set and stored in advance. Separated distribution information data or separated program information data is stored and stored in the data storage means. And it is characterized in that the stored stored distribution information data or program information data to be distributed to a plurality of display control devices.

  In Patent Document 6 (Japanese Patent Application Laid-Open No. 2011-244438), in a portable information processing apparatus including a touch panel means, an input screen and a display screen having a sufficiently large size and screen resolution are ensured. Portable information processing apparatus provided with touch panel means described above, which is realized by adding interface means with an external device and adding some functions to the originally provided signal processing control means, and the portable information processing apparatus An information processing apparatus program is disclosed.

  A portable information processing apparatus having touch panel means described in Patent Document 6 (Japanese Patent Application Laid-Open No. 2011-244438) includes a display function for displaying an image on the screen based on a digital display signal received from the signal processing control means, and Input that detects manual operation such as contact, pressing, shielding of incident light, etc., generates a “signal corresponding to the manual operation” (hereinafter abbreviated as “manual operation signal”), and transmits it to the signal processing control means Touch panel means having a function; storage means for storing a program for operating the data processing means; and converting a manual operation signal received from the touch panel means into data, and digitally based on the data and the program stored in the storage means Signal processing for generating a display signal and transmitting it to the touch panel means and / or the external output interface means A control means; and an external device comprising the display means or connecting the display means is connected, and an external display signal is transmitted to the external device based on the digital display signal received from the signal processing control means The signal processing control means converts the manual operation signal received from the touch panel means into data and generates a single digital display signal and transmits it only to the touch panel means. Control mode 1; manual operation signal received from the touch panel means is converted into data in a manner different from control mode 1, two digital display signals are generated, one is sent to the touch panel means, and the other is externally output Selectively realizing control mode 2 for transmitting to the interface means; It is.

Special table 2012-517188 gazette JP 2009-016967 A JP 2008-103868 A JP 2007-179210 A JP 2002-318755 A JP 2011-244438 A

  The distribution of the TV-based advertisement and the TV widget for mobile phones described in Patent Document 1 is provided so as to show interest in the content on the TV screen using the mobile phone. The information processing apparatus, the control method for the information processing apparatus, and the display system described in Patent Document 2 activate the display device and output the decoded content data to the display device when receiving a reproduction request signal for content data from a mobile phone. It is something to be made.

  In the portable terminal device and program described in Patent Document 3, an external receiver is remotely controlled by a portable communication terminal while viewing a television broadcast.

  In addition, the service providing system, interactive display apparatus, and service providing method described in Patent Document 4 can easily switch the service provided on the system by linking the video display apparatus and the mobile terminal.

  In addition, the information distribution method and information distribution system using PDA described in Patent Document 5 are (1) widely used in a large number of display control devices installed in a wide area using a relatively simple communication terminal such as a PDA. (2) Combining a plurality of program information, creating new program information and distributing it to a plurality of arbitrary display control devices, (3) Personal like PDA Broadcast information such as broadcasting can be delivered using the media.

  Finally, in the portable information processing apparatus including the touch panel means described in Patent Document 6, the portable information processing apparatus can transmit a display signal to the external display and display the display signal in accordance with the resolution of the display.

  However, although there is disclosure about connecting a mobile communication terminal to an external display device (external reception device, video display device, television screen, etc.), the output of the mobile communication terminal is simply displayed on the external display device. is there. That is, the user interface displayed on the external display device, that is, a so-called GUI (Graphical User Interface) type and layout is not changed in accordance with the configuration of the combination of the external input device and the external display device.

  For example, as a result of combining an external input device and an external display device, the optimum user interface is possible depending on the difference in configuration such as touch input corresponding to a tablet terminal or not corresponding to a laptop computer, for example. Is different.

  That is, when the combination of the external input device and the external display device does not support touch input, processing is performed with small pictures and symbols such as Windows XP (registered trademark) or Windows 7 (registered trademark) suitable for mouse operation. User interface lined up with icons representing the contents or objects of the user interface, which is easy for the user to operate and supports touch input, a user interface with large tile-shaped buttons that can be operated with a finger, such as Windows 8 (registered trademark) Is easy for the user to operate.

  Furthermore, even if the mobile communication terminal and the external display device are connected, it is necessary to operate from the mobile communication terminal, power consumption becomes severe, and it is difficult to maintain high operability for a long time.

  An object of the present invention is to recognize the optimal user interface by a combination of an external display device and an external input device when the mobile communication terminal, the external display device, and the external input device are connected, and to configure the configuration information thereof. It is to provide a communication connection system and a program for the communication connection system that can provide a user interface corresponding to the user.

(1)
A communication connection system according to one aspect includes an external display device, an external input device, an external display connection unit that outputs a display signal to the external display device, and a mobile communication terminal that has an external input connection unit connectable to the external input device. The mobile communication terminal receives an input signal from the external input device, thereby transmitting a user interface type request signal to the external input device, and a user interface type configuration signal from the external input device And a display control unit that selects a user interface pre-recorded in the mobile communication terminal according to the user interface type configuration signal and supplies the selected user interface image to an external display device for display. , Has.

A communication connection system according to the present invention includes an external display device, an external input device, an external display connection unit that outputs a display signal to the external display device, and an external input connection unit that can be connected to the external input device. And including.
In addition, the mobile communication terminal receives an input signal from the external input device through the external input connection unit, thereby transmitting a user interface type request signal to the external display device. The receiving unit receives a user interface type configuration signal from the external display device. The display control unit selects a user interface recorded in advance in the mobile communication terminal according to the user interface type configuration signal, and supplies the selected user interface image to the external display device for display.

In this case, it is possible to easily connect the mobile communication terminal, the external input device, and the external display device by selecting an optimal user interface.
That is, an optimal user interface can be displayed on the external display device according to the configuration of the combination of the external input device and the external display device. For example, a user interface such as Windows XP (registered trademark), Windows 7 (registered trademark), Windows 8 (registered trademark), or MAC (registered trademark) can be selected and displayed according to the configuration.

As a result, the mobile communication terminal can be operated by the external input device, and a user interface corresponding to the configuration of the combination of the external input device and the external display device can be displayed on the external display device from the mobile communication terminal. Therefore, the versatility of the mobile communication terminal can be further improved.
In addition, since an external input device can be used, an input operation can be easily performed for a long time.

(2)
A communication connection system according to a second invention is a communication connection system according to one aspect, wherein the external display device includes a display unit, the external input device includes an operation unit, and the operation unit and the display unit are provided integrally. Any of a touch panel type, a separable type in which the operation unit and the display unit are detachable, and a separation type in which the operation unit and the display unit are separately provided may be used.

  In this case, in any of the touch panel type in which the external display device and the external input device are integrated, the external display device and the external input device are separable, and the external display device and the external input device are separately provided. A user interface corresponding to the configuration of the combination of the external input device and the external display device can be displayed on the external display device.

(3)
A communication connection system according to a third aspect is a communication connection system according to one aspect, wherein at least one of the external input device and the external display device includes at least an operation unit and a display unit, and the operation unit and the display unit are provided integrally. Any of a touch panel type, a separable type in which the operation unit and the display unit are detachable, and a separation type in which the operation unit and the display unit are separately provided may be used.

In this case, a touch panel type in which the operation unit and the display unit are integrally provided, a separable type in which the operation unit and the display unit are detachable, and a separation type in which the operation unit and the display unit are provided separately. In any case, a user interface corresponding to the configuration of the combination of the external input device and the external display device can be displayed on the external display device.
Specifically, an external input device or an external display device in which an operation unit and a display unit are integrally provided, an external input device or an external display device in which an operation unit and a display unit are detachably provided, an operation unit and a display unit Is an external input device or an external display device provided separately.

(4)
A communication connection system according to a fourth aspect is the communication connection system according to one aspect or the second and third aspects, wherein the mobile communication terminal is configured to transmit, receive, and transmit according to the external display connection unit and the external input connection unit. And the display control unit may be automatically operated.

In this case, the mobile communication terminal automatically recognizes the external display connection unit and the external input connection unit, and operates with the transmission unit, the reception unit, and the display control unit being driven. As a result, a user interface type request signal is automatically transmitted from the transmission unit, a user interface pre-recorded in the mobile communication terminal is selected from the reception unit according to the user interface type configuration signal, and external display is performed by the display control unit Displayed on the device.
That is, it can be automatically displayed on the external display device.

(5)
A communication connection system according to a fifth aspect of the present invention is the communication connection system according to one aspect or the second and third aspects of the present invention, and has a selection unit that can select one operation mode from among the user interface types. Also good.

In this case, the selection unit can select one operation mode from the user interface types.
For example, regardless of the configuration of the combination of the external input device and the external display device, it can be displayed on the external display device in an operation mode by a predetermined user interface.
Specifically, the smartphone 200 is provided with a switch that can select “Auto” and “fixed”, and when the switch is set to “Auto”, the user interface is changed depending on the combination of the external input device and the external display device. When selected and set to “fixed”, the operation mode can be set to the user interface set in advance regardless of the configuration of the combination of the external input device and the external display device.
The switch may be a button switch, a slide switch, a dial switch, or the like, or may be a switch having a physical shape, and is realized by software that displays the switch on the touch panel screen of the smartphone 200. May be.

(6)
A communication connection system according to a sixth aspect is the communication connection system according to one aspect to the fifth aspect, wherein the external input device has a power control unit, and the power control unit is connected to the mobile communication terminal and the external display device. Control of power supply may be performed.

  In this case, the communication connection system can be charged from the power supply control unit of the external input device when the mobile communication terminal or the external display device is no longer charged.

(7)
A program for a communication connection system according to another aspect includes an external display device, an external input device, an external display connection unit that outputs a display signal to the external display device, and a portable communication having an external input connection unit that can be connected to the external input device A communication connection system program used for a terminal, wherein the mobile communication terminal receives an input signal from the external input device, thereby transmitting a user interface type request signal to the external input device, and an external input A receiving process for receiving a user interface type configuration signal from the device, and a user interface pre-recorded in the mobile communication terminal according to the user interface type configuration signal is selected, and the selected user interface image is supplied to the external display device Display control processing to be displayed.

A communication connection system program according to the present invention includes an external display device, an external input device, an external display connection unit that outputs a display signal to the external display device, and a portable communication terminal having an external input connection unit that can be connected to the external input device. It is a program of the communication connection system used for.
In addition, the mobile communication terminal receives the input signal from the external input device through the transmission process, thereby transmitting a user interface type request signal to the external input device. The user interface type configuration signal from the external input device is received by the reception process. A user interface recorded in advance in the mobile communication terminal is selected according to the user interface type configuration signal by the display control process, and the selected user interface image is supplied to the external display device for display.

In this case, it is possible to easily connect the mobile communication terminal, the external input device, and the external display device by selecting an optimal user interface.
That is, display can be performed according to the interface type of the external input device and the external display device.
As a result, the mobile communication terminal can be operated with the external input device, and a user interface corresponding to the configuration of the combination of the external input device and the external display device can be displayed on the external display device from the mobile communication terminal. Therefore, the versatility of the mobile communication terminal can be further improved.

It is a mimetic diagram for explaining an example of a communication connection system concerning a 1st embodiment. It is a schematic diagram which shows an example of the internal structure of a communication connection system. It is a flowchart which shows an example of the connection of a communication connection system. It is a schematic diagram which shows the other example of an internal structure of a communication connection system. It is a schematic diagram for demonstrating an example of the communication connection system concerning 2nd Embodiment. It is a flowchart which shows an example of the connection of the communication connection system concerning 2nd Embodiment. It is a schematic diagram for demonstrating an example of the communication connection system concerning 3rd Embodiment. It is a schematic diagram for demonstrating an example of the communication connection system concerning 4th Embodiment. It is a schematic diagram for demonstrating an example of the communication connection system concerning 5th Embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

(First embodiment)
FIG. 1 is a schematic diagram for explaining an example of the communication connection system 100 according to the first embodiment, and FIG. 2 is a schematic diagram showing an example of an internal configuration of the communication connection system 100. These are flowcharts which show an example of the connection of the communication connection system 100.

  As illustrated in FIGS. 1 and 2, the communication connection system 100 includes a smartphone 200, a keyboard 300, a mouse 390, and a display 400.

(display)
The display 400 shown in FIG. 1 and FIG. 2 has an interface of HDMI (High Definition Multimedia Interface) (registered trademark), and includes a memory (EDID (Extended display identification data) 410).

(keyboard)
1 and 2 includes a battery 310, a power control unit 320, an HDMI to MHL conversion unit 330, a device control unit 340, and an internal function 350.
Instead of the battery 310, one or more devices among an AC adapter, a built-in power supply, a battery, and a rechargeable battery may be provided.

(smartphone)
Next, the smartphone 200 illustrated in FIGS. 1 and 2 includes an external input connection unit 230, an external display connection unit 240, and a display control unit 270. The external input connection unit 230 includes a transmission unit 250 and a reception unit 260 inside.

  As will be described later, the external input connection unit 230 is connected to a keyboard 300 which is an external input device, and the external display connection unit 240 is connected to the display 400 which is an external display device or to the display 400 via the keyboard 300. The connection is made.

In the above case, the external input connection unit 230 and the external display connection unit 240 may be wired or may be configured to be wirelessly connectable.
The transmitting unit 250 and the receiving unit 260 transmit and receive a configuration confirmation signal that is a user interface type configuration signal indicating a user interface type and a request confirmation signal that is a user interface type request signal.

  The display control unit 270 includes modes such as a Windows 7 (registered trademark) mode, a Windows 8 (registered trademark) mode, and a MAC (registered trademark) mode of the user interface. Each of these modes has a user interface corresponding to configuration information by a combination of the display 400 and the keyboard 300, such as a user interface in which large tile-shaped buttons suitable for touch input are arranged and a user interface in which small icons suitable for mouse input are arranged. It is.

(mouse)
Next, the mouse 390 according to the present embodiment is provided so as to be connectable to the device control unit 340 of the keyboard 300. The connection may be a wired connection or a configuration capable of wireless connection. Further, the mouse 390 is not essential, and may include any other device and may not be provided.

(Overview of connection)
First, as shown in FIGS. 1 and 2, a connection is made from the keyboard 300 to the display 400 using a communication line. That is, using this communication line, information for displaying the image signal of the user interface on the display 400 is transmitted and received from the smartphone 200 to the display 400 via the keyboard 300.

  The smartphone 200 acquires screen mode information that the display 400 can display, such as unique information of the display 400 or the resolution and refresh rate of the screen, using a communication line.

Specifically, for example, the EDID recorded in the memory 410 in the display 400 is acquired using a DDC (Display Data Channel) defined by VESA.
The smartphone 200 performs display settings on the external display connection unit 240 in accordance with the screen mode of the display 400 with the screen mode that the smartphone 200 can support as an upper limit.

  When transmitting / receiving each information from the smartphone 200 to the display 400 via the keyboard 300, a function of mutually converting the interface supported by the external display connection unit 240 of the smartphone 200 and the interface on the display 400 side so as to be connectable May be provided to the keyboard 300.

  Specifically, as shown in FIG. 2, the keyboard 300 uses an HDMI to MHL conversion unit 330 to transmit an image signal so that the external display connection unit 240 of the smartphone 200 performs MHL (Mobile High-Definition Link, Mobile High-definition). If the interface is a Link) interface, the MHL interface is converted into an HDMI (registered trademark) interface using the keyboard 300 and transmitted to the display 400. Here, the HDMI to MHL conversion unit 330 can convert HDMI (registered trademark) to MHL, and can convert MHL to HDMI (registered trademark).

When the external display connection unit 240 of the smartphone 200 is an HDMI (registered trademark) interface, the keyboard 300 uses the HDMI to MHL conversion unit 330 to transmit the signal from the external display connection unit 240 of the smartphone 200 to the HDMI to MHL. A configuration in which the data is transmitted to the display 400 via the conversion unit 330 may be used.
In this case, the HDMI to MHL conversion unit 330 exchanges HDMI (registered trademark) signals between the external display connection unit 240 of the smartphone 200 and the display 400.

  In this embodiment, a wired connection such as HDMI (registered trademark) is used between the display 400 and the keyboard 300. However, the present invention is not limited to this, and image data is transmitted using a wireless connection, for example, a wireless LAN. Any connection such as a wireless connection to transmit or wireless HDMI may be used.

  Moreover, as shown in FIG. 1 and FIG. 2, the keyboard 300 and the smart phone 200 are connected. In this case, for example, when the connection between the smartphone 200 and the keyboard 300 is a wireless connection, for example, Bluetooth (registered trademark), the smartphone 200 is used to connect to the keyboard 300 via the short-range wireless communication (NFC) to the keyboard 300 (registered trademark). Authentication information for connection is acquired, and connection is made using Bluetooth (registered trademark).

  As a result, the smartphone 200 recognizes the keyboard 300 as a Bluetooth (registered trademark) keyboard connected to itself, sets it to be usable as an external input device, and operates the user interface displayed on the display 400 by the input from the keyboard 300. Set as possible. Note that the software program that is set to be operable may be installed in advance in the smartphone 200 as a device driver. Of course, if the keyboard 300 is compatible with wireless communication other than Bluetooth (registered trademark), for example, wireless LAN, authentication information for the wireless communication may also be acquired.

  In this embodiment, authentication and connection by NFC have been described. However, the present invention is not limited to this. For example, when the keyboard 300 has the HDMI to MHL conversion unit 330, the smartphone 200 and the keyboard 300 use MHL. When the external display connection unit 240 of the smartphone 200 and the HDMI to MHL conversion unit 330 of the keyboard 300 are connected by the interface, an MHL RCP command is transmitted between the external display connection unit 240 of the smartphone 200 and the HDMI to MHL conversion unit 330 of the keyboard 300. The authentication information may be passed by using.

  Note that whether the smartphone 200 is connected to the keyboard 300 via the MHL interface is, for example, in the case of wired connection, whether the connector is physically connected to the keyboard 300 or the signal level of the MHL interface. In the case of wireless connection, it may be determined by whether or not a link is established.

  In addition, the smartphone 200 may acquire authentication information by capturing an image of a QR code (registered trademark) attached to or attached to the keyboard 300, or may use HDMI-CEC.

For example, when the smartphone 200 and the keyboard 300 are connected by the HDMI (registered trademark) interface by the HDMI to MHL conversion unit 330 included in the keyboard 300, the external display connection unit 240 of the smartphone 200 and the HDMI to MHL conversion unit 330 of the keyboard 300 Authentication information can be exchanged using a CEC command between them, and the authentication process can be automatically completed.
In this case, the external display connection unit 240 of the smartphone 200 is an HDMI (registered trademark) interface, and the HDMI to MHL conversion unit 330 transmits an HDMI (registered trademark) signal between the external display connection unit 240 of the smartphone 200 and the display 400. It will be handed over to each other.

In the present embodiment, Bluetooth (registered trademark), which is an interface different from the interface used to transmit an image to the display 400, is used as an interface for connecting the keyboard 300 as an external input device of the smartphone 200. However, an interface used for image transmission may be used.
For example, the HDMI to MHL conversion unit 330 included in the keyboard 300 can recognize the keyboard 300 as an external input device of the smartphone 200 using the MHL interface between the smartphone 200 and the keyboard 300.

  Moreover, since the MHL interface that can be used for image transmission can transmit Unicode characters, it can be used as an interface for an external input device. In this case, authentication for connecting the keyboard 300 and the smartphone 200 is not necessary, and it is not necessary to connect the keyboard 300 to the Bluetooth (registered trademark), so that the power consumption of the smartphone 200 can be reduced.

  In this embodiment, as will be described later, after the smartphone 200, the keyboard 300, and the display 400 are connected, the smartphone 200 operates as a wireless LAN access point and operates via the smartphone 200 as a 3G line, LTE, or the like. It can be connected to the Internet using a so-called tethering mode.

(Specific connection operation)
Next, a specific operation in the communication connection system 100 will be described with reference to FIGS. 2 and 3.

  As shown in FIGS. 2 and 3, the application software program 210 in the display control unit 270 of the smartphone 200 is activated by a signal from the keyboard 300 or an operation of the smartphone 200 itself (step S1).

  When the application software program 210 is activated, the transmission unit 250 of the external input connection unit 230 of the smartphone 200 is instructed to transmit a user interface type request signal to the keyboard 300 (step S2).

  The keyboard 300 confirms whether or not the display 400 is connected to the keyboard 300, and adds connection presence / absence information of the display 400 to the user interface type request signal according to the user interface type request signal (step S3).

  Whether the display 400 is connected is determined, for example, when the communication line is wired, based on whether the communication line is physically connected to the keyboard 300 or the signal level of the communication line. Alternatively, in the case of a wireless connection, the determination may be made based on whether or not a link is established.

  Subsequently, the keyboard 300 further adds its own system information to the user interface type request signal and transmits it to the smartphone 200 as a user interface type configuration signal (step S4).

  Here, specifically, the system information is information indicating what functions the keyboard 300 can provide to the smartphone 200 as an external input device. For example, the keyboard, mouse, trackball, electrostatic Information such as capacitive touchpads and their combined devices. The smartphone 200 sets the keyboard 300 to be usable as its own external input device based on the information.

When the keyboard 300 determines that the display 400 is not connected to the keyboard 300, the keyboard 300 adds the fact that the display 400 is not connected to the user interface type request signal and transmits the user interface type configuration signal to the smartphone 200.
In such a case, since the smartphone 200 can recognize that the display 400 does not exist and can output a user interface image from the external display connection unit 240, the power consumed by the smartphone 200 can be saved.

  The smartphone 200 recognizes the system information and the user interface type configuration signal (step S5). In the communication connection system 100 according to the first embodiment, a display 400, a keyboard 300, and a mouse 390 are connected, and the display 400 does not particularly have an input unit. Therefore, the user interface has Windows 7 (registered trademark) in which small icons are arranged. ) Set as mode.

  Therefore, in the case of the communication connection system 100 illustrated in FIG. 1, the display control unit 270 of the smartphone 200 determines that the mode is, for example, the Windows 7 (registered trademark) mode and can display on the display 400 in the Windows 7 (registered trademark) mode. Set as the correct state.

  The smartphone 200 converts the video and sound signals in accordance with the user interface (step S6) and performs settings so that the input signal can be operated according to the system information of the keyboard 300 (step S7).

  Specifically, the video signal is displayed on the display 400 from the external display connection unit 240 according to the user interface, and the audio signal is adjusted from the external display connection unit 240 according to the sound card incorporated in the display 400. Output.

  In this embodiment, the case where the display 400 includes a speaker is described, but the keyboard 300 may include a speaker. For example, when the connection between the external input connection unit 230 of the smartphone 200 and the keyboard 300 is a connection using Bluetooth (registered trademark), the keyboard 300 provides the smartphone 200 with a function as a Bluetooth (registered trademark) connection speaker. You may comprise.

  In addition, the smartphone 200 recognizes its remaining battery level, and if it is determined that the smartphone 200 is insufficient, the smartphone 200 performs charging from the battery 310 built in the keyboard 300 (step S8). In this case, electricity can be supplied from the battery 310 to the smartphone 200 using, for example, an MHL MicroUSB power line.

  The smartphone 200 operates in the tethering mode (step S9), sets the external input connection unit 230 to receive a signal from the keyboard 300, and waits (step S10).

  As a result, by operating the keyboard 300, the smartphone 200 can be operated indirectly. Therefore, by operating the keyboard 300, the video and sound signals recorded on the smartphone 200 can be converted and displayed on the display 400.

For example, by operating the keyboard 300, the display 400 can be turned on and off, and playback stop or recording can be operated.
That is, arbitrary operations such as one-touch record, system standby, timer programming, and preset download can be performed.

  In this embodiment, the smartphone 200, the keyboard 300, and the display 400 are connected to determine the user interface according to the configuration of the combination of the keyboard 300 and the display 400, and the smartphone 200 automatically starts the tethering mode. However, the smartphone 200 may also be an auxiliary input device such as an application for providing a calendar function to the user on the touch input display screen of the smartphone 200 or a numeric keypad screen specialized for numeric input. For example, an arbitrary application may be automatically started in accordance with a combination of the keyboard 300 and the display 400, such as starting an application that functions as

  That is, the user can realize a comfortable input / output environment including image display such as a user interface with the keyboard 300 and the display 400 with the smartphone 200 as the center, and the tethering function of the smartphone 200 allows wireless connection with other network devices and the Internet. Access is possible, and user convenience is increased by automatically starting an arbitrary application.

  When the display 400 is not HDMI (registered trademark) but MHL, the smartphone 400 is displayed by directly connecting the smartphone 200 to the display 400 without using the HDMI to MHL conversion unit 330 to convert video and sound signals. be able to.

  In the present embodiment, when the smartphone 200, the keyboard 300, and the display 400 are connected, the user interface is determined according to the configuration of the combination of the keyboard 300 and the display 400. However, the present invention is not limited to this. Alternatively, an optimal user interface may be selected by switching the OS that runs on the smartphone 200. For example, a virtual PC (so-called virtual PC) is created on an OS that operates on the smartphone 200, another OS is operated in the created virtual PC, and a user interface of the other OS is displayed on the display 400. Also good.

FIG. 4 is a schematic diagram illustrating another example of the communication connection system 100 according to the first embodiment.
As shown in FIG. 4, when the display 400 includes the touch panel control unit 420, the mouse 390 of FIG. In the case of FIG. 4 as well, a mouse 390 may be provided.

  In the display 400 shown in FIG. 4, the touch panel control unit 420 is connected to the device control unit 340 through a USB interface.

(Second Embodiment)
FIG. 5 is a schematic diagram for explaining an example of the communication connection system 100a according to the second embodiment. FIG. 6 is a flowchart illustrating an example of the communication connection system 100a according to the second embodiment. is there.

  In the second embodiment, only differences from the first embodiment will be described, and description of the same parts will be omitted.

  As illustrated in FIG. 5, the communication connection system 100 a according to the second embodiment includes a smartphone 200 and a touch panel display 500.

  A touch panel display 500 shown in FIG. 5 is composed of a tablet terminal. In the touch panel display 500, a display capable of reproducing video as a display unit and a touch panel having operability as an operation unit are integrally formed.

  Note that the touch panel display 500 does not necessarily have a high-performance CPU (Central Processing Unit) and an OS (Operating System), and may simply have a shape like a tablet terminal. In other words, the smartphone 200 plays the role of a high-performance CPU and OS.

  The touch panel display 500 shown in FIG. 5 is made of MHL. That is, the connection between the smartphone 200 and the display unit of the touch panel display 500 is connected through the MHL interface.

  The smartphone 200 obtains authentication information through short-range wireless communication (NFC) with the operation unit of the touch panel display 500, and makes a connection using Bluetooth (registered trademark).

  Similarly to the first embodiment, also in the second embodiment, the smartphone 200 may pass authentication information using the MCP RCP command. In addition, the smartphone 200 may use a QR code (registered trademark), or may use HDMI-CEC (High-Definition Multimedia Interface-Consumer Electronics Control).

Subsequently, as shown in FIG. 6, the application software program 210 recorded on the smartphone 200 is activated by a signal from the touch panel display 500 or an operation of the smartphone 200 itself (step S11).
When the application software program 210 is activated, the user interface type request signal is instructed to be transmitted from the external input connection unit 230 of the smartphone 200 to the touch panel display 500 via the transmission unit 250 (step S12).
In response to the user interface type request signal, the touch panel display 500 adds a signal indicating that it has its own system information and display unit to the user interface type request signal and transmits it as a user interface type configuration signal (step S13). .

  The smartphone 200 recognizes the system information and the user interface type configuration signal (step S15). In the case of the communication connection system 100a illustrated in FIG. 5, the smartphone 200 is a user interface in which tile-type buttons suitable for the touch panel display 500 are arranged as a user interface image displayed on the display unit of the touch panel display 500, for example. The setting is performed as the Windows 8 (registered trademark) mode.

Here, the Windows 8 (registered trademark) mode is used, but the present invention is not limited to this, and the Windows 7 (registered trademark) mode may be selected.
The smartphone 200 converts the video and sound signals according to the system information and the user interface (step S16).

  In addition, the smartphone 200 performs setting so that an input signal can be operated according to the system information of the touch panel display 500 (step S17).

  Specifically, the video signal is displayed on the display unit of the touch panel display 500 from the external display connection unit 240 according to the user interface, and the audio is displayed on the external display connection unit according to the sound card built in the touch panel display 500. The audio signal is adjusted from 240 and output.

  If the smartphone 200 recognizes its remaining battery level and determines that it is insufficient, the smartphone 200 performs charging from the battery 310 (see FIG. 1 or 2) built in the touch panel display 500 (step S18). In this case, electricity can be supplied from the battery 310 (see FIG. 1) to the smartphone 200 using, for example, the MHL MicroUSB power line.

  In addition, the smartphone 200 operates as a wireless LAN access point and operates in a so-called tethering mode that can be connected to the Internet line using the 3G line, LTE, or the like via the smartphone 200 (step S19). The external input connection unit 230 is set so as to receive a signal from the display 500 and waits (step S20).

  As a result, by operating the touch panel of the touch panel display 500, the smartphone 200 can be operated indirectly. Therefore, it is possible to operate the touch panel, convert the video and sound signals of the smartphone 200, and display and reproduce them on the touch panel display 500.

For example, by operating the touch panel display 500, the smartphone 200 can be turned on / off, and playback stop or recording can be operated.
That is, arbitrary operations such as one-touch record, system standby, timer programming, and preset download can be performed.

  In this embodiment, the smartphone 200 and the touch panel display 500 are connected, and the user interface is determined according to the combination of the operation unit and the display unit of the touch panel display 500, and the smartphone 200 automatically starts the tethering mode. In addition to this, for example, the smartphone 200 may be an auxiliary device such as an application for providing a calendar function to the user on the touch input display screen of the smartphone 200 or a numeric keypad screen specialized for numeric input. A configuration that automatically activates an arbitrary application in accordance with a configuration of a combination of an operation unit and a display unit of the touch panel display 500, such as starting an application that functions as a typical input device It may be.

  That is, the user can realize a comfortable input / output environment including image display such as a user interface with the touch panel display 500 centering on the smartphone 200, and the tethering function of the smartphone 200 allows wireless connection or Internet access with other network devices. In addition, user convenience is increased by automatically starting an arbitrary application.

When the external display connection unit 240 of the smartphone 200 is an MHL interface and the touch panel display 500 is not MHL but HDMI (registered trademark), video and sound signals are transferred from the MHL interface to the HDMI (registered trademark) interface. Need to convert.
Therefore, it is desirable that it is the same as the user interface of the touch panel display 500 connected to the external display connection unit 240 of the smartphone 200. Alternatively, it is desirable to include a conversion unit that can be connected to the external display connection unit 240 of the smartphone 200.

(Third embodiment)
The third embodiment will be described below. In the third embodiment, only differences from the first or second embodiment will be described, and description of the same parts will be omitted.

  FIG. 7 is a schematic diagram for explaining an example of the communication connection system 100b according to the third embodiment.

As illustrated in FIG. 7, the communication connection system 100 b includes a smartphone 200 and a notebook computer 600.
Note that the notebook personal computer 600 does not necessarily have a high-performance CPU and OS, and may simply have a shape like a notebook personal computer. In other words, the smartphone 200 plays the role of a high-performance CPU and OS, and as shown in FIG. 7, the operation unit and the display unit are detachable, and the operation unit and the display unit are separated. Including the separation type provided.

A notebook computer 600 shown in FIG. 7 has a touch panel display screen. Moreover, the touch panel display screen and the input part of the keyboard are detachably provided.
The smartphone 200 acquires the other authentication information by the near field communication (NFC) with the notebook computer 600 and performs connection by Bluetooth (registered trademark).

  In the third embodiment, the same processing as the flowchart of the communication connection system 100a according to the second embodiment is performed. Instead of the touch panel display 500, a notebook computer 600 is used.

  In this embodiment, since it is a display screen of a touch panel, Windows 8 (registered trademark) is set. However, the present invention is not limited to this, and Windows 7 (registered trademark) may be set. Arbitrary settings may be made.

  Furthermore, in the present embodiment, the notebook computer 600 is used, but the present invention is not limited to this, and an optional device such as a wired or wireless mouse, microphone, headphones, webcam, etc. is further added and connected. Also good.

(Fourth embodiment)
FIG. 8 is a schematic diagram for explaining an example of the communication connection system 100c according to the fourth embodiment. Similarly, in the fourth embodiment, only differences from the communication connection systems 100, 100a, 100b of the first to third embodiments will be described, and description of the same parts will be omitted.

  As illustrated in FIG. 8, the communication connection system 100 c according to the fourth embodiment includes a smartphone 200 and a keyboard 300. That is, the display 400 and the mouse 390 of the communication connection system 100 according to the first embodiment are removed.

  The smartphone 200 acquires the other authentication information by the near field communication (NFC) with the keyboard 300, and performs connection by Bluetooth (registered trademark).

  Similar to the first to third embodiments, also in the fourth embodiment, the smartphone 200 uses the MCP (Mobile High-Definition Link) RCP command for authentication information. May be delivered. The smartphone 200 may use a QR code (registered trademark) or may use HDMI-CEC.

  The communication connection system 100c in the fourth embodiment performs the same operation as the flowchart in FIG.

  As a result, by operating the keyboard 300, the smartphone 200 can be operated indirectly. Therefore, the smartphone 300 can be operated by operating the keyboard 300.

  As described above, in the individual communication connection systems 100, 100a, 100b, and 100c of the first to fourth embodiments, the smartphone 200, the keyboard 300 and the display 400, the smartphone 200, the touch panel display 500, the smartphone 200, and The notebook computer 600, the smartphone 200, and the keyboard 300 can be easily connected.

  That is, the mode can be selected and displayed according to the user interface type that can be used on the keyboard 300, the display 400, the touch panel display 500, and the notebook computer 600.

  In the first to fourth embodiments, the Windows 8 (registered trademark) mode or the Windows 7 (registered trademark) mode is automatically selected. However, the present invention is not limited to this. It may be selected by any other method.

  As a result, the operation of the smartphone 200 can be performed using any one of the keyboard 300, the touch panel display 500, and the notebook computer 600, and the display of the smartphone 200 is performed on each of the display 400, the touch panel display 500, and the notebook computer 600. Since it can be displayed with the optimal user interface according to the configuration information, it is not necessary to visually recognize the small display unit of the smartphone 200. Therefore, the versatility of the smartphone 200 can be further improved.

  Furthermore, since input can be performed with the keyboard 300 or the like, it is possible to prevent a decrease in operability even for a long time or a long sentence.

  Further, according to the connection status of the external input connection unit 230 and the external display connection unit 240, a user interface request signal is automatically transmitted from the transmission unit 250, a user interface configuration signal is received by the reception unit 260, and the smartphone 200 A user interface recorded in advance in the display control unit 270 is selected, and can be automatically displayed on the display 400 from the display control unit 270.

  The communication connection systems 100, 100a, 100b, and 100c can be charged from the battery 310 of the keyboard 300 when the power of the smartphone 200 or the display 400 is reduced or lost.

(Fifth embodiment)
FIG. 9 is a schematic diagram illustrating an example of a communication connection system 100d according to the fifth embodiment.

As shown in FIG. 9, the keyboard 300 of the communication connection system 100d according to the fifth embodiment may be configured to be able to connect other input / output devices.
In that case, the device connected to the keyboard 300 is connected to the smartphone 200 via the keyboard 300.

  As shown in FIG. 9, specifically, the connection between the keyboard 300 and the external input connection unit 230 of the smartphone 200 is a Bluetooth (registered trademark) interface, and has a USB interface for connecting other input / output devices, When a USB mouse is connected to the USB interface, the keyboard 300 behaves as a keyboard 300 having a mouse function by adding the USB mouse connected to the keyboard 300 by the device control unit 340 to its own system information.

  For example, when the keyboard 300 has a keyboard function and a USB mouse is connected to the keyboard 300, the keyboard 300 behaves as a combined keyboard and mouse Bluetooth (registered trademark) device with respect to the smartphone 200, and is connected to the external input connection unit 230 of the smartphone 200. Connected.

Then, the smartphone 200 sets the keyboard 300 to be usable as a combined Bluetooth (registered trademark) device of a keyboard and a mouse.
As a matter of course, other input / output devices are not limited to a mouse, and any device such as a trackball, a capacitive touch pad, a camera, a microphone, and a speaker may be connectable.
In addition, when a camera or a microphone is connected as an arbitrary device, a gesture operation with respect to a user interface displayed on the display 400, for example, image information input from the camera and audio information from the microphone, or It can be used as voice operation information.

In the present invention, the display 400 corresponds to an “external display device”, the keyboard 300 corresponds to an “external input device”, the external display connection unit 240 corresponds to an “external display connection unit”, and the external input connection unit 230. Corresponds to the “external input connection unit”, the smartphone 200 corresponds to the “mobile communication terminal”, the interface type request signal corresponds to the “interface type request signal”, the transmission unit 250 corresponds to the “transmission unit”, The reception unit 260 corresponds to a “reception unit”, Windows 7 (registered trademark) or Windows 8 (registered trademark), MAC (registered trademark) corresponds to a “user interface”, the display control unit 270 includes a “display control unit”, “ The communication connection systems 100, 100a, 100b, 100c, and 100d correspond to the “communication connection system”. Chipaneru type display 500 corresponds to a "touch panel", the power control unit 320 corresponds to the "power control unit".

  A preferred embodiment of the present invention is as described above, but the present invention is not limited thereto. It will be understood that various other embodiments may be made without departing from the spirit and scope of the invention. Furthermore, in this embodiment, although the effect | action and effect by the structure of this invention are described, these effect | actions and effects are examples and do not limit this invention.

100, 100a, 100b, 100c, 100d Communication connection system 200 Smartphone 210 Application software program 230 External input connection unit 240 External display connection unit 250 Transmission unit 260 Reception unit 300 Keyboard 310 Battery 400 Display 500 Touch panel display 600 Notebook PC

Claims (9)

An external display device;
An external input device;
An external display connection unit for outputting a display signal to the external display device, and a mobile communication terminal having an external input connection unit connectable to the external input device,
The mobile communication terminal is
Communicate with the external input device,
A receiving unit that receives a configuration signal including system information indicating a function that the external input device can provide as an external input device to the mobile communication terminal from the external input device;
Among the operation modes of a plurality of user interfaces that are recorded in advance in the mobile communication terminal and supplied to the external display device for display.
A first selection unit for selecting an operation mode of the user interface according to the configuration signal;
Having a second selection unit for selecting a preset operation mode of the user interface regardless of the configuration signal;
A selection unit for selecting one of the first selection unit and the second selection unit;
A display control unit for supplying and displaying a user interface image of an operation mode of the user interface selected by the selection unit on the external display device;
A communication connection system. The first selection unit of the mobile communication terminal is
The operation mode of the user interface recorded in advance in the mobile communication terminal is selected according to the connection between the configuration signal, the external display connection unit of the mobile communication terminal and the external display device, and the selected user interface The communication connection system according to claim 1, further comprising: a display control unit configured to supply and display a user interface image in an operation mode on the external display device.   The communication connection system according to claim 1, wherein the configuration signal further includes information on presence / absence of connection between the external display device and the external input device. The external display device includes a display unit,
The external input device includes an operation unit,
The touch panel type in which the operation unit and the display unit are integrally provided, the separable form in which the operation unit and the display unit are detachable, and the operation unit and the display unit are provided separately. The communication connection system according to any one of claims 1 to 3, wherein the communication connection system is any one of the separated types. At least one of the external display device and the external input device is:
Including at least an operation unit and a display unit,
The touch panel type in which the operation unit and the display unit are integrally provided, the separable form in which the operation unit and the display unit are detachable, and the operation unit and the display unit are provided separately. The communication connection system according to any one of claims 1 to 3, wherein the communication connection system is any one of the separated types. The mobile communication terminal is
The communication connection system according to any one of claims 1 to 5, wherein the receiving unit and the display control unit are automatically operated according to a connection state of the external display connection unit and the external input connection unit. The external display connection part of the mobile communication terminal is
The communication connection system according to any one of claims 1 to 6, wherein when the external display device is recognized not to exist, a user interface image is not output from the external display connection unit. The external input device has a power control unit,
The communication connection system according to claim 1, wherein the power control unit controls power supply to the mobile communication terminal. A program for a communication connection system used for an external display device, an external input device, an external display connection unit that outputs a display signal to the external display device, and an external input connection unit that can be connected to the external input device There,
The mobile communication terminal is
Communicate with the external input device,
A receiving process for receiving a configuration signal including system information indicating a function that the external input device can provide as an external input device to the mobile communication terminal from the external input device;
Among the operation modes of a plurality of user interfaces that are recorded in advance in the mobile communication terminal and supplied to the external display device for display.
A first selection process for selecting an operation mode of the user interface according to the configuration signal;
A second selection process for selecting a preset operation mode of the user interface regardless of the configuration signal;
A selection process for selecting one of the first selection process and the second selection process;
A display control process for supplying and displaying a user interface image of an operation mode of the user interface selected by the selection process on the external display device;
A communication connection system program.