JP6991276B2 - Display system - Google Patents

Description

The present invention relates to a display system for displaying an image or the like.

In an electronic device provided with a touch panel such as a car navigation device, an image such as a button is displayed on the display unit, and the operation is performed by touching the button.

In this type of electronic device, there is a problem that accurate operation is difficult due to the small size of the button displayed on the screen, and for the solution, for example, the method described in Patent Document 1 has been proposed. There is.

In Patent Document 1, when the touch panel is touched with a finger, the selection button 2 around the finger contact portion is enlarged and displayed, and the selection button to be touched is moved without taking the finger off the touch panel as it is, and then the finger is moved. It is described that the operation is performed by releasing.

Japanese Unexamined Patent Publication No. 2008-65504

In the case of the method described in Patent Document 1, since the periphery of the finger contact portion is enlarged and displayed, there is a problem that the position of the button or the like to be operated next is difficult to understand when it is outside the enlarged display range. For example, when inputting characters from a software keyboard or the like in a car navigation device to input a destination, etc., in the case of Patent Document 1, perform the enlarged key input, release the finger to return to the normal display, and then input. You need to find the key you want. Therefore, it may be difficult to input smoothly and lightly.

Further, in general, a touch panel used for a car navigation device or the like is often a resistance film type with an emphasis on cost. Since this resistance film type touch panel detects the touch position from the voltage at the point where the two resistance films come into contact with each other, so-called multi-touch operations (flick, swipe, pinch-in / pinch-out, etc.) are often not accepted. Therefore, it is difficult to improve the operability by the multi-touch function. Further, in the case of an electronic device without a touch panel, unlike the buttons displayed on the screen, it cannot be enlarged or the like, so it is impossible to physically change the size of the buttons.

Therefore, in view of the above-mentioned problems, it is an object of the present invention to provide, for example, a display system capable of light operation.

In order to solve the above problems, the invention according to claim 1 is a display system including a first terminal and a second terminal, wherein the first terminal is a plurality of for operating the first terminal. A first display unit for displaying a first image including an image and a first communication unit for communicating with the second terminal are provided, and the second terminal is a second communication unit for communicating with the first terminal and the first image. Is a mode in which the arrangement of the plurality of images is rearranged, and is a storage unit for storing a second image for operating the first terminal, and a second image for displaying the second image corresponding to the first image. The first terminal includes a display unit, receives display range information indicating a display range in the second display unit of the second image from the second terminal, and displays the display range information on the first display unit based on the display range information. It is characterized in that the display range of the second image in the first image is displayed.

The invention according to claim 7 is a display unit that displays a first image including a plurality of images for operating a display device, and the first image is an image in which the arrangement of the plurality of images is rearranged. A communication unit for storing a second image for operating the display device and communicating with an external terminal on which the second image is displayed is provided, and the communication unit displays the second image on the external terminal. The display unit receives the display range information indicating the range, and the display unit displays the display range of the second image in the first image based on the display range information.

The invention according to claim 8 is a display method executed by a display device for displaying an image on a display unit, wherein the plurality of images are arranged with a first image including a plurality of images for operating the display device. Display range information indicating the display range of the second image on the external terminal from the external terminal in which the second image for operating the display device is stored and the second image is displayed, which is a rearranged image. It is characterized by including a communication step of receiving and a display step of displaying the display range of the second image in the first image on the display unit based on the display range information.

The invention according to claim 9 is a display program characterized in that the display method according to claim 8 is executed by a computer.

The invention according to claim 10 is a computer-readable recording medium comprising the display program according to claim 9.

It is a schematic block block diagram of the display system which concerns on 1st Embodiment of this invention. It is explanatory drawing about each display mode of the car navigation device of the display system shown in FIG. 1 and a smartphone. It is a flowchart of the operation of the display system shown in FIG. It is explanatory drawing about each display mode of the car navigation device and the smartphone of the display system which concerns on the 2nd Embodiment of this invention. It is a flowchart of the operation of the display system which concerns on the 2nd Embodiment of this invention.

Hereinafter, a display system according to an embodiment of the present invention will be described. In the display system according to the embodiment of the present invention, the first terminal includes a first display unit for displaying an image and a first communication unit for communicating with the second terminal, and the second terminal is the first terminal. A second communication unit that communicates with the user and a second display unit that displays an enlarged image obtained by enlarging a designated part of the image are provided. Then, the first terminal receives the information indicating the range of the enlarged image from the second terminal, and displays the information indicating the range of the enlarged image in the image on the first display unit. By doing so, it is possible to display the UI (User Interface) displayed on the first terminal on the second terminal and operate the first terminal on the second terminal. Therefore, for example, a light operation can be performed by operating from a second terminal having an input device or the like having better operability than the first terminal. Further, by displaying the range displayed on the second terminal on the first terminal, it becomes easier to understand which area is displayed on the second display unit, and the second terminal operates next. It becomes easier to perform scrolling operations to display buttons and the like.

Further, in the display system according to another embodiment of the present invention, the first terminal includes a first display unit for displaying a first image and a first communication unit for communicating with the second terminal, and the second terminal is a second terminal. It includes a second communication unit that communicates with one terminal, a storage unit that stores a second image for operating the first terminal, and a second display unit that displays a second image corresponding to the first image. Then, the first terminal receives the display range information of the second image from the second terminal, and displays the display range information of the second image in the first image on the first display unit. By doing so, it is possible to display an image corresponding to the UI (User Interface) displayed on the first terminal on the second terminal and operate the first terminal on the second terminal. Therefore, for example, a light operation can be performed by operating from a second terminal having an input device or the like having better operability than the first terminal. Further, by displaying the range corresponding to the display of the second terminal on the first terminal, it becomes easy to understand which area is being operated in the second display unit. Further, since the image is not transmitted from the first terminal, the amount of data at the time of communication can be reduced.

Further, the first terminal may be displayed on the first display unit as a frame surrounding the range based on the information received from the second terminal. By doing so, the range of the enlarged image and the range corresponding to the second image can be displayed as a frame on the first terminal and displayed to the user or the like.

Further, the first terminal may display the inside of the range on the first display unit in a manner different from the outside of the range based on the information received from the second terminal. By doing so, the range of the enlarged image and the range corresponding to the second image can be displayed in the form of shading, coloring, blinking, or the like and displayed to the user or the like.

Further, a resistance film type touch panel may be provided on the first display unit of the first terminal, and a capacitance type touch panel may be provided on the second display unit of the second terminal. By doing so, even in the first display unit provided with the resistance film type touch panel, the first terminal can be operated by flicking, swiping, or pinching in / pinching out from the second terminal. It will be possible.

Further, the first terminal may be a navigation device and the second terminal may be a mobile device. By doing so, the navigation device can be operated from a mobile device such as a smartphone. Therefore, the navigation device can be operated by, for example, flicking or swiping, or pinch-in / pinch-out operations corresponding to the smartphone.

Further, the display device according to the embodiment of the present invention includes a display unit for displaying an image and a communication unit for communicating with an external terminal on which an enlarged image obtained by enlarging a designated part of the image is displayed. ing. Then, the communication unit transmits the image to the external terminal, receives the information indicating the range of the enlarged image from the external terminal, and the display unit displays the information indicating the range of the enlarged image in the image. By doing so, for example, a light operation can be performed by operating from an external terminal having an input device or the like having better operability than the display device. In addition, by displaying the range displayed on the external terminal on the display unit, it becomes easier to understand which area is displayed on the external terminal, and the button to be operated next on the external terminal is displayed. It becomes easier to perform scrolling operations for this purpose.

Further, the display device according to another embodiment of the present invention includes a display unit for displaying a first image, an external terminal for storing a second image for operating the display device, and displaying the second image. It is equipped with a communication unit that communicates. Then, the communication unit receives the display range information of the second image, and the display unit displays the display range information of the second image in the first image. By doing so, for example, a light operation can be performed by operating from an external terminal having an input device or the like having better operability than the display device. Further, by displaying the range corresponding to the display of the external terminal on the display unit, it becomes easy to understand which area is being operated from the external terminal. Furthermore, since the image is not transmitted to the external terminal, the amount of data at the time of communication can be reduced.

Further, in the display method according to the embodiment of the present invention, an image is transmitted to an external terminal, and information indicating the range of the enlarged image is displayed from the external terminal on which an enlarged image obtained by enlarging a specified part of the image is displayed. It includes a communication step of receiving and a display step of displaying information indicating a range corresponding to the enlarged image in the image on the display unit. By doing so, for example, a light operation can be performed by operating from an external terminal having better operability than itself. In addition, by displaying the range displayed on the external terminal on the display unit, it becomes easier to understand which area is being displayed, and it becomes easier to perform scrolling operations to display the buttons to be operated next. ..

Further, the display method described above may be executed by a computer. By doing so, it is possible to perform a light operation by using a computer, for example, by operating from an external terminal having better operability than itself. In addition, by displaying the range displayed on the external terminal on the display unit, it becomes easier to understand which area is being displayed, and it becomes easier to perform scrolling operations to display the buttons to be operated next. ..

Further, the above-mentioned display program may be stored in a computer-readable recording medium. By doing so, the program can be distributed as a single unit in addition to being incorporated in the device, and version upgrades and the like can be easily performed.

Further, in the display method according to another embodiment of the present invention, a second image for operating the display device is stored, and the display range information of the second image is received from an external terminal on which the second image is displayed. It includes a communication step and a display step of displaying the display range information of the second image in the first image on the display unit. By doing so, for example, a light operation can be performed by operating from an external terminal having better operability than a display device. Further, by displaying the range corresponding to the display of the external terminal on the display unit, it becomes easy to understand which area is being operated from the external terminal. Furthermore, since the image is not transmitted to the external terminal, the amount of data at the time of communication can be reduced.

Further, the display method described above may be executed by a computer. By doing so, it is possible to perform a light operation by using a computer, for example, by operating from an external terminal having better operability than a display device. Further, by displaying the range corresponding to the display of the external terminal on the display unit, it becomes easy to understand which area is being operated from the external terminal. Furthermore, since the image is not transmitted to the external terminal, the amount of data at the time of communication can be reduced.

Further, the above-mentioned display program may be stored in a computer-readable recording medium. By doing so, the program can be distributed as a single unit in addition to being incorporated in the device, and version upgrades and the like can be easily performed.

The display system 100 having the display device according to the first embodiment of the present invention will be described with reference to FIGS. 1 to 3.

As shown in FIG. 1, the display system 100 includes a car navigation device 10 as a first terminal and a smartphone 20 as a second terminal (portable device).

The car navigation device 10 includes a CPU 11, a ROM 12, a RAM 13, a voice signal processing unit 14, a position recognition processing unit 15, an I / F block 16, a storage unit 17, an operation unit 18, and a wired processing unit 19. It has a wireless processing unit 1A, a display control unit 1B, a display unit 1C, a voice synthesis unit 1D, and a speaker 1E.

The CPU 11 is a central processing unit that operates based on a processing program stored in the ROM 12 and controls the overall operation of the car navigation device 10. In this embodiment, the wired processing unit 19 or the wireless processing unit 1A is controlled so that the image displayed on the display unit 1C is transmitted to the smartphone 20, or the wired processing unit 19 or the wireless processing unit 1A is acquired from the smartphone 20. Based on the coordinate information, the operation of specifying the range displayed on the display unit 26 of the smartphone 20 among the images displayed on the display unit 1C is performed.

The ROM 12 is a read-only non-volatile memory (Read Only Memory) in which various processing programs and the like as a car navigation device read by the CPU 11 are stored.

The RAM 13 is a volatile memory (Random Access Memory) used as a work area when the CPU 11 performs various processes.

The audio signal processing unit 14 reproduces music data stored in the storage unit 17, or rips music data stored in an optical disk set in an optical disk device (not shown) and stores the music data in the storage unit 17. ..

The position recognition processing unit 15 calculates (recognizes) its own current position based on a signal from a GPS (Global Positioning System) receiver, a gyro sensor, or the like (not shown).

The I / F block 16 is an interface (I / F) for connecting the storage unit 17 or the operation unit 18 to the CPU 11.

The storage unit 17 stores, for example, map data for guidance, the above-mentioned music data, and the like. The storage unit 17 is composed of a non-volatile storage medium such as a hard disk drive or an SSD (Solid State Drive). The data stored in the storage unit 17 may be stored in an external server or the like and downloaded as needed.

The operation unit 18 is composed of, for example, a touch panel superimposed on the surface of the display unit 1C. The touch panel constituting the operation unit 18 of this embodiment is composed of a resistance film type touch panel.

The wired processing unit 19 as the first communication unit serves as an interface for communicating with the smartphone 20 by wire connection. Examples of the wired connection standard include USB (Universal Serial Bus), HDMI (registered trademark) (High-Definition Multimedia Interface), and MHL (Mobile High-definition Link).

The wireless processing unit 1A as the first communication unit serves as an interface for wirelessly connecting to and communicating with the smartphone 20. Examples of wireless connection standards include Wi-Fi (registered trademark) and Bluetooth (registered trademark). The wired processing unit 19 and the wireless processing unit 1A may not have both as long as the smartphone 20 as the communication partner has one of them. Moreover, even if both are possessed, it is sufficient to communicate with only one of them.

The display control unit 1B generates image data to be displayed on the display unit 1C based on the control from the CPU 11.

The display unit 1C as the first display unit is composed of a liquid crystal display, an EL display, or the like, and displays image data generated by the display control unit 1B. On the display unit 1C, for example, a map for guidance, menus and buttons for various operations, a music title being played, and the like are displayed.

The voice synthesis unit 1D synthesizes guidance voice and the like output from the speaker 1E based on the control from the CPU 11.

The speaker 1E outputs the guidance voice and the like synthesized by the voice synthesis unit 1D.

The smartphone 20 includes a CPU 21, a ROM 22, a RAM 23, a public line communication unit 24, a display control unit 25, a display unit 26, a voice processing unit 27, a speaker 28, a microphone 29, and an I / F block 2A. It has a storage unit 2B, an operation unit 2C, a wired processing unit 2D, and a wireless processing unit 2E.

The CPU 21 operates based on a processing program or the like stored in the ROM 22, and controls the overall operation of the smartphone 20. In this embodiment, the display control unit 25 is controlled so that the image acquired by the wired processing unit 2D or the wireless processing unit 2E from the car navigation device 10 is displayed on the display unit 26, or the image displayed on the display unit 26. The coordinate information indicating the range of is calculated and transmitted to the car navigation device 10 by the wired processing unit 2D or the wireless processing unit 2E.

The ROM 22 is a non-volatile memory in which a processing program such as an OS (Operating System) read by the CPU 21 is stored.

The RAM 13 is a volatile memory used as a work area when the CPU 21 performs various processes.

In the public line communication unit 24, the smartphone 20 communicates with a base station or the like constituting a public line such as a mobile telephone network.

The display control unit 25 generates image data to be displayed on the display unit 26 based on the control from the CPU 21.

The display unit 26 as the second display unit is composed of a liquid crystal display, an EL display, or the like, and displays image data generated by the display control unit 25. The display unit 26 displays, for example, an initial screen, a screen of a running application, and the like.

When the voice processing unit 27 is used as a mobile phone, the voice processing unit 27 reproduces the voice of the other party received by the public line communication unit 24 and outputs it to the speaker 28, or outputs the call content input by the user to the microphone 29. Convert to voice data. Further, the voice processing unit 27 outputs the voice data or the like generated or reproduced by the application to the speaker 28.

The speaker 28 outputs the voice output from the voice processing unit 27.

The microphone 29 converts the call content or the like input by the user or the like into an electric signal and outputs it to the voice processing unit 27.

The I / F block 2A is an interface for connecting the storage unit 2B or the operation unit 2C and the CPU 21.

The storage unit 2B stores, for example, data such as an application. The storage unit 2B is composed of a non-volatile storage medium such as an SSD.

The operation unit 2C is composed of, for example, a touch panel superimposed on the surface of the display unit 26. The touch panel constituting the operation unit 2C of this embodiment is composed of a capacitive touch panel. As is well known, the capacitance type touch panel is capable of multi-touch operation and is superior in operability to the resistance film type touch panel.

The wired processing unit 2D as the second communication unit serves as an interface for communicating with the car navigation device 10 by wire connection. Examples of the wired connection standard include USB (Universal Serial Bus), HDMI (registered trademark) (High-Definition Multimedia Interface), and MHL (Mobile High-definition Link).

The wireless processing unit 2E as the second communication unit serves as an interface for wirelessly connecting and communicating with the car navigation device 10. Examples of wireless connection standards include Wi-Fi (registered trademark) and Bluetooth (registered trademark).

Next, an outline of the operation of the display system 100 having the above-described configuration will be described with reference to FIG. FIG. 2A is a front view showing an image display example of the display unit 1C of the car navigation device 10, and FIG. 2B is a front view showing a display example of an enlarged image displayed on the smartphone 20. In this embodiment, first, the car navigation device 10 and the smartphone 20 are connected wirelessly or by wire.

Then, the entire image (image information of the entire screen) displayed on the display unit 1C of the car navigation device 10 is transmitted to the smartphone 20. In the smartphone 20, the entire image received from the car navigation device 10 is displayed on the display unit 26. In the example of FIG. 2, the image displayed on the display unit 1C will be described using a software keyboard, but a menu image or the like may be used, or an operation button image may be displayed together with a map or the like. In short, it may be an image including an image used for operating the car navigation device 10.

Here, the user or the like enlarges and designates a part of the entire image as shown in FIG. 2 (b) by the operation function such as pinch-in that the smartphone 20 has in advance. That is, the display unit 26 displays an enlarged image obtained by enlarging the entire image or a designated part of the image. Then, the coordinate information of the range of the enlarged image is transmitted to the car navigation device 10 as information indicating the range of the enlarged image.

The car navigation device 10 displays a frame F indicating the range of the enlarged image displayed on the smartphone 20 in the menu image displayed on the display unit 1C based on the received coordinate information. This frame F is information indicating the range of the enlarged image displayed so as to surround the range displayed on the smartphone 20 as shown in FIG. 2 (a). That is, the car navigation device 10 receives coordinate information (information indicating the range of the enlarged image) from the smartphone 20 (second terminal), and displays information indicating the range of the enlarged image on the display unit 1C (first display unit). it's shown.

When the frame F is scrolled by an operation function such as swiping on the display unit 26 of the smartphone 20, the coordinate information is updated and moves accordingly. Further, even when the image is further enlarged or reduced, the coordinate information is updated according to the display range and the frame F is deformed.

In FIG. 2, the range displayed on the display unit 26 of the smartphone 20 is displayed by the frame F. For example, the range is shaded or colored to be different from the surroundings, or only the range is blinked. , The inside and the outside of the range may be displayed in different modes.

Next, a flowchart of the operation of the display system 100 having the above-described configuration will be described with reference to FIG. This flowchart is executed by the CPU 11 on the car navigation device (car navigation) 10 side and by the CPU 21 on the smartphone 20 side. That is, the car navigation device 10 side is a computer program in which the computer executes the display method of the display device for displaying the image on the display unit 1C, and the smartphone 20 side is the display method of the display device for displaying the image on the display unit 26. Is a computer program to be executed.

First, on the car navigation device 10 side, the mobile operation mode is turned on in step S11. This mobile operation mode is a mode for permitting operation on the mobile terminal (smartphone 20) as described above. For example, the user or the like determines whether or not to display an option on the display unit 1C at startup and turn it on. May be selected, or it may be turned on later from the menu screen or the like.

Next, in step S12, a communication connection process is performed with the smartphone 20. That is, the wired processing unit 19 or the wireless processing unit 1A is made to perform a process of connecting to the wired processing unit 2D or the wireless processing unit 2E of the smartphone 20 by a predetermined communication standard (USB, Bluetooth (registered trademark), etc.).

Next, in step S13, the display control unit 1B causes the display unit 1C to display a menu image or the like. Then, the wired processing unit 19 or the wireless processing unit 1A is made to transmit the menu image or the like displayed on the display unit 1C to the smartphone 20.

On the other hand, on the smartphone 20 side, the car navigation control UI application is activated (ON) in step S21. This application is installed in the smartphone 20 in advance, and among the operations described in the outline, the operation on the smartphone 20 side is performed.

Next, in step S22, a communication connection process is performed with the car navigation device 10. That is, the wired processing unit 2D or the wireless processing unit 2E is made to perform a process of connecting to the wired processing unit 19 or the wireless processing unit 1A of the car navigation device 10 by a predetermined communication standard (USB, Bluetooth (registered trademark), etc.).

Next, in step S23, the wired processing unit 2D or the wireless processing unit 2E receives the menu image transmitted from the car navigation device 10, and the display control unit 25 causes the display unit 1C to display the menu image or the like. Then, the coordinate information of the display range on the display unit 26 at this time is calculated and transmitted to the wired processing unit 2D or the wireless processing unit 2E.

These coordinates are coordinates added to the menu image or the like received in step S23, and are based on the resolution of the image, the number of pixels on the screen, or the like, with the upper left of the image received from the car navigation device 10 as the origin (0, 0). Is added as appropriate. Then, the coordinates indicating the display range of the display unit 26 are transmitted to the car navigation device 10 as coordinate information. As the coordinates to be transmitted as the coordinate information, for example, in the case of a rectangle (quadrangle), the coordinates at the upper left and the coordinates at the lower right of the display range may be used. In the case of step S23, since it is in the initial state and the entire menu image or the like is displayed on the display unit 26, the coordinates of the origin and the lower right position of the menu image or the like may be transmitted as the coordinate information. ..

Next, in step S14, based on the coordinate information received from the smartphone 20 on the car navigation device 10 side, the display range on the display unit 26 of the smartphone 20 is displayed in a rectangular frame on the menu image displayed on the display unit 1C. indicate. Also in the car navigation device 10, a frame can be displayed by adding coordinates according to the same rules as in the smartphone 20. In the case of step S14, since the entire menu image is displayed on the display unit 26, it becomes a frame that surrounds the entire menu image and the like. Further, the shape of the frame is not limited to a quadrangle, and may be another shape such as a circle, an ellipse, or a polygon. Alternatively, when the entire menu image or the like is displayed on the display unit 26, the effect of displaying the menu image or the like is small, so that it is not necessary to transmit the coordinate information.

On the other hand, on the smartphone 20 side, operations such as pinch-in / pinch-out and swipe / flick are performed in step S24. Then, as in step S23, the coordinates indicating the display range of the display unit 26 are transmitted to the car navigation device 10 as coordinate information. Further, when the button or the like displayed on the display unit 26 on the smartphone 20 is touched, the information (operation information) indicating the touch is also transmitted to the car navigation device 10.

Next, in step S15, based on the coordinate information received from the smartphone 20 on the car navigation device 10 side, the menu image or the like displayed on the display unit 1C is quadrangular according to the display range of the display unit 26 of the smartphone 20. Enlarge or reduce the frame. Alternatively, if the smartphone 20 is scrolled by a swipe operation, the frame is moved. Further, when the information indicating that the smartphone has been touched is received from the smartphone 20, the operation corresponding to the operation indicated by the information is executed.

For example, when the software keyboard as shown in FIG. 2 (a) is displayed as a menu image, a pinch-in operation is performed so as to enlarge the “A” part, and the display unit 26 of the smartphone 20 is performed as shown in FIG. 2 (b). When displayed in, the coordinate information indicating the display range of FIG. 2B is transmitted to the car navigation device 10, and the frame F is displayed on the display unit 1C based on the coordinate information.

Then, when the menu image or the like (image data) is updated on the car navigation device 10 side by the operation, a new menu image or the like is transmitted to the smartphone 20 each time, and in the smartphone 20, the new menu image or the like is transmitted in step S25. Is displayed on the display unit 26. After that, steps S14 to S15 and steps S24 to 25 are repeated.

As is clear from the description of the flowchart described above, steps S13, S14, and S15 function as a communication process, and steps S14 and S15 function as a display process.

Further, the car navigation device 10 according to the present embodiment is a wired process that communicates with a display unit 1C for displaying an image and a smartphone 20 (external terminal) for displaying an enlarged image obtained by enlarging a designated part of the image. A unit 19 or a wireless processing unit 1A (communication unit) is provided, and the wired processing unit 19 or the wireless processing unit 1A (communication unit) transmits an image to a smartphone 20 (external terminal) and from the smartphone 20 (external terminal). The display unit 1C functions as a display device characterized by receiving information indicating the range of the enlarged image and displaying the range corresponding to the enlarged image.

Further, the smartphone 20 according to the present embodiment has a menu image received from the wired processing unit 2D or the wireless processing unit 2E (communication unit) communicating with the car navigation device 10 (external device) and the car navigation device 10 (external device). A display unit 26 for displaying an enlarged image obtained by enlarging a designated part of the above (image) is provided, and the wired processing unit 2D or the wireless processing unit 2E (communication unit) provides coordinate information to the smartphone 20 (external device). It functions as a display device characterized by transmitting (information indicating the range of an enlarged image).

According to this embodiment, the car navigation device 10 includes a display unit 1C for displaying a menu image or the like, a wired processing unit 19 or a wireless processing unit 1A for communicating with the smartphone 20, and the smartphone 20 is a car navigation device. It includes a wired processing unit 2D or a wireless processing unit 2E that communicates with 10, and a display unit 26 that displays an enlarged image of a designated part of the menu image or the like. Then, the car navigation device 10 receives the coordinate information from the smartphone 20 and displays the range of the enlarged image in the menu image or the like as the frame F on the display unit 1C. By doing so, it is possible to display the UI (User Interface) displayed on the car navigation device 10 on the smartphone 20 and operate the car navigation device 10 on the smartphone 20. Therefore, for example, a light operation can be performed by operating from a smartphone 20 having a touch panel having a touch panel superior in operability to the car navigation device 10.

Further, by displaying the range displayed by the smartphone 20 on the car navigation device 10, it becomes easier to understand which area is displayed on the display unit 26, and the button or the like to be operated next on the smartphone 20 or the like. It becomes easier to perform scrolling operations to display.

Further, the operation unit 18 of the car navigation device 10 is composed of a resistance film type touch panel and is superposed on the display unit 1C, and the operation unit 2C of the smartphone 20 is composed of a capacitive touch panel and is superposed on the display unit 26. .. By doing so, even in the car navigation device 10 having the display unit 1C provided with the resistance film type touch panel, the car navigation device can be operated by flicking, swiping, or pinching in / pinching out from the smartphone 20. Can be done.

The display system according to the second embodiment of this embodiment will be described with reference to FIGS. 4 to 5. The same parts as those in the first embodiment described above are designated by the same reference numerals, and the description thereof will be omitted.

In this embodiment, the block configuration and the like are the same as those in FIG. 1, but in the case of this embodiment, the smartphone 20 does not transmit an image such as a menu image from the car navigation device 10 and the smartphone 20 previously performs the menu image and the like of the car navigation device 10. The difference is that it has an image corresponding to.

The image corresponding to the menu image of the car navigation device 10 (for example, the same image as the menu image of the car navigation device 10) may be installed in the smartphone 20 as an application and stored in the storage unit 2B. In this case, instead of transmitting image data such as a menu in step S13 of FIG. 3, the flowchart displays display image identification information, which is information for identifying the menu image or the like currently displayed on the display unit 1C, on the smartphone 20. To send to. This display image identification information is composed of, for example, an ID assigned to each menu image to be displayed. The smartphone 20 that has received the display image identification information causes the display unit 26 to display the menu image or the like shown in the display image identification information. After that, the operation is the same as the flowchart of FIG.

Further, in the case of this embodiment, the arrangement of the buttons and the like in the menu image and the like of the application does not have to match the display mode on the car navigation device 10. That is, it does not have to be the same image as the menu image of the car navigation device 10.

FIG. 4 shows a display example when the arrangement of buttons and the like in the menu image and the like of the application does not match the display mode on the car navigation device 10. FIG. 4A is an example of a menu image or the like (first image) displayed on the display unit 1C of the car navigation device 10. FIG. 4B is a display example (second image) of the display unit 26 of the application running on the smartphone 20. In FIG. 4B, only a part of the menu items shown in FIG. 4A is displayed, and when other items are selected, it is necessary to scroll the items to display them.

As shown in FIG. 4, the menu image or the like displayed on the display unit 1C of the car navigation device 10 does not match the image of the application displayed on the smartphone 20. Even in this case, by transmitting the information indicating the range of the display image of the application from the smartphone 20 to the car navigation device 10 as the display range information of the second image instead of the coordinate information, FIG. 4A is shown. The display range of the smartphone 20 can be displayed as the display range information of the second image as in the frame F of.

The information indicating the range of the display image of the application is, for example, an ID given to each menu button of the application. Explaining with the example of FIG. 4 (b), the ID assigned to each of the "name / multi-search" button, the "free word voice search" button, the "address" button, and the "phone number" button is displayed on the display screen of the application. Send as information indicating the range. On the car navigation device 10 side, the received ID is associated with a button or the like displayed on the menu image, and the display like the frame F shown in FIG. 4A is possible based on the ID. Become.

Although the frame F is one in the example of FIG. 4, a plurality of frames F may be displayed on the application side depending on the arrangement of buttons and the like.

Also in this embodiment, the enlargement operation may be performed on the smartphone 20 side. In the case of this embodiment, unlike the first embodiment, the images displayed by the car navigation device 10 and the smartphone 20 do not match, so that the frame F cannot be displayed correctly even if the coordinate information is transmitted. Therefore, instead of the coordinate information, the ID of the button or the like in the range enlarged and displayed on the display unit 26 is transmitted to the car navigation device 10 as information indicating the range of the display image of the application, and the frame F is based on the information. Is displayed. By doing so, it is possible to show a range substantially equivalent to the range enlarged and displayed on the smartphone 20.

Next, a flowchart in the case where the arrangement of the buttons and the like in the menu image and the like of the application does not match the display mode on the car navigation device 10 will be described with reference to FIG. This flowchart is executed by the CPU 11 on the car navigation device (car navigation) 10 side and by the CPU 21 on the smartphone (smartphone) 20 side.

First, on the car navigation device 10 side, steps S11 and S12 are the same as in FIG. Next, in step S13A, the display control unit 1B causes the display unit 1C to display a menu image or the like. Then, the wired processing unit 19 or the wireless processing unit 1A is made to transmit the display image identification information, which is the information for identifying the menu image or the like currently displayed on the display unit 1C, to the smartphone 20.

On the other hand, on the smartphone 20 side, steps S21 and S22 are the same as in FIG. Next, in step S23A, the wired processing unit 2D or the wireless processing unit 2E receives the display image identification information transmitted from the car navigation device 10 in step S13A, and an application corresponding to the ID or the like indicated by the display image identification information. The menu image and the like in the above are displayed on the display unit 26. Then, the information indicating the range of the display image of the application displayed on the display unit 26 at this time is transmitted to the wired processing unit 2D or the wireless processing unit 2E.

Next, in step S14A, the display unit 26 of the smartphone 20 displays the menu image displayed on the display unit 1C based on the information indicating the range of the display image of the application received from the smartphone 20 on the car navigation device 10 side. Display the frame corresponding to the display range of. The frame does not have to be a quadrangle as shown in FIG. 4A.

On the other hand, on the smartphone 20 side, operations such as pinch-in / pinch-out and swipe / flick are performed in step S24A. Then, as in step S23A, information indicating the range of the display image of the application is transmitted to the car navigation device 10. Further, when the button or the like displayed on the display unit 26 on the smartphone 20 is touched, the information indicating the touch is also transmitted to the car navigation device 10.

Next, in step S15A, the display unit 26 of the smartphone 20 is displayed on the menu image or the like displayed on the display unit 1C based on the information indicating the range of the display image of the application received from the smartphone 20 on the car navigation device 10 side. Transform the frame to fit the display range in. Alternatively, if the smartphone 20 is scrolled by a swipe operation, the frame is moved. Further, when the information indicating that the smartphone has been touched is received from the smartphone 20, the operation corresponding to the operation indicated by the information is executed.

Then, when the menu image or the like (image data) is updated on the car navigation device 10 side by the operation, new display image identification information is transmitted to the smartphone 20 each time, and in the smartphone 20, the new display image is obtained in step S25. The menu image or the like in the application corresponding to the identification information is displayed on the display unit 26. After that, steps S14A to S15A and steps S24A to 25A are repeated.

As is clear from the description of the flowchart described above, steps S14A and S15A function as a communication process, and steps S14A and S15A function as a display process.

Further, the car navigation device 10 according to this embodiment has a display unit 1C for displaying a menu image or the like (first image) and a smartphone 20 (external) for displaying an image (second image) of an application for operating the display device. The wired processing unit 19 or the wireless processing unit 1A (communication unit) that communicates with the terminal) is provided, and the wired processing unit 19 or the wireless processing unit 1A (communication unit) provides information (second) indicating the range of the display screen of the application. The display device 1C receives the image display range information), and the display unit 1C displays the display range of the application image (second image) in the menu image or the like (first image) as the frame F. Functions as.

Further, the smartphone 20 according to the present embodiment displays an image of operating the car navigation device 10 (external device) with the wired processing unit 2D or the wireless processing unit 2E (communication unit) communicating with the car navigation device 10 (external device). A wired processing unit including a storage unit 2B for storing and a display unit 26 for displaying an image of a corresponding application based on display image identification information (information about display contents) received from a car navigation device 10 (external device). The 2D or wireless processing unit 2E (communication unit) functions as a display device characterized in that information indicating the range of the display screen of the application (display range information of the second image) is transmitted to the car navigation device 10.

According to this embodiment, the car navigation device 10 includes a display unit 1C for displaying a menu image or the like, a wired processing unit 19 or a wireless processing unit 1A for communicating with the smartphone 20, and the smartphone 20 is a car navigation device. It includes a wired processing unit 2D or a wireless processing unit 2E that communicates with the car 10, a storage unit 2B that stores an application for operating the car navigation device 10, and a display unit 26 that displays a menu image or the like of the application. Then, the car navigation device 10 receives information indicating the range of the display image of the application from the smartphone 20, and displays the range of the display image of the application in the menu image or the like as the frame F on the display unit 1C. By doing so, it is possible to display an image corresponding to the UI (User Interface) displayed on the car navigation device 10 on the smartphone 20 and operate the car navigation device 10 on the smartphone 20. Therefore, for example, a light operation can be performed by operating from a smartphone 20 having a touch panel having a touch panel superior in operability to the car navigation device 10.

Further, by displaying the range corresponding to the display of the smartphone 20 on the car navigation device 10, it becomes easy to understand which part of the smartphone 20 is being operated. Further, since the image is not transmitted from the car navigation device 10, the amount of data at the time of communication can be reduced.

In the above two embodiments, the car navigation device 10 is described as the first terminal and the smartphone 20 is described as the second terminal, but the present invention is not limited thereto. For example, the second terminal may be an electronic device having a touch panel capable of multi-touch, such as a tablet terminal, instead of the smartphone 20. Further, the first terminal may not be the car navigation device 10 but may be a navigation device for a ship or an aircraft, a car audio system, or the like. Further, the first terminal may be a device (personal computer or the like) that does not have a touch panel but operates menu buttons, icons, and the like on the screen.

Further, the touch panel of the second terminal is not limited to the capacitance type, and may be another method as long as it is a method capable of multi-touch such as an optical type. The touch panel of the first terminal is not limited to the resistance film type, and may be an ultrasonic type or the like, or may not be provided with the touch panel as described above.

Further, the present invention is not limited to the above examples. That is, those skilled in the art can carry out various modifications according to conventionally known knowledge within a range that does not deviate from the gist of the present invention. As long as the display device and the display system of the present invention are still provided by such a modification, the present invention is, of course, included in the scope of the present invention.

10 Car navigation device (1st terminal, display device)
18 Operation unit (resistive film type touch panel)
19 Wired processing unit (1st communication unit, communication unit)
1A Wireless processing unit (1st communication unit, communication unit)
1C display unit (first display unit, display unit)
20 Smartphone (second terminal)
26 Display section (second display section)
2B storage unit 2C operation unit (capacitive touch panel)
2D wired processing unit (second communication unit)
2E wireless processing unit (second communication unit)
100 Display system F frame (range)

Claims (10)

A display system consisting of a first terminal and a second terminal.
The first terminal includes a first display unit that displays a first image including a plurality of images for operating the first terminal, and a first communication unit that communicates with the second terminal.
The second terminal is a second communication unit that communicates with the first terminal, and the first image is a mode in which the arrangement of the plurality of images is rearranged, and a second image for operating the first terminal is displayed. A storage unit for storing and a second display unit for displaying the second image corresponding to the first image are provided.
The first terminal receives display range information indicating a display range in the second display unit of the second image from the second terminal, and based on the display range information, the first display unit is in the first image. A display system comprising displaying the display range of the second image in the above. The plurality of images are button images for operating the first terminal, and are
The display range information includes an ID assigned to each of the button images, and includes the ID.
The first terminal displays the range of the button image associated with the ID in the first image as the display range.
The display system according to claim 1. The display system according to claim 1 or 2, wherein the first terminal displays on the first display unit as a frame surrounding the display range based on the display range information received from the second terminal. .. The first terminal is characterized in that the inside of the display range is displayed on the first display unit in a manner different from the outside of the display range based on the display range information received from the second terminal. The display system according to item 1 or 2. The first display unit of the first terminal is provided with a resistance film type touch panel, and the second display unit of the second terminal is provided with a capacitance type touch panel. The display system according to any one of 4 to 4. The display system according to any one of claims 1 to 5, wherein the first terminal is a navigation device, and the second terminal is a mobile device. A display unit that displays a first image including a plurality of images for operating the display device, and the first image is an image in which the arrangement of the plurality of images is rearranged, and a second image for operating the display device. A communication unit that stores an image and communicates with an external terminal on which the second image is displayed is provided.
The communication unit receives the display range information indicating the display range of the second image in the external terminal, and receives the display range information.
The display unit displays the display range of the second image in the first image based on the display range information.
A display device characterized by that. In the display method executed by the display device that displays the image on the display unit,
The first image including the plurality of images for operating the display device is an image in which the arrangement of the plurality of images is rearranged, and the second image for operating the display device is stored and the second image is stored. A communication process for receiving display range information indicating the display range of the second image on the external terminal from the displayed external terminal, and
A display step of displaying the display range of the second image in the first image on the display unit based on the display range information, and a display step of displaying the display range of the second image in the first image.
A display method characterized by including. A display program comprising executing the display method according to claim 8 by a computer. A computer-readable recording medium comprising the display program according to claim 9.

Images