JP2012242927A - Mobile terminal device, control method for mobile terminal device, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a mobile terminal device, a control method for the mobile terminal device, and a program that enable a device external to the mobile terminal device to perform operation in which manipulation in the mobile terminal device is reflected.SOLUTION: A mobile terminal device 21 capable of transmitting data to a projector 11 displays an image corresponding to image data on a display panel 22, and when a contact manipulation on the display panel 22 is detected in a state where the image is displayed, the image data is transmitted to the projector 11.

Description

  The present invention relates to a mobile terminal device, a control method for a mobile terminal device, and a program.

  In recent years, mobile terminal devices that reproduce image data and display images have become widespread. As a method of using this type of mobile terminal device, it has been proposed to transmit image data to an external display device and display the image data on the external display device (see, for example, Patent Document 1). In Patent Document 1, image data is transmitted from a PDA as a mobile terminal device to a projector as a display device and displayed.

JP 2004-259090 A

By the way, many of the mobile terminal devices that have become particularly popular in recent years are equipped with an input device such as a large touch screen and can perform various operations. However, unlike the configuration described in Patent Document 1, the operation mode of the mobile terminal device has not been reflected to the operation of the external device.
The present invention solves the above-described problems of the prior art, and controls a mobile terminal device and a mobile terminal device capable of causing an external device of the mobile terminal device to perform an operation reflecting an operation in the mobile terminal device. It is an object to provide a method and a program.

In order to achieve the above object, the present invention is a mobile terminal apparatus, which corresponds to image data on a display screen, a communication means capable of transmitting data to an external display device, a storage means for storing image data. Display means for displaying an image; detection means for detecting a contact operation on the display screen; and when the contact means is detected by the detection means in a state where an image corresponding to the image data is displayed by the display means And control means for transmitting the image data to the display device by the communication means.
According to the present invention, when the mobile terminal device performs a contact operation on the display screen on which the image is displayed, the image data corresponding to the image is transmitted to the display device. The same image as the image can be displayed on the display device. Accordingly, the display device can be operated by reflecting the operation in the mobile terminal device, and the operability of the display device can be improved by using the user interface of the mobile terminal device.

In order to achieve the above object, the present invention provides a mobile terminal device that is capable of transmitting data to an external display device, storing means for storing image data, and corresponding to the image data on a display screen. Display means for displaying an image to be detected, detection means for detecting an operation of moving the mobile terminal apparatus, and moving the mobile terminal apparatus by the detection means in a state where an image corresponding to the image data is displayed by the display means Control means for transmitting the image data to the display device by the communication means when an operation is detected.
According to the present invention, when the mobile terminal device performs an operation of moving the mobile terminal device while displaying an image, image data corresponding to the image is transmitted to the display device, so that the mobile terminal device displays the image data. The same image as the displayed image can be displayed on the display device. Accordingly, the display device can be operated by reflecting the operation in the mobile terminal device, and the operability of the display device can be improved by using the user interface of the mobile terminal device.

In the mobile terminal device, the present invention further includes an operation determination unit that determines at least one of a direction or a speed of the contact operation or an operation of moving the mobile terminal device. When a contact operation or an operation of moving the mobile terminal device is detected by the detection unit in a state where an image corresponding to image data is displayed, the direction or speed determined by the operation determination unit is reflected. Information for the display device to display an image corresponding to the image data is transmitted to the display device by the communication means.
According to the present invention, at least one of a contact operation in the mobile terminal device or an operation direction or speed of the operation of moving the mobile terminal device is determined, and the display device displays an image in a form reflecting the operation direction or speed. Since the information for display is transmitted to the display device, it is possible to cause the display device to perform display that reflects the mode of operation on the mobile terminal device.

In the mobile terminal device according to the present invention, the control unit transmits information indicating the direction and speed determined by the operation determination unit to the display device together with the image data.
According to the present invention, the display device can easily acquire the direction and speed of the operation of the mobile terminal device, and can display an image in a form reflecting the direction and speed of the operation.

In the mobile terminal device according to the present invention, the control unit transmits the information to the display device when the contact operation detected by the detection unit is a slide operation that continues outside the display screen. It is characterized by that.
According to the present invention, in response to the slide operation on the display screen of the mobile terminal device, information indicating the direction and speed of the slide operation is transmitted to the display device, so that the display device can be operated easily and easily. Thus, the image can be displayed in an arbitrary form.

In order to achieve the above object, the present invention provides a method for controlling a mobile terminal device capable of transmitting data to an external display device, displaying an image corresponding to image data on a display screen, and contacting the display screen When an operation is detected and a contact operation is detected in a state where an image corresponding to the image data is displayed on the display screen, the image data is transmitted to the display device.
By performing the control method of the present invention, when the mobile terminal device performs a touch operation on the display screen on which the image is displayed, image data corresponding to the displayed image is transmitted to the display device, and the mobile terminal device The currently displayed image is displayed on the display device. Accordingly, the display device can be operated by reflecting the operation in the mobile terminal device, and the operability of the display device can be improved by using the user interface of the mobile terminal device.

In order to achieve the above object, the present invention provides a method for controlling a mobile terminal device capable of transmitting data to an external display device, displaying an image corresponding to image data on a display screen, When an operation for moving the mobile terminal device is detected by the detection means in a state where an image corresponding to the image data is displayed on the display screen, the image data is transmitted to the display device. It is characterized by doing.
According to the present invention, when the mobile terminal device performs an operation of moving the mobile terminal device while displaying an image, image data corresponding to the displayed image is transmitted to the display device and displayed on the mobile terminal device. Are displayed on the display device. Accordingly, the display device can be operated by reflecting the operation in the mobile terminal device, and the operability of the display device can be improved by using the user interface of the mobile terminal device.

In order to achieve the above object, the present invention provides communication means capable of transmitting data to an external display device, storage means for storing image data, and display means for displaying an image corresponding to the image data on a display screen. A computer-executable program for controlling a mobile terminal device comprising: a detecting means for detecting a touch operation on the display screen; and an image corresponding to the image data displayed by the display means. When a contact operation is detected by the detection unit, the image data is transmitted to the display device by the communication unit and functions as a control unit.
When the mobile terminal device performs a touch operation on the display screen on which the image is displayed by executing the program of the present invention, image data corresponding to the displayed image is transmitted to the display device, and the mobile terminal device The image being displayed is displayed by the display device. Accordingly, the display device can be operated by reflecting the operation in the mobile terminal device, and the operability of the display device can be improved by using the user interface of the mobile terminal device.

In order to achieve the above object, the present invention provides communication means capable of transmitting data to an external display device, storage means for storing image data, and display means for displaying an image corresponding to the image data on a display screen. A computer-executable program for controlling a mobile terminal device comprising: detecting means for detecting an operation for moving the mobile terminal device; and a state in which an image corresponding to the image data is displayed by the display means When the operation of moving the mobile terminal device is detected by the detecting unit, the control unit functions as a control unit that transmits the image data to the display device by the communication unit.
By executing the program of the present invention, the mobile terminal device performs an operation of moving the mobile terminal device while displaying an image, whereby image data corresponding to the displayed image is transmitted to the display device, and the mobile terminal The image being displayed on the device is displayed by the display device. Accordingly, the display device can be operated by reflecting the operation in the mobile terminal device, and the operability of the display device can be improved by using the user interface of the mobile terminal device.

  ADVANTAGE OF THE INVENTION According to this invention, the operativity of a display apparatus can be improved using the user interface of a mobile terminal device.

It is a figure which shows the example of schematic structure and the display aspect of the display system which concerns on embodiment to which this invention is applied. It is a block diagram which shows the functional structure of a mobile terminal device. It is a block diagram which shows the functional structure of a projector. It is a figure which shows another example of the display mode of a display system. It is a flowchart which shows operation | movement of a mobile terminal device. It is a flowchart which shows operation | movement of a projector.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a diagram showing a schematic configuration of a display system 10 configured to include a projector 11 as a display device to which the present invention is applied and a mobile terminal device 21.
As shown in FIG. 1, the projector 11 is a device that projects an image onto a screen SC. In addition, the mobile terminal device 21 has a display panel 22 as a display screen on the front surface of the housing. The surface of the display panel 22 is a touch screen 23 which will be described later, and a touch operation on the display panel 22 can be detected. In addition, the mobile terminal device 21 is provided with operators such as a switch 24 arranged side by side on the display panel 22.
The screen SC on which the projector 11 projects an image is almost upright, and the screen surface has, for example, a rectangular shape. The projector 11 can project a moving image (video) on the screen SC or can continue to project a still image on the screen SC.

  The projector 11 and the mobile terminal device 21 are connected so as to be able to transmit and receive various data by a wireless communication method. As this wireless communication method, for example, a short-range wireless communication method such as wireless LAN, Bluetooth (registered trademark), UWB, infrared communication, or a wireless communication method using a mobile phone line can be adopted. In addition, the projector 11 and the mobile terminal device 21 are not limited to a form in which the projector 11 and the mobile terminal apparatus 21 are connected on a one-to-one basis, and may be a form in which the projector 11 and the mobile terminal apparatus 21 are communicably connected together with other plural devices.

The mobile terminal device 21 is a portable terminal device that a user operates with a hand. The mobile terminal device 21 can be operated by a user touching the surface of the display panel 22 with a finger in addition to the operation of the switches 24 and the like. In response to these operations, for example, the stored image data is reproduced to display an image.
An operation on the display panel 22 is detected as position coordinates in an orthogonal coordinate system 221 virtually provided on the display panel 22. That is, when the user touches the display panel 22 with a finger, the mobile terminal device 21 that has detected this operation specifies the coordinates of the contact position. 1 shows an orthogonal coordinate system 221 with the center of the display panel 22 as the origin, but one corner of the display panel 22 may be the origin. When the operation on the surface of the display panel 22 is a so-called slide operation in which the finger moves on the display panel 22, the mobile terminal device 21 acquires the movement locus, and the movement direction and movement speed. It has a function to determine the thickness. Therefore, for example, as shown by an arrow A in FIG. 1, when a slide operation is performed from the lower left side of the display panel 22 toward the upper right side, the mobile terminal device 21 determines the direction and moving speed of the operation. In the example of FIG. 1, the slide operation indicated by the arrow A is an operation to go out from the edge of the display panel 22. In response to this sliding operation, the mobile terminal device 21 changes the display mode so that the image 201 displayed on the display panel 22 is moved in the arrow A direction. When it is detected that the slide operation has moved out of the edge of the display panel 22, the mobile terminal device 21 transmits movement data indicating the direction and speed of the slide operation and image data of the image 201 to the projector 11. To do.

On the other hand, the orthogonal coordinate system 110 is virtually set in the projector 11 in the projection area where the projector 11 projects an image. In the present embodiment, as an example, the projection area of the projector 11 is rectangular, and is considered to be the same as the screen SC. Therefore, in FIG. 1, coordinate axes are set along the horizontal direction and the vertical direction of the screen SC.
When the projector 11 receives the image data and the movement data from the mobile terminal device 21, the projector 11 displays the image 201 on the screen SC based on the received image data, and reflects the direction and speed of the slide operation in the figure. The image 201 is moved in the direction indicated by the arrow A ′.
As described above, in the display system 10, an operation for moving the image 201 displayed on the mobile terminal device 21 is performed, and when this operation goes out of the display panel 22, the image 201 is displayed by the projector 11. Therefore, using the display panel 22 which is a user interface of the mobile terminal device 21 and a touch screen 23 (FIG. 2) to be described later, both the mobile terminal device 21 and the projector 11 are operated, and an interesting display is performed. be able to. In addition, the operability of the projector 11 can be improved.

Hereinafter, the configuration of the display system 10 of the embodiment will be described in detail.
FIG. 2 is a block diagram showing a functional configuration of the mobile terminal device 21.
As shown in FIG. 2, the mobile terminal device 21 includes a control unit 211 that controls each unit of the mobile terminal device 21. The control unit 211 includes a CPU, RAM, ROM, and the like (not shown), and controls the mobile terminal device 21 by executing a basic control program stored in the ROM by the CPU. The control unit 211 is connected to a storage unit 214 as a storage unit. The storage unit 214 stores various programs including the control program 214A and various data such as image data 215 in a nonvolatile manner. Yes.
The control unit 211 executes the control program 214 </ b> A stored in the storage unit 214 to determine the direction and speed of the operation detected by the operation detection unit 217, and the image data to the projector 11. It functions as an image transmission control unit 213 that performs processing for transmitting 215.

In addition, the mobile terminal device 21 includes the touch screen 23 that detects a contact operation on the entire surface of the display panel 22 as described above, the switch unit 25 including various operators including the switch 24, and the acceleration sensor 26. Yes. The touch screen 23 detects a contact operation on the display panel 22 and outputs a signal indicating the detected operation position to the operation detection unit 217. The operation detection unit 217 serving as a detection unit generates control data indicating the coordinates of the operation position based on a signal input from the touch screen 23 and outputs the control data to the control unit 211. The switch unit 25 outputs an operation signal to the operation detection unit 217 when each operation element including the switch 24 is operated. The operation detection unit 217 generates control data corresponding to the operated operator based on the operation signal input from the switch unit 25 and outputs the control data to the control unit 211. The acceleration sensor 26 is fixed to the main body (housing) of the mobile terminal device 21 and detects acceleration applied to the mobile terminal device 21. As the acceleration sensor 26, a sensor that detects acceleration in directions of one axis, two axes, or three axes or more can be used. The acceleration sensor 26 constantly samples the acceleration at a predetermined cycle, and outputs a signal indicating the detected acceleration and the axial direction to the operation detection unit 217. The operation detection unit 217 is based on a signal input from the acceleration sensor 26 and the detected acceleration and a direction axis preset in the mobile terminal device 21 (for example, similar to the orthogonal coordinate system 221 shown in FIG. 1). Control data indicating the direction of acceleration with respect to the axis) and output to the control unit 211.
Based on the control data input from the operation detection unit 217, the control unit 211 can detect a contact operation on the display panel 22, an operation of each operator including the switch 24, and an operation of moving the main body of the mobile terminal device 21. .

  Connected to the control unit 211 is a display unit 216 as display means for driving the display panel 22 to display various screens. The display unit 216 draws a frame according to the display resolution of the display panel 22 in a drawing memory (not shown) based on the image data input from the control unit 211, and drives the display panel 22 based on the drawn frame. The display panel 22 is a flat panel display composed of a transmissive, reflective or transflective liquid crystal display panel, an organic EL display panel called OLED (Organic Light-emitting-diode), OEL (Organic Electro-Luminescence), or the like. is there. In the case of using a transmissive and transflective liquid crystal panel, a backlight is attached.

  The control unit 211 is connected to a wireless communication unit 218 as a communication unit that transmits and receives various data to and from the projector 11 according to the wireless communication method described above. The wireless communication unit 218 includes an antenna and an RF circuit (not shown), and is controlled by the image transmission control unit 213 of the control unit 211 to transmit image data and the like to the projector 11.

When the control data indicating the coordinates of the operation position on the touch screen 23 is input from the operation detection unit 217 to the operation determination unit 212 as the operation determination unit, the touch operation to the display panel 22 is performed based on the control data. It is determined whether the operation is a touch operation at a location or a slide operation that moves on the display panel 22. The operation determination unit 212 detects an operation when a contact operation that is not a slide operation is performed when a screen displayed on the display panel 22 by the display unit 216 forms a GUI (graphical user interface). The process or function corresponding to the operation position specified by the control data input from the unit 217 is specified, and this process or function is executed. Further, the operation determination unit 212 determines the presence / absence of an operation for moving the main body of the mobile terminal device 21 based on the control data input from the operation detection unit 217 based on the detection value of the acceleration sensor 26. The operation determination unit 212 determines the direction and speed of the operation based on the acceleration detected by the acceleration sensor 26 when an operation of moving the mobile terminal device 21 is performed. The control unit 211 controls the display unit 216 according to the direction and speed of the operation determined by the operation determination unit 212 and changes the display mode of the image being displayed on the display panel 22.
In addition, the image transmission control unit 213 as a control unit generates movement data indicating the direction and speed of the operation determined by the operation determination unit 212, and the image data 215 stored in the storage unit 214 together with the wireless communication unit 218. Transmit to the projector 11.

FIG. 3 is a block diagram illustrating a functional configuration of the projector 11.
The projector 11 includes an I / F (interface) 101 connected to an external device, and a PC 13 is connected to the I / F 101. For example, the I / F 101 is a composite video signal such as a USB interface, a wired or wireless LAN interface, a VGA terminal to which an analog video signal is input, a DVI (Digital Visual Interface) to which a digital video signal is input, NTSC, PAL, and SECAM. Input S video terminal, composite video signal input RCA terminal, component video signal input D terminal, HDMI (registered trademark) standard HDMI connector, etc. via the above terminals and connectors And an interface circuit for inputting and outputting signals.

The projector 11 is roughly composed of a projection unit 3 (display unit) that forms an optical image and an image processing system that electrically processes an image signal input to the projection unit 3. The projection unit 3 includes an illumination optical system 31, a liquid crystal panel 32 as a light modulation device, and a projection optical system 33. The illumination optical system 31 includes a light source including a xenon lamp, an ultra high pressure mercury lamp, an LED (Light Emitting Diode), and the like. The illumination optical system 31 may include a reflector and an auxiliary reflector that guide light emitted from the light source to the liquid crystal panel 32, and a lens group (not shown), a polarizing plate, A light control element or the like that reduces the amount of light emitted from the light source on the path to the liquid crystal panel 32 may be provided.
The liquid crystal panel 32 receives a signal from an image processing system, which will be described later, and forms an image on the panel surface. The liquid crystal panel 32 includes three liquid crystal panels corresponding to the three primary colors of RGB in order to perform color projection. Therefore, the light from the illumination optical system 31 is separated into three color lights of RGB, and each color light enters each corresponding liquid crystal panel. The color light modulated by passing through each liquid crystal panel is combined by a combining optical system such as a cross dichroic prism and emitted to the projection optical system 33.

The projection optical system 33 includes a zoom lens that performs enlargement / reduction of a projected image and a focus adjustment, a zoom adjustment motor that adjusts the degree of zoom, a focus adjustment motor that performs focus adjustment, and the like. The projection optical system 33 projects the incident light modulated by the liquid crystal panel 32 on the screen SC using a zoom lens.
The projection unit 3 includes a projection optical system drive unit 121 that drives each motor included in the projection optical system 33 according to the control of the control unit 103, and a light source drive that drives a light source included in the illumination optical system 31 according to the control of the control unit 103. The unit 117 is connected.

  The image processing system is configured around a control unit 103 that controls the entire projector 11 in an integrated manner, a storage unit 105 that stores data processed by the control unit 103 and a control program 105A executed by the control unit 103, and an operation panel 45. And an input processing unit 123 for detecting an operation via the remote control light receiving unit 41, an image processing unit 113 for processing an input image input from the I / F 101, and a liquid crystal based on an image signal output from the image processing unit 113. A light modulation device driving unit 119 that performs drawing by driving the panel 32 is provided.

  The control unit 103 reads out and executes the control program 105 </ b> A stored in the storage unit 105, thereby controlling each unit of the projector 11. The control unit 103 detects the content of the operation performed by the user based on the operation signal input from the input processing unit 123, and in response to this operation, the image processing unit 113, the light modulation device driving unit 119, and the projection optical system. The driving unit 121 and the light source driving unit 117 are controlled to cause the projection unit 3 to project an image on the screen SC.

In the main body of the projector 11, an operation panel 45 provided with various switches and indicator lamps for operation by the user is arranged. The operation panel 45 is connected to the input processing unit 123, and the input processing unit 123 turns on or blinks the indicator lamp of the operation panel 45 as appropriate according to the operation state and setting state of the projector 11 according to the control of the control unit 103. . When the switch of the operation panel 45 is operated, an operation signal corresponding to the operated switch is output from the input processing unit 123 to the control unit 103.
The projector 11 has a remote controller (not shown) used by the user. The remote control includes various buttons, and transmits an infrared signal corresponding to the operation of these buttons. The main body of the projector 11 is provided with a remote control light receiving unit 41 that receives an infrared signal emitted from the remote control. The remote control light receiving unit 41 decodes the infrared signal received from the remote control, generates an operation signal indicating the operation content on the remote control, and outputs the operation signal to the control unit 103.

The I / F 101 acquires an analog image signal or digital image data input via the I / F 101, and determines an analog image signal and digital image data, identifies a data format of the digital image data, and the like. 113 is connected.
The image processing unit 113 has a function of A / D converting the analog input signal and outputting digital image data when an analog image signal is input from an external image supply device. Further, the image processing unit 113 executes resolution conversion processing for converting the image data of the input image into data having a resolution that conforms to the specifications of the liquid crystal panel 32, and the display image displayed on the liquid crystal panel 32 is displayed in the frame memory 115. And the developed display image is output to the light modulator driving unit 119. The light modulator driving unit 119 drives the liquid crystal panel 32 based on the display image input from the image processing unit 113. Accordingly, an image is drawn on the liquid crystal panel 32 under the control of the control unit 103, and this image is projected as a projected image on the screen SC via the projection optical system 33.

A wireless communication unit 47 (reception unit) is connected to the control unit 103. The wireless communication unit 47 transmits / receives data to / from the mobile terminal device 21 using the wireless communication method described above, and outputs the received data to the control unit 103.
The control unit 103 functions as the communication control unit 131 by executing the control program 105A. The communication control unit 131 controls the wireless communication unit 47 to receive image data transmitted from the mobile terminal device 21 and movement data indicating the direction and speed of the operation.
Further, the control unit 103 functions as the display control unit 132 by executing the control program 105A. The display control unit 132 (display control unit) controls the image processing unit 113 to perform processing for displaying the image data received by the wireless communication unit 47 in the same manner as the image input via the I / F 101. Let it be done. Further, the display control unit 132 controls the image processing unit 113 so that the image displayed on the liquid crystal panel 32 moves based on the movement data received from the mobile terminal device 21 by the communication control unit 131. Change state.
With the function of the display control unit 132, as shown in FIG. 1, the image 201 is displayed on the screen SC in a manner reflecting the direction and speed of the operation on the display panel 22, and the image 201 on the screen SC is further displayed. The display state can be changed.

In the display system 10, image data can be transmitted from the mobile terminal device 21 to the projector 11 and displayed by an operation of moving the mobile terminal device 21.
FIG. 4 is a diagram illustrating another example of the display mode in the display system 10.
In the example of FIG. 1 described above, the projector 11 displays the image 201 on the screen SC in a form that reflects the direction and speed of the slide operation in response to the slide operation on the display panel 22. On the other hand, in the example shown in FIG. 4, similarly to the example of FIG. 1, the mobile terminal device 21 is set with an orthogonal coordinate system 221 according to the display panel 22, and the projector 11 is matched with the projection range on the screen SC. An orthogonal coordinate system 110 is set.
In a state where the mobile terminal device 21 displays the image 201 on the display panel 22 by the function of the display unit 216, for example, as shown in FIG. 4, the user performs an operation of shaking the mobile terminal device 21 main body (so-called shake operation). In the case (arrow B), the acceleration sensor 26 mounted on the display panel 22 detects the acceleration in the direction indicated by the arrow C in the figure. The operation determination unit 212 acquires control data input from the operation detection unit 217, determines the direction of acceleration based on the detection value of the acceleration sensor 26 obtained from the control data, and further detects the magnitude of the detected acceleration. Based on the change in height, the speed at which the mobile terminal device 21 is shaken is determined.

The image transmission control unit 213 generates movement data indicating the direction of acceleration determined by the operation determination unit 212 and the speed of the operation, and transmits the movement data to the projector 11 together with the image data 215.
When the projector 11 receives the image data 215 and the movement data from the mobile terminal device 21 under the control of the communication control unit 131, the display control unit 132 projects the received image data on the screen SC by the projection unit 3. Further, the display control unit 132 changes the display mode so as to move the displayed image data based on the movement data.
Therefore, as shown in FIG. 4, the image 201 displayed on the display panel 22 is projected onto the screen SC, and the image 201 moves in the direction C ″ corresponding to the arrow C of the mobile terminal device 21 on the screen SC. Projected to do.

  Furthermore, the display control unit 132 of the projector 11 can also project the image 201 in such a manner that the image 201 appears from below the screen SC as indicated by an arrow C ′. That is, not only the image 201 is moved so as to simply reflect the direction and speed of the operation of shaking the display panel 22, but also the movement trajectory of the image 201 is extended and displayed along this operation direction. Also good. In this case, since the operation in the mobile terminal device 21 is exaggerated and reflected in the display mode, an impression that the operability becomes sharp is given to the user, and more interesting display can be performed.

FIG. 5 is a flowchart showing the operation of the mobile terminal device 21.
When the display unit 216 displays an image on the display panel 22 in accordance with an operation on the touch screen 23 or the switch unit 25 under the control of the control unit 211, the mobile terminal device 21 displays the image on the display panel 22 (step S11). A contact operation to the display panel 22 (display panel 22) is detected (step S12). If there is a touch operation on the touch screen 23 (step S12; Yes), the operation determination unit 212 acquires an operation position based on the control data input from the operation detection unit 217 (step S13), It is determined whether or not the detected operation is a slide operation (step S14).

  When the detected operation is a slide operation (step S14; Yes), the operation determination unit 212 determines the direction and speed of the slide operation (step S15). Subsequently, the image transmission control unit 213 generates movement data indicating the direction and speed determined by the operation determination unit 212 (step S16). Then, the image transmission control unit 213 controls the display unit 216 so as to correspond to the generated movement data and moves the image displayed on the display panel 22 (step S17), while the image of the image being displayed is displayed. The data and the movement data generated in step S16 are transmitted to the projector 11 (step S18). Thereafter, the controller 211 shifts to an operation standby state (step S19).

Further, when the operation determination unit 212 determines that the operation detected by the operation detection unit 217 is not a slide operation (step S14; No), the function or process corresponding to the operation position in the GUI displayed on the display panel 22 is performed. Is specified, the specified function or process is executed (step S20), and the operation standby state is entered (step S19).
On the other hand, when there is no touch operation on the touch screen 23 (step S12; No), the operation determination unit 212 acquires the detection value of the acceleration sensor 26 from the control data input from the operation detection unit 217, The presence / absence of an operation of shaking the mobile terminal device 21 is determined (step S21). When the shake operation is not performed (step S21; No), the operation determination unit 212 returns to step S12.

When there is a shake operation on the mobile terminal device 21 (step S21; Yes), the operation determination unit 212 determines the direction and speed of the operation based on the control data input from the operation detection unit 217 (step S22). The process proceeds to step S16. Thereafter, movement data is generated by the image transmission control unit 213 (step S16), the display is updated based on the movement data (step S17), and the movement data is transmitted to the projector 11 together with the image data (step S18). .
By performing a slide operation or a shake operation on the mobile terminal device 21 by these processes, transmission of image data corresponding to the image being displayed on the mobile terminal device 21 to the projector 11 is started. It becomes possible to display an image being displayed by the device 21.

FIG. 6 is a flowchart showing the operation of the projector 11.
When the communication control unit 131 of the projector 11 receives the data transmitted from the mobile terminal device 21 by the wireless communication unit 47 (step S31), the communication control unit 131 determines whether the received data includes movement data (step S32). ). Here, when movement data indicating the direction and speed of operation in the mobile terminal device 21 is received (step S32; Yes), the display control unit 132 performs the direction and speed of operation based on the received movement data. Is acquired (step S34). Next, the display control unit 132 determines a display mode so as to reflect the direction and speed of the acquired operation (step S35), controls the image processing unit 113 according to the display mode, and causes the projection unit 3 to perform image processing. The data is displayed on the screen SC and further moved (step S36). Thereafter, the control unit 103 shifts to a standby state (step S37) and waits until data is received by an operation of a remote controller (not shown) or the operation panel 45 or by the wireless communication unit 47.

  If the data received from the mobile terminal device 21 does not include the movement data (step S32; No), the display control unit 132 controls the image processing unit 113 to receive the image data received from the mobile terminal device 21. Is displayed on the screen SC (step S33), and a transition is made to a standby state in step S37.

  As described above, the mobile terminal device 21 of the display system 10 according to the embodiment to which the present invention is applied includes the wireless communication unit 218 that can transmit data to the projector 11, the storage unit 214 that stores image data, and the storage A display unit 216 that displays an image corresponding to the image data stored in the unit 214 on the display panel 22, an operation detection unit 217 that detects a touch operation on the display panel 22, and an image corresponding to the image data by the display unit 216. An image transmission control unit 213 that transmits the image data to the projector 11 by the wireless communication unit 218 when a contact operation is detected by the operation detection unit 217 in the displayed state. The image displayed by the mobile terminal device 21 by performing a contact operation on the displayed display panel 22 There is displayed by the projector 11. Thereby, the projector 11 can be operated by reflecting the operation in the mobile terminal device 21, and the operability of the projector 11 can be improved using the user interface of the mobile terminal device 21.

  In addition, the mobile terminal device 21 displays on the display panel 22 a wireless communication unit 218 that can transmit data to the projector 11, a storage unit 214 that stores image data, and an image corresponding to the image data stored in the storage unit 214. Display unit 216, operation detection unit 217 that detects an operation of moving mobile terminal device 21, and display unit 216 displays mobile terminal device 21 by operation detection unit 217 in a state where an image corresponding to the image data is displayed. An image transmission control unit 213 that transmits the image data to the projector 11 by the wireless communication unit 218 when a moving operation is detected, and the mobile terminal device 21 moves the mobile terminal device 21 while displaying an image. By performing the operation, the image being displayed on the mobile terminal device 21 is displayed by the projector 11. Thereby, the projector 11 can be operated by reflecting the operation in the mobile terminal device 21, and the operability of the projector 11 can be improved using the user interface of the mobile terminal device 21.

In addition, the mobile terminal device 21 includes an operation determination unit 212 that determines the direction and speed of the contact operation detected by the operation detection unit 217, and the image transmission control unit 213 displays an image corresponding to the image data on the display unit 216. When the operation detection unit 217 detects a contact operation or an operation of moving the mobile terminal device 21 in the displayed state, the projector 11 reflects the image data in a form reflecting the direction and speed determined by the operation determination unit 212. Since the information for displaying the image corresponding to is transmitted to the projector 11 by the wireless communication unit 218, the projector 11 can cause the display reflecting the mode of operation on the mobile terminal device 21.
Here, the mobile terminal device 21 determines at least one of the direction and speed of the contact operation, and the projector 11 may perform display reflecting the direction or speed of the contact operation. In this case as well, the display reflecting the mode of operation on the mobile terminal device 21 can be performed as in the above embodiment.
Further, since the image transmission control unit 213 transmits the image data displayed on the display panel 22 by the display unit 216 to the projector 11, the image data stored in the mobile terminal device 21 can be displayed by the projector 11.

  In addition, the image transmission control unit 213 transmits, together with the image data, movement data indicating the direction and speed determined by the operation determination unit 212 to the projector 11, so in the projector 11, the direction of operation of the mobile terminal device 21 and The speed can be easily acquired, and the image can be displayed in a form reflecting the direction and speed of the operation.

  In addition, the image transmission control unit 213 transmits information to the projector 11 when the contact operation detected by the operation detection unit 217 is a slide operation that continues outside the display panel 22, and thus the display panel of the mobile terminal device 21. In response to the slide operation on the movement number 22, movement data indicating the direction and speed of the slide operation is transmitted to the projector 11. Therefore, the projector 11 can be easily and easily operated to display an image in an arbitrary form. be able to.

  In addition, the projector 11 is a wireless communication unit that receives the projection unit 3 that displays image data, the image data transmitted from the mobile terminal device 21, and the movement data that indicates the direction and speed of the operation on the mobile terminal device 21. 47 and a display control unit 132 that displays the image data received by the wireless communication unit 47 by the projection unit 3 in a form that reflects the direction and speed of the operation in the mobile terminal device 21. 11, an image can be displayed reflecting the direction and speed of the operation on the mobile terminal device 21.

  In addition, embodiment mentioned above does not limit this invention, It is also possible to apply this invention as an aspect different from the said embodiment. For example, in the above-described embodiment, the projector 11 has been described with an example in which the image 201 is moved on the screen SC so as to coincide with the direction of operation on the mobile terminal device 21, but the present invention is limited to this. The display mode may not completely match the operation on the mobile terminal device 21 or may be more roughly reflected, and the user operating the mobile terminal device 21 reflects the direction of the operation. What is necessary is just to be able to recognize. The same applies to the speed of operation. Furthermore, in the above-described embodiment, the configuration in which the acceleration sensor 26 is provided to detect the operation of shaking the mobile terminal device 21 is exemplified, but the same effect can be obtained by providing a gyro sensor instead of the acceleration sensor 26.

Further, for example, in the above-described embodiment, the case where the mobile terminal device 21 having a function of storing and displaying image data is used as the mobile terminal device has been described as an example. However, the function provided in the mobile terminal device 21 is not limited. The present invention may be applied to various portable devices such as a device having a call function as a portable phone and a communication function via a wireless telephone line, a portable video game machine, and an electronic book browsing terminal.
Further, for example, in the above-described embodiment, a configuration using three transmissive or reflective liquid crystal panels 32 corresponding to each color of RGB as a modulation unit that modulates light emitted from the light source has been described as an example. However, the present invention is not limited to this, for example, a system using one liquid crystal panel and a color wheel, a system using three digital mirror devices (DMD), a single digital mirror device, You may comprise by the system etc. which combined the color wheel. Here, when only one liquid crystal panel or DMD is used as the modulation unit, a member corresponding to a synthetic optical system such as a cross dichroic prism is unnecessary. In addition to the liquid crystal panel and DMD, any light can be used without any problem as long as the light emitted from the light source can be modulated.

  Furthermore, the display device of the present invention is not limited to the projector that projects an image on the screen SC, but a liquid crystal monitor or liquid crystal television that displays an image on a liquid crystal display panel, or a monitor that displays an image on a PDP (plasma display panel). Various display devices such as a monitor device that displays an image on an organic EL display panel such as a device or a television receiver, OLED, OEL, or a self-luminous display device such as a television receiver are also included in the display device of the present invention. A portable display device that can display an image based on the input image signal in color is also included. In this case, a liquid crystal display panel, a plasma display panel, and an organic EL display panel correspond to the modulation means.

  Further, in the above embodiment, the non-volatile memory (not shown) stores the control program stored in the storage unit 105 of the projector 11 and the control program 214A stored in the storage unit 214 of the mobile terminal device 21. Alternatively, it may be configured to be stored in a portable recording medium, or may be stored so that the mobile terminal device 21 can be downloaded to another device connected via a communication network. Moreover, each function part of the mobile terminal device 21 and the projector 11 shown in FIGS. 2 and 3 shows a functional configuration, and a specific mounting form is not particularly limited. That is, it is not always necessary to mount hardware corresponding to each function unit individually, and it is of course possible to adopt a configuration in which the functions of a plurality of function units are realized by one processor executing a program. In addition, in the above embodiment, a part of the function realized by software may be realized by hardware, or a part of the function realized by hardware may be realized by software. In addition, the specific detailed configuration of the display system 10 can be arbitrarily changed without departing from the spirit of the present invention.

  DESCRIPTION OF SYMBOLS 3 ... Projection part (display means), 10 ... Display system, 11 ... Projector (display device), 21 ... Mobile terminal device, 22 ... Display panel (display screen), 23 ... Touch screen, 26 ... Acceleration sensor, 45 ... Operation Panel 47: Wireless communication unit (reception unit) 103 ... Control unit 105 ... Storage unit 105A ... Control program 113 ... Image processing unit 123 ... Input processing unit 131 ... Communication control unit 132 ... Display control unit , 201 ... image, 211 ... control unit, 212 ... operation determination unit (operation determination unit), 213 ... image transmission control unit (control unit), 214 ... storage unit (storage unit), 214A ... control program, 215 ... image data 216: Display unit (display unit), 217 ... Operation detection unit (detection unit), 218 ... Wireless communication unit (communication unit), SC ... Screen.

Claims (9)

A mobile terminal device,
A communication means capable of transmitting data to an external display device;
Storage means for storing image data;
Display means for displaying an image corresponding to the image data on a display screen;
Detecting means for detecting a contact operation on the display screen;
Control means for transmitting the image data to the display device by the communication means when a contact operation is detected by the detection means in a state where an image corresponding to the image data is displayed by the display means;
A mobile terminal device comprising: A mobile terminal device,
A communication means capable of transmitting data to an external display device;
Storage means for storing image data;
Display means for displaying an image corresponding to the image data on a display screen;
Detecting means for detecting an operation of moving the mobile terminal device;
Control for transmitting the image data to the display device by the communication means when an operation of moving the mobile terminal device is detected by the detection means in a state where an image corresponding to the image data is displayed by the display means Means,
A mobile terminal device comprising: An operation determining means for determining at least one of the direction or speed of the contact operation or the operation of moving the mobile terminal device;
The control means is determined by the operation determination means when a contact operation or an operation of moving the mobile terminal device is detected by the detection means in a state where an image corresponding to the image data is displayed by the display means. The information for the display device to display an image corresponding to the image data in a form reflecting the direction or speed is transmitted to the display device by the communication means. Mobile terminal device.   4. The mobile terminal apparatus according to claim 3, wherein the control means transmits information indicating the direction and speed determined by the operation determination means to the display device together with the image data.   2. The mobile terminal according to claim 1, wherein the control means transmits the information to the display device when the contact operation detected by the detection means is a slide operation that continues outside the display screen. apparatus. A method of controlling a mobile terminal device capable of transmitting data to an external display device,
Display the image corresponding to the image data on the display screen,
Detecting a touch operation on the display screen;
Transmitting the image data to the display device when a contact operation is detected in a state where an image corresponding to the image data is displayed on the display screen;
A method for controlling a mobile terminal device. A method of controlling a mobile terminal device capable of transmitting data to an external display device,
Display the image corresponding to the image data on the display screen,
Detecting an operation to move the mobile terminal device,
Transmitting the image data to the display device when an operation of moving the mobile terminal device is detected by the detection means in a state where an image corresponding to the image data is displayed on the display screen;
A method for controlling a mobile terminal device. A computer for controlling a mobile terminal device, comprising: a communication means capable of transmitting data to an external display device; a storage means for storing image data; and a display means for displaying an image corresponding to the image data on a display screen. An executable program,
Detecting means for detecting a contact operation on the display screen;
Control means for transmitting the image data to the display device by the communication means when a contact operation is detected by the detection means in a state where an image corresponding to the image data is displayed by the display means;
A program characterized by making it function. A computer for controlling a mobile terminal device, comprising: a communication means capable of transmitting data to an external display device; a storage means for storing image data; and a display means for displaying an image corresponding to the image data on a display screen. An executable program,
Detecting means for detecting an operation of moving the mobile terminal device;
Control for transmitting the image data to the display device by the communication means when an operation of moving the mobile terminal device is detected by the detection means in a state where an image corresponding to the image data is displayed by the display means Means,
A program characterized by making it function.

Images