JP4805022B2 - Display device, terminal device, image pasting system and methods thereof - Google Patents

Description

  The present invention relates to a display device for pasting an image on a terminal device side to a display device, a terminal device, an image pasting system, a method thereof, and a computer program.

  Display screens mounted on televisions and PCs (personal computers), such as LCD (Liquid Crystal Display) and PDP (Plasma Display Panel), etc. High definition is progressing, not only displaying digital images one by one as in the past, but also displaying multiple images at the same time, providing a level of performance that can be viewed by multiple people together ing.

  Under such circumstances, a means for displaying an image stored in another device such as a digital camera or a mobile phone terminal with a camera function on a large screen display device such as a television is desired. In particular, there is a demand for a means for displaying a photograph in a layout (position, size, inclination) as intended by the user as easily as sticking a photograph to a cork board and with a high degree of freedom.

  Conventionally, as a means for displaying an image stored in a digital camera or a mobile phone terminal on a TV, a memory card storing the image is inserted into the TV and image data is displayed one by one, or a predetermined amount is displayed. Displaying a list with a layout has been put into practical use. However, in order to lay out the displayed image freely (setting / changing the position, size, and tilt), first copy the image data to the PC, then start the digital camera image management software on the PC and edit it. The operation must be performed, which is cumbersome and time-consuming.

As this improvement measure, Patent Document 1 describes the following method. In other words, this is a method for designating an arbitrary display layout by moving the position of a digital camera storing an image or operating an operation button of a digital camera with respect to a display device to be displayed. Specifically, in this method, the user performs the following operation procedure. 1) Select the display image on the terminal, 2) Press the shutter halfway with the terminal facing the display, 3) Move the terminal position to adjust the image display position on the display, 4) Operate the zoom button on the terminal Adjust the image display size on the display, 5) Press the shutter fully. The display is confirmed by this procedure.
JP-A-2005-316403

  The prior art described in the above-mentioned Patent Document 1 aims at improving the operability by paying attention only to the layout operation. However, it is inconvenient for the user to perform individual operations such as image transfer from the portable terminal device to the television, image display on the television, and layout designation on the television display screen as a series of operation procedures. .

  The present invention has been made in view of the above circumstances, and an object thereof is to freely display images stored in a portable terminal device such as a digital camera or a cellular phone on a large screen display device such as a television or a PC. It is to improve the operability of a series of necessary user operations when displaying with a simple layout so that the user can easily perform them.

In order to solve the above problems, according to one aspect of the present invention, there is provided contact state information acquisition means for acquiring contact state information representing a contact state with an external display device, and the display of a pasted image according to the contact state information. Pasted image transmission control means for controlling transmission to the apparatus , wherein the contact state information acquiring means detects a contact position on an image display unit of an external display device, and the pasted image transmission control means Is a terminal device that controls to transmit contact state information including the contact position to the display device .

Further, according to one aspect of the present invention , in the above terminal device, the pasted image transmission control unit is configured to paste an image pasted in advance when a pasted image is selected when receiving a contact notification from the contact state information obtaining unit. When the request is transmitted to the display device and the image paste response indicating the paste permission is received from the display device, the paste image is controlled to be transmitted to the display device. .

According to another aspect of the present invention, contact state information acquisition means for acquiring contact state information indicating a contact state with an external display device, and a paste image is transmitted to the display device in accordance with the contact state information. Contact state information for acquiring the contact state information representing the contact state of the contact body with the image display unit, the image display unit for displaying an image, and the contact body to the image display unit An acquisition unit; an image receiving unit that receives a pasted image according to the contact state information; and a display that controls a layout when the received pasted image is displayed on the image display unit according to the contact state information. the display device consists, the contact state information acquiring means and control means detects a contact position on the image display unit of the external display device, the sticking image transmission control means, said contact position An image pasting system that control means controls so as to transmit the contact information to the display device comprising.

Further, one aspect of the present invention is characterized in that, in the image pasting system, the display control unit reduces the display size of the pasted image with time according to the contact state information.

Moreover, one aspect of the present invention is characterized in that, in the image pasting system, the display control means changes the display position of the pasted image with time according to the contact state information.

Another embodiment of the present invention is an image transmission control method in a terminal device, wherein the contact state information represents a contact state with the external display device by detecting a contact position on an image display unit of the external display device. The contact state information including the contact position is transmitted to the display device, and the pasted image is controlled to be transmitted to the display device according to the contact state information. This is a transmission control method.

One embodiment of the present invention is a computer program for controlling a terminal device, the contact state information acquiring process for acquiring contact state information representing a contact state with an external display device, and the contact state information A pasted image transmission control process for controlling the pasted image to be transmitted to the display device; and a contact position on an image display unit of an external display device is detected in the contact state information obtaining process. A computer program for controlling to transmit contact state information including the contact position to the display device in the pasted image transmission control process .

In addition, according to one embodiment of the present invention, an image display unit that displays an image and a predetermined position are provided so that the terminal device can detect a contact position between the image display unit and an external terminal device. A reference signal transmission unit that emits a signal of the contact, and contact state information that represents contact state information representing a contact state of the contact body with the image display unit, and includes contact state information detected based on the signal An acquisition unit; an image receiving unit that receives a pasted image according to the contact state information; and a display that controls a layout when the received pasted image is displayed on the image display unit according to the contact state information. And a control means .

  As described above, according to the present invention, a series of image pasting operations such as transfer of image information (pasted image) from the mobile terminal device to the display device, change of the image display layout in the display device, and confirmation of the image display layout are displayed. Control is performed based on contact state information of the mobile terminal device with respect to the device.

  According to the image pasting system, the display device, and the mobile terminal device of the present invention, the user transfers the image stored in the mobile terminal to the display device, and changes the display layout when the transferred image is displayed on the display device. In addition, a series of user operations for pasting an image, such as finalizing the display layout of the image when the change work is completed, can be easily performed with a simple one action without using complicated button operations or various complicated user interfaces. It can be done intuitively. As a result, the user interface can be simplified, and an apparatus and system that are easy to use for everyone can be provided.

[First Embodiment]
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a schematic diagram showing the appearance of the entire image pasting system according to an embodiment of the present invention. As illustrated in FIG. 1, the image pasting system includes a display device 100 and a mobile terminal device 200.

  The display device 100 is, for example, a digital tuner built-in television or a PC display. The mobile terminal device 200 is, for example, a digital camera or a mobile phone terminal with a digital camera function. The display device 100 includes an image display unit 101 that displays various images, and a contact position detection unit 103 (contact) that detects the contact and the contact position when an external object contacts the image display unit 101. Status information acquisition means). In addition, the mobile terminal device 200 includes a mobile terminal display unit 201 for displaying characters and images, and a contact detection unit 203 (contact state information acquisition unit) that detects that there is a contact with an external object. And an input unit 208 that receives input from the user.

  For the portable terminal display unit 201, for example, an LCD or the like is used. The contact detection unit 203 is realized using, for example, a mechanical switch. Alternatively, the contact detection unit 203 may be realized by incorporating an acceleration sensor in the mobile terminal device 200 and analyzing a time-series change in acceleration measured by the acceleration sensor. The input unit 208 is, for example, a numeric keypad (“0” to “9” and “*” and “#”) in which key switches are arranged in a matrix.

  In this system, when the user holds the portable terminal device 200 by hand and brings the tip of the contact detection unit 203 into contact with a location on the image display unit 101, the contact detection unit 203 has made contact with the portable terminal 200 side. In the display device 100 side, the contact position detecting unit 103 detects the contact and the contact position.

Next, an internal functional configuration of the display device 100 will be described.
FIG. 2 is a block diagram illustrating an internal functional configuration of the display device 100. Hereinafter, FIG. 2 will be described.

  The image display unit 101 has a function of displaying display screen information. The display screen information (image data) is the content displayed on the image display unit 101 and is passed from the display control unit 105. A device constituting the image display unit 101 is a display device such as an LCD, an organic EL (Electro-Luminescence), a plasma display, a CRT (Cathode Ray Tube), a projector.

  The display device storage unit 102 has a function of storing image data, and transfers the image data by a writing / reading operation from the display control unit 105. Devices constituting the display device storage unit 102 are, for example, a flash memory, a RAM (Random Access Memory), an HDD (Hard Disk Drive), and the like.

The contact position detection unit 103 detects whether or not an external object (contact body) such as the mobile terminal device 200 is currently in contact with the image display unit 101, and further detects the contact position in the case of contact. The contact position detection unit 103 displays the position information of these contact objects with respect to the display change unit 106 (specifically, the display change control unit 1061 (FIG. 3) which is one of the elements constituting the display change unit 106). Notice. A device constituting the contact position detection unit 103 is, for example, an optical touch panel, a resistive film type touch panel, or the like.
An optical touch panel is provided with a plurality of cameras at the periphery of the display screen of the display device, and these cameras capture images over a continuous time in a direction substantially parallel to the screen, or intermittently capture them, By reading and analyzing the image, the contact position is detected when the contact body contacts the display screen. For example, when two small cameras are installed sufficiently apart from each other, each camera can detect a two-dimensional position on the display screen when the contact body is captured as an image. An infrared camera is used as the camera, and infrared illumination for irradiating the contact body is provided as necessary. Two or more cameras may be used.
The resistive film type touch panel is configured by attaching a film electrode having two electrical resistances on a display screen. These two electrodes are not in contact with each other by a spacer at normal times (when there is no contact body). When the contact body comes into contact with the display portion, one of the two electrodes (movable electrode) is pushed by the pressure, and only that portion (this point is called a contact point) is the other electrode (fixed electrode). To touch. At this time, the distance from the edge of the screen to the contact point can be calculated by measuring the potential difference from the electrode at the edge of the screen to the contact point in each of the X-axis direction and the Y-axis direction. Then, the X coordinate and the Y coordinate of the contact point are respectively calculated by switching the timing for measuring the distance in the X-axis direction and the timing for measuring the distance in the Y-axis direction using a changeover switch or the like.

  The display device wireless communication unit 104 (image receiving unit) performs data communication with the mobile terminal device 200 and also transmits the communication data with the display changing unit 106 and the display control unit 105 inside the display device 100. Has a function to deliver. The display device wireless communication unit 104 exchanges an image pasting request signal and an image pasting response signal with the display as-needed changing unit 106. In addition, the display device wireless communication unit 104 exchanges a pasted image transfer signal with the display control unit 105. The wireless communication method of the display device wireless communication unit 104 is, for example, Bluetooth (registered trademark), wireless LAN (Local Area Network, local area network), or the like.

  The display changing unit 106 communicates with the mobile terminal device 200 via the display device wireless communication unit 104 and starts a series of image pasting operations triggered by reception of an image pasting request signal from the mobile terminal device 200. It has a function of controlling the display content on the image display unit 101 in conjunction with the position detection unit 103 and the display control unit 105 (the display change unit 106 and the display control unit 105 constitute a display control unit). Details of the display change unit 106 will be described later.

  The display control unit 105 has a function of receiving image data to be pasted from the mobile terminal device 200 via the display device wireless communication unit 104. Further, it has a function of analyzing the format of the received image data, creating resolution information as an analysis result, and notifying the display changing unit 106 as needed. Further, display area information defining the position and size at which the image data is displayed on the image display unit 101 is received from the display changing unit 106, display screen information is created from the display area information and the image data, and image display is performed. A function of displaying on the unit 101.

  Next, a detailed configuration of the display changing unit 106 will be described. FIG. 3 is a block diagram showing an internal configuration of the display changer 106 at any time. Hereinafter, it will be described with reference to FIG.

The display change unit 106 includes a display change supervision unit 1061, a paste start unit 1062, and a display area change unit 1063 therein. The interaction between these parts is as follows.
The display change supervision unit 1061 sends an image pasting request to the pasting start unit 1062. In response to the contact state inquiry sent from the sticking start unit 1062, the display change control unit 1061 returns the contact state information to the sticking start unit 1062. Also, the display change supervision unit receives an image pasting response sent from the pasting start unit 1062.
In addition, the display change supervision unit 1061 sends contact state information and resolution information to the display area change unit 1063. From the display area changing unit 1063, an initial display area is sent to the display change managing unit 1061. In addition, the display change supervision unit 1061 sends a display enlargement request to the display area change unit 1063. The display area is sent from the display area changing unit 1063 to the display change managing unit 1061.

(Display Change Supervision Unit) The display change supervision unit 1061 manages input / output to the pasting start unit 1062 and the display area change unit 1063. The input to the display changing unit 106 is received by the display change managing unit 1061 and transferred to the paste starting unit 1062 and the display area changing unit 1063 via the display change managing unit 1061 as necessary. In addition, the display change supervision unit 1061 always serves as an output source for output from the display changing unit 106 to the outside (display device wireless communication unit 104, contact position detection unit 103, display control unit 105).
In addition to the transfer of various types of information, the functions installed in the display change control unit 1061 will be described.
The display change supervision unit 1061 instructs the display area change unit 1063 to increase the display size, and receives the changed display area. In addition, the display layout change start and the determination of the display layout are determined. The outline of the judgment is described. The display layout change operation starts when the display change supervision unit 1061 passes the initial value of the display area of the pasted image to the display control unit 105. During the display layout change, contact information (contact presence / absence information and contact position information) is acquired from the contact position detection unit 103 at a predetermined time interval (for example, every 1 second). When the acquired contact information is examined and it is determined that the contact position cannot be detected, the display layout is determined.
That is, by the cooperative operation of the display change control unit 106 and the display control unit 105, the layout (display size) of the pasted image is changed (enlarged) over time according to the contact state information, and the contact state information is changed. Sometimes stop this layout change. In other words, the display size of the pasted image is changed while the contact presence / absence information included in the contact state information indicates yes, and the change in the display size of the pasted image is stopped when the contact presence / absence information indicates nothing.
The elements of the pasted image layout are the display position of the pasted image on the image display unit 101 of the display device 100, the change in the display position, the display size (resolution, number of pixels, display area, enlargement / reduction ratio, etc.), display Changes in size (enlargement and reduction), display direction / tilt, and display direction / tilt change.
The pasted image is handled and processed as digital data in a computer system or a digital circuit. The pasted image is, for example, a digital still image, a digital animation image, a moving image, or the like. In addition, the pasted image is JPEG (Joint Photographic Experts Group), GIF (Graphic Interchange Format), PNG (Portable Network Graphics) standard format, MPEG (Moving Picture Expert Data), etc. The

  (Paste Start Unit) The paste start unit 1062 has a function of determining the start of the image paste operation based on the image paste request signal received from the mobile terminal device 200 and the contact state information received from the contact position detector 103. .

(Display Area Changing Unit) The display area changing unit 1063 has a function of calculating a display area when an image is displayed on the image display unit 101 in a layout manner. The calculated display area information is passed to the display change control unit 1061.
When calculating the initial value of the display area information, contact state information and resolution information are received from the display change control unit 1061 and calculated based on these information.
When a display enlargement request is received from the display change control unit 1061 after the initial value is calculated, a new display region value is calculated based on the previously calculated display region information and is passed to the display change control unit 1061.

  That is, while the display position detection unit 103 detects the contact of the external object, the display size is continuously increased, and when the display position detection unit 103 cannot detect the contact of the external object, the display size is not increased. The display layout is finalized.

Next, the internal configuration of the mobile terminal device 200 will be described. FIG. 4 is a block configuration diagram showing an internal functional configuration of the mobile terminal device 200. Hereinafter, a description will be given with reference to FIG.
The mobile terminal device 200 includes a mobile terminal display unit 201, a mobile terminal storage unit 202, a contact detection unit 203, a mobile terminal wireless communication unit 204, an imaging unit 205, a display image selection unit 206, and an image pasting control unit 207 (pasting). Image transmission control means) and an input unit 208.

  The portable terminal display unit 201 has a function of displaying display screen information. Display screen information (image data) is passed from the display image selection unit 206. That is, corresponding image data is received from the portable terminal storage unit 202 based on the image ID passed from the display image selection unit 206, and display using this image data is performed. A device constituting the mobile terminal display unit 201 is, for example, a flat panel display such as an LCD or an organic EL.

  The portable terminal storage unit 202 has a function of storing image data. First, the image data is delivered from the imaging unit 205, and is stored in association with (associated with) an image ID for uniquely identifying the image data. In addition, the mobile terminal storage unit 202 receives an image ID from the mobile terminal display unit 201 or the image pasting control unit 207 and passes the corresponding image data. Further, the portable terminal storage unit 202 passes a list of image IDs corresponding to the stored image data in response to an image ID request from the display image selection unit 206. The devices constituting the portable terminal storage unit 202 are, for example, flash memory, RAM, HDD, and the like.

  The contact detection unit 203 detects that the mobile terminal device 200 is in contact with a contacted object such as the display device 100. The contact detection unit 203 notifies the image pasting control unit 207 of contact detection (contact state information). The device constituting the contact detection unit 203 is, for example, a contact sensor using a piezoelectric element.

  The portable terminal wireless communication unit 204 has a function of performing data communication with the display device 100. The wireless communication method of the portable terminal wireless communication unit 204 is, for example, Bluetooth (registered trademark), wireless LAN, or the like.

  The imaging unit 205 has a function of taking a photograph and recording it in the portable terminal storage unit 202 as digital image data. A device that constitutes the imaging unit 205 includes, for example, a condensing unit such as a lens, an image sensor such as a CCD (Charge Coupled Devices) or a CMOS (Complementary Metal Oxide Semiconductor, a complementary metal oxide semiconductor), and an image. It is a signal processing LSI (Large Scale Integration, semiconductor integrated circuit).

  The input unit 208 has a function of receiving a user input and notifying the display image selection unit 206. The devices constituting the input unit 208 are, for example, various operation buttons and a touch panel.

The image pasting control unit 207 receives a contact notification from the contact detection unit 203. Further, the image pasting control unit 207 receives the image ID of the image selected by the user from the display image selection unit 206. Further, the image pasting control unit 207 passes the image ID to the mobile terminal storage unit 202 and reads out image data corresponding to the ID from the mobile terminal storage unit 202. Also, the image pasting control unit 207 communicates with the display device 100 via the portable terminal wireless communication unit 204, thereby passing an image pasting request, receiving an image pasting response, and passing image data.
And by these, the image sticking control part 207 controls the portable terminal storage part 202, the contact detection part 203, the portable terminal wireless communication part 204, and the input part 208, and the function which transfers an image to the display apparatus 100 of a contact other party. Have
That is, the image pasting control unit 207 controls to send the pasted image to the display device according to the contact state information.

  The display image selection unit 206 has a function of selecting and displaying a desired image from a plurality of images stored in the mobile terminal storage unit 202 based on a user input. Furthermore, it has a function of notifying the image pasting control unit 207 of the selected image.

  Next, an outline of a method for using the image pasting system according to the present embodiment will be described. FIG. 5 is a schematic view showing how to use the image pasting system.

  In (0) of FIG. 5, the user operates the input unit 208 of the mobile terminal device 200 to select an image to be pasted on the display device 100.

  Next, in (1), in a state where the desired image selected in (0) is displayed on the mobile terminal display unit 201, the user places the mobile terminal device 200 on the image display unit 101, which is the image paste destination. Make contact.

  In (2), the image display unit 101 displays the image selected in (0) at the position touched by the mobile terminal device 200 in (1), and starts the display layout change.

  At the start of the display layout change, that is, in the initial state shown in (a), the image display unit 101 displays an image with the minimum display size.

  Then, when the user keeps the portable terminal device 200 that has been in contact with the image display unit 101 in (1), the image display unit 101 displays it according to the contact time as shown in (b). The image display size gradually increases.

  In (3), the user moves the mobile terminal device 200 away from the screen of the display device 100 (releases the contact state). Then, the display layout is determined, and the image remains displayed on the image display unit 101 with the display size when the mobile terminal device 200 is released.

  Next, a data communication sequence performed between the mobile terminal device 200 and the display device 100 will be described. FIG. 6 is a schematic diagram showing a communication sequence between the mobile terminal device 200 and the display device 100 corresponding to the operation shown in FIG. Hereinafter, a description will be given with reference to FIG.

  The user operates the mobile terminal device 200 to bring the mobile terminal device 200 into contact with the image display unit 101 in a state where an image to be pasted is selected and displayed in advance.

  When the contact detection unit 203 detects a contact, the portable terminal device 200 searches for the display device 100 of the communication partner, so that the image pasting control unit 207 broadcasts (transmits) an image pasting request signal via the portable terminal wireless communication unit 204. (S501).

  The format of the image pasting request signal (S501) is as indicated by F521, and the information included in the signal is a broadcast address, a source address, a command type, and a pasting ID. The broadcast address specifies all devices that are received as the signal destination. The transmission source address is an ID (address) that identifies the mobile terminal device that is the transmission source, and is used as a destination when a device that has received this signal transmits a response to the mobile terminal device 200. As the value of the command type, a value for identifying the image pasting request signal is set. The pasting ID is assigned and used to uniquely identify the image pasting request signal.

  Upon receiving this image sticking request signal (S501), the display device 100 uses the contact position detection unit 103 to check whether the contact body is in contact with the image display unit 101 and the contact position. If the contact position can be detected, the source address included in the received image pasting request signal (S501) is set as the destination address, and the image pasting response signal is sent to the mobile terminal device 200 that is the source. Is transmitted (S502).

  The format of the image pasting response signal (S502) is as indicated by F522, and information included in the signal is a transmission destination address, a transmission source address, a command type, and a pasting ID. As the value of the transmission source address, an ID for identifying the display device of the transmission source is set. The command type sets a value that can identify that the mobile terminal that has received the signal is an image pasting response signal (paste permission). As the pasting ID, the same information as the pasting ID information included in the image pasting request signal received by the display device 100 is set.

  When the portable terminal device 200 receives this image paste response signal (S502), the portable terminal device 200 examines the signal and includes it in the paste ID and the paste image response signal (S502) transmitted by itself in the image paste request signal (S501). If the pasted ID is the same, the pasted image transfer signal is transmitted to the display device 100 (S503). The format of the pasted image transfer signal (S503) is as indicated by F523, and information included in the signal is a transmission destination address, a transmission source address, a command type, a pasting ID, and image data. Here, the command type is set to a value that can identify the pasted image transfer signal. The pasting ID is set to the same information as the pasting ID information included in the image pasting request signal transmitted by the mobile terminal device 200 in S501.

  When receiving the pasted image transfer signal (S503), the display device 100 displays an image on the image display unit 101 using the image data included in the signal, and enters a layout display changing state. Then, while the portable terminal device 200 and the image display unit 101 are kept in contact with each other, the display of the pasted image is continuously enlarged. When the contact end is detected, the display enlargement is stopped and the image display layout is determined.

FIG. 7 is a schematic diagram showing a format of data handled in the display device.
In FIG. 7, the data format of the contact state information is as shown in F430. This contact state information includes items of a contact presence / absence flag, a coordinate X value, and a coordinate Y value. The contact presence / absence flag is ON (contact is present) when an external contact body is in contact with the image display unit 101 and its position can be detected, and the value is OFF (no contact) otherwise. When the value of the contact presence / absence flag is ON (F431, when contact is detected), the detected coordinate value of the current position of the contact body is stored in the coordinate X value and the coordinate Y value. When the value of the contact presence / absence flag is OFF (F432, when no contact is detected), the coordinate X value and the coordinate Y value of the current position of the contact body are indefinite.

Next, processing procedures inside the mobile terminal device 200 and inside the display device 100 will be described.
FIG. 8 is a flowchart showing a processing procedure on the mobile terminal device 200 side, and the processing content corresponds to the communication sequence shown in FIG. Hereinafter, a description will be given with reference to FIG.
The image data stored in the portable terminal storage unit 202 is captured in advance by the imaging unit 205, and stored in association with image ID information that uniquely identifies the image data.

  The display image selection unit 206 acquires an image ID from the mobile terminal storage unit 202 in response to a user input, passes the image ID to the mobile terminal display unit 201, and displays an image. The portable terminal display unit 201 passes the received image ID to the portable terminal storage unit 202 to receive image data, and causes the image display unit 101 to display the image data. The display image selection unit 206 passes the image ID associated with the image data being displayed to the image pasting control unit 207 (step S601).

  When the contact detection unit 203 detects that the mobile terminal device 200 has touched something, the contact detection unit 203 notifies the image pasting control unit 207 (step S603).

  The image pasting control unit 207 broadcasts an image pasting request signal via the mobile terminal wireless communication unit 204 (step S604). The image pasting request signal includes the image ID information received from the display image selection unit 206 previously.

  The image pasting control unit 207 waits for an image pasting response signal as a response to the image pasting request signal via the portable terminal wireless communication unit 204 for a predetermined time. When the image pasting response signal has not been received, the image pasting control unit 207 ends the image pasting operation. If an image pasting response signal has been received, the process proceeds to step S607 (step S605).

  When receiving the response signal, the image pasting control unit 207 checks the pasting ID included in the request signal. When the pasting ID is the same as the image pasting request signal transmitted earlier, the image ID information received from the display image selection unit 206 is passed to the portable terminal storage unit 202 and the image data is extracted from the portable terminal storage unit 202. The pasted image transfer signal including the image data is transmitted to the display device 100 that has transmitted the image data request signal (step S607).

  FIG. 9 is a flowchart showing a processing procedure on the display device 100 side, and the processing content corresponds to the communication sequence shown in FIG. Hereinafter, a description will be given with reference to FIG.

  The image pasting request signal transmitted from the mobile terminal device 200 in S501 (FIG. 6) is received by the display device wireless communication unit 104 and transferred to the display change unit 106 as needed. In the display changing unit 106, the information is transferred from the display change managing unit 1061 to the pasting start unit 1062 (step S701).

The pasting start unit 1062 has a function of determining whether image pasting is possible in response to an image pasting request from the mobile terminal device side.
The pasting start unit 1062 makes a contact state inquiry to check the contact state of the image display unit 101. The contact state inquiry signal is passed from the sticking start unit 1062 to the contact position detection unit 103 via the display change control unit 1061.
The contact position detection unit 103 checks whether or not the contact body is currently in contact with the image display unit 101 and whether the contact position can be specified. As a result, the contact position detection unit 103 passes the contact state information (F430 in FIG. 7) to the display change unit 106 as needed. The contact state information is passed to the pasting start unit 1062 via the display change unit 106 at any time (step S702).

  Upon receiving the contact state information, the sticking start unit 1062 checks the contact presence / absence flag included in the information (step S703). If the flag value is OFF, a series of processing relating to FIG. 9 ends here.

  When the contact presence / absence flag of the contact state information received by the pasting start unit 1062 is ON, the pasting start unit 1062 passes an image pasting response signal to the display change control unit 1061. This image pasting response signal is wirelessly transmitted via the display device wireless communication unit 104 and received by the mobile terminal device 200 that is the transmission source of the image pasting request signal (step S704).

  When the portable terminal wireless communication unit 204 receives the pasted image transfer signal including the image data, the portable terminal wireless communication unit 204 transfers it to the display control unit 105 (step S706).

  When receiving the pasted image transfer signal, the display control unit 105 records the image data included in the signal in the display device storage unit 102. The display device storage unit 102 stores image data (step S707).

The display control unit 105 analyzes the format of the received image data, and passes the image resolution information to the display change control unit 1061.
The display change supervision unit 1061 makes a contact state inquiry to the contact position detection unit 103 and acquires contact state information.
The display area changing unit 1063 receives contact state information and resolution information from the display change managing unit 1061. The display area changing unit 1063 calculates the initial value (initial display area) of the display area and passes it to the display change managing unit 1061 (step S708). A method for calculating the display area will be described. The display area information includes position information and size information. The position information included in the contact state information is used as the position information of the display area. The size information of the display area is a set of values in the X direction (horizontal direction) and Y direction (vertical direction) of the rectangular area. The display area changing unit 1063 calculates an aspect ratio from the received resolution information, calculates integer values of X and Y that are closest to a predetermined initial display area value, and sets the size information.

The display area changing unit 1061 passes the initial value of the display area information received from the display area changing unit 1063 to the display control unit 105.
The display control unit 105 creates display screen information, which is the content displayed on the image display unit 101, and passes it to the image display unit 101 for display (step S709).

Upon receiving the initial value of the display area information from the display area changing unit 1063, the display change managing unit 1061 thereafter acquires contact state information from the contact position detecting unit 103 repeatedly every predetermined time (step S710).
When the display change control unit 1061 acquires the contact state information. Check the contact presence / absence flag.
If the value of the flag is OFF, the series of display layout change processing shown in FIG. 9 is terminated (step S711), that is, the display layout is fixed without changing the display size.

  When the value of the contact presence / absence flag in step S711 is ON, the display change supervising unit 1061 notifies the display region changing unit 1063 of a display region enlargement request, and the display size is determined from the display region changing unit 1063 by a predetermined size from the previous time. The display area information enlarged at the rate of is received (step S712).

The display change control unit 1061 passes the received display area information to the display control unit 105. The display control unit 105 creates display screen information based on the new display area information and displays it on the image display unit 101 (step S713). Thereafter, the process returns to step S710 to perform processing based on the contact state information after the next predetermined time has elapsed.

[Second Embodiment]
Next, a second embodiment of the present invention will be described.
The configurations of the display device 100 and the mobile terminal device 200 in the present embodiment are substantially the same as those in the first embodiment. However, in the present embodiment, the mobile terminal device 200 does not have the contact detection unit 203.

In the present embodiment, when the user selects the pasted image and makes the mobile terminal device 200 contact the image display unit 101 of the display device 100, the contact position detection unit 103 on the display device 100 side first detects the contact. . In response to this, an image pasting polling signal is broadcast from the display device 100. When receiving the image sticking polling signal, the portable terminal device 200 that is ready for the sticking image receives the sticking image transfer signal (see FIG. 6) including the image data of the sticking image with the display device 100 as the transmission destination. (Corresponding to S503).
The processing on the display device 100 side after receiving this pasted image transfer signal is the same as in the case of the first embodiment.
In the present embodiment, the presence or absence of contact is detected only on the display device side. At this time, the mobile terminal wireless communication unit 204 that receives the image sticking polling signal corresponds to a contact state information acquisition unit that acquires contact state information representing a contact state with an external display device on the mobile terminal device side.

[Third Embodiment]
Next, a third embodiment of the present invention will be described.
The configurations of the display device 100 and the mobile terminal device 200 in the present embodiment are substantially the same as those in the first embodiment. However, in the present embodiment, the display device 100 does not have the contact position detection unit 103. And the contact detection part 203 which the portable terminal device 200 has not only detects the presence or absence of a contact, but also detects its own contact position (coordinate X value and coordinate Y value) on the image display part 101 of the display device. be able to. As an example, the contact detection unit 203 receives a signal (a signal using light, infrared rays, radio waves, etc.) emitted from one or a plurality of reference signal transmission units provided at a predetermined position on the display device side. Based on the intensity or signal waveform, contact position information on the image display unit 101 is calculated.

In this embodiment, the display changing unit 106 on the display device 100 side inquires about the contact state by transmitting a contact state inquiry signal to the mobile terminal device side via the display device wireless communication unit 104 when necessary. On the mobile terminal device 200 side, upon receiving this contact state inquiry signal, the contact detection unit 203 detects the presence or absence of contact and the contact position, and includes this contact state information (contact presence flag, coordinate X value, coordinate Y value). The contact state response signal is returned to the display device 100 side. The display changing unit 106 receives contact state information included in the contact state response signal. Processing procedures other than the contact state inquiry are the same as those in the first embodiment.
In the present embodiment, the presence / absence of contact and the contact position are detected only on the mobile terminal device side. At this time, the display device wireless communication unit 104 that receives the contact state response signal including the contact state information described above acquires contact state information representing the contact state of the contact body with the image display unit on the display device side. Corresponds to status information acquisition means.

  The entire processing function on the display device side or a part thereof, and the entire processing function on the mobile terminal device side or a part thereof in the first, second, and third embodiments described above are programs for realizing these functions. May be recorded on a computer-readable recording medium, and a program recorded on the recording medium may be read into a computer system and executed. Here, the “computer system” includes an OS and hardware such as peripheral devices.

  The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Further, the “computer-readable recording medium” dynamically holds a program for a short time, like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. It is also possible to include those that hold a program for a certain time, such as a volatile memory inside a computer system serving as a server or client in that case. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes designs and the like that do not depart from the gist of the present invention.
For example, in each of the above-described embodiments, the case where the display size is enlarged is described as a specific example of the layout change of the pasted image. However, the display size may be reduced or the display position may be changed. Is also possible.

(Application scene)
According to the embodiment described above, when the user uses the image pasting system, a user can operate a large screen display device such as a TV or a PC to display an image stored in a portable terminal such as a digital camera or a mobile phone. However, a series of necessary user operations can be easily and intuitively performed with one action when displaying in a free layout.
Finally, the user scene assumed by this system is described below. This system is installed in a home and displays a photograph taken by a user on a large screen TV in a desired layout so that it can be viewed with friends and family. In addition, this system can be installed in public places such as stations and department stores and used as a bulletin board for communication between users. Here, the data handled by this system can be expanded not only to image information but also to text information, and it can be expanded to record when and who is pasted. It can be used for.

It is the schematic which shows the external appearance of the whole image sticking system by embodiment of this invention. It is a block diagram which shows the internal function structure of the display apparatus (100) by embodiment of this invention. It is a block diagram which shows the internal structure of the display occasional change part (106) by embodiment of this invention. It is a block diagram which shows the internal function structure of the portable terminal device (200) by embodiment of this invention. It is the schematic which showed the usage of the image sticking system by embodiment of this invention. In the image sticking system by embodiment of this invention, it is the schematic which shows the communication sequence between a portable terminal device (200) and a display apparatus (100). It is the schematic which shows the format of the data handled inside the display apparatus by embodiment of this invention. It is a flowchart which shows the process sequence in the portable terminal device (200) side by embodiment of this invention. It is a flowchart which shows the process sequence by the side of the display apparatus (100) by embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 ... Display apparatus, 101 ... Image display part, 102 ... Display-device storage part, 103 ... Contact position detection part (contact state information acquisition means), 104 ... Display-device radio | wireless communication part ( Image receiving means), 105... Display control section (display control means), 106... Display change section (display control means), 200... Mobile terminal device, 201. ... Mobile terminal storage unit, 203 ... Contact detection unit (contact state information acquisition means), 204 ... Mobile terminal wireless communication unit, 205 ... Imaging unit, 206 ... Display image selection unit, 207 ... Image pasting control unit (pasted image transmission control means), 208 ... Input unit, 1061 ... Display change supervision unit, 1062 ... Paste start unit, 1063 ... Display region change unit

Claims (8)

Contact state information acquisition means for acquiring contact state information representing a contact state to an external display device;
Affixed image transmission control means for controlling to transmit a pasted image to the display device according to the contact state information,
The contact state information acquisition means detects a contact position on an image display unit of an external display device,
The terminal image transmission control means controls to transmit contact state information including the contact position to the display device. The affixed image transmission control unit transmits an image affixing request for affixing a previously selected affixed image to the display device when receiving a contact notification from the contact state information acquisition unit, and from the display device 2. The terminal device according to claim 1, wherein when the image paste response indicating the paste permission is received, the paste image is controlled to be transmitted to the display device. Contact state information acquisition means for acquiring contact state information representing a contact state to an external display device;
The terminal device comprising: a pasted image transmission control unit configured to control a pasted image to be transmitted to the display device according to the contact state information;
An image display unit for displaying an image;
Contact state information acquisition means for acquiring contact state information representing a contact state of the contact body to the image display unit;
Image receiving means for receiving a pasted image according to the contact state information;
The display device comprising: display control means for controlling a layout when displaying the received pasted image on the image display unit according to the contact state information;
Consisting of
The contact state information acquisition means detects a contact position on an image display unit of an external display device,
The pasted image transmission control means controls to transmit contact state information including the contact position to the display device.   4. The image pasting system according to claim 3, wherein the display control unit reduces the display size of the pasted image as time passes according to the contact state information.   5. The image pasting system according to claim 3, wherein the display control unit changes a display position of the pasted image as time elapses according to the contact state information. An image transmission control method in a terminal device,
Detecting a contact position on an image display unit of an external display device, obtaining contact state information representing a contact state with the external display device, and transmitting contact state information including the contact position to the display device And controlling to transmit the pasted image to the display device in accordance with the contact state information. A computer program for controlling a terminal device,
A contact state information acquisition process for acquiring contact state information representing a contact state to an external display device;
Causing the computer to execute a pasted image transmission control process for controlling the pasted image to be transmitted to the display device according to the contact state information,
In the contact state information acquisition process, a contact position on an image display unit of an external display device is detected,
A computer program for controlling to transmit contact state information including the contact position to the display device in the pasted image transmission control process. An image display unit for displaying an image;
A reference signal transmission unit which is provided at a predetermined position and emits a signal for causing the terminal device to detect a contact position with an external terminal device in the image display unit ;
Contact state information acquisition means for acquiring contact state information including a contact position detected based on the signal, which is contact state information representing a contact state of a contact body to the image display unit;
Image receiving means for receiving a pasted image according to the contact state information;
A display device comprising: display control means for controlling a layout when displaying the received pasted image on the image display unit according to the contact state information .

Images