JP5377209B2 - Image display device, image display method, and program - Google Patents

Description

  The present invention relates to a technique for transferring data stored in a mobile terminal device to an image display device for display.

  In recent years, image display devices have increased in size and definition, and not only for the purpose of displaying single content such as images and videos, but also as a place for arranging and editing a large number of content on the screen. It can be used now. For this reason, there is an increasing need to transfer and display content between various mobile terminal devices and image display devices that create content, such as taking pictures and moving images and recording audio.

  Conventionally, in order to display content stored in a mobile terminal device on an image display device, it has been necessary to perform a plurality of procedures. First, the user selects the content to be transferred from the contents stored in the mobile terminal device, and executes the transfer. Next, the contents are laid out at a desired place one by one or a plurality of contents on the image display device. In order to assist and simplify the user's operation, a method of directly touching the display surface and using the traced locus to select content is disclosed (for example, see Patent Document 1).

Japanese Patent Laying-Open No. 2005-092386

  However, the conventional technology cannot solve the point that a plurality of procedures are required to display desired content stored in the mobile terminal device on the image display device. When a large amount of content is stored on the mobile terminal device side and only specific content is to be transferred from the content, it is necessary for the user himself to select from a list or the like, which is complicated.

  In addition, when the target content is a moving image and it is desired to cut out only a part of the accumulated moving image, it is necessary to edit the moving image in advance or edit it on the image display device side after transfer. Mobile terminal devices and image display devices may not have enough editing functions, and a very complicated operation is necessary to cut out a desired part from a moving image.

  Therefore, an object of the present invention is to transfer desired data from data stored in an external device (for example, a portable terminal device) to an image display device and display it on a display surface with a simple procedure.

The image display device of the present invention, an extraction means for extracting a trajectory external device drew to the display surface, if the trajectory is extracted by the extraction means, from among the data displayed in the display surface, An acquisition unit that acquires attribute information of data displayed at a position that overlaps the locus, a transmission unit that transmits attribute information acquired by the acquisition unit to the external device, and data stored in the external device among them, with a data attribute information matching the attribute information transmitted by said transmitting means, receiving means for receiving from said external device, and a display control means for displaying the data received by the receiving unit on the display surface It is characterized by that.

  In the present invention, it is possible to transfer desired data from data stored in an external device (for example, a portable terminal device) to the image display device and display it on the display surface with a simple procedure.

It is a figure which shows the structure of the principal part of the image display apparatus and portable terminal device which concern on the 1st Embodiment of this invention. It is a flowchart which shows the whole process of the image display apparatus of the 1st Embodiment of this invention. It is a flowchart which shows the detail of the position and locus | trajectory acquisition process of step S203 of FIG. 3 is a flowchart showing details of attribute information / data acquisition processing in step S204 of FIG. 2. It is a flowchart which shows the detail of the display update process of step S205 of FIG. It is a flowchart which shows the whole process of the portable terminal device which concerns on the 1st Embodiment of this invention. It is a figure which shows notionally the operation | movement of the 1st Embodiment of this invention. It is a figure which shows notionally an example of operation | movement in case the content currently displayed on the display surface is the continuous still image extracted from the moving image, and the locus | trajectory represents a moving image. It is a figure which shows the structure of the principal part of the image display apparatus and portable terminal device which concern on the 2nd Embodiment of this invention. It is a flowchart which shows the whole process of the image display apparatus which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows the detail of the attribute information and data acquisition process of step S204 of FIG. It is a figure which shows the structure of the principal part of the image display apparatus and portable terminal device which concern on the 3rd Embodiment of this invention.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments to which the invention is applied will be described in detail with reference to the accompanying drawings. In addition, the structure shown in embodiment described below is only an example until it gets tired, and this invention is not limited to the structure shown in figure.

  First, a first embodiment of the present invention will be described. FIG. 1 is a diagram illustrating a configuration of main parts of an image display device 102 and a mobile terminal device 101 according to the first embodiment of the present invention. The image display device 102 in this embodiment stores and displays content such as photographs and moving images, and the mobile terminal device 101 stores content such as photos and moving images in an internal recording device. The image display device 102 is a configuration that is an application example of the image processing device of the present invention, and the mobile terminal device 101 is a configuration that is an application example of the external device and the mobile terminal device of the present invention. The configuration including the image display device 102 and the mobile terminal device 101 is a configuration that is an application example of the image display system of the present invention.

  In FIG. 1, when the user brings the mobile terminal device 101 closer to or in contact with the display surface 131 of the image display device 102, the approach detection unit 121 detects this and notifies the position detection unit 122. The position detection unit 122 acquires coordinate information specifying the position at which the mobile terminal device 101 approaches or contacts the display surface 131 and notifies the locus extraction unit 123 of the coordinate information. The trajectory extraction unit 123 records the coordinate information notified immediately before from the position detection unit 122, and the trajectory that the mobile terminal device 101 has moved on the display surface 131 from the previous coordinate information and the current coordinate information. Is calculated. Further, the trajectory extraction unit 123 identifies the content touched by the mobile terminal device 101 by comparing the information on the trajectory moved by the mobile terminal device 101 with the position information of the content displayed on the display surface 131. . When the target content is a series of still images extracted from the moving image, the touched range of the target moving image is specified. The attribute information acquisition unit 124 receives information (content information) indicating the content touched by the mobile terminal device 101 from the trajectory extraction unit 123, and is indicated in the content information from the attribute information of all the content stored in the recording device 125. Get content attribute information. When the content is a photograph or a moving image, the shooting time (shooting time) can be used as attribute information. In this case, a photograph or a moving image taken at the same time can be a search target. Alternatively, information on the latitude and longitude of the position where the content was photographed can be used as attribute information. In addition, any information can be used as long as it can be given to the content as an attribute. The data transmission control unit 126 receives the attribute information of the target content from the attribute information acquisition unit 124 and transmits it to the mobile terminal device 101 via the communication unit 127. Note that the communication between the image display apparatus 102 and the mobile terminal apparatus 101 may be wireless communication or wired communication. The trajectory extraction unit 123 is a configuration that is an application example of the extraction unit of the present invention, and the attribute information acquisition unit 124 is a configuration that is an application example of the acquisition unit of the present invention. The communication unit 127 is a configuration serving as an application example of the transmission unit, the reception unit, the first transmission unit, and the second reception unit of the image display apparatus of the present invention. The display control unit 130 is configured as an application example of the display control means in the present invention.

  In the mobile terminal device 101, the content search unit 112 receives the attribute information via the communication unit 111 and searches the content stored in the recording device 113 for a match with the attribute information. Further, the content search unit 112 transmits the content selected by the search to the image display device 102.

  In the image display device 102, the data transmission control unit 126 receives content from the mobile terminal device 101, records the content in the recording device 125, and notifies the attribute information acquisition unit 124. The attribute information acquisition unit 124 generates combination information between the content displayed on the display surface 131 and the content received from the mobile terminal device 101 based on the attribute information, and sends the target content to the display position control unit 128. The display position control unit 128 determines the display position of the content received from the mobile terminal device 101 based on the combination information received from the attribute information acquisition unit 124. The display position of the content is overlapped with the content having the same attribute, or is set at a position separated by a preset distance. Or you may calculate dynamically according to the magnitude | size of the displayed content. The image processing unit 129 creates a screen that displays the content received from the mobile terminal device 101 in accordance with the display position determined by the display position control unit 128, and updates the display on the display surface 131 via the display control unit 130. . The communication unit 111 is a configuration serving as an application example of the first reception unit, the second transmission unit, and the transmission unit of the mobile terminal device of the present invention. Moreover, the content search part 112 is a structure used as the application example of the search means of this invention.

  FIG. 2 is a flowchart showing the entire processing of the image display apparatus 102 of the present embodiment. In step S <b> 201, the approach detection unit 121 detects the approach or contact of the mobile terminal device 101 to the display surface 131. In step S <b> 202, the approach detection unit 121 confirms the distance between the mobile terminal device 101 and the display surface 131, and determines that the mobile terminal device 101 has approached or contacted the display surface 131 if the distance is less than x.

  When it is determined that the mobile terminal device 101 has approached or contacted the display surface 131, in step S203, the position detection unit 122 and the locus extraction unit 123 are in contact with the position at which the mobile terminal device 101 has approached or contacted and the movement locus thereof. Examine the content The process of step S203 will be described later.

  In step S <b> 204, the attribute information acquisition unit 124 and the data transmission control unit 126 acquire the attribute information of the content that the mobile terminal device 101 touches on the display surface 131. Further, the data transmission control unit 126 receives content with matching attribute information from the mobile terminal device 101 and stores it in the recording device 125. Details of the processing in step S204 will be described later.

  In step S205, the display position control unit 128 and the image processing unit 129 determine the display position of the content acquired from the mobile terminal device 101, and update the display content on the display surface 131. Details of the processing in step S205 will be described later.

  When the process of step S205 is completed, the process returns to the process of confirming the approach or contact of the mobile terminal device 101 in step S201, and the subsequent processes are repeated. If it is determined in step S202 that the mobile terminal device 101 is not approaching or touching the display surface 131, the process proceeds to step S206. In step S206, the previous coordinate information held by the trajectory extraction unit 123 for the calculation of the trajectory is initialized. Accordingly, when the user once separates the mobile terminal device 101 from the display surface 131 and is contacted again, a correct locus can be calculated.

  FIG. 3 is a flowchart showing details of the position / trajectory acquisition processing in step S203 of FIG. In step S <b> 301, the position detection unit 122 acquires the position where the mobile terminal device 101 is approaching or in contact with the display surface 131 as coordinate information. At this time, if the coordinate information of the portable terminal device 101 has already been held, the value is recorded again as the previous coordinate information, and the current coordinate information is recorded again. In step S <b> 302, the trajectory extraction unit 123 acquires the content list displayed on the display surface 131. In step S303, the trajectory extraction unit 123 checks the processing status of the content list, and when there is unprocessed content, the process proceeds to step S304 to process the content.

  In step S304, the trajectory extraction unit 123 acquires the coordinate information of the content. In this embodiment, in order to simplify the description, it is assumed that the content occupies the position of the rectangular area on the display surface 131 in the direction parallel to the coordinate axis. In step S304, the upper left and lower right of the rectangle occupied by the content are assumed. Get the coordinates of. However, since the purpose here is to check whether the content and the locus are in contact, the position occupied by the content may be processed as a tilted rectangle, a circle centered on the center of gravity of the content, or the like.

  In step S305, the trajectory extraction unit 123 confirms the overlap between the content and the trajectory. The trajectory is a line segment that connects the current coordinate to the previous coordinate of the mobile terminal device 101. A line segment surrounding the content is obtained from the coordinate information of the upper left and lower right of the content. When the line segment surrounding the content and the line segment of the locus intersect, it is determined that the content and the locus are in contact. The trajectory extraction unit 123 records the presence / absence of contact between the target content and the trajectory, determines that the target content has been processed, and returns to the process of step S303. If all the contents have been processed in step S303, the position / trajectory acquisition process ends.

  FIG. 4 is a flowchart showing details of the attribute information / data acquisition processing in step S204 of FIG. In step S401 and step S402, the attribute information acquisition unit 124 acquires attribute information from the recording device 125 for all contents that the trajectory extraction unit 123 determines to be in contact with the trajectory. When the attribute information of all contents is acquired, the process proceeds to step S403.

  In step S <b> 403, the data transmission control unit 126 transmits the attribute information acquired by the attribute information acquisition unit 124 to the mobile terminal device 101. In steps S <b> 404 and S <b> 405, the data transmission control unit 126 receives the content transmitted from the mobile terminal device 101 and accumulates it in the recording device 125. Here, it is assumed that the mobile terminal device 101 transmits content that matches the attribute information transmitted by the data transmission control unit 126 in step S403.

  FIG. 5 is a flowchart showing details of the display update process in step S205 of FIG. In step S501 and step S502, the attribute information acquisition unit 124 acquires a list of contents received from the mobile terminal device 101, and executes the processes of steps S503 and S504 for all received contents.

  In step S503, the attribute information acquisition unit 124 selects a content closest to the target content from the content selected by the trajectory extraction unit 123, and creates a combination.

  In step S504, the display position control unit 128 determines the coordinates for displaying the content received from the mobile terminal device 101 for each combination of the content created in step S503. The coordinates to be set here are set to positions that are overlapped with the contents combined in step S503 or separated by a preset distance. Or you may calculate dynamically according to the magnitude | size of the displayed content.

  In step S <b> 505, the image processing unit 129 and the display control unit 130 create a screen displaying the content received from the mobile terminal device 101 in accordance with the display position determined by the display position control unit 128, and display the display surface 131. Update.

  FIG. 6 is a flowchart illustrating the entire processing of the mobile terminal device 101 according to the present embodiment. In step S <b> 601, the content search unit 112 receives attribute information from the data transmission control unit 126 of the image display apparatus 102 via the communication unit 111.

  In step S602 and step S603, the content search unit 112 searches for and extracts content with matching attribute information from all the content stored in the recording device 113 in the mobile terminal device 101. When the processing of all contents is completed, the process proceeds to step S604.

  In step S <b> 604, the content search unit 112 transmits the content extracted in steps S <b> 602 and S <b> 603 to the data transmission control unit 126 of the image display device 102 via the communication unit 111.

  FIG. 7 is a diagram conceptually illustrating an example of the operation described above. The mobile terminal device 101 is moved so as to trace over the content 701 displayed on the display surface 131. Then, among the contents stored in the mobile terminal apparatus 101, the contents whose attribute information matches the contents 701 are transferred, and are displayed as received contents 702 near the contents 701 whose attributes match.

  FIG. 8 conceptually shows an example of the operation when the content 701 displayed on the display surface 131 in FIG. 7 is a continuous still image extracted from a moving image, and the locus represents the moving image. FIG.

  A moving image trajectory 801 is a trajectory in which continuous still images extracted from a moving image are arranged as content 701 in time series, and is displayed on the display surface 131 of the image display device 102. The moving image photographing device 802 is a kind of the mobile terminal device 101, in which photographed moving images are stored. The extracted moving image 803 is a kind of the received content 702 and is a part of the moving image stored in the moving image capturing device 802. By tracing the moving image trajectory 801 with the moving image capturing device 802, only the portion of the moving image trajectory 801 whose attribute information matches the traced area is cut out as the extracted moving image 803 by the processing described so far. Displayed. The image capturing device 804 is a kind of the mobile terminal device 101 and stores captured still images. The extracted still image 805 is a kind of the received content 702 and is a part of the still image stored in the image capturing device 804. By tracing the moving image trajectory 801 with the image capturing device 804, only the still image whose attribute information matches the traced position in the moving image trajectory 801 is transferred and displayed by the processing described so far. That is, in the example shown in FIG. 8, the elapsed time from the beginning of the moving image (moving image content) is acquired as the attribute information of the content 701.

  Next, a second embodiment of the present invention will be described. FIG. 9 is a diagram illustrating a configuration of main parts of an image display device and a mobile terminal device according to the second embodiment of the present invention. The difference between the configuration of the image display device shown in FIG. 9 and the configuration of the image display device according to the first embodiment shown in FIG. 1 is that the content search unit 112 is eliminated from the mobile terminal device 101 and the approach detection unit. The data transmission control unit 126 is connected from 121. The other parts are basically the same as the parts in FIG. 1, and the description is omitted except for the differences.

  In FIG. 9, the approach detection unit 121 notifies the data transmission control unit 126 when the approach or contact of the mobile terminal 101 is detected. In response to the notification from the approach detection unit 121, the data transmission control unit 126 receives all the content stored in the mobile terminal device 101 and stores it in the recording device 125.

  When the attribute information acquisition unit 124 receives the list information of the content in contact with the trajectory from the trajectory extraction unit 123, the attribute information acquisition unit 124 checks the attribute information from the recording device 125. Then, the attribute information acquisition unit 124 resets the content that matches the attribute information from the content received in advance from the mobile terminal device 101 as the received content.

  FIG. 10 is a flowchart showing the entire processing of the image display apparatus according to the second embodiment of the present invention. The difference from the first embodiment (FIG. 2) is that step S1001 is added.

  In step S <b> 1001, the data transmission control unit 126 receives the notification from the approach detection unit 121, receives all the contents stored in the mobile terminal device 101, and stores them in the recording device 125.

  In step S204, the attribute information acquisition unit 124 acquires the attribute information of the content that the mobile terminal device 101 touches on the display surface 131, and searches for matching content from the content received from the mobile terminal device 101 in step S1001. The process of step S204 will be described later.

  Since the other steps in the entire process are the same as those in the first embodiment (FIG. 2), description thereof is omitted.

  FIG. 11 is a flowchart showing details of the attribute information / content acquisition processing in step S204 of FIG.

  The difference from the process shown in FIG. 4 of the first embodiment is that steps S403, S404, and S405 are eliminated, and steps S1101 and S1102 are added instead.

  In step S1101, the attribute information acquisition unit 124 searches the received content from the mobile terminal device 101 stored in the recording device 125 for content that matches the attribute information acquired in step S402. If it is determined in step S401 that the attribute information acquisition unit 124 has processed all the display contents received from the trajectory extraction unit 123, the process proceeds to step S1102.

  In step S1102, the attribute information acquisition unit 124 updates the received content list information. The updated received content list information includes only those whose attributes are determined to match in step S1101, and this information is sent to the display update process in step S205 of FIG. 10, which is the next process. Since other steps are the same as the processing shown in FIG. 4 of the first embodiment, description thereof will be omitted.

  Next, a third embodiment of the present invention will be described. FIG. 12 is a diagram illustrating a configuration of main parts of the image display device and the mobile terminal device according to the third embodiment of the present invention. The difference between the configuration of the image display device shown in FIG. 12 and the configuration of the image display device according to the first embodiment shown in FIG. 1 is that a user's finger 1201 is added and an object related to the approach detection unit 121. The point is that the mobile terminal device 101 is changed to the user's finger 1201. The other parts are basically the same as the parts in FIG. 1 of the first embodiment, and thus the description other than the differences will be omitted.

  In FIG. 12, when the user makes the user's finger 1201 approach or contact the display surface 131 of the image display device 102, the approach detection unit 121 detects and notifies the position detection unit 122. Note that what is brought close to or in contact with the display surface 131 may be a pencil or a bar as long as it can indicate a specific position on the display surface 131. Further, position information and input corresponding to contact may be performed using a pointing device connected to the image display apparatus 102.

  The flowchart of the process in the present embodiment is the same as that shown in FIGS. 2 to 6 of the first embodiment, and a description thereof will be omitted. In addition, the method of detecting that the user's finger 1201 is approaching or touching the display surface 131 and the position thereof in the present embodiment can also be used in the configuration of the second embodiment.

  In the above-described embodiment, it is possible to transfer and display a desired content from the content stored in the mobile terminal device to the image display device with a simple procedure.

  In addition, when handling moving image content, it is possible to realize an editing function that cuts out a portion of the moving image content stored in the mobile terminal device by a simple procedure.

  Each process of the present invention can also be realized by executing software (program) acquired via a network or various storage media by a processing device (CPU, processor) such as a personal computer.

  101: mobile terminal device, 102: image display device, 111: communication unit, 112: content search unit, 113: recording device, 121: approach detection unit, 122: position detection unit, 123: locus extraction unit, 124: attribute information Acquisition unit, 125: recording device, 126: data transmission control unit, 127: communication unit, 128: display position control unit, 129: image processing unit, 130: display control unit, 131: display surface

Claims (12)

Extracting means for extracting a trajectory drawn by the external device on the display surface;
An acquisition means for acquiring attribute information of data displayed at a position overlapping the locus among the data displayed on the display surface when the locus is extracted by the extraction means;
Transmitting means for transmitting attribute information acquired by the acquiring means to the external device;
Receiving means for receiving, from the external apparatus , data of attribute information that matches attribute information transmitted by the transmitting means among data stored in the external apparatus;
An image display device comprising: display control means for displaying data received by the receiving means on the display surface. Receiving means for receiving data from an external device;
Extracting means for extracting a trajectory drawn by the external device on the display surface;
When the locus is extracted by the extraction means, an acquisition means for obtaining attribute information of data displayed at a position overlapping the locus among the data displayed on the display surface;
Search means for searching for data matching the attribute information acquired by the acquisition means from the data received by the reception means;
An image display apparatus comprising: display control means for displaying data searched by the search means on the display surface.   The image display device according to claim 1, wherein the extraction unit extracts a locus drawn by the external device moving in contact with or close to the display surface.   The image display apparatus according to claim 1, wherein the acquisition unit acquires information indicating a shooting time of data as attribute information.   The image display apparatus according to claim 1, wherein the acquisition unit acquires information indicating a position where data is captured as attribute information.   The image display apparatus according to claim 1, wherein the acquisition unit acquires information indicating elapsed time from the beginning of the moving image content as attribute information. An image display system including an image display device that performs display control of data and a mobile terminal device that stores data,
The image display device includes:
Extracting means for extracting a trajectory drawn by the external device on the display surface;
An acquisition means for acquiring attribute information of data displayed at a position overlapping the locus among the data displayed on the display surface when the locus is extracted by the extraction means;
First transmission means for transmitting attribute information acquired by the acquisition means to the external device;
The portable terminal device
First receiving means for receiving attribute information transmitted from the first transmitting means;
Search means for searching for attribute information data matching the attribute information received by the first receiving means among the data stored in the portable terminal device ;
Second transmission means for transmitting the data searched by the search means to the image display device;
The image display device includes:
Second receiving means for receiving data transmitted from the second transmitting means;
The image display system further comprising display control means for displaying data received from the second receiving means on the display surface. An image display system including an image display device that performs display control of data and a mobile terminal device that stores data,
The portable terminal device
Transmission means for transmitting data to the image display device;
The image display device includes:
Receiving means for receiving data from the portable terminal device;
Extracting means for extracting a trajectory drawn by the mobile terminal device on a display surface;
When the locus is extracted by the extraction means, an acquisition means for obtaining attribute information of data displayed at a position overlapping the locus among the data displayed on the display surface;
Search means for searching for data matching the attribute information acquired by the acquisition means from the data received by the reception means;
An image display system comprising: display control means for displaying the data searched by the search means on the display surface. An extraction step of extracting a trajectory drawn by the external device on the display surface;
When the trajectory is extracted by the extraction step, an acquisition step of acquiring attribute information of data displayed at a position overlapping the trajectory among data displayed on the display surface;
A transmission step of transmitting the attribute information acquired in the acquisition step to the external device;
A reception step of receiving, from the external device , data of attribute information that matches the attribute information transmitted by the transmission step among data stored in the external device;
A display control step of displaying the data received in the receiving step on the display surface. A receiving step for receiving data from an external device;
An extraction step of extracting a trajectory drawn by the external device on the display surface;
When the trajectory is extracted by the extraction step, an acquisition step of acquiring attribute information of data displayed at a position overlapping the trajectory among the data displayed on the display surface;
A search step for searching for data that matches the attribute information acquired by the acquisition step from the data received by the reception step;
A display control step of displaying the data searched in the search step on the display surface. An extraction step of extracting a trajectory drawn by the external device on the display surface;
When the trajectory is extracted by the extraction step, an acquisition step of acquiring attribute information of data displayed at a position overlapping the trajectory among data displayed on the display surface;
A transmission step of transmitting the attribute information acquired in the acquisition step to the external device;
A reception step of receiving, from the external device , data of attribute information that matches the attribute information transmitted by the transmission step among data stored in the external device;
A program for causing a computer to execute a display control step of displaying data received in the receiving step on the display surface. A receiving step for receiving data from an external device;
An extraction step of extracting a trajectory drawn by the external device on the display surface;
When the trajectory is extracted by the extraction step, an acquisition step of acquiring attribute information of data displayed at a position overlapping the trajectory among the data displayed on the display surface;
A search step for searching for data that matches the attribute information acquired by the acquisition step from the data received by the reception step;
A program for causing a computer to execute a display control step of displaying data retrieved in the retrieval step on the display surface.

Images