JP2012074973A - Image communication display system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce a reception load when transmitting a series of images, with the image themes being transmitted to the receiving side.SOLUTION: An image communication display system 1 comprises: an image folder 152 for storing the series of images; a CPU 18 for detecting the image theme of each image, and for extracting an image sequence representation theme for each image sequence L; and a communication unit 13 for extracting, as a representative image DG, at least one image of the image sequence representation theme on the basis of each image sequence L, and for generating thumbnail images SG of other images than the representative image DG, so as to transmit the images DG, SG to another device. The CPU 18 displays the representative image DG and the thumbnail images SG transmitted from another device. To the other device, that is, the transmission source of a thumbnail image SG on which a designation operation is received from a user, the communication unit 13 transmits a transmission request signal of the original image of the thumbnail image SG of concern. Also, on receipt of a transmission request signal from another device, the communication unit 13 transmits a requested original image.

Description

  The present invention relates to an image communication display device and a program.

  2. Description of the Related Art Conventionally, an image display apparatus that captures a plurality of image data and displays an image can transmit a series of a plurality of images to another apparatus so that the other user can view the images. (For example, refer to Patent Document 1).

JP 2010-140195 A

  However, simply sending a series of multiple images together, the receiving device will receive all the images regardless of whether the sent images meet the user's interests. The receiving burden is large.

  On the other hand, from the viewpoint of reducing the receiving burden, each image is once thumbnailed and transmitted, and after waiting for the receiving user to return an image that suits his / her interest, the related image is transmitted again. However, it is difficult to convey the image theme to the receiving user with thumbnail images.

  An object of the present invention is to provide an image communication display device and a program capable of reducing the burden on the receiving side while transmitting the theme of these images to the receiving side when transmitting a series of a plurality of images. is there.

In order to solve the above-mentioned problem, the invention described in claim 1
In an image communication display device capable of communicating between its own device and another device,
Display means;
Image storage means for storing an image folder storing a series of images;
Image theme detection means for detecting an image theme of each of the series of images;
Representative theme extracting means for extracting, as an image string representative theme, an image theme representing the contents of the image string for each image string obtained by dividing the series of images from the image theme detected by the image theme detecting means; ,
A transmission instruction means for receiving a transmission instruction operation from the user for the series of images;
Based on the transmission instruction operation, for each of the image sequences, at least one image of the same image theme as the image sequence representative theme of the image sequence is extracted as a representative image, and among the series of images, the image sequence Image transmitting means for creating thumbnail images for images other than the representative image, and transmitting the representative image and the thumbnail image to another device;
Image display control means for causing the display means to display the representative image and the thumbnail image transmitted from another device;
Thumbnail image designation means for receiving a designation operation from a user for any one of the thumbnail images controlled by the image display control means;
A transmission request signal transmitting means for transmitting a transmission request signal of the original image of the thumbnail image to another device as a transmission source of the thumbnail image that has received the designation operation;
When receiving the transmission request signal from another device, an image retransmission means for transmitting the original image of the thumbnail image requested by the transmission request signal to the other device;
It is characterized by providing.

The invention described in claim 2 is the image communication display device according to claim 1,
Icon storage means for storing a plurality of types of icons to be arranged on the image;
Icon placement means for placing any icon stored in the icon storage means on the original image or the representative image of the thumbnail image based on a user operation;
And an icon-added image transmission unit that transmits the original image of the thumbnail image or the representative image on which the icon is arranged by the icon arrangement unit to another apparatus as a transmission source of the image based on a user operation. Features.

The invention according to claim 3 is the image communication display device according to claim 2,
The image display control means includes
A similar image of the representative image is detected on the network and displayed on the display unit together with the representative image;
The icon arrangement means is
Based on a user operation, any icon stored in the icon storage means can be arranged on the similar image,
The icon-added image transmission means includes
The similar image in which icons are arranged can be transmitted by the icon arrangement means based on a user operation.

The invention according to claim 4 is a program,
A computer capable of communicating between its own device and another device and having a display means,
An image storage function for storing an image folder storing a series of images;
An image theme detection function for detecting an image theme of each of the series of images;
A representative theme extracting function for extracting, from the image theme detected by the image theme detecting function, an image theme representing the contents of the image sequence as an image sequence representative theme for each image sequence obtained by dividing the series of images. ,
A transmission instruction function for receiving a transmission instruction operation from the user for the series of images;
Based on the transmission instruction operation, for each of the image sequences, at least one image of the same image theme as the image sequence representative theme of the image sequence is extracted as a representative image, and among the series of images, the image sequence An image transmission function for creating thumbnail images for images other than the representative image and transmitting these representative images and thumbnail images to other devices;
An image display control function for causing the display means to display the representative image and the thumbnail image transmitted from another device;
A thumbnail image designation function that receives a designation operation from a user for any one of the thumbnail images that is display-controlled by the image display control function;
A transmission request signal transmission function for transmitting a transmission request signal of the original image of the thumbnail image to another device as a transmission source of the thumbnail image that has received the designation operation;
When receiving the transmission request signal from another device, an image retransmission function for transmitting the original image of the thumbnail image requested by the transmission request signal to the other device;
It is characterized by realizing.

According to the present invention, an image theme of each of a series of images is detected, and an image sequence representative theme is extracted from the detected image theme for each image sequence obtained by dividing the series of images. For each image sequence, at least one image of the same image theme as the image sequence representative theme of the image sequence is extracted as a representative image and transmitted to the other device. Can tell.
In addition, a thumbnail image for an image other than the representative image in the series of images is created and transmitted together with the representative image, and when a designation operation is received from the user for any of the transmitted thumbnail images, The original image transmission request signal is returned for the operated thumbnail image, and the original image of the thumbnail image requested by the transmission request signal is transmitted. In contrast, it is possible to prevent an image that does not match the interest of the other user from being transmitted as it is. Therefore, the burden on the receiving side can be reduced.

It is a conceptual diagram which shows schematic structure of an image display system. It is a block diagram which shows schematic structure of an image communication display apparatus. It is a figure which shows schematic structure of an image communication display apparatus. It is a block diagram which shows schematic structure of a server. It is a figure which shows the data structure of an image display control table. It is a figure which shows the data structure of an image display control table. It is a figure which shows the data structure of an image display control table. It is a figure which shows the data structure of the image table classified by theme. It is a flowchart which shows the flow of a server process. It is a flowchart which shows the flow of an image theme / image link data creation process. It is a flowchart which shows the flow of the auto select process of a representative image. It is a flowchart which shows the flow of an image display / communication process. It is a flowchart which shows the flow of an image display / communication process. It is a figure which shows the display content of a display part. It is a figure which shows the display content of a display part. It is a figure which shows the display content of a display part. It is a figure which shows the display content of a display part. It is a figure which shows the display content of a display part.

Hereinafter, an example of an embodiment according to the present invention will be described in detail with reference to the accompanying drawings. However, the scope of the invention is not limited to the illustrated examples.
FIG. 1 is a diagram showing a schematic configuration of the image display system 9.
As shown in this figure, the image display system 9 includes a plurality of image communication display devices 1 and a server 2.

[Configuration of image communication display device]
FIG. 2 is a block diagram illustrating a schematic configuration of the image communication display device 1. The image communication display device 1 according to the present embodiment is a digital photo frame or the like installed on a table as shown in FIG. 3, for example, and acquires image data from an external device (for example, a digital camera). Display based on image data is performed.

  Specifically, as shown in FIG. 2, the image communication display device 1 includes a display unit 11, an input unit 12, a communication unit 13, a storage medium reading unit 14, a ROM 15, a RAM 16, a CPU 18, and the like. It is configured with.

  The display unit 11 includes a liquid crystal display (LCD), an organic electroluminescence (EL) display, and the like, and displays various types of information according to display signals from the CPU 18. Note that a multi-touch-capable touch panel 120 is integrally provided over the entire display screen on the display of the display unit 11 in the present embodiment.

  The input unit 12 includes the touch panel 120 and the mouse 121 described above, and outputs an operation signal corresponding to a user operation to the CPU 18.

  The communication unit 13 performs data communication with other electronic devices such as a personal computer and a camera. In the present embodiment, information in the ROM 15 can be transmitted and received. In addition, the communication unit 13 can be connected to the Internet, thereby enabling communication with an external device connected to the Internet. Note that the communication method may be wireless or wired.

  The storage medium reading unit 14 includes a card slot 140. The storage medium reading unit 14 reads information from the external information storage medium 14a attached to the card slot 140 and records information on the external information storage medium 14a. ing. The external information storage medium 14a can record information in the ROM 15 and RAM 16.

  The ROM 15 is a memory that stores programs and data for realizing various functions of the image communication display device 1. In the present embodiment, the ROM 15 stores an image display program 150 according to the present invention, an icon folder 155, an image folder group 151, an address book 156, and the like.

  The image display program 150 is a program for causing the CPU 18 to execute image display / communication processing (see FIGS. 12 to 13) described later.

  The icon folder 155 stores a plurality of types of additional icons I (see FIG. 17A) arranged in an image in an image display / communication process (see FIGS. 12 to 13) described later.

  The image folder group 151 has a plurality of image folders 152. In each image folder 152, image data for a series of a plurality of images is stored in association with the creation date (shooting date) and the like.

  Here, in these image folders 152, received image folders received from another image communication display device 1 (hereinafter referred to as other devices) in an image display / communication process (see FIGS. 12 to 13) described later. 152R is included. In the received image folder 152R, the user name of the other device of the transmission source, the representative image DG representing the images in the folder (see FIG. 16B, etc.), and thumbnails for images different from the representative image DG. The image SG (see FIG. 16B, etc.), the additional image FG (see FIG. 16B) displayed in addition to the representative image DG, and the representative image DG or the additional image FG by the transmission source user A plurality of additional icons I arranged in are stored. Here, the additional image FG is associated with one of the representative images DG. Further, the additional icon I is associated with position information of the additional icon I in the image. Note that the additional image FG and the additional icon I need not be stored in the received image folder 152R as long as the CPU 18 can access them.

  The address book 156 stores a user name of another device registered by the user and a mail address in association with each other. These user names and e-mail addresses can be arbitrarily registered by the user.

  The RAM 16 includes a memory area that temporarily stores various programs executed by the CPU 18 and data related to the execution of these programs.

  The CPU 18 executes processing based on a predetermined program in accordance with an input instruction, performs an instruction to each function unit, data transfer, and the like, and comprehensively controls the image communication display device 1. Yes. Specifically, the CPU 18 reads out various programs stored in the ROM 15 in accordance with an operation signal or the like input from the input unit 12, and executes processing according to the program. Then, the CPU 18 stores the processing result in the RAM 16 and causes the display unit 11 to appropriately output the processing result.

[Server configuration]
FIG. 4 is a block diagram illustrating a schematic configuration of the server 2.

  As shown in this figure, the server 2 includes a communication unit 21, a ROM 22, a RAM 23, a CPU 25, a storage unit 24, and the like. In order to secure the function as a WWW server, a DNS server or a local LAN is generally provided in the network. However, in this embodiment, the server 2 is directly connected for the sake of simplicity. It is assumed that it is connected to the Internet. Further, since the server 2 is the same as a computer of a general WWW server, the description will focus on the characteristic part according to the present embodiment.

  The communication unit 21 communicates with an external device connected to the Internet. The ROM 22 stores an image display program 220 according to the present invention, in addition to initial data when the server 2 is started up. The image display program 220 causes the CPU 25 to execute server processing (see FIG. 9) described later.

  The RAM 23 forms a work area for temporarily storing various processing data executed by the CPU 25. CPU25 reads the program memorize | stored in the memory | storage part 24 or ROM22, and performs the process according to the said program.

  The storage unit 24 is configured by a hard disk or the like, and stores an image folder 240, an image display control table 241 and a theme-specific image table 242 in server processing (see FIG. 9) described later.

  In the image folder 240, image data for a series of images received from the image communication display device 1 in a server process (see FIG. 9) described later is stored in association with the creation date and time (shooting date and time). It has become so.

  As shown in FIGS. 5 to 7, the image display control table 241 stores an image number and a plurality of types of data related to image display control in association with each image in the image folder 240.

  Specifically, the image display control table 241 stores at least one theme of the image in association with each image (“theme name 1” and “theme name 2” in the figure). Column).

  The image display control table 241 stores at least one image number of a similar image (hereinafter referred to as a link image) existing in the image folder 240 in association with each image (see FIG. (Refer to “Link image 1” and “Link image 2”).

Further, the image display control table 241 stores the suitability of the representative image DG in association with each image (see the column “Representative image suitability” in the figure).
In the image display control table 241, an image theme representing the contents of the image row L (hereinafter referred to as an image row representative theme) is associated with each image row L obtained by dividing the stored image. In addition, in association with each image in the image sequence L, whether or not the image theme of the image matches the image sequence representative theme is stored. (Refer to the “Representative theme” and “Applicable ○” columns in the figure). In the present embodiment, the image in the image display control table 241 is divided into _three image rows L _{1 to} L ₃ .

  As shown in FIG. 8, the theme-specific image table 242 includes, for each of a plurality of types of image themes that can be represented by images, a theme name and a general image (hereinafter referred to as a typical image) TG representing the theme. It is stored in association.

[Operation]
Next, the operation of the image display system 9 will be described with reference to FIGS.

<Server processing>
FIG. 9 is a flowchart showing a server process flow in which the CPU 25 of the server 2 reads and executes the image display program 220.

  As shown in this figure, in this server process, first, the CPU 25 receives the image folder 152 and the destination address from the image communication display device 1 by the process of step S5 in the image display / communication process described later (see FIG. 12). It is determined whether it has been received (step T1), and if it is determined that it has been received (step T1; Yes), an image theme / image link data creation process is performed (step T2).

  Specifically, as shown in FIG. 10, in this image theme / image link data creation process, the CPU 25 first stores the received image folder 152 as an image folder 240, and data is stored for this image folder 240. A new image display control table 241 is created, and the image data in the image folder 240 is sorted in time order (in order of creation date and time in this embodiment) and stored in the image display control table 241. (Step U1).

  Next, the CPU 25 designates each image data in the image display control table 241 as a processing target in order, and then the image of the processing target image data (hereinafter referred to as a processing target image) and the theme-specific image table 242. The typical images TG similar to the image to be processed are searched in the theme-specific image table 242, and the detected number of image themes of each typical image TG is the largest. One or more types of image themes are stored in the image display control table 241 as the image theme of the image to be processed (step U2). It should be noted that a conventionally known image matching technique can be used to determine the ratio between the image to be processed and the typical image TG.

Next, the CPU 25 divides a series of images in the image display control table 241 into a plurality (three in the present embodiment) of image sequences L (L _{1 to} L ₃ ), and these image sequences L For each, an image theme representing the contents of the image sequence L is extracted from a plurality of image themes associated with each image in the image display control table 241, and associated with the image sequence L as an image sequence representative theme. It memorize | stores in the image display control table 241 (step U3).

  Next, the CPU 25 determines whether or not the image theme of each image in each image row L matches the image row representative theme. “×” is stored in the image display control table 241 in association with the image (step U4).

  Next, the CPU 25 designates the first image in the image display control table 241 as a link data creation target (step U5), and then from the image with the image number after the designated image in the image display control table 241. A similar image of the designated image is searched (step U6).

  Next, the CPU 25 determines whether or not a similar image is detected (step U7). If it is determined that no similar image is detected (step U7; No), the CPU 25 proceeds to step U9 described later.

  If it is determined in step U7 that a similar image has been detected (step U7; Yes), the CPU 25 stores the image number of the similar image in the image display control table 241 as the number of the link image for the designated image. (Step U8). If a plurality of similar images are detected at this time, the CPU 25 stores the image number of each similar image.

  Next, the CPU 25 determines whether or not there is a next image in the image display control table 241 (step U9). If it is determined that there is a next image (step U9; Yes), the next image is generated as link data. After designating as a target (step U10), the process proceeds to step U6 described above.

  If it is determined in step U9 that there is no next image in the image display control table 241 (step U9; No), the CPU 25 ends the image theme / image link data creation process.

  When the above image theme / image link data creation processing is completed, as shown in FIG. 9, the CPU 25 next performs auto-selection processing of the representative image (step T3).

  Specifically, as shown in FIG. 11, in this auto-select process, first, the CPU 25 receives an input operation for the number of representative images selected (step V1). In the present embodiment, “6” is set as the default selection number.

  Next, the CPU 25 designates the first image in the image display control table 241 as an evaluation target (step V2), and then refers to the image display control table 241 and the image theme of the designated image includes the designated image. It is determined whether or not the image column representative theme of the column L matches (step V3).

  When it is determined in step V3 that the image theme of the designated image does not match the image string representative theme (step V3; No), the CPU 25 determines the suitability of the designated image as a representative image by “x” (not appropriate). ) In the image display control table 241 (step V4), and the process proceeds to step V8 described later.

  When it is determined in step V3 that the image theme of the designated image matches the image string representative theme (step V3; Yes), the CPU 25 links the image number of the link destination in the image display control table 241 for the designated image. Are determined, that is, whether or not the designated image is the link source (step V5).

  If it is determined in step V5 that the designated image is the link source (step V5; Yes), the CPU 25 displays the image with the suitability as a representative image for the designated image as “◯” (appropriate). After being stored in the control table 241 (step V6), the process proceeds to step V8 described later.

  When it is determined in step V5 that the designated image is not the link source (step V5; No), the CPU 25 displays the image with the suitability of the designated image as “Δ” (somewhat appropriate) as the representative image. It is stored in the control table 241 (step V7).

  Next, the CPU 25 determines whether or not there is a next image in the image display control table 241 (step V8). If it is determined that there is a next image (step V8; Yes), the next image is designated as an evaluation target. (Step V9), the process proceeds to Step V3 described above.

  If it is determined in step V8 that there is no next image in the image display control table 241 (step V8; No), the CPU 25 counts the number of images in each image row L (step V10), and the above step V1. The number of selected representative images input in step S11 is assigned to each image row L in proportion to the number of images (step V11).

  Next, the CPU 25 selects an image of suitability “◯” as the representative image DG from each image row L for the number of selected selections, sets the suitability of the selected representative image DG to “●”, and other images. Is stored in the image display control table 241 (step V12), and the autoselect process is terminated. At this time, if there is no image of suitability “◯” in the image row L by the number of selected images, the CPU 25 selects the image of suitability “Δ”. If the number of images with the suitability “◯” is larger than the number of selections, the CPU 25 selects images with different creation dates, that is, images stored in a distributed manner in the image display control table 241.

  When the above auto-select processing is completed, as shown in FIG. 9, the CPU 25 next creates thumbnail images for images other than the representative image DG in the image display control table 241, and the image folder together with the representative image DG of the actual size. And transmitted to the destination address (step T4), the process proceeds to the above-described step T1.

  If it is determined in step T1 that the image folder 152 and the address of the transmission destination are not received from the image communication display device 1 (step T1; No), the CPU 25 performs steps in image display / communication processing described later. It is determined whether or not a search request signal for a similar image existing on the Internet has been received from the image communication display device 1 by the process of S23 (see FIG. 13) (step T5).

  If it is determined in step T5 that a similar image search request signal has been received (step T5; Yes), the CPU 25 searches the Internet for a similar image related to the search request signal and detects the detected image. Are transmitted to the image communication display device 1 that is the source of the search request signal (step T6), and then the process proceeds to step T1 described above.

  If it is determined in step T5 that a similar image search request signal has not been received (step T5; No), the CPU 25 performs a thumbnail in step S27 (see FIG. 13) in the image display / communication process described later. It is determined whether or not an original image transmission request signal for the image SG has been received from the image communication display device 1 (step T7).

  If it is determined in step T7 that the original image transmission request signal for the thumbnail image SG has been received (step T7; Yes), the CPU 25 converts the original image of the thumbnail image SG specified by the transmission request signal to the Internet. After searching from the upper or image display control table 241 and transmitting the detected image to the image communication display device 1 that is the transmission source of the transmission request signal (step T8), the process proceeds to step T1 described above.

  If it is determined in step T7 that an original image transmission request signal for the thumbnail image SG is not received (step T7; No), the CPU 25 receives an instruction signal for other processing from the image communication display device 1. (Step T9), if it is determined that it has been received (step T9; Yes), the process proceeds to another process, whereas if it is determined that it has not been received (step T9; No), the above-described steps Transition to T1.

<Image display / communication processing>
12 and 13 are flowcharts showing the flow of image display / communication processing in which the CPU 18 of the image communication display device 1 reads and executes the image display program 150.

  As shown in FIG. 12, in the image display / communication process, the CPU 18 first receives a process content designation operation from the user (step S1) and determines whether or not a transmission instruction operation for the image folder 152 has been received (step S2). .

  If it is determined in step S2 that a transmission instruction operation for the image folder 152 has been received (step S2; Yes), the CPU 18 receives a designation operation for the image folder 152 to be transmitted from the user (step S3), and the destination An address selection operation is received from the user (step S4). In the present embodiment, in step S4, the user can display the contents of the address book 156 on the display unit 11 and select a destination address.

  Next, after transmitting the image data in the designated image folder 152 to the server 2 together with the selected address (step S5), the CPU 18 proceeds to step S1 described above. Note that the server 2 that has received the image data and the address in step S5 performs the above-described processing in step T2 (see FIG. 9).

  If it is determined in step S2 that the instruction to transmit the image folder 152 has not been received (step S2; No), the CPU 18 performs a browsing operation on the received image folder 152, that is, the received image folder 152R. It is determined whether it has received (step S6).

  When it is determined in step S6 that the browse operation for the received image folder 152R is not received (step S6; No), the CPU 18 determines whether or not to receive an end operation (step S60), and determines that it is not received. If so (step S60; No), the process proceeds to another process. If it is determined that the process has been received (step S60; Yes), the image display / communication process ends.

  If it is determined in step S6 that the received image folder 152R has been browsed (step S6; Yes), the CPU 18 receives a designation operation for any received image folder 152R from the user (step S6). S7) The head representative image DG in the designated received image folder 152R (hereinafter, designated designated received image folder 152RS) is designated as a display target (step S8). At this time, the CPU 18 displays the user name of the transmission source of the designated received image folder 152RS on the top row of the display unit 11.

  Next, the CPU 18 determines whether or not the additional image FG or the additional icon I is added to the representative image DG specified as a display target (hereinafter referred to as the specified representative image DGS), and the information in the specified received image folder 152RS. (Step S9; No), the designated representative image DGS is displayed on the display unit 11 on the full screen (step S10), and then to step S12 described later. Transition.

  Further, when it is determined in step S9 that the additional image FG or the additional icon I is added (step S9; Yes), the CPU 18 displays the designated representative image DGS on the upper left of the display unit 11, and designates the designated representative image. The additional image FG corresponding to DGS is displayed side by side from the left side to the right side at the bottom of the display unit 11 (step S11). At this time, the CPU 18 arranges and displays the additional icon I on the image (specified representative image DGS or additional image FG) to which the additional icon I is added based on the information in the specified received image folder 152RS.

  Next, the CPU 18 determines whether or not a touch operation is performed on the designated representative image DGS on the display unit 11 (step S12). If it is determined that the touch operation is not performed (step S12; No), a predetermined time is determined. It is determined whether or not it has elapsed (step S13). Here, as the predetermined time, for example, a time preset by the user between 5 seconds and 20 seconds can be used.

  If it is determined in step S13 that the predetermined time has not elapsed (step S13; No), the CPU 18 proceeds to step S12 described above.

  If it is determined in step S13 that the predetermined time has elapsed (step S13; Yes), the CPU 18 determines whether or not there is a next representative image DG in the designated received image folder 152RS (step S14). If it is determined that there is not (step S14; No), the process proceeds to step S1 described above.

  If it is determined in step S13 that the next representative image DG is present in the designated received image folder 152RS (step S14; Yes), the CPU 18 designates the next representative image DG as a display target in the designated representative image DGS. (Step S15), the process proceeds to Step S9 described above.

  If it is determined in step S12 that the designated representative image DGS has been touched (step S12; Yes), the CPU 18 displays the designated representative image DGS on the display unit 11 as shown in FIG. While displaying on the left side (step S21), the image area of the touch portion is extracted from the designated representative image DGS (step S22). Here, as the image area of the touch part, for example, the image area of the subject displayed including the touch part can be used.

  Next, the CPU 18 transmits a search request signal on the Internet for an image similar to the extracted image region to the server 2 (step S23), and performs the above-described processing of step T6 (see FIG. 9) on the server 2. Then, a thumbnail image of the detected similar image is received from the server 2 and displayed on the right side of the display unit 11 (step S24).

  Next, the CPU 18 searches the designated received image folder 152RS for a thumbnail image SG similar to the image area extracted in step S22, and displays the detected thumbnail image SG on the right side of the display unit 11 (step S25). .

  Next, the CPU 18 determines whether or not a touch operation is performed on any one of the thumbnail images SG displayed on the display unit 11 (step S26), and determines that the touch operation is not performed (step S26; No). Shifts to other processing.

  If it is determined in step S26 that any of the thumbnail images SG has been touched (step S26; Yes), the CPU 18 sends an original image transmission request signal for the touched thumbnail image SG to the server 2. After the server 2 performs the process of step T8 (see FIG. 9), the original image transmitted from the server 2, that is, an image obtained by enlarging the thumbnail image SG is added to the designated representative image DGS. The image FG is displayed at the bottom of the display unit 11 (step S27). When there are a plurality of thumbnail images SG touched at this time, the CPU 18 displays the additional images FG corresponding to these thumbnail images SG side by side from the left side to the right side at the bottom of the display unit 11.

  Next, the CPU 18 displays a list of additional icons I in the icon folder 155 between the upper center of the display unit 11, that is, between the designated representative image DGS on the left side and the thumbnail image SG on the right side (step S28).

  Next, the CPU 18 determines whether or not a drag operation on the image (designated representative image DGS or additional image FG) is performed on any of the displayed additional icons I (step S30). If it is determined (step S30; Yes), the additional icon I on which the drag operation has been performed is arranged and displayed at a specified position on the image.

  Next, the CPU 18 determines whether or not an enlargement operation is performed on the additional icon I on the image (step S31). If it is determined that the enlargement operation is not performed (step S31; No), the following step is performed. The process proceeds to S33. In the present embodiment, the enlargement operation is performed by performing a touch operation on the additional icon I with two fingers and widening the interval between the fingers.

  If it is determined that the enlargement operation has been performed in step S31 (step S31; Yes), the CPU 18 enlarges and displays the additional icon I according to the enlargement operation (step S32).

  Next, the CPU 18 stores the type of the additional icon I and the position and size of the additional icon I in the image in association with the dragged image in the received image folder 152R (step S33), and then the above. The process proceeds to step S30.

  If it is determined in step S30 that no drag operation is performed on any additional icon I (step S30; No), the CPU 18 determines whether an image return operation is performed. (Step S35). In the present embodiment, a reply operation is performed by dragging the designated representative image DGS toward the user name of the transmission source displayed at the top of the display unit 11.

  If it is determined in step S35 that a reply operation has been performed (step S35; Yes), the CPU 18 displays information about the designated representative image DGS currently displayed, the additional image FG, and the additional icon I (additional image). The contents and types of the FG and the additional icon I and the position and size of the additional icon I in the image are associated with each other and sent back to the image communication display device 1 as the transmission source (step S36), and then shown in FIG. Thus, the process proceeds to step S15 described above. In the process of step S36, the CPU 18 transmits the designated representative image DGS or the like to the image communication display device 1 on the other side without going through the server 2.

  Further, as shown in FIG. 13, when it is determined in step S35 that the reply operation is not performed (step S35; No), the CPU 18 performs a return operation to return the process to the immediately previous display state. (Step S37; No), the process proceeds to step S30. On the other hand, if it is determined (step S37; Yes), the process proceeds to step S30. As shown in FIG. 12, the process proceeds to step S9. In the present embodiment, a return operation is performed by performing a touch operation on the designated representative image DGS.

(Operation example of image display / communication processing)
Next, the server process and the image display / communication process will be specifically described with reference to FIGS.

  First, the user “Takashi” performs a transmission instruction operation for the image folder 152 in his / her image communication display device 1 (step S2; Yes), and transmits the image folder 152 storing the series of images shown in FIGS. When the address of the user “Toge” is selected as the destination address (step S4), the image data in the image folder 152 is transmitted to the server 2 together with the selected address (step S3). Step S5).

  Next, in the server 2, after the received image folder 152 is stored as the image folder 240, as shown in FIGS. 5 to 7, a new image display control table in which no data is stored for the image folder 240. 241 is created, and each image data in the image folder 240 is sorted in time order and stored in the image display control table 241 (step U1).

  Next, after each image data in the image display control table 241 is designated as a processing target in order, the processing target image and each typical image TG in the theme image table 242 are compared, and the processing target image is obtained. Similar typical images TG are searched in the theme-specific image table 242, and one or more image themes “shop”, “PC”,. It is stored in the image display control table 241 as the image theme of the image to be processed (step U2).

Next, the series of images of the image display control table 241 is divided into three picture sequence _L 1 ~L _3, these in each image sequence _L 1 ~L _3, each image in the image display control table within 241 The image themes “PC”, “Festival”, and “Sky Tree” representing the contents of the image sequence L _{1 to} L ₃ are extracted from the plurality of image themes associated with the image sequence L, and the image sequence L as the image sequence representative theme is extracted. _{1 to} L ₃ are stored in the image display control table 241 in association with each other (step U3).

Next, it is determined whether or not the image theme of each image in each of the image sequences L _{1 to} L ₃ matches the image sequence representative themes “PC”, “Festival”, and “Sky Tree”. Is stored in the image display control table 241 in association with the image (step U4).

  Next, after the image of the image number “1” in the image display control table 241 is designated as the link data creation target (step U5), the similarity of the designated image is selected from the images of the image numbers “2” to “30”. An image is retrieved (step U6). Then, it is determined that the image with the image number “4” is detected as a similar image (step U7; Yes), and the image number “4” is image display control as the link image number for the image with the image number “1”. It is stored in the table 241 (step U8).

  In the same manner, after images of image numbers “2” to “30” in the image display control table 241 are sequentially designated as link data creation targets (step U10), the designation from the images of the subsequent image numbers is performed. A similar image is searched for (step U6). If it is determined that a similar image has been detected (step U7; Yes), the image number is stored in the image display control table 241 as the link image number for the designated image (step U8).

Next, after the image with the image number “1” in the image display control table 241 is designated as the evaluation target (step V2), the image display control table 241 is referred to, and the image themes “shop” and “PC” of the designated image are referred to. "along with is determined that matches the image sequence representative theme image sequence L ₁ included a the designated image" PC "(step V3; Yes), the link destination of the image in the image display control table 241 for the specified image It is determined that the number “4” is associated (step V5; Yes), and the suitability as the representative image is stored in the image display control table 241 as “◯” (appropriate) for the designated image (step S5). V6).

  In the same manner, after images of image numbers “2” to “30” in the image display control table 241 are sequentially designated as evaluation targets (step V9), the image display control table 241 is referred to and When the image theme matches the image row representative theme of the image row L including the designated image (step V3; Yes), the linked image number is associated with the designated image in the image display control table 241. If it is determined (step V5; Yes), the appropriateness of the designated image as a representative image is stored as “◯” (appropriate) in the image display control table 241 (step V6).

Next, the number of images “9”, “15”, “6” in each of the image rows L _{1 to} L ₃ is counted (step V10), and the number of selected representative images “6” is the number of images “9”, “15”. "in proportion to the image sequence _{L 1} to" 6 "," 2 "," 3 to the image column _{L 2} "are allocated by" 1 "in the image sequence _{L 3} (step V11).

Next, as many images as the number of selected selections “2”, “3”, and “1” are assigned, images of suitability “◯” are selected from the image rows L _{1 to} L ₃ as representative images DG, and the selected representative images are selected. The suitability of DG is set to “●” and the suitability of other images is made blank and stored in the image display control table 241 (step V12).

  Then, thumbnail images SG for images other than the representative image DG in the image display control table 241 are created, stored in the image folder together with the actual size representative image DG, and transmitted to the address of the transmission destination “Toge” (step). T4).

  Next, when the user “Toji” browses the received image folder 152R from “Takashi” in his / her image communication display device 1 (step S7), the user “Toge” is designated as shown in FIG. The head representative image DG (image number “1” in FIG. 5) in the received image folder 152RS is designated as a display target (step S8), and the additional image FG and the additional icon I are added to the designated representative image DGS. It is determined that the designated representative image DGS is not displayed (Step S9; No), and the designated representative image DGS is displayed on the full screen (Step S10). At this time, the user name “Takashi” of the transmission source of the designated received image folder 152RS is displayed at the top.

  Next, when it is determined that a predetermined time (10 seconds in this operation example) has passed (step S13; Yes), as shown in FIG. 14B, the next representative image DG (image number “ 5 ”) is designated as the designated representative image DGS (step S15), and it is determined that the additional image FG and the additional icon I are not added to the designated representative image DGS (step S9; No). DGS is displayed on the full screen (step S10).

  Similarly, if it is determined that 10 seconds have elapsed (step S13; Yes), as shown in FIGS. 14C and 15A to 15C, the next representative image DG (FIG. 5 to 7, the image numbers “10”, “15”, “20”, and “29”) are designated as the designated representative image DGS (step S15), and then the additional image FG and the addition are added to the designated representative image DGS. It is determined that the icon I is not added (step S9; No), and the designated representative image DGS is displayed on the full screen (step S10).

  When the user “Toge” performs a touch operation on the designated representative image DGS from the state shown in FIG. 15B described above (step S12; Yes), this designation is performed as shown in FIG. The representative image DGS is displayed on the left side of the display unit 11 (step S21), and the image area of the touch portion (here, “sky tree” portion) is extracted from the designated representative image DGS (step S22) and extracted. A search request signal on the Internet for an image similar to the image area is transmitted to the server 2 (step S23).

  Next, a similar image of the image related to the search request signal is searched from the Internet by the server 2, and a thumbnail image of the detected image is transmitted to the image communication display device 1 of the user “Toge” (step T6). The thumbnail image is displayed on the right side of the display unit 11 (step S24, see the “Web” column on the right side of the figure).

  Next, a thumbnail image SG similar to the image region (“sky tree” portion) extracted in step S22 is searched in the designated received image folder 152RS, and the detected thumbnail image SG is displayed on the right side of the display unit 11. (Step S25. Refer to the “Takashi” column on the right side of the figure).

  Next, as shown in the figure, when the user “Toge” performs a touch operation on the thumbnail image SG detected from the designated received image folder 152RS (step S26; Yes), the original about the touched thumbnail image SG is displayed. An image transmission request signal is transmitted to the server 2. As a result, the original image of the thumbnail image SG specified by the transmission request signal is retrieved from the image display control table 241 by the server 2, and the detected image is transmitted to the image communication display device 1 of “Toge” (step T8). ). Then, as shown in FIG. 16B, the original image transmitted from the server 2 is displayed at the bottom of the display unit 11 as the additional image FG of the designated representative image DGS (step S27).

  Similarly, as shown in the figure, when the user “Toge” performs a touch operation on the thumbnail image SG detected from the Internet (step S26; Yes), the original image of the touched thumbnail image SG is displayed. A transmission request signal is transmitted to the server 2. As a result, the original image of the thumbnail image SG designated by the transmission request signal is searched from the Internet by the server 2, and the detected image is transmitted to the image communication display device 1 of “Toge” (step T8). Then, as shown in FIG. 17A, the original image transmitted from the server 2 is displayed side by side at the bottom of the display unit 11 as the additional image FG of the designated representative image DGS (step S27).

  Next, a list of additional icons I in the icon folder 155 is displayed in the upper center of the display unit 11 (step S28), and the user “Toge” is displayed as an image (designated representative image DGS or additional image FG) with respect to the displayed additional icon I. When an upward drag operation is performed (step S30; Yes), the additional icon I subjected to the drag operation is arranged and displayed at a specified position on the image. Then, the type of the additional icon I and the position and size of the additional icon I in the image are associated with the dragged image and stored in the received image folder 152R (step S33). In this operation example, the user “Toge” looks at the image of “Sky Tree” displayed as the designated representative image DGS and the image of “Tokyo Tower” displayed as the additional image FG, and the highest building As the position of “Tokyo Tower” has changed to “Sky Tree”, the “Medal” additional icon I is placed on the designated representative image DGS of “Sky Tree” while the additional image of “Tokyo Tower” Additional icons I of “medal” and “x mark” are arranged on the FG.

  Next, as shown in FIG. 17B, when the user “Toge” performs a reply operation (step S35; Yes), the designated representative image DGS, the additional image FG, and the additional icon I that are currently displayed are displayed. Information (the contents and types of the additional image FG and the additional icon I, the position and size of the additional icon I in the image), and the image communication display device 1 of the user “Takashi” via the server 2. (Step S36).

  When the user “Takashi” browses the received image folder 152R from “Toge” in his / her image communication display device 1 (step S7), as shown in FIG. 18, the designated received image folder After the head representative image DG in 152RS (designated representative image DGS in FIG. 17B) is designated as a display target (step S8), an additional image FG and an additional icon I are added to the designated representative image DGS. (Step S9; Yes). Then, the designated representative image DGS is displayed at the upper left of the display unit 11, and the additional image FG corresponding to the designated representative image DGS is displayed side by side from the left side to the right side at the lower part of the display unit 11 (step S11). Further, based on the information in the designated received image folder 152RS, the additional icon I is arranged and displayed on the image (the designated representative image DGS or the additional image FG) to which the additional icon I is added. Further, the user name “Toge” of the transmission source of the designated received image folder 152RS is displayed at the top of the display unit 11.

  As described above, according to the image communication display device 1 of the present embodiment, as shown in FIG. 5 to FIG. 7, steps U2 to U4 of FIG. 10, FIG. 11, FIG. An image theme of each of the plurality of images is detected, and an image sequence representative theme is extracted for each image sequence L obtained by dividing the series of images from the detected image theme. Since at least one image of the same image theme as the image row representative theme of the image row L is extracted as the representative image DG and transmitted to another device, the theme of a series of a plurality of images is transmitted to the other party by the representative image DG. Can do.

  Also, as shown in step T4 in FIG. 9, steps S26 to S27 in FIG. 13, FIG. 16, and the like, thumbnail images SG are created for images other than the representative image DG among a plurality of images, and the representative images are created. When a user performs a designation operation on any one of the thumbnail images SG transmitted and transmitted together with the DG, a transmission request signal for the original image is returned for the thumbnail image SG that has received the designation operation, and is requested by the transmission request signal. Since the original image of the thumbnail image SG is transmitted, unlike the case of simply transmitting a series of a plurality of images together, an image that does not match the interest of the other user is transmitted as it is. Can be prevented. Therefore, the burden on the receiving side can be reduced.

  Further, as shown in steps S30 to S33 in FIG. 13 and FIGS. 17 to 18 and the like, any additional icon I is arranged on the original image or the representative image DG of the thumbnail image SG based on the user operation. Since the image in which the additional icon I is arranged is transmitted to another apparatus as a transmission source, it is possible to receive an evaluation and impression about the image from the other party.

  Further, as shown in steps S23 to S24, S30 to S33 of FIG. 13 and FIGS. 17 to 18 and the like, a similar image of the representative image DG is detected from the network and displayed together with the representative image DG. When any additional icon I is arranged on the upper side, a similar image in which the additional icon I is arranged is transmitted to another device, so which representative image DG the other user is interested in is displayed. It is possible to grasp with certainty.

  It should be noted that the detailed configuration and detailed operation of each component of the image communication display device 1 in the above embodiment can be changed as appropriate without departing from the spirit of the present invention.

  For example, the image communication display device according to the present invention has been described as a photo frame or the like, but those to which the present invention can be applied are not limited to such products, but are mobile phones, personal computers, PDAs (Personal Digital Assistants), and games. It can be applied to all electronic devices such as machines. Further, the image display program 150 according to the present invention may be stored in a memory card, a CD, or the like that can be attached to and detached from the image communication display device 1.

  Further, although the theme-specific image table 242 has been described as storing the theme name and the typical image TG in association with each other, the theme name and a keyword related to the theme name may be stored in association with each other. In this case, in step U2 described above, the CPU 25 searches for an image on the Internet using each keyword, and uses the detected image as the typical image TG.

  The image display system 9 has been described as including the server 2 and the plurality of image communication display devices 1, but may include only the plurality of image communication display devices 1. In this case, the image display program 220, the image display control table 241 and the theme-specific image table 242 are provided in the image communication display device 1, and the processing in steps T2 to T4 and T8 in the server processing is the image communication on the transmission side. It is performed by the CPU 18 of the display device 1, and the process of step T6 is performed by the CPU 18 of the image communication display device 1 on the receiving side.

DESCRIPTION OF SYMBOLS 1 Image communication display apparatus 11 Display part 12 Input part 15 ROM
16 RAM
18 CPU
150 Image display program

Claims (4)

In an image communication display device capable of communicating between its own device and another device,
Display means;
Image storage means for storing an image folder storing a series of images;
Image theme detection means for detecting an image theme of each of the series of images;
Representative theme extracting means for extracting, as an image string representative theme, an image theme representing the contents of the image string for each image string obtained by dividing the series of images from the image theme detected by the image theme detecting means; ,
A transmission instruction means for receiving a transmission instruction operation from the user for the series of images;
Based on the transmission instruction operation, for each of the image sequences, at least one image of the same image theme as the image sequence representative theme of the image sequence is extracted as a representative image, and among the series of images, the image sequence Image transmitting means for creating thumbnail images for images other than the representative image, and transmitting the representative image and the thumbnail image to another device;
Image display control means for causing the display means to display the representative image and the thumbnail image transmitted from another device;
Thumbnail image designation means for receiving a designation operation from a user for any one of the thumbnail images controlled by the image display control means;
A transmission request signal transmitting means for transmitting a transmission request signal of the original image of the thumbnail image to another device as a transmission source of the thumbnail image that has received the designation operation;
When receiving the transmission request signal from another device, an image retransmission means for transmitting the original image of the thumbnail image requested by the transmission request signal to the other device;
An image communication display device comprising: The image communication display device according to claim 1,
Icon storage means for storing a plurality of types of icons to be arranged on the image;
Icon placement means for placing any icon stored in the icon storage means on the original image or the representative image of the thumbnail image based on a user operation;
And an icon-added image transmission unit that transmits the original image of the thumbnail image or the representative image on which the icon is arranged by the icon arrangement unit to another apparatus as a transmission source of the image based on a user operation. A featured image communication display device. The image communication display device according to claim 2,
The image display control means includes
A similar image of the representative image is detected on the network and displayed on the display unit together with the representative image;
The icon arrangement means includes
Based on a user operation, any icon stored in the icon storage means can be arranged on the similar image,
The icon-added image transmission means includes
An image communication display device characterized in that, based on a user operation, the similar image with icons arranged can be transmitted by the icon arranging means. A computer capable of communicating between its own device and another device and having a display means,
An image storage function for storing an image folder storing a series of images;
An image theme detection function for detecting an image theme of each of the series of images;
A representative theme extracting function for extracting, from the image theme detected by the image theme detecting function, an image theme representing the contents of the image sequence as an image sequence representative theme for each image sequence obtained by dividing the series of images. ,
A transmission instruction function for receiving a transmission instruction operation from the user for the series of images;
Based on the transmission instruction operation, for each of the image sequences, at least one image of the same image theme as the image sequence representative theme of the image sequence is extracted as a representative image, and among the series of images, the image sequence An image transmission function for creating thumbnail images for images other than the representative image and transmitting these representative images and thumbnail images to other devices;
An image display control function for causing the display means to display the representative image and the thumbnail image transmitted from another device;
A thumbnail image designation function that receives a designation operation from a user for any one of the thumbnail images that is display-controlled by the image display control function;
A transmission request signal transmission function for transmitting a transmission request signal of the original image of the thumbnail image to another device as a transmission source of the thumbnail image that has received the designation operation;
When receiving the transmission request signal from another device, an image retransmission function for transmitting the original image of the thumbnail image requested by the transmission request signal to the other device;
A program characterized by realizing.

Images