JP5298728B2 - Image transmission apparatus, image transmission program, and image communication system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image transmission apparatus, an image transmission program and an image communication system, capable of highly efficiently notifying the transmission of images to a predetermined transmission destination. <P>SOLUTION: The image transmission apparatus 15 includes: an image acquiring means for acquiring a picked-up image representing an object from an image pickup means 12 for picking up the object; a communication means for receiving a request of transmission for requesting transmission of the picked-up image acquired by the image acquiring means and transmitting the picked-up images in response to the transmission request; a storing means for storing information indicating the transmission destination to which the communication means has transmitted the picked-up image; and a control means for controlling a notice device 14 for notifying the transmission of picked-up image to notify two or more predetermined transmission destinations that the picked-up images have been transmitted when it is determined that the notice means has transmitted the picked-up images to the two or more predetermined transmission destinations on the basis of the information indicating the transmission destination stored in the storing means. This configuration can highly efficiently notify the two or more predetermined transmission destinations that the picked-up image indicating the object have been transmitted. <P>COPYRIGHT: (C)2010,JPO&amp;INPIT

Description

  The present invention relates to an image transmission device, an image transmission program, and an image communication system.

Conventionally, there has been known a video conference system in which the quality of audio and image data reproduced on the receiving side can be known on the transmitting side (see, for example, Patent Document 1).
This video conference system is a video conference system that transmits and receives audio / image data between terminal devices connected via a network, and has a quality indicating the reception status of audio / image data transmitted to the terminal device. A first means for generating information and transmitting the generated quality information to a transmission source apparatus; and a second means for displaying the quality information transmitted from a counterpart terminal apparatus. To do.
JP 2004-120460 A

  An object of the present invention is to provide an image transmission apparatus, an image transmission program, and an image communication system that can efficiently notify that a captured image representing an object has been transmitted to two or more predetermined transmission destinations.

An image transmission apparatus according to the present invention is an image transmission apparatus, and includes an image acquisition unit that acquires a captured image representing an object from an imaging apparatus that images the object to be discussed, and an image acquired by the image acquisition unit A transmission unit that receives a transmission request for transmission of an image from a transmission destination outside the image transmission apparatus, and that transmits a captured image to the transmission destination in response to the received transmission request, and a transmission in which the communication unit transmits the captured image holding means for holding a transmission history including information indicating the previously based on the information indicating the destination holding means is included in the transmission history to hold, communication means imaging to all 2 or more destination predetermined after the completion of the transmission of the image, indicating that notification device that notifies the transmission of the captured image to the commentators discuss the object represented by the captured image, and transmits the captured image for all 2 or more predetermined destination Is characterized by comprising a control means for controlling the notification unit to the notification, the.

  In the above configuration, the communication unit receives a connection request for connection in order to request transmission of a captured image, and transmits the captured image to a connection destination connected in response to the received connection request. The information indicating the connection destination connected according to the connection request received by the means is held, and two or more predetermined transmission destinations are all the connection destinations indicated by the information held by the holding means, and the control means Based on the information indicating the transmission destination held by the holding means and the information indicating the connection destination, it is determined whether or not the image has been transmitted to all the connection destinations, and for two or more predetermined transmission destinations. A configuration can be adopted in which the notification device is controlled to notify that the captured image has been transmitted.

  In the above configuration, the notification device is a display device that displays the captured image acquired by the image acquisition unit, and the control unit controls the display device to display the captured image transmitted by the communication unit to a predetermined transmission destination. Can be adopted.

  In the above configuration, the control unit may employ a configuration in which the captured image transmitted from the communication unit to a predetermined transmission destination is displayed in association with the order of transmission to the predetermined transmission destination.

In the above configuration, the notification device is a projection device that projects the captured image acquired by the image acquisition means,
The control means can employ a configuration for controlling the projection apparatus to project a captured image transmitted by the communication means to a predetermined transmission destination onto one or more of the object and the background of the object.

  In the above configuration, the control unit may employ a configuration for controlling the projection apparatus to project the captured image transmitted by the communication unit to a predetermined transmission destination in association with the order of transmission to the predetermined transmission destination.

  In the above configuration, the notification device is a sound output device that outputs a predetermined sound, and the control means notifies the communication means that the captured image has been transmitted to the predetermined transmission destination by outputting the sound. A configuration for controlling the audio output device can be employed.

  In the above configuration, the notification device is a lighting device that lights a predetermined light, and the control means is lit so as to notify the communication means that a captured image has been transmitted to a predetermined transmission destination by lighting the light. A configuration for controlling the apparatus can be employed.

  In the above configuration, the communication unit transmits the captured image acquired by the image acquisition unit according to a predetermined signal, and whether the captured image represents a signal based on the pixel value of the captured image acquired by the image acquisition unit. The determination means for determining whether or not and the control means transmit the captured image according to the signal determined by the determination means based on the information indicating the transmission destination held by the holding means and the information indicating the connection destination. When it is determined that there is no connection destination, it is possible to employ a configuration in which the notification device is controlled so as to notify that there is a connection destination that has not transmitted a captured image.

  In the above configuration, the determination unit determines whether the captured image represents a cue using the image based on the image represented by the captured image detected based on the change in the pixel value of the captured image acquired by the image acquisition unit. Can be adopted.

In the above configuration, the receiving means further receives a projection instruction for instructing to project an annotation image for annotating the object represented by the captured image transmitted by the communication means, and the control means projects the projection for projecting the annotation image onto the object. A configuration in which the apparatus is controlled in accordance with a projection instruction received by the receiving unit can be employed.
In the above configuration, based on a comparison result between the transmitted captured image that has been transmitted by the communication unit and the captured image immediately before the transmitted captured image is transmitted, it is determined whether or not the logical operation is stationary. The control unit further includes a stationary determination unit, and the control unit discards the transmission history held by the holding unit when the stationary determination unit determines that the operation of the logical person is stationary for a predetermined time. After the transmission of the previous captured image is completed by the communication unit, the holding unit re-holds the transmission history including the information indicating the transmission destination, and the notification device is based on the information indicating the transmission destination included in the held transmission history It is possible to adopt a configuration for controlling the above.

The image communication system according to the present invention transmits an imaging device that captures an object to be discussed, a transmission request that requests transmission of a captured image captured by the imaging device, and a captured image that the transmitted transmission request requests. And a transmission history including information indicating a destination to which a captured image captured by the imaging device is transmitted in response to a transmission request transmitted by the image receiving device, and included in the retained transmission history based on the information indicating the transmission destination, after completion of the transmission of predetermined two or more destinations of the captured image to all, notification device that notifies the transmission of the captured image to the commentators discuss the object represented by the captured image, It is characterized by comprising an image transmitting apparatus that controls the notification unit to the notification of transmitting the captured image for all 2 or more predetermined destination, a.

Image transmission program according to the present invention, a computer, an image acquisition means to acquire a captured image representing an object from the imaging device for imaging an object of interest discussion, the transmission of the captured image by the image acquisition unit has acquired which receives a transmission request from the destination external to the computer to determine, the communication means to transmit the captured image to the destination in response to the transmission request, transmission history communication means includes information indicating a destination that has transmitted the captured image after holding hands stage, two or more destination communication means to all predetermined based on the information indicating the destination holding means is included in the transmission history holding has completed the transmission of the captured image that holds the imaging as the notification device that notifies the transmission of the captured image to the commentators discuss object image is represented, to the notification of transmitting the captured image for all 2 or more predetermined destination You can adopt a configuration to function as a control means for controlling the knowledge system.

  According to the structure of Claim 1, compared with the case where it does not have the structure of this invention, it can notify efficiently that the captured image showing a target object was transmitted to two or more predetermined transmission destinations.

  According to the structure of Claim 2, it can notify efficiently that the picked-up image was transmitted with respect to all the connection destinations compared with the case where it does not have the structure of this invention.

  According to the configuration of the third aspect, it is possible not only to notify the transmission of the captured image efficiently but also to display the content of the transmitted captured image as compared with the case without the configuration of the present invention.

  According to the structure of Claim 4, the content of the transmitted captured image can be displayed in association with the transmission order.

  According to the structure of Claim 5, compared with the case where it does not have the structure of this invention, not only the transmission of a captured image can be notified efficiently but the content of the transmitted captured image can be projected.

  According to the configuration of the sixth aspect, the contents of the transmitted captured image can be projected in association with the transmission order.

  According to the structure of Claim 7, compared with the case where it does not have the structure of this invention, transmission of a captured image can be notified efficiently using an audio | voice.

  According to the structure of Claim 8, compared with the case where it does not have the structure of this invention, transmission of a captured image can be notified efficiently using light.

  According to the structure of Claim 9, compared with the case where it does not have the structure of this invention, the presence of the connection destination which has not transmitted the captured image showing a target object can be notified efficiently and reliably.

  According to the configuration of the tenth aspect, it is possible to accurately determine whether or not the captured image represents a cue using the image represented by the captured image, as compared to the case where the configuration of the present invention is not provided.

  According to the structure of Claim 11, the annotation image which annotates the target object which the transmitted captured image represents can be projected according to a projection instruction | indication.

According to the structure of Claim 13 , compared with the case where it does not have the structure of this invention, it can notify efficiently that the captured image showing a target object was transmitted to two or more predetermined transmission destinations.

According to the structure of Claim 14 , compared with the case where it does not have the structure of this invention, it can notify efficiently that the picked-up image showing a target object was transmitted to two or more predetermined transmission destinations.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, exemplary embodiments of the invention will be described with reference to the accompanying drawings.

FIG. 1 is a configuration diagram illustrating an embodiment of an image communication system including an image transmission apparatus according to the present invention.
An image communication system 1 shown in FIG. 1 includes an image transmission system 10, image reception systems 80 and 90, and a communication network 100. In the present embodiment, the image communication system 1 is described as being composed of two image receiving systems 80 and 90, but is not limited thereto. For example, the image communication system 1 can adopt an embodiment constituted by a single image reception system or three or more image reception systems.

  The image transmission system 10 communicates an annotation image (hereinafter also referred to as an annotation image) for annotating the object 19 to be discussed and a captured image obtained by imaging the object 19 on which the annotation image is projected. Since the image receiving system 80 and the image receiving system 90 have substantially the same configuration, only the image receiving system 80 will be described below, and description of the image receiving system 90 will be omitted.

The image transmission system 10 includes a projection device 11, an imaging device 12, a notification device 14, and an image transmission device 15 installed on the object 19 side with the communication network 100 interposed therebetween.
The projection device 11 includes, for example, a liquid crystal projector, a CRT (Cathode Ray Tube) projector, a DLP (Digital Light Processing) projector, an LCOS (Liquid Crystal On Silicon) projector, or a GLV (Grating Light Valve) projector. The projection device 11 is connected to the image transmission device 15. The projection device 11 is controlled by the image transmission device 15 to project the annotation image onto the object 19.

  In this embodiment, the object 19 is disposed on the upper surface of the work table 18. The upper surface of the work table 18 functions as a background of the object 19. The projection device 11 projects the annotation image on the object 19 and the background of the object 19. Furthermore, the imaging device 12 to be described later will be described on the assumption that the object 19 onto which the annotation image is projected and the background of the object 19 are imaged. However, the present invention is not limited to this, and a configuration in which the object 19 is not disposed on the upper surface of the work table 18 can be adopted.

  Here, the projection area in which the projection apparatus 11 can project an image substantially coincides with an imaging area in which the imaging apparatus 12 described later can capture an image. As a specific example, as shown in FIG. 1, the projection device 11 and the imaging device 12 are targets for which the optical principal axes of the projection device 11 and the imaging device 12 are substantially parallel and are targets for projection and imaging. The object 19 is installed such that the distance between the projection device 11 and the imaging device 12 is a distance that satisfies a predetermined condition. Here, the distance satisfying the predetermined condition is that the projection area of the projection apparatus 11 and the imaging area of the imaging apparatus 12 are the same when the angles of view of the projection apparatus 11 and the imaging apparatus 12 are substantially the same. Is such a distance that substantially matches.

Here, with reference to FIG. 2, another embodiment of the image transmission system 10 will be described. FIG. 2 is a configuration diagram illustrating another embodiment of the image transmission system 10.
The image transmission system 10a illustrated in FIG. 2 includes a projection device 11a, an imaging device 12a, a spectroscope 13, a notification device 14, and an image transmission device 15. Since the projection device 11a, the imaging device 12a, the notification device 14, and the image transmission device 15 have substantially the same configuration as the devices and devices that constitute the image transmission system 10 shown in FIG. 1, the differences will be mainly described below. To do.

  The projection device 11a is installed so that the projection area of the projection device 11a and the imaging area of the imaging device 12a substantially coincide. Specifically, the optical principal axis via the spectroscope 13 of the projection device 11 and the optical principal axis via the spectroscope 13 of the imaging device 12 are substantially coincident. Similarly, the angle of view of the projection device 11 and the angle of view of the imaging device 12 are set to substantially match. Furthermore, both devices are installed so that the distance between the distance between the projection device 11 and the object to be projected and the distance between the image pickup device 12 and the object to be imaged substantially coincide. The projection device 11 a is controlled by the image transmission device 15 to project the annotation image onto the object 19 via the spectroscope 13. The imaging device 12 a is controlled by the image transmission device 15 and images the object 19 on which the annotation image of the projection device 11 a is projected via the spectroscope 13.

  The spectroscope 13 is composed of, for example, a beam splitter such as a half mirror. The spectroscope 13 divides incident light into transmitted light and reflected light. The spectroscope 13 transmits part of the light representing the annotation image projected onto the object 19 by the projection device 11a. The spectroscope 13 reflects a part of the reflected light reflected by the object 19 to the imaging device 12a.

Here, returning to FIG. 1, the configuration of the image communication system 1 will be described.
The imaging device 12 is configured by, for example, a video camera, a digital camera, or a web camera. The imaging device 12 is connected to the image transmission device 15. The imaging device 12 images the object 19 on which the annotation image is projected under the control of the image transmission device 15. Further, the imaging device 12 outputs a captured image representing the object 19 to the image transmission device 15. Since the installation position and the imaging area of the imaging device 12 have already been described, a duplicate description is omitted.
The notification device 14 is configured by a display device such as a liquid crystal display, a plasma display, a CRT (Cathode Ray Tube), or an organic EL (Electro-Luminescence) display. The notification device 14 is connected to the image transmission device 15. The notification device 14 is controlled by the image transmission device 15 to give a notification that the image transmission device 15 has transmitted the captured image to a person who discusses the object 19 represented by the captured image. Specifically, the captured image transmitted by the image transmission device 15 is displayed to notify that the image transmission device 15 has transmitted the captured image.

Here, the notification performed by the notification device 14 will be described with reference to FIG. FIG. 3 is a diagram illustrating an example of notification performed by the notification device 14.
The notification device 14 illustrated in FIG. 3 displays a captured image P transmitted to two or more predetermined devices connected to the image transmission device 15 on a display screen M1 configured by a liquid crystal panel, for example. Notifying that the captured image P to be displayed on two or more devices has been transmitted. In the present embodiment and Embodiments 2 to 6 described later, two or more predetermined devices are described as all devices connected to the image transmission device 15, but the present invention is not limited to this.

Here, returning to FIG. 1, the configuration of the image communication system 1 will be described.
The image transmission device 15 is configured by, for example, a personal computer. The image transmission device 15 is connected to the projection device 11, the imaging device 12, the notification device 14, and the image reception system 80 connected via the communication network 100. The image transmission device 15 performs the following various functions by executing software processing. Specifically, the image transmission device 15 holds information indicating a transmission destination to which a captured image captured by the imaging device 12 is transmitted in response to a transmission request transmitted by the image reception system 80. Next, when the image transmission apparatus 15 determines that an image has been transmitted to two or more predetermined transmission destinations based on the information indicating the transmission destination held, the image transmission apparatus 15 has two or more predetermined transmission destinations. The notification device 14 is controlled to notify that the captured image has been transmitted.
Further, the image transmission device 15 receives and receives a projection instruction (hereinafter also referred to as a projection command) for instructing to project an annotation image for annotating the object 19 represented by the transmitted captured image from the image reception system 80. The projection apparatus 11 is controlled according to the projection instruction.

  The projection instruction includes information for instructing an annotation image to be projected and an instruction for instructing projection of the annotation image. The information indicating the annotation image includes information representing any one or more of vectors and coordinates necessary for generating the annotation image. Here, the annotation image includes an image representing the annotation using lines, characters, symbols, and figures. Therefore, when the annotation image is a circle, the information indicating the annotation image includes information representing the center of the circle and the length of the radius as a character string. The information that designates the annotation image includes information that determines the color of the annotation image. Furthermore, the information indicating the annotation image composed of at least one of a character string and a symbol includes information defining at least one typeface of the character string and the symbol.

  Here, with reference to FIG. 4, a hardware configuration of the image transmission device 15 used for executing the software processing will be described. FIG. 4 is a diagram illustrating an example of a hardware configuration of the image transmission device 15.

  The image transmission device 15 is, for example, a read-only memory that is a read-only memory such as an execution unit 15a such as a CPU (Central Processing Unit), an EPROM (Erasable Programmable Read-Only Memory) or an EEPROM (Electrically Erasable Programmable Read-Only Memory). Device 15b, a readable memory device 15c composed of a volatile memory such as DRAM (Dynamic RAM) or SRAM (Static RAM) and a nonvolatile memory such as NVRAM (Non Volatile RAM), and a hard disk or flash memory An external storage device 15d, and an input / output circuit 15e including input / output ports. Note that the execution unit 15a, the read-only storage device 15b, the readable / readable storage device 15c, the external storage device 15d, and the input / output circuit 15e are connected to each other via a bus so that information can be exchanged.

  The software processing is realized by the execution unit 15a reading a program stored in the read-only storage device 15b or the external storage device 15d and performing an operation according to the execution procedure of the software processing represented by the read program. Information indicating the result of the calculation performed by the execution unit 15a is written in the readable storage device 15c. Further, the input / output circuit 15e inputs / outputs information representing the calculation result of the execution unit 15a to / from various apparatuses and devices such as the projection apparatus 11 and the imaging apparatus 12 to be connected as necessary.

  Here, with reference to FIG. 5, a configuration example of the image transmission device 15 will be described by paying attention to the function. FIG. 5 is a functional block diagram illustrating a configuration example of the image transmission device 15.

The image transmission device 15 includes an image acquisition unit 151, a stillness determination unit 152, a holding unit 153, a communication unit 154, and a control unit 155.
The image acquisition unit 151 is realized by the execution unit 15a executing an image acquisition process. The image acquisition unit 151 is connected to the imaging device 12, the stillness determination unit 152, and the communication unit 154. The image acquisition unit 151 acquires a captured image from the imaging device 12 and outputs the acquired captured image to the stillness determination unit 152 and the communication unit 154.

Here, the configuration of the image acquisition unit 151 will be described with reference to FIG. FIG. 6 is a functional block diagram illustrating a configuration example of the image acquisition unit 151.
The image acquisition unit 151 includes an acquisition unit 151a and a storage unit 151b. The acquisition unit 151a is realized by the execution unit 15a executing the acquisition process that constitutes the image acquisition process. The acquisition unit 151a is connected to the imaging device 12 and the storage unit 151b. The acquisition unit 151a acquires captured images from the imaging device 12 at a predetermined cycle (for example, 30 frames per second). The acquisition unit 151a stores the acquired captured image in the storage unit 151b. In the present embodiment, the acquisition unit 151a is described as overwriting the captured image in the storage unit 151b. However, the present invention is not limited to this.
The storage unit 151b includes, for example, a readable storage device 15c that is a RAM or an external storage device 15d that is an HDD. The storage unit 151b is connected to the acquisition unit 151a, the stillness determination unit 152, and the communication unit 154. The storage unit 151b stores the captured image acquired by the image acquisition unit 151. The image stored in the storage unit 151b is referred to by the stillness determination unit 152 and the communication unit 154.

Here, returning to FIG. 5, the configuration of the image transmission device 15 will be described.
The stillness determination unit 152 is realized by the execution unit 15a executing a stillness determination process. The stillness determination unit 152 is connected to the image acquisition unit 151 and the holding unit 153. The stillness determination unit 152 determines whether the image represented by the captured image is stationary based on the pixel value of the captured image acquired from the image acquisition unit 151. This determination process is a process for determining whether the captured image represents a predetermined signal. Specifically, the stillness determination unit 152 determines whether the captured image represents a cue using the image based on the image represented by the captured image detected based on the change in the pixel value of the captured image acquired by the image acquisition unit 151. Determine whether or not.

  Here, the predetermined cue can employ, for example, a configuration in which a person who discusses the object 19 is an act of standing still for a predetermined time. As a specific example, the predetermined cue includes the act of the arbiter causing the finger or arm to stand still for a predetermined time. In addition, the predetermined signal includes an act in which the arbiter interrupts the gesture or the hand gesture for a predetermined time. In addition, the predetermined cue includes the act of the contributor keeping the eyelid closed for a predetermined time. Note that the predetermined time can be configured to be shorter than the period in which the image transmission device 15 distributes the captured image. A suitable value for the predetermined time can be easily determined by a person skilled in the art by experiment or theory.

  In this configuration in which the act of standing still for a predetermined time is a signal, the stillness determination unit 152 acquires a captured image representing the object 19 and a controversy who discusses the object 19 from the image acquisition unit 151. Next, the stillness determination unit 152 detects stillness over a predetermined period of time for a person who discusses the object 19 based on the change in the pixel value of the captured image acquired by the image acquisition unit 151. Specifically, the stillness determination unit 152 detects a region of the captured image that represents the person's finger based on the pixel value of the captured image acquired by the image acquisition unit 151. Next, the stillness determination unit 152 detects the stillness over a predetermined time of the logical person based on the change in the position of the detected region in the captured image. As a specific example, the stillness determination unit 152 detects a region representing a reasoner's finger based on the shape of a region composed of pixel values belonging to a range of pixel values representing the color of the reasoner's skin.

In addition, the predetermined signal can adopt a configuration that is an act of stopping the light applied to any one or more of the object 29 and the background of the object 29 for a predetermined time. Specifically, the stillness determination unit 152 detects light applied to one or more of the object 19 and the background of the object 19 based on the pixel value of the captured image acquired by the image acquisition unit 151. . As a specific example, the stillness determination unit 152 calculates the lightness from the pixel value, and detects the number of pixels of the captured image in which the calculated lightness exceeds a predetermined threshold value 1. Next, the stillness determination unit 152 detects an image of light emitted when the ratio of the detected number of pixels to the captured image exceeds a predetermined threshold value 2. Thereafter, when the position and size of the detected image in the captured image do not change beyond a predetermined range, the stillness determination unit 152 detects the stillness of the irradiation light over a predetermined time. It should be noted that suitable values for the predetermined threshold 1 and threshold 2 can be determined based on experiments or theory that can be easily performed by those skilled in the art.
Note that although the stillness determination unit 152 has been described as detecting a predetermined signal based on the brightness calculated from the pixel value of the captured image, the present invention is not limited to this. For example, the stillness determination unit 152 can employ a configuration that detects the irradiation of light having a predetermined color such as red based on the pixel value itself of the captured image.

Here, the configuration of the stillness determination unit 152 will be described with reference to FIG. FIG. 7 is a functional block diagram illustrating a configuration example of the stillness determination unit 152.
The stillness determination unit 152 illustrated in FIG. 7 includes a determination unit 152a and a storage unit 152b.
The determination unit 152a acquires a captured image from the image acquisition unit 151. Next, it is determined whether or not the image represented by the captured image has been stationary for a predetermined time based on the pixel value of the captured image stored last time and the pixel value of the captured image acquired this time. Thereafter, the stillness determination unit 152 outputs the determination result to the communication unit 154. In addition, the stillness determination unit 152 stores the captured image acquired this time in the storage unit 152b as a stored image. Furthermore, when it is determined that the image represented by the captured image is stationary over time, the stillness determination unit 152 discards the transmission history held by the holding unit 153. The transmission history is information that associates information indicating a transmission destination to which the image transmission device 15 has transmitted a captured image with a transmission time at which the image is transmitted. That is, discarding the transmission history refers to deleting information that associates information indicating a transmission destination with a transmission time. The transmission destination can employ, for example, an IP (Internet Protocol) address, a MAC (Media Access Control) address, a machine name, and a domain name associated with these.

  The storage unit 152b includes, for example, a readable storage device 15c that is a RAM or an external storage device 15d that is an HDD. The storage unit 152b is connected to the determination unit 152a. The storage unit 152b stores the captured image stored by the determination unit 152a. The image stored in the storage unit 152b is referred to by the stillness determination unit 152.

Here, returning to FIG. 5, the configuration of the image transmission device 15 will be described.
The holding unit 153 is realized by, for example, a readable function device 15c or an external storage device 15d. The holding unit 153 holds (that is, stores) the connection history and the transmission history. Since the transmission history has already been described, redundant description is omitted. The connection history refers to information indicating a connection destination connected to (or scheduled to connect in advance) to the image transmission device 15 and information that associates the connection transmission time. Note that the information indicating the connection destination is expressed in the same manner as the information indicating the transmission destination. Information held by the holding unit 153 is referred to by the communication unit 154 and the control unit 155.
The holding unit 153 stores the transmission destination and the transmission time of the transmission image in association with each other. However, the storage unit 153 is not limited to this, and a configuration in which only the transmission destination is stored can be employed. Similarly, the holding unit 153 stores the connection destination and the connection time in association with each other. However, the storage unit 153 is not limited to this, and can be configured to simply store the connection destination.

  The communication unit 154 (hereinafter also referred to as an image distribution unit) is realized by the execution unit 15a executing communication processing. The communication unit 154 is connected to the communication network 100, the image acquisition unit 151, the holding unit 153, and the control unit 155. The communication unit 154 transmits (distributes) the captured image acquired by the image acquisition unit 151 to the image reception systems 80 and 90 connected via the communication network 100. Note that the communication unit 154 distributes an image in response to a request from the image receiving systems 80 and 90. As a specific example, the communication unit 154 can adopt a configuration in which an image is streamed as a moving image.

Specifically, the communication unit 154 receives a connection request for connection from the communication network 100. Next, the communication unit 154 connects to the image receiving system 80 that has transmitted the connection request in accordance with the connection request. Thereafter, the communication unit 154 records information (hereinafter also simply referred to as connection record) in which the information indicating the connected connection destination and the connection time are associated with each other in the holding unit 153.
The communication unit 154 receives a transmission request for transmission of the captured image acquired by the image acquisition unit 151 from the image reception system 80 connected via the communication network 100. Next, the communication unit 154 returns the captured image acquired from the image acquisition unit 151 to the communication network 100 in response to the transmission request. In particular, when the stationary determination unit 152 determines that the captured image represents a predetermined signal, the communication unit 154 transmits the captured image acquired from the image acquisition unit 151 to the communication network 100 according to the determined signal. . Thereafter, the communication unit 154 records information (hereinafter also simply referred to as transmission record) in which the information indicating the transmission destination that has transmitted the captured image according to the transmission request and the transmission time are associated with each other in the holding unit 153.
Further, the communication unit 154 receives a projection instruction for instructing to project an annotation image for annotating the object 19 represented by the transmitted transmission image from the image receiving system 80 or the like connected via the communication network 100 and receives the projection instruction. The projected instruction is output to the control unit 155. Thereafter, the communication unit 154 transmits a captured image obtained by capturing the object 19 on which the annotation image is projected according to the projection instruction to the image receiving system 80 connected via the communication network 100.

Here, returning to FIG. 5, the configuration of the image transmission device 15 will be described.
The control unit 155 includes a notification control unit 156 and an annotation control unit 157. The notification control unit 156 is connected to the notification device 14, the holding unit 153, and the communication unit 154. When the notification control unit 156 determines that the communication unit 154 has transmitted the captured image to two or more predetermined transmission destinations based on the information representing the transmission destination held by the holding unit 153, the notification control unit 156 determines the predetermined 2 The notification device 14 is controlled to notify that the captured image has been transmitted to the above transmission destination. In the present embodiment, the predetermined connection destinations are described as all connection destinations represented by the information held by the holding unit 153. Therefore, the notification control unit 156 determines whether the captured image has been transmitted to all the connection destinations based on the information indicating the transmission destination held by the holding unit 153 and the information indicating the connection destination. Specifically, the notification control unit 156 includes a connection destination that does not hold the information indicating the transmission destination of the same content among the connection destinations represented by the information held by the holding unit 153. Determines that the captured image has not been transmitted to all connection destinations, and otherwise determines that the captured image has been transmitted to all connection destinations. When the communication unit 154 determines that the captured image has been transmitted to two or more predetermined transmission destinations, the notification control unit 156 displays the captured image transmitted to the predetermined transmission destination by the communication unit 154. The notification device 14 is controlled. Next, the notification control unit 156 stores a notification record indicating that notification has been performed by controlling the notification device 14.

  The annotation control unit 157 is realized by the execution unit 15a executing the annotation control process. The annotation control unit 157 is connected to the projection device 11 and the communication unit 154. The control unit 155 controls the projection device 11 that projects the annotation image onto the object 19 in accordance with the projection instruction received by the communication unit 154. Specifically, the control unit 155 generates an annotation image according to the projection instruction. As a specific example, an annotation image representing a character string having a size indicated by the projection instruction or a figure having a shape indicated by the projection instruction is generated. Next, the control unit 155 superimposes the generated annotation image on the position indicated by the projection instruction of the background image that is the background of the annotation image. Thereafter, the control unit 155 controls the projection device 11 to project the annotation image onto the object 19 in accordance with the projection instruction by outputting the superimposed image to the projection device 11.

  The image transmission device 15 executes image transmission processing. The image transmission process includes an image transmission preparation process described later and a control transmission process described later. The image transmission preparation process is a process for preparing to transmit a captured image, and the control transmission process is a process for transmitting the captured image and controlling the notification device 14 to notify the image transmission.

Here, the image transmission preparation process executed by the image transmission device 15 will be described with reference to FIG. FIG. 8 is a flowchart illustrating an example of image transmission preparation processing executed by the image transmission device 15.
First, the image transmission device 15 acquires a captured image by the image acquisition unit 151 (step S01). Next, the image transmission device 15 stores the captured image acquired in the storage unit 151b of the image acquisition unit 151 (step S02). Thereafter, the image transmission device 15 performs a detection process for detecting the motion of the image represented by the captured image based on the saved image previously saved in the storage unit 152b of the stillness determination unit 152 and the acquired image acquired this time. Next, the image transmission device 15 determines whether or not an image motion is detected by executing the detection process (step S03). If it is determined that motion has been detected, the image transmission device 15 executes the process of step S04, and if not, executes the process of step S07.

  In step S03, when the image transmission device 15 determines that the movement of the image represented by the captured image is detected (that is, not stationary), the transmission of the transmission image corresponding to the signal represented by the captured image is completed. Judge. Therefore, the transmission history indicating the transmission destination that has transmitted the captured image in the past held by the holding unit 153 is discarded (step S04). Next, the image transmission device 15 ends the notification performed by the notification device 14 (step S05). Specifically, the image transmission device 15 controls the notification device 14 to end the display of the captured image. Thereafter, the image transmission device 15 deletes the notification record of the notification control unit 156 (step S06).

  In step S03, the image transmission device 15 determines that the motion of the image represented by the captured image has not been detected (that is, is still), or after executing the processing of step S06, the stillness determination unit 152. The acquired image is stored as a stored image in the storage unit 152b (step S07). Thereafter, the image transmission device 15 returns to step S01 and repeats the above processing.

  In FIG. 8, the processing in steps S01 and S02 corresponds to image acquisition processing for realizing the image acquisition unit 151, and the processing in steps S03 and S04 corresponds to stillness determination processing for realizing the stillness determination unit 152. The processing in steps S05 and S06 corresponds to notification control processing for realizing the notification control unit 156, and the processing in step S07 corresponds to stillness determination processing for realizing the stillness determination unit 152.

Here, the control transmission process executed by the image transmission device 15 will be described with reference to FIG. FIG. 9 is a flowchart illustrating an example of a control transmission process executed by the image transmission device 15.
First, the image transmission device 15 receives a transmission request (also illustrated as an image request) for requesting transmission of an image from the image reception system 80 by the communication unit 154 (step S11). Next, the image transmission device 15 acquires a captured image from the image acquisition unit 151 that stores an image whose request is requested to be transmitted by the communication unit 154 (step S12). Thereafter, the image transmission device 15 determines whether or not the determination result of the stillness determination unit 152 is a determination result that the image represented by the acquired captured image is still in the communication unit 154 (step S13). The image transmission device 15 executes the process of step S14 when determining that the determination result is that the image is still, and executes the process of step S19 otherwise.

  If it is determined in step S13 that the determination result is that the image is stationary, the communication unit 154 constituting the image transmission device 15 is information indicating the transmission destination of the image reception system 80 that requests transmission of the image. (Hereinafter, simply referred to as destination information) is recorded in the holding unit 153 (step S14). Specifically, the image transmission device 15 stores information for identifying the image transmission device 15 in the holding unit 153 as transmission destination information. Thereafter, the notification control unit 156 constituting the image transmission device 15 determines whether or not the captured image has been transmitted to all the image receiving systems 80 and 90 to be connected based on the information held by the holding unit 153 (step). S15). The image transmission device 15 executes the process of step S16 when determining that the captured image has been transmitted to all the image reception systems 80 and 90, and executes the process of step S19 otherwise.

  If it is determined in step S15 that the captured images have been transmitted to all the image receiving systems 80 and 90, the notification control unit 156 constituting the image transmitting device 15 transmits the captured images to all the image receiving systems 80 and 90. It is determined whether or not the notification device 14 has already been controlled to notify that it has been transmitted (step S16). Specifically, when there is a notification record in the notification control unit 156, the image transmission device 15 determines that the notification has already been completed by displaying the captured image. The image transmission device 15 executes the process of step S19 when determining that the notification has been made, and executes the process of step S17 otherwise.

  If it is determined in step S16 that notification has not been made, the notification control unit 156 constituting the image transmission device 15 controls the notification device 14 to display and notify the captured image (step S17). Next, the image transmission device 15 records a notification record in the notification control unit 156 (step S18).

  If it is determined in step S13 that the determination result of the stillness determination unit 152 is a determination result “not stationary”, it is determined in step S15 that the captured image has not been transmitted to all the image reception systems 80 and 90. In this case, when it is determined in step S16 that the notification has been made, and after executing the processing in step S18, the image transmission device 15 returns the acquired captured image to the image reception system 80 or 90 that transmitted the transmission request. (Step S19). Thereafter, the image transmission device 15 ends the execution of the control transmission process.

  In FIG. 9, the processing from steps S <b> 11 to S <b> 14 and S <b> 19 corresponds to communication processing for realizing the communication unit 154, and the processing from steps S <b> 15 to S <b> 18 corresponds to notification control processing for realizing the notification control unit 156. To do.

Here, returning to FIG. 1, the configuration of the image communication system 1 will be described.
The image receiving system 80 includes a display device 81, an input device 82, and an image receiving device 85. The image receiving system 80 is connected to the communication network 100. The image reception system 80 receives a captured image transmitted by the image transmission system 10 via the communication network 100.
The display device 81 includes, for example, a liquid crystal display, a plasma display, a CRT (Cathode Ray Tube), or an organic EL (Electro-Luminescence) display. The display device 81 is connected to the image receiving device 85. The display device 81 is controlled by the image receiving device 85 to display the following various images including the captured image.
The input device 82 is composed of, for example, a pointing device, a keyboard, or a touch panel, and is connected to the image receiving device 85. The input device 82 is operated by a person who discusses the object 19 represented in the transmission image displayed by the display device 81 or a user of the image receiving device 85, and outputs the above-described various commands, requests, and instructions to the image receiving device. Input to 85.

  The image receiving device 85 is constituted by a personal computer, for example. The image receiving device 85 is connected to the display device 81, the input device 82, and the communication network 100. The image reception device 85 sends a connection request and a transmission request when a predetermined period or the input device 82 inputs a request to the image transmission device 15 constituting the image transmission system 10 connected via the communication network 100. Send. In addition, the image reception device 85 receives the captured image and the transmission image transmitted by the image transmission device 15 in response to the request, and controls the display device 81 to display the received captured image and the transmission image.

  Further, the image receiving device 85 generates an annotation image based on the annotation instruction input by the input device 82 and controls the display device 81 to display the generated annotation image. When the image receiving device 85 acquires from the input device 82 a command to send an annotation image controlled to be displayed, the image receiving device 85 transmits an annotation instruction to the image transmitting device 15. Thereafter, the image receiving device 85 receives the captured image or the transmission image obtained by capturing the object 19 on which the annotation image is projected according to the transmitted annotation instruction from the image transmitting device 15, and displays the received image on the display device 81. To control.

  The communication network 100 includes, for example, a LAN (Local Area Network), a WAN (Wide Area Network), a MAN (Metropolitan Area Network), or a public line network, and can communicate with the image transmission device 15 and the image reception device 85. Connecting.

  In this embodiment, the image acquisition unit 151 corresponds to an image acquisition unit, the determination unit 152a corresponds to a determination unit, the holding unit 153 corresponds to a holding unit, the communication unit 154 corresponds to a communication unit, and the control unit 155. Corresponds to the control means.

Hereinafter, a second embodiment of the present invention will be described.
In the second embodiment, an embodiment of an image communication system including a notification device that is a projection device will be described.

  Since the image communication system according to the present embodiment has substantially the same configuration as the image communication system 1 described in the first embodiment, differences will be mainly described below. The image communication system according to the present embodiment includes an image transmission system, a communication network, and an image reception system as in the first embodiment.

First, an embodiment of an image transmission system according to the present invention will be described with reference to FIG. FIG. 10 is a diagram illustrating an embodiment of an image transmission system according to the second embodiment.
An image transmission system 20 illustrated in FIG. 10 includes a projection device 21, an imaging device 22, and an image transmission device 25. Similar to the first embodiment, the projection device 21 and the imaging device 22 project and capture an image with respect to the object 29 arranged on the work table 23.
The projection device 21 projects the captured image acquired by the image transmission device 25 from the imaging device 22 onto one or more of the object 29 and the background of the object 29.

Here, an image projected by the projection device 21 will be described with reference to FIG. FIG. 11 is a diagram illustrating an example of an image projected by the projection device 21 in the second embodiment.
The projection device 21 projects the image P described in the first embodiment with reference to FIG. The image P is a captured image P transmitted to all devices connected to the image transmission device 15. Therefore, since the projection device 21 is a device corresponding to the notification device 14 of the first embodiment, it is also referred to as a notification device 24 hereinafter.

Here, returning to FIG. 10, the configuration of the image transmission system 20 will be described.
As in the first embodiment, the image transmission device 25 includes an execution unit 25a (not shown) and an input / output circuit 25d. Similar to the first embodiment, the image transmission device 25 implements various functions by executing software processing by the execution unit 25a.

Here, with reference to FIG. 12, the structure of the image transmission apparatus 25 is demonstrated paying attention to a function. FIG. 12 is a functional block diagram illustrating a configuration example of the image transmission device 25 according to the second embodiment.
As in the first embodiment, the image transmission device 25 includes an image acquisition unit 251, a stillness determination unit 252, a holding unit 253, a communication unit 254, and a control unit 255. In addition, as in the first embodiment, the stillness determination unit 252 includes a determination unit 252a and a storage unit 252b (not shown). Further, the control unit 255 includes a notification control unit 256 and an annotation control unit 257 as in the first embodiment. The notification control unit 256 is different from the first embodiment in that it is connected to the projection device 21 that also serves as a notification device.
Note that the notification control process for realizing the notification control unit 256 in the second embodiment and the image transmission process executed by the image transmission device 25 are substantially the same as the notification control process and the image transmission process in the first embodiment. Is omitted.

  In the present embodiment, the projection device 21 also corresponds to a notification device, the image acquisition unit 251 corresponds to an image acquisition unit, the determination unit 252a corresponds to a determination unit, the holding unit 253 corresponds to a holding unit, and the communication unit. 254 corresponds to a communication unit, and the control unit 255 corresponds to a control unit.

Hereinafter, a third embodiment of the present invention will be described.
In the third example, an embodiment of an image communication system including a notification device that is a sound output device that outputs a predetermined sound will be described.

  Since the image communication system according to the present embodiment has substantially the same configuration as the image communication system 1 described in the first embodiment, differences will be mainly described below. The image communication system according to the present embodiment includes an image transmission system, a communication network, and an image reception system as in the first embodiment.

First, an embodiment of an image transmission system according to the present invention will be described with reference to FIG. FIG. 13 is a diagram illustrating an embodiment of an image transmission system according to the third embodiment.
An image transmission system 30 illustrated in FIG. 13 includes a projection device 31, an imaging device 32, a notification device 34, and an image transmission device 35. Similar to the first embodiment, the projection device 31 and the imaging device 32 project and capture an image with respect to the object 39 disposed on the work table 33.

  The notification device 34 is a sound output device that outputs a predetermined sound. The audio output device is constituted by a speaker, for example. The notification device 34 is controlled by the image transmission device 35 to output and notify a sound including a predetermined sound indicating that the image transmission device 35 has transmitted the captured image to two or more predetermined transmission destinations. I do. The sound that the notification device 34 outputs for notification is referred to as notification sound.

Here, returning to FIG. 13, the configuration of the image transmission system 30 will be described.
As in the first embodiment, the image transmission device 35 includes an input / output circuit 35d from an execution unit 35a (not shown). Similar to the first embodiment, the image transmission device 35 implements various functions by executing software processing by the execution unit 35a.

Here, with reference to FIG. 14, the structure of the image transmission apparatus 35 is demonstrated paying attention to a function. FIG. 14 is a functional block diagram illustrating a configuration example of the image transmission device 35 according to the third embodiment.
As in the first embodiment, the image transmission device 35 includes an image acquisition unit 351, a stillness determination unit 352, a holding unit 353, a communication unit 354, and a control unit 355. In addition, as in the first embodiment, the stillness determination unit 352 includes a determination unit 352a and a storage unit 352b (not shown). Furthermore, the control unit 355 includes a notification control unit 356 and an annotation control unit 357 as in the first embodiment. The notification control unit 356 is different from the first embodiment in that it is connected to the notification device 34 that is an audio output device. The notification control unit 356 controls the notification device 34 that is a sound output device so as to notify the communication unit 354 that a captured image has been transmitted to two or more predetermined transmission destinations by outputting a sound.
Note that the notification control process for realizing the notification control unit 356 in the third embodiment is substantially the same as the notification control process in the first embodiment, and thus the description thereof is omitted.

Here, with reference to FIG. 15, an image transmission preparation process executed by the image transmission device 35 will be described. FIG. 15 is a flowchart illustrating an example of image transmission preparation processing executed by the image transmission device 35 in the third embodiment.
The image transmission device 35 executes the processes of steps S21 to S24, S26, and S27. Steps S21 to S24, S26, and S27 are substantially the same as steps S01 to S04, S06, and S07 described in the first embodiment with reference to FIG. In Example 3, since notification is performed using sound, the image transmission device 35 does not execute the processing corresponding to step S05.

  In FIG. 15, the processing in steps S21 and S22 corresponds to image acquisition processing for realizing the image acquisition unit 351, and the processing in steps S23 and S24 corresponds to stillness determination processing for realizing the stillness determination unit 352. The process in step S26 corresponds to a notification control process for realizing the notification control unit 356, and the process in step S27 corresponds to a stillness determination process for realizing the stillness determination unit 352.

Next, a control transmission process executed by the image transmission device 35 will be described with reference to FIG. FIG. 16 is a flowchart illustrating an example of a control transmission process executed by the image transmission device 35 in the third embodiment.
The image transmission device 35 executes the processes of steps S31 to S36 (steps S31 to S36). The processing of steps S31 to S36 is substantially the same as steps S11 to S16 described with reference to FIG.

  If it is determined in step S36 that no notification record exists, the image transmission device 35 determines that no notification sound has been sent. Therefore, the image transmission device 35 controls the notification device 35 to output a notification sound (step S37). Thereafter, the image transmission device 35 performs the processes of steps S38 and S39 (steps S38 and S39). The processing of steps S38 and S39 is substantially the same as steps S18 and S19 described with reference to FIG.

  In FIG. 16, the processing from steps S31 to S34 and S39 corresponds to communication processing for realizing the communication unit 354, and the processing from steps S35 to S38 corresponds to notification control processing for realizing the notification control unit 356. To do.

  In this embodiment, the image acquisition unit 351 corresponds to an image acquisition unit, the determination unit 352a corresponds to a determination unit, the holding unit 353 corresponds to a holding unit, the communication unit 354 corresponds to a communication unit, and the control unit 355. Corresponds to the control means.

The fourth embodiment of the present invention will be described below.
In the fourth example, an embodiment of an image communication system including a notification device that is a lighting device that lights predetermined light will be described.

  Since the image communication system according to the present embodiment has substantially the same configuration as the image communication system 1 described in the first embodiment, differences will be mainly described below. The image communication system according to the present embodiment includes an image transmission system, a communication network, and an image reception system as in the first embodiment.

First, an embodiment of an image transmission system according to the present invention will be described with reference to FIG. FIG. 17 is a diagram illustrating an embodiment of the image transmission system according to the fourth embodiment.
An image transmission system 40 illustrated in FIG. 17 includes a projection device 41, an imaging device 42, a notification device 44, and an image transmission device 45. Similar to the first embodiment, the projection device 41 and the imaging device 42 project and capture an image with respect to the object 49 arranged on the work table 43.

  The notification device 44 is a lighting device that lights a predetermined light. The lighting device is constituted by a lamp, for example. In particular, the notification device 44 can employ a configuration that is a rotating lamp. The notification device 44 is controlled by the image transmission device 45 to turn on, turn off, or blink a predetermined light indicating that the image transmission device 45 has transmitted the captured image to two or more predetermined transmission destinations. To notify. In addition, the light which the notification apparatus 44 lights for notification is called notification light. Further, the notification device 44 can employ a configuration in which light of a predetermined color representing the above is turned on.

Here, returning to FIG. 17, the configuration of the image transmission system 40 will be described.
Similar to the first embodiment, the image transmission device 45 includes an execution unit 45a (not shown) and an input / output circuit 45d. Similar to the first embodiment, the image transmission device 45 implements various functions by executing software processing in the execution unit 45a.

Here, with reference to FIG. 18, the configuration of the image transmission device 45 will be described focusing on the function. FIG. 18 is a functional block diagram illustrating a configuration example of the image transmission device 45 according to the fourth embodiment.
As in the first embodiment, the image transmission device 45 includes an image acquisition unit 451, a stillness determination unit 452, a holding unit 453, a communication unit 454, and a control unit 455. The stillness determination unit 452 includes a determination unit 452a (not shown) and a storage unit 452b as in the first embodiment. Further, the control unit 455 includes a notification control unit 456 and an annotation control unit 457 as in the first embodiment. The notification control unit 456 is different from the first embodiment in that it is connected to a notification device 46 that is a lighting device. The notification control unit 456 controls the notification device 44 that is a lighting device so as to notify the notification light that the communication unit 454 has transmitted the captured image to two or more predetermined transmission destinations.
Note that the notification control process for realizing the notification control unit 456 according to the fourth embodiment is substantially the same as the notification control process according to the first embodiment, and a description thereof will be omitted.

Here, with reference to FIG. 19, the image transmission preparation process which the image transmission apparatus 45 performs is demonstrated. FIG. 19 is a flowchart illustrating an example of image transmission preparation processing executed by the image transmission device 45 in the fourth embodiment.
The image transmission device 45 executes the processing of steps S41 to S44 (steps S41 to S44). Next, the image transmission device 45 controls the notification device 44 to end the lighting and end the notification (step S45). Thereafter, the image transmission device 45 executes the processes of steps S46 and S47 (steps S46 and S47). Thereafter, the image transmission device 45 returns to step S41 and repeats the above processing. Note that the processing of steps S41 to S44, S46, and S47 is substantially the same as steps S01 to S04, S06, and S07 described with reference to FIG.

  In FIG. 19, the processes in steps S41 and S42 correspond to an image acquisition process for realizing the image acquisition unit 451, and the processes in steps S43 and S44 are equivalent to a stillness determination process for realizing the stillness determination unit 452. The processing in steps S45 and S46 corresponds to notification control processing for realizing the notification control unit 456, and the processing in step S47 corresponds to stillness determination processing for realizing the stillness determination unit 452.

Here, the control transmission process executed by the image transmission device 45 will be described with reference to FIG. FIG. 20 is a flowchart illustrating an example of a control transmission process executed by the image transmission device 45 in the fourth embodiment.
The image transmission device 45 executes the processing of steps S51 to S56 (steps S51 to S56). The processing of steps S51 to S56 is substantially the same as steps S11 to S16 described with reference to FIG.

  If it is determined in step S56 that no notification record exists, the image transmission device 45 determines that notification is not performed using the notification light. Therefore, the image transmission device 45 controls the notification device 35 to notify by turning on the notification light or the like (step S57). Thereafter, the image transmission device 45 executes the processes of steps S58 and S59 (steps S58 and S59). The processing in steps S58 and S59 is substantially the same as steps SS18 and S19 described in the first embodiment with reference to FIG.

  In FIG. 20, the processing from steps S51 to S54 and S59 corresponds to communication processing for realizing the communication unit 354, and the processing from steps S55 to S58 corresponds to notification control processing for realizing the notification control unit 456. To do.

  In this embodiment, the image acquisition unit 451 corresponds to an image acquisition unit, the determination unit 452a corresponds to a determination unit, the holding unit 453 corresponds to a holding unit, the communication unit 454 corresponds to a communication unit, and the control unit 455. Corresponds to the control means.

The fifth embodiment of the present invention will be described below.
In the fifth example, an embodiment of an image communication system configured by an image transmission device that warns that there is a transmission destination that has not transmitted a captured image will be described. Specifically, the image communication system according to the fifth embodiment is stationary when it is determined that the image represented by the captured image is released before the captured image is transmitted to all the image receiving devices to be connected. Notify (warn) that there is a transmission destination that has not transmitted a captured image representing an image.

  Since the image communication system according to the present embodiment has substantially the same configuration as the image communication system 1 described in the first embodiment, differences will be mainly described below. The image communication system according to the present embodiment includes an image transmission system, a communication network, and an image reception system as in the first embodiment.

  The image transmission system 50 according to the fifth embodiment includes a projection device 51, an imaging device 52, a notification device 54, and an image transmission device 55 (not shown). Similarly to the first embodiment, the projection device 51 and the imaging device 52 project and capture an image on the object 59 arranged on the work table 53.

  The notification device 54 is configured by a display device as in the first embodiment. The notification device 54 has a connection destination that is controlled by the image transmission device 55 and does not transmit a captured image when there is a connection destination that the image transmission device 55 does not transmit the captured image in accordance with a predetermined signal. Notification to that effect.

Here, the notification performed by the notification device 54 will be described with reference to FIG. FIG. 21 is a diagram illustrating an example of notification performed by the notification device 54.
The notification device 54a shown in FIG. 21A is configured to display a predetermined image including a predetermined character indicating that there is a connection destination that has not transmitted a captured image, a predetermined graphic, and an icon, for example. Display one or more of them.

  In the present embodiment, the notification device 54 has been described as being a display device as in the first embodiment. However, the present invention is not limited to this, and for example, the notification device 54 can employ a configuration that is a projection device as in the second embodiment. In this configuration, for example, the notification device 54b that is the projection device shown in FIG. 21B is any one of the same characters, figures, and images as the notification device 54b that is the display device shown in FIG. One or more are projected onto one or more of the object 59 and the background of the object 59.

  Further, for example, the notification device 54 can employ a configuration that is a sound output device as in the third embodiment. In this configuration, for example, the notification device 54c, which is a sound output device shown in FIG. 21C, outputs a predetermined sound indicating that there is a connection destination that has not transmitted the captured image.

  Further, for example, the notification device 54 can employ a configuration that is a lighting device as in the fourth embodiment. In this configuration, for example, the notification device 54d that is the lighting device illustrated in FIG. 21D turns on, blinks, or turns off a predetermined light indicating that there is a connection destination that has not transmitted the captured image.

Here, the configuration of the image transmission system 50 will be described.
As in the first embodiment, the image transmission device 55 includes an input / output circuit 55d from an execution unit 55a (not shown). As in the first embodiment, the image transmission device 55 implements various functions by executing software processing in the execution unit 55a.

Next, the configuration of the image transmission device 55 will be described focusing on the function.
As in the first embodiment, the image transmission device 55 includes an image acquisition unit 551, a stillness determination unit 552, a holding unit 553, a communication unit 554, and a control unit 555. The stillness determination unit 552 includes a determination unit 552a (not shown) and a storage unit 552b as in the first embodiment. Further, the control unit 555 includes a notification control unit 556 and an annotation control unit 557 as in the first embodiment.

  If the notification control unit 556 determines that the stationary state of the image represented by the captured image has been released before transmitting the captured image to all the image receiving devices to be connected, the notification control unit 556 transmits the captured image representing the stationary image. The notification device 54 is controlled so as to warn that there is an unsent destination. Specifically, the determination made by the notification control unit 556 is based on the information indicating the transmission destination held by the holding unit 553 and the information indicating the connection destination based on the cue determined by the determination unit 552a. It is determined that there is a connection destination that has not been transmitted. More specifically, the notification control unit 556 transmits the captured image when there is no transmission history held by the holding unit 553 or when the transmission history is only information corresponding to part of the connection history. Judge that there is no connection destination.

Here, with reference to FIG. 22, the image transmission preparation processing executed by the image transmission device 55 will be described. FIG. 22 is a flowchart illustrating an example of image transmission preparation processing executed by the image transmission device 55 in the fifth embodiment.
The image transmission device 55 executes the processing from step S61 to S63 (step S61 to S63). Note that the processing of steps S61 to S63 is substantially the same as steps S01 to S03 described in the first embodiment with reference to FIG.

  If it is determined in step S63 that the motion of the image has been detected (that is, it is not stationary), the image transmission device 55 determines that the transmission of the captured image based on the cue has ended. Next, the image transmission device 55 determines whether there is a transmission destination that has not transmitted the captured image that has been transmitted (step S64). Specifically, the image transmission device 55 determines that there is a transmission destination that has not transmitted the captured image when the holding unit 553 holds only transmission records of some image reception devices. The image transmitting device 55 executes the process of step S65 when determining that there is a transmission destination that has not transmitted the captured image, and executes the processes of steps S66 to S68 otherwise.

  In step S64, if the image transmission device 55 determines that there is a transmission destination that has not transmitted the captured image, the image transmission device 55 also notifies (or warns) that the image has not been delivered (hereinafter also referred to as a warning device). ) To control. Thereafter, the processing from step S66 to S68 is executed. Note that the processing in steps S66 to S68 is substantially the same as steps S04, S06, and S07 described in the first embodiment with reference to FIG.

  In FIG. 22, the processes in steps S61 and S62 correspond to an image acquisition process for realizing the image acquisition unit 551, and the processes in steps S63 and S64 are equivalent to a stillness determination process for realizing the stillness determination unit 552. The processing from step S65 to S67 corresponds to notification control processing for realizing the notification control unit 556, and the processing of step S68 corresponds to stillness determination processing for realizing the stillness determination unit 552.

  In this embodiment, the image acquisition unit 551 corresponds to an image acquisition unit, the determination unit 552a corresponds to a determination unit, the holding unit 553 corresponds to a holding unit, the communication unit 554 corresponds to a communication unit, and the control unit 555. Corresponds to the control means.

The sixth embodiment of the present invention will be described below.
In the sixth example, an embodiment of an image communication system including a notification device that is a display device that displays the contents of a transmitted captured image and the order in which the captured images are transmitted will be described.

  Since the image communication system according to the present embodiment has substantially the same configuration as the image communication system 1 described in the first embodiment, differences will be mainly described below. The image communication system according to the present embodiment includes an image transmission system, a communication network, and an image reception system as in the first embodiment.

  The image transmission system 60 according to the sixth embodiment includes a projection device 61, an imaging device 62, a notification device 64, and an image transmission device 65 (not shown). Similar to the first embodiment, the projection device 61 and the imaging device 62 project and capture an image on the object 69 arranged on the work table 63.

  The notification device 64 includes a display device as in the first embodiment. The notification device 64 is controlled by the image transmission device 65 and displays the captured image transmitted by the image transmission device 65 to a predetermined transmission destination in association with the order of transmission to the predetermined transmission destination.

Here, the notification performed by the notification device 64 will be described with reference to FIG. FIG. 23 is a diagram illustrating an example of notification performed by the notification device 64 in the sixth embodiment.
As in the first embodiment, the notification device 64 illustrated in FIG. 23 displays captured images transmitted to all devices connected to the image transmission device 65 on the display screen M6, thereby displaying on two or more predetermined devices. Notify that the captured image has been transmitted.
However, the notification device 64 is different from the first embodiment in that the captured image is displayed in association with the transmission order. As a specific example, the notification device 64 displays the previous captured image Q1 transmitted to the right of the area for displaying the latest captured image Q0 transmitted to all the image reception devices. Further, the notification device 64 displays the captured image Q2 transmitted two times before the right of the area where the captured image Q1 transmitted one before is displayed. Similarly, the notification device 64 displays the captured images Q arranged in the order of transmission.
In addition, after displaying the captured image up to the right end of the display screen M6, the notification device 64 continues to display the images in order from the left end below the area where the captured image is displayed. Note that the order in which the captured images are displayed side by side is not limited to the order shown in FIG.

  In the present embodiment, the notification device 64 has been described as being configured by a display device as in the first embodiment. However, the present invention is not limited to this, and the notification device 64 can employ an embodiment constituted by a projection device as in the second embodiment. The notification device configured by the projection device is controlled by the image transmission device 65 and associates the captured image transmitted from the image transmission device 65 to the predetermined transmission destination with the order of transmission to the predetermined transmission destination. Project.

Here, with reference to FIG. 24, the notification performed by the notification device 64 configured by the projection device will be described. FIG. 24 is a diagram illustrating an example of notification performed by the notification device 64 configured by the projection device in the sixth embodiment.
The notification device 64 illustrated in FIG. 24A is different from the second embodiment in that the captured image is projected onto any one or more of the object 69 and the background of the object 69 in association with the transmission order. As a specific example, as shown in FIG. 24B, the captured images are projected in the arrangement order shown in FIG.

Here, the configuration of the image transmission system 60 will be described.
Similar to the first embodiment, the image transmission device 65 includes an execution unit 65a (not shown) and an input / output circuit 65d. As in the first embodiment, the image transmission device 65 implements various functions by executing software processing with the execution unit 65a.

Next, the configuration of the image transmission device 65 will be described focusing on the function.
Similar to the first embodiment, the image transmission device 65 includes an image acquisition unit 651, a stillness determination unit 652, a holding unit 653, a communication unit 654, and a control unit 655. In addition, as in the first embodiment, the stillness determination unit 652 includes a determination unit 652a and a storage unit 652b (not shown). Further, the control unit 655 includes a notification control unit 656 and an annotation control unit 657 as in the first embodiment.
The notification control unit 656 controls the notification device 74 to display the captured images transmitted to the two or more predetermined transmission destinations by the communication unit 654 in association with the order of transmission to the predetermined transmission destinations. This is different from the first embodiment.
In the embodiment in which the notification device 64 is configured by a projection device, the notification control unit 656 transmits the captured image transmitted to the two or more predetermined transmission destinations by the communication unit 654 to the predetermined transmission destination. This differs from the second embodiment in that the notification device 74 is controlled to project in association with the order.

Now, with reference to FIG. 25, the image transmission preparation process executed by the image transmission device 65 will be described. FIG. 25 is a flowchart illustrating an example of image transmission preparation processing executed by the image transmission device 65 in the sixth embodiment.
The image transmission device 65 executes the processing from step S71 to S76 (step S71 to S76). The processing of steps S71 to S76 is substantially the same as steps S11 to S16 described with reference to FIG.

  If it is determined in step S76 that no notification record exists, the image transmission device 65 controls the notification device 64 to display the acquired and transmitted captured image in a region next to the region where the captured image has already been displayed. (Step S77). Thereafter, the image transmission device 65 ends the execution of the control transmission process after executing the processes of steps S78 and S79 (steps S78 and S79). The processing in steps S78 and S79 is substantially the same as steps S18 and S19 described in the first embodiment with reference to FIG.

  In FIG. 25, the processing from steps S71 to S74 and S79 corresponds to communication processing for realizing the communication unit 654, and the processing from steps S75 to S78 corresponds to notification control processing for realizing the notification control unit 656. To do.

  In the embodiment in which the notification device 64 is a projection device, the image transmission preparation process executed by the image transmission device 65 is almost the same as the processing already described in the sixth embodiment in which the notification device 64 is a display device. Since it is the same, description is abbreviate | omitted.

  In this embodiment, the image acquisition unit 651 corresponds to an image acquisition unit, the determination unit 652a corresponds to a determination unit, the holding unit 653 corresponds to a holding unit, the communication unit 654 corresponds to a communication unit, and the control unit 655. Corresponds to the control means.

Here, an image transmission method using the image transmission devices 15, 25, 35, 35, 45, 55, and 65 can be implemented.
The programs executed by the image transmission devices 15, 25, 35, 35, 45, 55, and 65 are stored and distributed on magnetic disks, optical disks, semiconductor memories, and other recording media, or distributed via a network. Can be provided.

  Although the preferred embodiments of the present invention have been described in detail above, the present invention is not limited to the specific embodiments, and various modifications, within the scope of the gist of the present invention described in the claims, It can be changed.

It is a block diagram which shows one Embodiment of an image communication system provided with the image transmission apparatus of this invention. It is a block diagram which shows other embodiment of an image transmission system. It is a figure showing an example of the notification which a notification apparatus performs. It is a figure showing an example of the hardware constitutions of an image transmission apparatus. It is a functional block diagram showing the example of 1 structure of an image transmitter. It is a functional block diagram showing one structural example of an image acquisition part. It is a functional block diagram showing the example of 1 structure of a stillness determination part. It is a flowchart showing an example of the image transmission preparation process which an image transmission apparatus performs. It is a flowchart showing an example of the control transmission process which an image transmission apparatus performs. 6 is a diagram illustrating an embodiment of an image transmission system in Example 2. FIG. FIG. 10 is a diagram illustrating an example of an image projected by a projection apparatus in Embodiment 2. FIG. 10 is a functional block diagram illustrating a configuration example of an image transmission device according to a second embodiment. 10 is a diagram illustrating an embodiment of an image transmission system in Example 3. FIG. FIG. 10 is a functional block diagram illustrating a configuration example of an image transmission device according to a third embodiment. 10 is a flowchart illustrating an example of an image transmission preparation process executed by an image transmission apparatus according to a third embodiment. 10 is a flowchart illustrating an example of a control transmission process executed by an image transmission apparatus according to a third embodiment. 10 is a diagram illustrating an embodiment of an image transmission system in Example 4. FIG. FIG. 10 is a functional block diagram illustrating a configuration example of an image transmission device according to a fourth embodiment. 10 is a flowchart illustrating an example of image transmission preparation processing executed by an image transmission device in Embodiment 4. 10 is a flowchart illustrating an example of a control transmission process executed by an image transmission apparatus in a fourth embodiment. It is a figure showing the other example of the notification apparatus in Example 5. FIG. 10 is a flowchart illustrating an example of an image transmission preparation process executed by an image transmission apparatus according to a fifth embodiment. It is a figure showing an example of the notification which a notification apparatus performs in Example 6. FIG. It is a figure showing an example of the notification which the notification apparatus comprised with a projection apparatus in Example 6 performs. 18 is a flowchart illustrating an example of image transmission preparation processing executed by an image transmission device in Embodiment 6.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Image communication system 10 ... Image transmission system
DESCRIPTION OF SYMBOLS 100 ... Communication network 10a ... Image transmission system
11 ... Projection device 11a ... Projection device
12 ... Imaging device 12a ... Imaging device
13 ... Spectroscope (half mirror)
14 ... Notification device (display device) 14 ... Display device
DESCRIPTION OF SYMBOLS 15 ... Image transmission apparatus 151 ... Image acquisition part (image acquisition means)
151a ... Acquisition unit 151b ... First storage unit
152 ... Stillness determination unit 152a ... Determination unit
152b ... Storage unit 153 ... Holding unit (holding means)
154 ... Communication unit (communication means) 155 ... Control unit (control means)
156 ... Notification control unit 157 ... Annotation control unit
15a ... execution unit (CPU) 15b ... read-only storage device
15c: Readable storage device 15d: External storage device
15e ... I / O circuit 18 ... Workbench
19 ... object 20 ... image transmission system
DESCRIPTION OF SYMBOLS 21 ... Notification apparatus (projection apparatus) 21 ... Projection apparatus ... Cum ... Imaging apparatus 22 ... Imaging apparatus 25 ... Image transmission apparatus
251 ... Image acquisition unit (image acquisition means)
252 ... Stillness determination unit 253 ... Holding unit (holding means)
254 ... Communication unit (communication means) 255 ... Control unit (control means)
256 ... Notification control unit 257 ... Annotation control unit
25a ... Image transmission device 28 ... Working table
29 ... object 30 ... image transmission system
31 ... Projection device 32 ... Imaging device
35 ... Image transmission device 351 ... Image acquisition unit (image acquisition means)
352 ... Stillness determination unit 353 ... Holding unit (holding means)
354 ... Communication unit (communication means) 355 ... Control unit (control means)
356 ... Notification control unit 357 ... Annotation control unit
36 ... Notification device (voice output device)
38 ... Workbench 39 ... Subject
40 ... Image transmission system 41 ... Projector
42 ... Imaging device 45 ... Image transmission device
451 ... Image acquisition unit (image acquisition means)
452: Stillness determination unit 453 ... Holding unit (holding means)
454 ... Communication unit (communication means) 455 ... Control unit (control means)
456 ... Notification control unit 457 ... Annotation control unit
46 ... Notification device (lighting device) 48 ... Work table
49 ... object 54a ... display device
54b ... Projection device 54c ... Audio output device
54d ... lighting device 55 ... image transmission device
551 ... Image acquisition unit (image acquisition means)
552 ... Stillness determination unit 555 ... Notification control unit
56 ... Notification device (voice output device)
64 ... Notification device (display device) 65 ... Image transmission device
654 ... Communication unit (communication means) 656 ... Notification control unit
80: Image receiving system 81: Display device
82 ... Input device 85 ... Image receiving device
90 ... Image receiving system 91 ... Display device
92 ... Input device 95 ... Image receiving device

Claims (14)

An image transmission device,
Image acquisition means for acquiring a captured image representing the object from an imaging device that images the object to be discussed;
Communication for receiving a transmission request for transmission of a captured image acquired by the image acquisition unit from a transmission destination outside the image transmission apparatus, and transmitting the captured image to the transmission destination in response to the received transmission request Means,
Holding means for holding the transmission history by the communication means comprises information representative of the destination which sent the captured image,
Based on the information indicating the transmission destination included in the transmission history the holding means for holding, after the communication unit has completed the transmission of the captured image to all two or more of the destination predetermined the captured image The notification device is configured to notify a person who discusses the object represented by the notification device that the transmission of the captured image is transmitted to all of the two or more predetermined transmission destinations. Control means for controlling ;
An image transmitting apparatus comprising: The communication means receives a connection request for connection to request transmission of the captured image, and transmits the captured image to a connection destination connected in response to the received connection request.
The holding unit holds information representing the connection destination connected in response to the connection request received by the communication unit;
The two or more predetermined transmission destinations are all the connection destinations represented by the information held by the holding unit,
The control means determines whether or not the image has been transmitted to all the connection destinations based on information indicating the transmission destination held by the holding means and information indicating the connection destination, and the two or more The image transmission device according to claim 1, wherein the notification device is controlled to notify that the captured image is transmitted to a predetermined transmission destination. The notification device is a display device that displays a captured image acquired by the image acquisition unit;
The image transmission device according to claim 1, wherein the control unit controls the display device to display a captured image transmitted from the communication unit to the predetermined transmission destination.   The control means controls the display device to display the captured image transmitted by the communication means to the predetermined transmission destination in association with the order of transmission to the predetermined transmission destination. The image transmission apparatus according to claim 3. The notification device is a projection device that projects a captured image acquired by the image acquisition means,
The control means controls the projection apparatus to project the captured image transmitted by the communication means to the predetermined transmission destination onto one or more of the object and the background of the object. The image transmission apparatus according to claim 1, wherein the image transmission apparatus is an image transmission apparatus.   The control unit controls the projection device to project the captured image transmitted by the communication unit to the predetermined transmission destination in association with the order of transmission to the predetermined transmission destination. The image transmission apparatus according to claim 5. The notification device is a sound output device that outputs a predetermined sound,
3. The control unit according to claim 1, wherein the control unit controls the audio output device so as to notify the output of the audio that the communication unit has transmitted a captured image to the predetermined transmission destination. The image transmission device described. The notification device is a lighting device that lights a predetermined light,
The said control means controls the said lighting device to notify that the said communication means transmitted the picked-up image to the said predetermined transmission destination by lighting of the said light, The Claim 1 or 2 characterized by the above-mentioned. Image transmission device. The communication means transmits the captured image acquired by the image acquisition means according to a predetermined signal,
Determination means for determining whether or not the captured image represents the cue based on a pixel value of the captured image acquired by the image acquisition means;
The control unit is configured to transmit the captured image according to a signal determined by the determination unit based on information indicating the transmission destination held by the holding unit and information indicating the connection destination. 3. The image transmission device according to claim 1, wherein the notification device is controlled to notify that there is a connection destination that has not transmitted the captured image when it is determined that there is a captured image.   The determination unit determines whether the captured image represents a cue using the image based on an image represented by the captured image detected based on a change in a pixel value of the captured image acquired by the image acquisition unit. The image transmission device according to claim 9, wherein the determination is performed. The receiving means further receives a projection instruction for instructing to project an annotation image for annotating an object represented by the captured image transmitted by the communication means;
The image transmission apparatus according to claim 1, wherein the control unit controls a projection apparatus that projects the annotation image onto the object in accordance with a projection instruction received by the reception unit. Stillness that determines whether or not the operation of the logical person is stationary based on a comparison result between a transmitted captured image that has been transmitted by the communication unit and a captured image that is transmitted immediately after the transmitted captured image. A determination means;
The control means discards the transmission history held by the holding means when the stillness determining means determines that the operation of the logical person has been stationary for a predetermined time, and the communication means After the transmission of the immediately preceding captured image is completed by the above, the holding unit again holds a transmission history including information indicating the transmission destination, and based on the information indicating the transmission destination included in the held transmission history The image transmission device according to claim 1, wherein the notification device is controlled. An imaging device for imaging an object to be discussed;
An image receiving apparatus that transmits a transmission request for requesting transmission of a captured image captured by the imaging apparatus, and that receives a captured image requested by the transmitted transmission request;
Information holds the transmission history including information indicating a destination which the imaging device transmits the captured image captured in response to the transmission request image receiving device transmits, represents the transmission destination included in the transmission history holding based on, after the completion of the transmission of the captured image to all two or more of the destination predetermined notification device that notifies the transmission of the captured image to the commentators discuss object to the captured image is represented, the An image transmission device that controls the notification device to notify that all of the two or more predetermined transmission destinations have transmitted the captured image ;
An image communication system comprising: Computer
Image acquisition means to acquire a captured image representing the object from the imaging device for imaging an object of interest of discussion,
Which receives from the transmission destination in the transmission request for transmission of the captured image by the image acquisition unit has acquired to the outside of the computer, the communication means to transmit the captured image to the transmission destination in response to the transmission request,
Holding means to hold the transmission history by the communication means comprises information representative of the destination which sent the captured image,
After two or more of the destination of the communication means to all predetermined based on the information indicating the transmission destination included in the transmission history the holding means for holding has completed the transmission of the captured image, the captured image is notification device for notifying the transmission of the captured image to the commentators discuss the object represented by, controls the notification unit to the notification of transmitting the captured image to the transmission destination all the two or more predetermined An image transmission program which functions as a control means for performing

Images