JP2006074242A - Image communication system, image receiving device and imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image communication system in which both sides of a transmitter and a recipient can confirm still images with a sufficient time as needed and can switch smoothly a moving video and a still image. <P>SOLUTION: When the still image which is imaged or recorded with a camera 101 or is received and the still image is displayed during a moving video communication with the camera 101, a PC 103 stores a still image display time duration, measures a lapse time from a time point displaying the still image by a timer 304, and displays the still image until the measured lapse time reaches the still image display time. After it reaches the still image display time, when it receives the moving image from the camera 101, the moving image is displayed. On the other hand, when the still image is received, the still image is displayed. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to image communication processing.

  2. Description of the Related Art Conventionally, a moving image communication system is known that can display a still image captured or recorded by a camera side on a receiving side terminal device during moving image communication.

Patent Document 1 discloses a video conference system that switches between transmission of a moving image and transmission of a still image inside a camera on the transmission side and displays an image as it is on the reception side.
JP 2002-271667 A

  However, the conventional image communication system has the following problems. That is, switching between a moving image and a still image must be performed by a camera on the transmission side, and the switching of images is completely synchronized between the transmission side and the reception side, which may cause inconvenience.

  For example, when the camera on the transmission side takes a still image during video communication and automatically returns to video communication after a predetermined time has elapsed, the terminal device on the reception side checks the still image for a longer time. If you want to do that, you're going back to the video.

  Therefore, the present invention provides an image communication system and an image receiving apparatus in which both the transmitting side and the receiving side can check a still image for a sufficient time and smoothly switch between a moving image and a still image as necessary. It is another object of the present invention to provide an imaging device.

  In order to achieve the above object, an image communication system of the present invention is an image communication system in which an imaging device and an image receiving device are connected via a communication medium, and the imaging device includes a captured still image and the imaging A transmission means for transmitting information relating to the current operation mode of the apparatus, wherein the image reception apparatus relates to a reception means for receiving a captured still image and information relating to the operation mode of the imaging apparatus, and an operation mode of the imaging apparatus. And display means for displaying predetermined information together with the still image on a display device based on the information.

  An imaging apparatus for transmitting an image to an image receiving apparatus, the imaging apparatus comprising: a transmission unit that transmits a captured still image and information related to a current operation mode of the imaging apparatus.

  According to the image communication system of the present invention, on the image receiving device side, the still image display time can be set independently of the setting time on the imaging device side. Even when the transmission is switched, the user of the image receiving apparatus can continue to check the same still image without being bothered by it. In this way, both the transmitting side and the receiving side can check a still image for a sufficient time and smoothly switch between a moving image and a still image as necessary.

  Embodiments of an image communication system, an image receiving apparatus, and an imaging apparatus according to the present invention will be described with reference to the drawings. The image communication system of this embodiment is applied to an image reception client / camera server system. FIG. 1 is a diagram showing a configuration of an image receiving client / camera server system in the embodiment. The image receiving client / camera server system includes a camera 101, a network 102, and a personal computer (PC).

  The camera 101 captures an image and selectively transmits a moving image and a still image to the network 102. The network 102 is a network such as the Internet through which a TCP / IP bucket flows, a telephone network, and the like, and the type thereof is not particularly limited. Moreover, any of wired and wireless may be sufficient, and also all these combinations may be sufficient. The PC 103 is an information processing device that receives an image from the camera 101 and displays the image on the screen of the display device.

  In FIG. 1, the camera 101 and the PC 103 are connected one-to-one. However, the present invention is not limited to this configuration, and may be connected one-to-many, many-to-one, or many-to-many. In this embodiment, the camera 101 is a device on the image transmission side, and the PC 103 is a device on the image reception side. The role is fixed, but the configuration is not limited thereto. Alternatively, it may be a video conference system in which a PC with a camera exchanges images in both directions. The camera is not limited to the camera itself, but may be a PDA (Personal Digital Assistant) with a camera module attached.

  FIG. 2 is a block diagram showing the configuration of the camera 101. The camera 101 has a central control unit (CPU) 201 that controls the entire camera, a ROM 202 that stores various operation programs for executing processing in the present embodiment in a readable manner, and temporarily holds data during program operation. RAM 203, timer 204 for measuring various times, display 205 for displaying various setting menus and images, microphone 206 for inputting sound, speaker 207 for sound output, various operation buttons 208, captured images and various setting data A flash ROM 209 as a non-volatile memory for holding the data, a network I / F 210 for connecting to the network 102, and a charge coupled device (CCD) 211 for converting the light collected through the lens into an electric signal are provided on the bus 212. Connected to each other via Having the configuration.

  FIG. 3 is a block diagram showing the configuration of the PC 103. The PC 103 temporarily holds a central control unit (CPU) 301 that controls the entire PC, a ROM 302 that stores various operation programs for executing processing in the present embodiment in a readable manner, and data during program operation. A RAM 303, a timer 304 for measuring various times, a display 305 for displaying an operating system and various applications, a microphone 306 for inputting sound, a speaker 307 used for sound output, a keyboard 308, a mouse 309, various programs and data are stored. The hard disk 310 and the network I / F 311 for connection to the network 102 are connected to each other via a bus 312.

  As described above, both the camera 101 and the PC 103 include the microphone and the speaker, and voice communication can be performed between the camera 101 and the PC 103 using these. That is, voice communication can be performed simultaneously with image communication.

  Note that how the image communication channel and the voice communication channel are secured depends on the configuration of the network 102, and is not specified here. However, if both communication is possible, the user of the PC 103 It is also possible to give instructions to the photographer of the camera 101 as appropriate, and cause the photographer of the camera 101 to photograph the video desired by the user of the PC 103. In addition, when a moving image communication channel and a still image communication channel are secured separately, it is possible to simultaneously display a still image recorded in the camera 101 while displaying a moving image on the PC 103 side. On the other hand, it is also possible to simultaneously display a moving image recorded in the camera 101 while displaying a captured still image. In the present embodiment, basically, the PC 103 only needs to display a moving image when the camera 101 is capturing a moving image, and the PC 103 only needs to display a still image when the camera 101 is capturing a still image. The communication channel and the still image communication channel may be shared. Of course, it goes without saying that separate channels may be secured.

  FIG. 4 is a view showing the appearance of the back surface of the camera 101. On the back of the camera 101, a display 205, a mode change switch 402 for switching between a shooting mode and a playback mode, a cross button 403 for moving the cursor vertically and horizontally in various setting menus, and a menu button for displaying and deleting the setting menus 404, a SET button 405 is provided for use in determining values in various setting menus. A shutter button 401 is provided on the upper surface of the camera 101.

  When the mode changeover switch 402 is switched to the photographing side, the camera 101 enters a photographing mode, and an image currently captured through the lens is displayed on the display 205 as a moving image. This moving image is transmitted to the PC 103 via the network 102. At this time, if the photographer detects that the shutter button 401 has been pressed, the photographed still image is displayed on the display 205 and is also saved in the flash ROM 209, and the saved image is stored in the PC 103 via the network I / F 210. Sent to.

  The time for which the shot still image is displayed on the display 205 is determined by the preview time in the setting menu. In FIG. 4, the display 205 displays a setting menu for setting the preview time. For example, the preview time can be selected from “none”, “2 seconds”, and “10 seconds”. When the preview time elapses, the display 205 returns from the captured still image to the moving image display. The photographer can check still images taken using this time.

  On the other hand, when it is detected that the mode changeover switch 402 has been selected to the “playback” mode, the camera 101 enters the playback mode, and the images stored in the flash ROM 209 are read one by one and displayed on the display 205 in accordance with the image selection operation. To do. At the same time, the selected image is transmitted to the PC 103. Note that the still image stored in the flash ROM 209 and the still image transmitted to the PC 103 are not necessarily the same image. For example, when an image is sent from the camera 101 to a PDA (not shown), the taken still image may be sent after being reduced in consideration of the small screen size. In the case of sending to the PC 103, an image having a size corresponding to the current display resolution of the PC 103 may be taken into consideration.

  In order to realize such a thing, an image of an appropriate size corresponding to the other party to be sent is recorded in the flash ROM 209, or a predetermined protocol is used before actually starting transmission of a still image. You may make it negotiate. In any case, the size of the still image to be transmitted can be set as preferable for the user of the PC 103.

  FIG. 5 is a view showing a screen of an image communication application operating on the PC 103. On the screen, an image communication application window 501 having various functions is displayed. This window 501 displays not only the image received from the camera 101 but also other information. Specifically, an image display window 502 for displaying a moving image or a still image, a still image display extension button 503 for extending the display time of a still image taken by the camera 101, and an image currently captured by the camera 101 are synchronized. A synchronization button 504 for displaying a remaining time display bar 505 for displaying a display remaining time of a still image taken by the camera 101, and a status line 506 for displaying a current state as a character string are displayed.

  A still image shot by the camera 101 is displayed in the image display window 502 for the set still image display time. As time elapses, the length of the remaining time display bar 505 is shortened, and the user of the PC 103 is notified that the remaining display time of the still image has decreased. When the remaining display time becomes “0”, the camera 101 is configured to return to the moving image display when the moving image is being shot by the camera 101.

  The operation of the image receiving client / camera server system having the above-described configuration will be described. 6 and 7 are flowcharts showing the operation processing procedure of the camera 101. This processing program is stored in the ROM 202 in the camera 101 and is executed by the CPU 201. When the photographer performs a predetermined operation, the CPU 201 connects an image and audio communication path to the PC 103 (step S1). The communication path connection method differs depending on the configuration of the network 102. When the network 102 is the Internet, an IP address is designated for connection. In the case of a telephone network, a call is made and connected. Connection may be made from either the camera 101 side or the PC 103 side.

  Then, the CPU 201 starts voice communication (step S2). As a result, voice exchange between the camera 101 and the PC 103 becomes possible. Thereafter, the CPU 201 determines whether or not the mode indicated by the mode switch 402 is the shooting mode (step S3). When the mode is the shooting mode, the moving image captured by the CCD 211 is displayed on the display 205 and transmitted to the PC 103 (step S4). Here, the display of the image on the display 205 and the transmission to the PC 103 may be performed by the CPU 201, but in order to prevent the load on the CPU 201 from increasing, it is performed by a dedicated image processing chip (not shown). You may do it.

  It is determined whether or not the shutter button 401 has been pressed during moving image transmission (step S5). If the shutter button 401 has not been pressed, the process returns to step S3. Then, the moving image transmission is continued until the mode is switched to the reproduction mode in step S3 or the shutter button 401 is pressed in step S5.

  On the other hand, when the shutter button 401 is pressed during moving image transmission in step S5, the captured still image is displayed on the display 205 (step S6), and is recorded in the flash ROM 209 (step S7). Further, data indicating that the current operation mode of the imaging apparatus is the shooting mode and still image data are transmitted to the PC 103 (step S8).

  Thereafter, the CPU 201 starts measuring the timer 204 and waits for the preview time to elapse (step S9). Here, the preview time is determined in advance in the setting menu described above (see FIG. 4). It is determined whether the preview time has elapsed (step S10). If the preview time has not elapsed, it is determined whether the photographer has performed a predetermined operation to extend the preview reproduction (step S11). If the preview reproduction is not extended, it is determined whether or not the mode is the reproduction mode (step S12). If the shooting mode is not the playback mode, the process returns to step S10 and the same processing is repeated. On the other hand, when the preview reproduction is extended in step S11, or in the reproduction mode in step S12, the process proceeds to step S14 described later.

  That is, the process of step S10, step S11 and step S12 is performed without taking any action by the photographer of the camera 101. When the preview time elapses, the preview time elapses in step S10, and the mode is captured in step S3. If the mode remains unchanged, the video transmission state is restored. On the other hand, before the preview time elapses, the photographer performs a predetermined operation to extend the preview reproduction, or when the photographer switches the mode switching switch 402 to the reproduction side and enters the reproduction mode, the CPU 201 reproduces the mode. The data indicating the mode and the still image data reproduced on the display 205 at that time are transmitted to the PC 103 (step S14). When the preview reproduction extension operation is performed, the camera 101 automatically switches the mode changeover switch 402 to the reproduction side to enter the reproduction mode.

  In the playback mode, the CPU 201 monitors whether or not the shutter button 401 has been half-pressed (step S15). If the shutter button 401 has not been half-pressed, the process returns to step S3, and whether or not the mode switch 402 has been switched to the photographing side. Alternatively, it is determined whether or not the reproduction side remains. That is, if the mode is not the shooting mode but the playback mode in step S3, it is determined whether or not the reproduced still image has been changed (step S13). If not changed, the process returns to step S3. That is, the loop following NO in step S3 → NO in step S13 → step S3 is repeated. On the other hand, when the still image to be reproduced has been changed, the still image data in the reproduction mode is transmitted to the PC 103 in step S14.

  In the playback mode, the photographer can select an arbitrary still image from among the still images recorded in the flash ROM 209. Each time the selection is made again, the still image to be reproduced in step S13 is changed in the loop, and the CPU 201 displays the selected still image on the display 205, and the mode is the reproduction mode. The data indicating that it is present and the still image data being reproduced on the display 205 at that time are transmitted to the PC 103 in step S14.

  On the other hand, when the shutter button 401 is pressed halfway during the playback mode in step S15, the mode is switched to the shooting mode, the mode changeover switch 402 enters the shooting side, and moving image transmission is performed in step S4. Note that immediately after the process of step S2, when the CPU 201 determines whether or not the mode is the shooting mode, if the playback mode is not the shooting mode, has the still image to be played back changed in step S13? Although it is determined whether or not, in the first step S13, it is processed as changed.

  8, 9, and 10 are flowcharts showing the operation processing procedure of the PC 103. This processing program is stored in the ROM 302 in the PC 103 and is executed by the CPU 301. First, after the user of the PC 103 starts an image communication application, the CPU 301 connects an image and audio communication path to the camera 101 (step S21). Then, the CPU 301 starts voice communication (step S22). Thereafter, the state of the PC 103 changes according to the type of data received from the camera 101. That is, it is determined whether a moving image is received, a still image in the shooting mode is received, or a still image in the playback mode is received.

  First, the CPU 301 determines whether information relating to the operation mode of the camera 101 and a moving image are received via the network I / F 311 (step S23). When a moving image is received, the received moving image is displayed on the image display window 502 (step S24), and the status line 506 is cleared (step S25). Here, the reason for clearing the status line 506 is to end the display of the status line 506 performed when the still image is displayed. Then, after clearing the status line 506, the process returns to step S23 to repeat the same processing. Thus, the PC 103 continues to display the moving image while receiving the moving image.

  On the other hand, if no moving image is received in step S23, it is determined whether or not the information regarding the operation mode of the camera 101 is the shooting mode and whether a still image has been received (step S26). When a still image whose mode is the shooting mode is received while the moving image is being displayed, the received still image is displayed on the image display window 502 (step S27), and the timer 304 is started to measure the still image display time (step S27). S28). Here, it is assumed that the still image display time is set in advance in a menu (not shown) of the image communication application and stored in, for example, the RAM 303. As described above, the still image display time is set to a value independent of the preview time. That is, even if the preview time is set short on the photographer side, the user of the PC 103 can set the still image display time long so that it can be sufficiently confirmed.

  After the measurement of the still image display timer 304 is started in step S28, the CPU 301 displays “capturing still image display” on the status line 506 (step S29). By viewing this display, the user of the PC 103 knows that the still image was just taken and that the display lasts for the still image display time. Note that the CPU 301 counts down the still image display time as time passes and shortens the length of the remaining time display bar 505 by another process. Then, the user of the PC 103 knows the remaining display time of the still image by viewing this display.

  After that, while monitoring whether or not the still image display time has elapsed, the CPU 301 has received a moving image, received a still image, whether the still image display extension button 503 has been pressed, or a synchronization button. Check if 504 is pressed.

  Before the still image display time elapses, the CPU 301 detects whether a moving image is received through the network I / F 311 in preparation for a case where a moving image is transmitted from the camera 101 (see step S4) (step S30). When the moving image is received, the fact that the camera 101 is transmitting the moving image is stored in the RAM 303 as temporary data (step S31). The process returns to step S30 again. When a new still image is transmitted from the camera 101 before the still image display time elapses (see steps S8 and S14), the CPU 301 detects whether or not a still image is received through the network I / F 311. (Step S32).

  When the still image is received, the received still image is stored in the RAM 303 (step S33), and further, the mode of the camera 101 sent together with the still image is stored in the RAM 303 as temporary data (step S34). Thereafter, the process returns to step S30. Here, the process of step S31 and the process of step S34 are in an exclusive relationship, and the stored state of the camera 101 differs depending on which step process was executed last.

  If no still image has been received in step S32, it is determined whether or not the still image display extension button 503 has been pressed before the end of the still image display time (step S35). When detecting that the still image display extension button 503 has been pressed, the CPU 301 clears the still image display timer 304 and stops the countdown (step S36). At the same time, the display of the remaining time display bar 505 is terminated. As a result, the user of the PC 103 can check the still image for a longer time than the still image display time. Then, it continues to display the current still image and waits for the synchronization button 504 to be pressed (step S37).

  On the other hand, if the still image display extension button 503 has not been pressed in step S35, whether or not the synchronization button 504 has been pressed before the still image display time ends and before the still image display extension button 503 is pressed. When the synchronization button 504 is pressed, the CPU 301 clears the still image display timer (step S39), and the process proceeds to step S41. On the other hand, if the synchronization button 504 is not pressed, it is determined whether or not the still image display time has elapsed (step S40). If not, the process returns to step S30. On the other hand, when the still image display time is over, the process proceeds to step S41.

  When the synchronization button 504 is pressed by the user of the PC 103 in step S37, the CPU 301 determines whether or not the camera 101 is performing video communication (step S41). Here, if it is finally stored in step S31 that the camera 101 is transmitting a moving image, the moving image display state is reached in step S24. On the other hand, when the camera 101 is not transmitting moving images, the CPU 301 determines whether or not the camera 101 has transmitted a still image (step S42). If it is stored in the last step S34 that the camera 101 has transmitted a still image, the CPU 301 determines whether or not the mode of the camera 101 stored in step S34 is the playback mode (step S43). ).

  When the current operation mode of the camera 101 is the playback mode, the still image stored in step S33 is displayed on the image display window 502 (step S45), and “reproducing still image is being displayed” is displayed on the status line 506 ( Step S46). By confirming this display, the user of the PC 103 can know that the still image is being played back by the camera 101. Thereafter, the process returns to step S23.

  On the other hand, when the camera is in the shooting mode in step S43, the still image stored in step S33 is displayed on the image display window 502 in step S27, and the same procedure as that when the still image in the shooting mode is received is followed.

  If no still image in the photographing mode is received in step S26, it is determined whether or not a still image in the reproduction mode has been received (step S44). If a still image in playback mode is received, the process proceeds to step S45 and the same process is performed. If no still image is received, the process returns to step S23. That is, when the CPU 301 is executing a loop composed of step S23, step S26, and step S44 and receives a still image in playback mode (see step S14) from the camera 101, the CPU 301 executes playback still image processing from step S45. To do.

  As described above, according to the image reception client / camera server system of the present embodiment, the photographer of the camera 101 tries to shorten the preview time by setting the still image display time independently of the preview time. In addition, the user of the PC 103 can check the still image for a sufficient time no matter how the mode switching operation is performed after shooting. Meanwhile, even if the camera 101 switches to moving image transmission or transmits another still image, the user of the PC 103 can continue to check the same still image without being bothered by it. Further, when the still image display time is shorter than the preview time, the same still image is continuously displayed until the preview time ends or until the photographer of the camera 101 switches the mode, so there is no particular problem. Also, when the still image display time has elapsed, it can be immediately restored to the synchronized state regardless of whether the camera mode is the shooting mode or the playback mode. In this way, both the transmitting side and the receiving side can check a still image for a sufficient time and smoothly switch between a moving image and a still image as necessary. Further, when a still image can be sufficiently displayed on the receiving side, it is possible to immediately synchronize with the transmitting side without waiting for the display time of the still image to elapse. In addition, if it is determined that the still image cannot be sufficiently confirmed within the predetermined still image display time on the receiving side, the still image display time is stopped by stopping the measurement of the still image display time and continuing to display the still image. Regardless of the setting, still images can be confirmed on the receiving side until they are satisfied. Further, since the size of the image sent from the camera server is changed according to the display capability on the receiving side, the size of the still image to be sent can be set to a value preferable for the PC user.

  The present invention is not limited to the configuration of the above-described embodiment, and any configuration can be used as long as the functions shown in the claims or the functions of the configuration of the present embodiment can be achieved. Is also applicable.

  For example, although the present invention requires hardware, it can be realized by a program operating on each device. Therefore, the above-described functions can be realized by reading and executing the software program and the storage medium storing the program codes for realizing the functions of the above-described embodiments. In other words, an object of the present invention is to supply a storage medium storing software program codes for realizing the functions of the above-described embodiments to a system or apparatus, and a computer (or CPU, MPU, or the like) of the system or apparatus stores the storage medium. This can also be achieved by reading and executing the program code stored in the program. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention.

  Examples of storage media for supplying the program code include ROM, floppy (registered trademark) disk, memory card such as PCMCIA card and compact flash (registered trademark), hard disk, micro DAT, magneto-optical disk, CD-R, and the like. You may comprise with optical disks, such as CD-RW, phase change type optical disks, such as DVD. The program code may be downloaded via a network.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) or the like running on the computer is actually executed based on the instruction of the program code. It goes without saying that a case where the function of the above-described embodiment is realized by performing a part or all of the process and the process is included.

  Further, after the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. This includes the case where the CPU or the like provided in the board or the function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

It is a figure which shows the structure of the image receiving client camera camera system in embodiment. 2 is a block diagram illustrating a configuration of a camera 101. FIG. 2 is a block diagram showing a configuration of a PC 103. FIG. 2 is a diagram illustrating an appearance of a back surface of a camera 101. FIG. 2 is a diagram illustrating a screen of an image communication application that operates on a PC 103. FIG. 3 is a flowchart showing an operation processing procedure of the camera 101. It is a flowchart which shows the operation | movement process sequence of the camera 101 following FIG. It is a flowchart which shows the operation | movement process sequence of PC103. FIG. 9 is a flowchart showing an operation processing procedure of the PC 103 continued from FIG. 8. FIG. 10 is a flowchart showing an operation processing procedure of the PC 103 following FIG. 8 and FIG. 9.

Explanation of symbols

101 Camera 102 Network 103 PC
201, 301 CPU
202, 302 ROM
205 Display 304 Timer 402 Mode Changeover Switch 501 Image Communication Application Window

Claims (7)

An image communication system in which an imaging device and an image reception device are connected via a communication medium,
The imaging device
Transmission means for transmitting a photographed still image and information on the current operation mode of the imaging device;
The image receiving device includes:
Receiving means for receiving a captured still image and information relating to an operation mode of the imaging device;
An image communication system comprising: display control means for displaying predetermined information together with the still image on a display device based on information relating to an operation mode of the imaging device. The image receiving device further includes a still image display time storage means for storing a still image display time;
Timer means for measuring an elapsed time from the time when the still image is displayed, and the display control means, when the imaging device is in an imaging mode, the measured elapsed time becomes the still image display time. 2. The image communication system according to claim 1, further comprising display control means for controlling to display the still image until it reaches.   The image communication system according to claim 1, wherein the image receiving apparatus further includes a still image display extension button that can be operated by a user of the image receiving apparatus.   The image receiving device of the image communication system according to any one of claims 1 to 3.   A program for operating the image receiving apparatus according to claim 4.   A storage medium storing the program according to claim 5. An imaging device that transmits an image to an image receiving device,
An imaging apparatus, comprising: a captured image and a transmission unit configured to transmit information related to a current operation mode of the imaging apparatus.

Images