JP2007288265A - Video communication apparatus and method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method of a video communication apparatus configured attachably to / detachably from an imaging section for properly switching a video communication method and a video storage method. <P>SOLUTION: The video communication apparatus configured attachably to / detachably from an imaging apparatus is provided, which includes: a means for discriminating a kind of a video imaging operation; a means for selecting a storage method of a photographed video image; and a means for storing the video image; and particularly a means for selecting the storage method of the photographed video image depending on the kind of the video imaging operation. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a video distribution technique for distributing video data by communication. In particular, the present invention relates to a video apparatus or the like in which an imaging unit for capturing video and a communication unit for transmitting video are separable.

  Conventionally, a technique for instructing camera settings for shooting and camera operation, etc. has been established and products are being sold while delivering live video using a communication infrastructure such as the Internet. For example, Patent Document 1 and Canon Inc. network camera VB-C10.

  In the video distribution system of Canon Inc., in addition to video distribution, camera control such as panning, tilting, zooming, and backlight correction can be provided via a network. In addition, an access control function is provided, and camera control and video distribution can be restricted according to the access authority of the user.

  Furthermore, it is possible to limit the area to be imaged by camera control. For example, the privileged user can use all of the zoom functions provided in the camera, but the normal user is limited so that only a part of the zoom function (for example, the tele end cannot be used up) can be used. The same applies to the pan function and tilt function.

  Strictly speaking, a network camera integrated with an imaging device and a camera server for delivering a video source of another imaging device to the network are distinguished in the same sense in this document. Used in.

  Also, PTP (Picture Transfer Protocol) is defined as a protocol for operating a digital camera or a digital camcorder via a device connection interface such as a USB. With PTP, standard imaging settings of digital cameras and delivery of captured images are possible. On the other hand, there are camera devices that have unique settings and operations that cannot be described by PTP.

  Conventionally, Patent Document 2 proposes one method for storing video data captured by a digital camera. In this method, in order to effectively use the storage capacity of the digital camera, a temporary erasure flag and a storage priority order are specified for an image stored in the storage device. It is supposed to be erased.

  Furthermore, for the above-mentioned designation, a method in which the user manually designates (Patent Document 3) and a method that reflects a camera shake result at the time of photographing (Patent Document 4) have been proposed.

  Furthermore, in recent years, mobile phone terminals and digital cameras that transmit captured images to networks including the Internet by attaching emails have been used.

JP 09-289607 A Japanese Patent Laid-Open No. 2002-57978 JP 2000-339200 A JP 2000-341620 A

  However, when shooting by operating a camera server or a network camera that can be controlled on a network, it is difficult to use information generated by the above operation as a means for determining whether to delete or delete a video. There was a problem.

  In particular, when the imaging unit and the communication unit are configured to be detachable, the above problem becomes more conspicuous due to shooting by remote operation, saving of a shot video in an external storage, or the influence of communication conditions.

  The present invention has been made in view of such problems, and a video communication device configured to be detachable from an imaging unit appropriately switches between a video communication method and a video storage method according to the type of imaging operation. A method is provided.

  In order to solve the above-described problem, the present invention is a video communication apparatus configured to be detachable from an imaging unit, and a shooting classification unit for identifying the type of video imaging operation and a storage for selecting a method for storing the captured video Provided is a video communication apparatus or the like comprising a method selection unit and a storage execution unit for storing a video.

  The storage execution unit may be a shooting attribute simultaneous storage execution unit that stores the type of video imaging operation together with the video. In this case, the shooting attribute simultaneous storage execution unit may be a file shooting attribute simultaneous storage execution unit that incorporates the type of video imaging operation into a video file. Further, the file photographing attribute simultaneous saving execution means may be incorporated into a file format such as an EXIF or JFIF file format or an mp4 file format. The photographing attribute simultaneous storage execution unit may be incorporated in a communication attribute such as an HTTP header.

  According to the present invention, in a video communication apparatus in which an imaging unit and a communication unit are configured to be detachable, video data is stored with an appropriate storage attribute at an appropriate storage destination at an appropriate timing according to a shooting factor. , And can be deleted.

  As a result, not only the user's video shooting but also the arrangement and management of the shooting data can be assisted, and the limited storage area on the device can be effectively used without losing important video.

  Furthermore, by providing a means to incorporate shooting factor information into the video data itself, even video data distributed to various storage destinations can be classified and organized by shooting factors at timings other than imaging. It becomes.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[First Embodiment]
In the first embodiment, an example will be described in which a video communication device configured to be detachable from the imaging unit appropriately performs video communication and video storage according to the type and situation of the imaging operation.

  Among these, the imaging unit is configured by a widely used digital camera, and the video communication device is characterized by being configured as a cradle for the digital camera.

  The cradle in this embodiment is a stand-type expansion device for a digital camera, which is connected just by placing the digital camera body, and has a network connection function, a charging function, a sensor input / output function, a pan / tilt function, etc. It is to provide.

  Thus, an example will be described in which a cradle device having a video communication function delivers video data obtained by digital camera operation to an appropriate storage destination at an appropriate timing by an appropriate file operation.

  FIG. 1 is a diagram showing a typical use form of an embodiment using the present invention.

  101 is a cradle according to the present invention, and 102 and 103 are viewer operation display terminals.

  A digital camera 110 can be attached to and detached from the cradle 101. The cradle 101 and the operation display terminals 102 and 103 are each connected to a network 150. A request is sent from the operation display terminal 102 to the cradle 101 via the network. When this request is accepted, the video data is delivered from the cradle 101 to the operation display terminal 102 and the video can be viewed on the operation display terminal.

  In addition, a camera control command is sent from the operation display terminal 102 to the cradle 101, and operations such as zooming, panning, and tilting operations of the camera 110 to the cradle 101 become possible. The operation display terminal 103 is the same.

  Reference numeral 120 denotes a network-attached storage device (Network Attached Storage; hereinafter referred to as NAS), which accepts data storage or reference requests from other devices connected to the network. The NAS 120 may be a home NAS, a business-use large-scale NAS, or a storage service on the Internet.

  The network 150 in the figure may be an intranet operated in a company or organization, or may be the Internet that widely connects the world.

  In some cases, it is a home network operated in the home. Furthermore, the medium may be wired or wireless.

  FIG. 2 is a diagram illustrating functional blocks of the cradle 101 and the camera 110.

  These functional blocks are implemented by software and hardware on the cradle 101 to the camera 110, and functions implemented by the software are executed by a processor or memory built in the cradle 101 or the camera 110, although not shown. In addition, functions implemented by hardware are internally connected to a processor and a memory.

  The camera 110 includes an image capturing unit 2-11, an image compression unit 2-12, an image storage unit 2-13, a viewfinder display unit 2-14, an operation switch unit 2-15, an external IF control unit 2-16, and a camera control unit. 2-17 and a strobe control unit 2-18. The camera 110 has a basic function as a so-called digital camera.

  The image capturing unit 2-11 includes a lens, an imaging device, a video signal processing circuit, and the like. The image compression unit 2-12 compresses the digital image data obtained from the imaging unit 2-11 with JPEG or the like if it is a still image, and with Motion JPEG or MPEG4 if it is a moving image.

  The compressed image data is recorded as a file in the image storage unit 2-13.

  The finder display unit 2-14 displays an image of the imaging unit 2-11, a captured image, and other operation GUIs, and setting and changing the release and image quality for that purpose can be performed using the operation switch 2-15. it can.

  In addition, the angle of view can be set while viewing the image instead of the optical viewfinder.

  The external IF control unit 2-16 is a part where the camera 110 exchanges control signals or power with an external device, and conforms to USB (Universal Serial Bus).

  A power supply IF for driving and charging the camera may be included.

  A digital camera control command is received from the cradle or image data is input to and output from the cradle via the external IF control unit.

  A strobe 2-18 is also provided. The setting storage unit 2-19 stores a setting value set by a command from the operation switch unit 2-16 or the cradle.

  The camera 110 includes an ID (digital camera identifier) for identifying the individual, and is stored in the setting storage unit in a non-rewritable state.

  The cradle 101 includes a pan / tilt driving unit 2-31, a lock mechanism control unit 2-32, a pan head control unit 2-21, a cradle control unit 2-22, an external IF control unit 2-23, and a network control unit 2-24. It has. Further, an image storage unit 2-25, a sensor input unit 2-26, and a data temporary storage unit 2-27 are provided.

  The pan / tilt driving unit 2-31 performs pan / tilt driving of the camera 110.

  The pan / tilt head control unit 2-21 controls the pan / tilt driving unit 2-31.

  The cradle control unit 2-22 controls the entire cradle.

  The external IF control unit 2-23 is an interface control unit for supplying power to the camera 110 and controlling the camera 110.

  In conformity with USB, it is connected to the external IF control unit 2-16 to send a control command to the camera 110 and to input / output captured image data from the camera 110.

  The cradle has a connection mechanism so that the external IF unit 2-16 of the camera 110 and the external IF control unit 2-23 of the cradle 101 are electrically connected when the camera 110 is mounted.

  Whether or not the camera 110 is attached can be determined from the electrical characteristics of the power supply or USB in this external IF control unit.

  The network control unit 2-24 is a network interface that is connected to the operation display terminals 102 and 103 to exchange control commands and the like.

  The network control unit 2-24 interprets control commands from the operation terminals 102 and 103 via the network 150 to control the camera 110 and the pan head control unit 2-21, and also displays the captured image via the network 150 as an operation display terminal. 102, 103, etc.

  The image storage unit 2-25 is a storage device such as a hard disk that stores images taken by the camera 110.

  The sensor input unit 2-26 is a part that takes out a signal from an external sensor such as a human sensor as a trigger.

  The data temporary storage unit 2-27 temporarily stores data to be set in the camera 110.

The commands that the cradle receives from the operation display terminal via the network are categorized as follows.
(1) Session command: There is a command that needs to establish a session in advance between the cradle and the operation display terminal. A session control command is defined for this purpose.
(2) Camera control command: A command for transferring a camera control right is defined for an operation command that requires exclusive control for access to the digital camera.
An operation display terminal holding the camera control right can perform a camera control operation.
In addition to the control of the digital camera, some commands related to the cradle (head) are included in this command category because a camera control right is required.
(3) Camera browse command: An operation relating to the internal state of the digital camera (including the contents of the image storage unit).
(4) Camera setting command: An operation for changing the setting of the digital camera.
(5) Cradle browse command: An operation related to the internal state of the cradle (including the contents of the image storage unit).
(6) Cradle setting command: An operation for changing the setting of the cradle.

  Next, the operation flow of the cradle will be described.

  FIG. 3 is a diagram for explaining a rough operation flow of the cradle.

  There are two cradle operation modes, a cradle mode and a monitoring mode.

  The cradle mode is an operation mode when the camera is not mounted on the cradle, and the monitoring mode is an operation mode when the camera is mounted.

  The monitoring mode command refers to the camera control command (2) and the camera browse command (3).

  When the cradle is activated, initialization processing is performed in S301, and then it is confirmed whether or not the camera is mounted on the cradle, and the cradle mode operation S304 to the monitoring mode operation S305 are started.

  When the cradle mode operation S311 is started, initialization processing for the cradle mode (S421 to be described later) is performed, waiting for an event occurring in the cradle or waiting for a command from the operation display terminal (S313).

  In the present embodiment, the event means that the camera is attached to or removed from the cradle, the sensor is detected, has stopped, the state of the camera has changed, or the like.

  The commands are as described above. Here, if the event is that the camera is attached (S314), the monitoring mode operation is started (S315, that is, S331). If it is a session command (S316), the session start / end processing described in (1) Session command is performed.

  If the command is a monitoring mode command (S318), the command is not accepted because the camera is not mounted, and an error is returned to the operation display terminal (S319).

  When a command other than the monitoring mode command, that is, a camera setting command (4), a cradle browse command (5), or a cradle setting command (6) (S320), an operation corresponding to each command is performed (S321).

  If it is a sensor event, it is ignored in this mode (S323). If the power is OFF, the process is terminated (S325). Otherwise, other processes are performed (S326).

  On the other hand, when the monitoring mode operation S331 is started, a monitoring mode initialization process (S401 to be described later) is performed, and similarly to the cradle mode operation, an event generated in the cradle or a command from the operation display terminal is waited (S333). .

  Here, if the event is that the camera has been removed (S334), a warning that the camera has been removed is sent to all operation display terminals that have established sessions (S345), and operation in the cradle mode is started. (S336, that is, S421). If it is a session command (S337), the session start / end processing described in (1) Session command is performed (S338).

  If it is a monitoring mode command (S339), that is, if it is a camera control (2) or a camera browse command (3), the command is received and executed (S340).

  When a command other than the monitoring mode command, that is, a camera setting command (4), a cradle browse command (5), or a cradle setting command (6) (S341), an operation corresponding to each command is performed (S342).

  If it is a sensor event, event processing described later is performed (S344, FIG. 14). If the power is OFF, the process ends (S346). Otherwise, other processes are performed (S347).

  FIG. 4 is a diagram for explaining the initialization process of the cradle. The initialization process refers to a monitoring mode initialization process (S332) and a cradle mode initialization process (S312).

  In the monitoring mode initialization process S401, first, if the camera power is not turned on, the camera is turned on (S402), and a camera authentication process is performed to determine whether or not the camera ID (digital camera identifier) held by the camera is accepted by the cradle. (S403). Assume that the camera ID to be received is registered in advance on the cradle side.

  If there is no problem in authentication, cradle setting data is read from the camera (S404).

  Here, the cradle setting data is basically the same as the parameter of the cradle setting command, and is set and changed on the camera side using a GUI described later (FIG. 12).

  The items are the same as the items that can be set by the cradle setting command, and are IP address setting, notification destination email address, access permission address, password, preset, detection area, PT restriction range, and sensor setting.

  Since the content is the same as the cradle setting command, the description is omitted.

  If there is monitoring mode parameter data in the data storage unit 2-27 of the cradle described later, it is set as an optimal camera setting value and various shooting parameters for operating the camera in the monitoring mode.

  A phase for setting parameters (described later) for the monitoring mode for the camera (S406), and a phase for setting the camera itself to the monitoring mode (S407).

  Further, the camera button is invalidated so that it cannot be operated arbitrarily (S408), and the cradle setting data read from the camera in step S404 is set in the cradle and validated (S409). Further, the pan head position is initialized to the home position according to the cradle setting data (S410).

  Further, all connected operation display devices are notified that the monitoring mode has been set (S411), and the camera is set to the sleep mode (S412).

  Note that the sleep mode is a state in which shooting can be performed immediately after the camera is turned on. For example, the camera is turned off with the camera lens extended.

  In the browse mode initialization process S421, since the camera has been removed, the pan / tilt position of the camera platform is moved to a position where the camera can be mechanically easily mounted (S422), and all the operation display terminals connected to the camera are moved. Notification is made (S423).

  Note that the monitoring mode parameters are camera parameters that take into account the shooting conditions in consideration that the digital camera is used in a cradle instead of being held by hand, or an image is transmitted. Consists of.

[Image size and quality settings]
In the monitoring mode, the image size (resolution) is set small and the image quality is set low during normal shooting in consideration of communication.
However, in the continuous shooting mode, which will be described later, it is possible to set continuous shooting with a plurality of sizes and image quality.

[Drive mode setting]
Single or continuous shooting can be specified with a single release trigger. In addition, continuous shooting with different image sizes and image quality is possible.
During continuous shooting, the data to be transmitted to the operation display unit may be different from the image size / image quality held locally.

[Low-speed shutter setting]
The camera shake limit at the time of determining the exposure can be set lower than in hand-held shooting.

[Focus setting]
Focus setting method. By limiting the autofocus range on the assumption that it is used indoors, for example, the autofocus speed can be increased. Alternatively, such a setting may be used when the focal position may be fixed depending on the installation environment.

  FIG. 5 is a diagram illustrating cradle session command processing. The monitoring flow and cradle mode will be described with the same flow.

  When a connection request is received from the operation display terminal (S501), first, whether or not there is an access right is authenticated (S502). If there is no access right, an access right error is returned (S512). On the other hand, if access is possible, connection establishment processing is performed (S504) and registered in the address list (S505).

  The address list is a list including addresses of all operation display terminals that are currently connected.

  For example: IP address 1, IP address 2, IP address 3,..., IP address N (N is variable). Further, if it is in the monitoring mode, a response indicating that it is in the current monitoring mode is returned to the operation display terminal (S507), and it is checked whether the camera power is turned on. If not, it is turned on (S508). . If the camera is not in the finder acquisition mode, the finder acquisition mode is set (S509), and the finder image is continuously transmitted to the operation display terminal that requested the connection (S510).

  Accordingly, the finder image is transmitted along all the address lists to all connected operation display terminals.

  The finder acquisition mode is a state in which a finder image is acquired from the camera, and is a non-finder acquisition mode in a state in which the finder image is not sent to one operation display terminal.

  Here, if the monitor mode is not set, a finder image cannot be acquired because there is no camera, so the processing of S507 to S510 is unnecessary.

  However, it only returns a response indicating that it is in the cradle mode to the operation display terminal (S511).

  By the way, a finder image is an image to be displayed on a liquid crystal attached to a digital camera, and is an image displayed as a moving image at a low resolution when a high-resolution image of the camera is taken.

  It can be taken out from a digital camera as electronic data in a cradle.

  Next, when a disconnection request is received from the operation display terminal (S521), basically the reverse process of the connection request is performed.

  That is, if it is in the monitoring mode, transmission of the finder image is terminated (S523), and if there is no other connected operation display terminal, the finder acquisition mode is stopped (S525), and the camera is set to the pause mode (S526). . Further, the address of the operation display terminal that requested the disconnection regardless of the monitoring mode is deleted from the address list (S527).

  FIG. 6 is a diagram illustrating the start / end of camera control. Prior to issuing the camera control command (2) to the camera browse command (3), the operation display terminal must always acquire and hold the camera control right.

  Upon receiving the camera control right acquisition request (S601), the cradle first confirms the access right related to camera control (S602). Thereafter, if the operation display terminal is permitted to operate the camera, it is confirmed whether or not the camera control right can be obtained, that is, whether or not there is another operation display terminal having the camera control right (S604). .

  If the control right is available, the control right is given (S605), and the camera is mechanically locked to the cradle, thereby preventing the camera from being removed when the camera is going to be controlled (S606).

  If there is no vacancy in the control right, that is, if another control display terminal holds the control right, a control right wait response is returned (S607), and an order wait process is performed (S608, S609).

  The order waiting process is, for example, a process that is arranged in a queue for a certain period of time or a certain number of times and gives up if the order does not come.

  The control right granting system only needs to be operating, and since it is not essential here, detailed description is omitted.

  Finally, if the control right cannot be obtained, a control right acquisition error response is returned (S610) to notify the operation display terminal that the camera cannot be controlled.

  The operation display terminal that no longer requires the control right issues a control right release request.

  When the cradle receives this (S621), the camera's mechanical lock is released (S622), and the control right is released (S623). With such a mechanism, the operation from the multiple operation display terminal to the camera is arbitrated at the same time, and the camera is prevented from being removed during the camera control.

  FIG. 7 is a diagram for explaining processing of the camera control command (2) to the camera browse command (3). The camera control command or camera browse command is issued from the operation display terminal that has acquired the control right.

  When the camera control command (2) is received (S701), it is confirmed whether or not the operation display terminal that is the command transmission source holds the control right (S702, S703). Returns an error.

  If the control right is held, processing corresponding to the camera control command is performed (S704).

  Then, it returns to the operation display terminal as a response whether the result of the command processing is a success or an error (S705). Processing according to the camera control command is realized by issuing a PTP (Picture Transfer Protocol) command or a unique command corresponding to the camera control command to the camera 110 via the external IF control unit (USB).

  For example, in the case of a shutter release request, a release request PTP command is sent to the camera 110 to perform the same shooting process as when the release button of the camera is pressed, and the shot image is stored in the image storage unit 2-13 of the camera. Or the image storage unit 2-25 of the cradle. Note that it is possible to select an image storage unit 2-13 of the camera or an image storage unit 2-25 of the cradle with an argument of a camera control command.

  When the storage destination is not explicitly selected by an argument of the camera control command, the captured video is stored with restriction in the image storage unit 2-25 of the cradle.

  In the case of zoom control, the zoom of the digital camera is controlled by sending a zoom request PTP command to the camera 110.

  In the case of an exposure setting request, the exposure value of the camera at the time of shooting according to the next release request changes.

  In the case of a release half-press request, it means that the exposure, focus position, and the like at that time are held, as in the case of a manual shutter button half-press operation.

  The exposure, the focus position, and the like are held for a period until the next release half-press request is released or a release request is issued. The camera control command is not limited to this, but is omitted here.

  When the camera browse command (3) is received (S721), that is, when a request for browsing an image stored in the image storage unit 2-13 in the camera is received, the process is the same as the camera control command processing. Command execution is allowed only when the user has control right.

  The same is true in that whether the result of the command processing is successful or an error is returned to the operation display terminal as a response (S727).

  In limited storage, storage attributes such as access control, storage period, and erasure timing are automatically determined from the cradle settings and the internal state of the cradle.

  For example, the reference to the stored video is freely permitted, but the storage attribute is designated so that the stored video can be erased or rewritten only to the user of the operation display terminal that has started the shutter release request session.

  Further, at the timing when the camera 110 is removed, the restricted storage video is erased from the image storage unit 2-25 of the cradle.

  Further, when saving to the NAS 120, the video attribute is limited to the user group of the cradle 101, and the storage attribute for prohibiting erasure is designated and saved.

  In addition, when continuous shooting is designated in the drive mode setting, limited storage is applied to each video.

  Then, a part of the continuous shot video is stored in the NAS 120.

  FIG. 8 is a diagram for explaining the processing of the camera setting command (4).

  When the camera setting request is received, after confirming whether or not the access right exists (S802), if the setting is permitted (S803), it is confirmed whether or not the cradle is in the monitoring mode (S804).

  Since the camera is mounted on the cradle in the monitoring mode, if the control right is further held, the setting value is immediately set for the camera 110 (805), but if the control right is not held, Returns an error and returns to the operation display terminal that it is necessary to take control.

  When the monitor mode is not set, that is, when the camera is not attached to the cradle, the camera setting value is stored in the temporary storage area 2-27 of the cradle, and when the camera is attached next time, step S405 in the monitor mode initialization process. Is read and set in the camera 110.

  FIG. 9 is a diagram for explaining processing of the cradle browse command (5) and the cradle setting command (6).

  That is, after confirming the access right, the process according to the command is executed (S902).

  Since these two types of commands can be processed in the cradle, requests from a plurality of operation display terminals can be processed at the same time as long as there is no conflict between individual browse target files or setting items.

  This is because the process is the same as a normal multitasking OS. By the way, the access right is different for each command category, that is, for each session (1), camera control (2), camera browsing (3), camera setting (4), cradle browsing (5), and cradle setting (6). Rights can be set.

  For example, only camera owners can execute camera settings (4) and cradle settings (6).

  The access right setting method includes various restriction methods such as an address list and an address range, but is omitted here because it is not essential.

  FIG. 10 is a diagram for explaining a packet data format of a request command from the operation display terminal to the cradle.

  Next, the operation flow of the camera will be described.

  On the camera 110 side, as described above, control corresponding to camera control, camera browsing, and camera setting is performed via USB.

  Since these are PTP compliant methods, explanations are omitted.

  When the shutter is manually released by operating a dedicated remote controller of the camera 110 (infrared or wireless LAN is typically used) while the cradle 101 is mounted, the camera control request for the shutter release shown in FIG. It is processed in the same way.

  The same is true in that the save destination can be specified explicitly.

  However, the processing when not explicitly specified is different. In the case of a manual shutter release (sometimes referred to as a local shutter), it is stored in both the image storage unit 2-13 of the camera and the image storage unit 2-25 of the cradle.

  If any of the storage capacities is insufficient, the limited video data is moved to the NAS 120, the capacity is secured and saved.

  At this time, for the video data to be moved to the NAS 120, a thumbnail video is created, and the link information to the destination NAS 120 is associated with the thumbnail video and stored on the cradle side.

  FIG. 11 is a diagram for explaining the operation of the camera 110 when the camera 110 is detached from the cradle 101.

  When the camera is removed from the cradle, the removal is detected on the camera side, the camera setting in the monitoring mode is canceled (S1102), the disabled button is enabled (S1103), the lens is retracted, and the power is turned off. (S1104).

  FIG. 12 is a diagram illustrating a cradle setting operation using a camera. FIG. 12 is an operation panel surface of the camera 110.

  Reference numeral 12-1 denotes a camera (back side), and 12-2 denotes a display panel, which includes an LCD.

  12-3 are operation switches (details of arrangement and functions are omitted), 12-4 is a release button, and 12-5 is a power switch.

  Using the display panel 12-2 and the operation switches 12-3, the camera 110 has an operation GUI that can change the setting equivalent to the cradle setting command (6) in addition to the normal camera setting operation. Prepare.

  When the user switches to the cradle setting mode GUI while the camera is turned off and the camera is turned on, a cradle setting GUI such as 12-2 is displayed.

  The cradle setting items are arranged on the GUI so that they can be selected using the operation switch 12-3.

  Further, when each item for cradle setting is selected, a panel for setting a value for each item is displayed, and the value is set.

  For example, when “access right” is selected as an item, an address list and a command category for which access is permitted are displayed, and an allowed address can be added and edited, and a command category for access permission can be selected. If “PT control range” is selected, the pan / tilt operation range can be limited, and therefore the pan / tilt angle range can be input / changed.

  The cradle setting value set here is used when acquiring cradle data from the camera in step S404 in the monitoring mode initialization process.

  Note that the method for inputting the set value to the camera 110 is not limited to the GUI on the display panel, but may be a method using an operation switch or two-dimensional code photographing.

  When the cradle is set so as not to allow the cradle setting command (6) from the operation display terminal, the cradle setting can be limited to the camera.

  As a result, various settings over the network can be prevented, so that safer operation can be performed.

  FIG. 13 is a diagram illustrating processing on the operation display terminal side. FIG. 13 shows a screen example of the operation display terminal.

  In this example, an operation display terminal side capable of performing GUI operation using a mouse / keyboard such as a PC is assumed.

  The operation display terminal issues the command described above to the cradle, and performs the cradle or camera operation.

  Reference numeral 13-1 denotes a finder image display unit, 13-2 denotes a camera operation panel, 13-3 denotes an image display unit, and 13-4 denotes an image browse panel.

  A finder image is displayed on the finder image display unit 13-1.

  The camera operation panel 13-2 includes a control right acquisition button 13-21, an operation end button 13-22, a release button 13-23, a release half-press ON / OFF toggle switch 13-24, and a zoom scroller 13-25. ing. Furthermore, pan / tilt control buttons 13-26 to 13-29 are also provided.

  The image display unit 13-3 displays a high-resolution image acquired from the camera.

  The image browsing panel 13-4 browses images in the camera or cradle using the thumbnail image list 13-43.

  Reference numerals 13-41 and 13-42 denote toggle switches for selecting whether to browse an image of the cradle or the camera.

  When the connection application software having the operation screen as shown in FIG. 13 is started from the operation display terminal by specifying the address of the cradle of the connection destination (may be specified after the start), the connection processing is performed according to the procedure described so far. Do. Then, a finder image of the camera 110 is acquired and displayed on 13-1.

  If the control right can be acquired by further pressing the control right button 13-23, the pan / tilt angle and the zoom value are displayed on the finder image 13- using the zoom scroller 13-25, the pan / tilt control buttons 13-26 to 13-29, and the like. It can be changed while looking at 1 and an appropriate control value can be designated.

  If necessary, the user locks the exposure and focus by pressing the shutter button halfway at 13-24, and further changes the pan / tilt angle and zoom value, and then presses the release button 13-23 to shoot.

  The captured image is temporarily stored in the camera or cradle according to the setting item, but is further transmitted to the operation display terminal and displayed on the image display unit 13-3.

  In addition, when browsing an image in the camera, when the control right is acquired by the control right button 13-21 and the camera button 13-42 is pressed, the image icon (thumbnail image) in the camera is changed to 13-4. You can browse above.

  Here, when a required image icon is double-clicked, it is displayed in detail as a high-resolution image on the image display unit 13-3.

  Note that the cradle button 13-41 can be selected regardless of the holding state of the camera control right, and browsing of image icons in the cradle and high-resolution image detail display are possible.

  It should be noted that the response from the operation display terminal at the time of connection (steps S507 and S511) determines whether the cradle is in the monitoring mode or the cradle mode, and displays on the finder image display unit 13-1 and the camera operation panel 13-2. The state changes.

  That is, in the monitoring mode, the GUIs 13-1 and 13-2 are displayed, but in the cradle mode, they are unnecessary, so they are invalidated or the 13-1 and 13-2 GUIs themselves are displayed. Do not.

  In addition, since a response is returned from steps S411 and S423 even when the camera is removed or attached, the state of the cradle mode and the monitoring mode of the cradle is similarly determined, and the GUI of the operation display terminal is determined. Is changing.

  FIG. 14 is a diagram for explaining an automatic operation when a cradle sensor event is detected. For example, when a sensor event occurs in the monitoring mode.

  In FIG. 14, two operations of motion detection 14-1 and tracking 14-2 will be described.

  First, sensor event processing 14-1 in motion detection will be described.

  If there is a sensor event (S1401), after confirming the locked state of the camera to the cradle, it is set to the locked state (S1402), and the camera power supply is turned on from the sleep mode (S1403). Further, the motion detection process is turned on (S1404).

  The motion detection process is a process of detecting the presence or absence of motion, for example, by so-called inter-frame difference processing that obtains a funder image and calculates a difference between the previous image frame and the current image frame.

  Furthermore, according to the position where the movement has occurred, an appropriate ranging point is set out of the ranging points for automatic focusing of a plurality of cameras (S1404), and the release of the camera is controlled to perform high-resolution shooting. The image is accumulated in the cradle or camera (S1406).

  The above is repeated until no motion is detected for a certain time (S1407). When no motion is detected, the motion detection process is turned off (S1408), the camera is set to the sleep mode (S1409), the lock state is released (S1410), and the sensor event process is terminated.

  It should be noted that here, it is not limited to the motion detection algorithm, and it is sufficient that the motion can be detected from the image.

  Next, the tracking 14-2 operation will be described. This is substantially the same as 14-1, except that the pan / tilt operation is temporarily stopped until the release is completed in order to prevent blurring of the imaging system due to the tracking process (S1425).

  The tracking algorithm is not particularly limited here, but for example, tracking may be performed based on the motion detection processing of 1404 so that the point where the motion has occurred is the center, or the target object is detected from the image. Tracking processing may be performed so that the detected object becomes the center.

  In any case, both the motion detection process 14-1 and the tracking process 14-2 are performed in the cradle using the camera's funder image.

  Here, the video captured by the automatic operation is stored in the same manner as when the storage destination is not explicitly specified by the shutter release camera control request of FIG.

  However, the difference is that storage attributes such as access control, storage period, and erasure timing in limited storage are determined by the cause event of automatic shooting.

  For example, the video imaged by the motion detection event is stored in both the NAS 120 and the image storage unit 2-25 of the cradle.

  However, the video stored in the cradle is temporarily stored until it is taken out by the cradle browse command (5).

  Also, the video shot by the timer event is stored only in the NAS 120 and is not stored in the image storage unit 2-25 of the cradle.

  By the way, in the above explanation, the case where there is no control from the operation display terminal is explained, but even if there is a sensor event during the control on the operation display terminal, the control from the operation display terminal is interrupted and forced. Specifically, the operations 14-1 to 14-2 may be performed.

  Conversely, an embodiment in which the operations 14-1 to 14-2 are suppressed during the control of the operation display terminal is also conceivable.

  With the above configuration, the video communication apparatus configured to be detachable from the imaging unit can appropriately perform video communication and video storage according to the type and situation of the imaging operation.

  In particular, the present embodiment is characterized in that the imaging unit is configured by a widely used digital camera, and the video communication device is configured as a cradle for the digital camera.

  In addition, the result of shooting by automatic shooting, the result of video shooting requested by the communication function, and the result of shooting by manual shooting are stored at an appropriate timing and in an appropriate storage location with an appropriate storage attribute. There is a feature.

  In this embodiment, an example in which a digital camera is used as the imaging unit connected to the cradle is described, but the imaging unit is not limited to a digital camera.

  It is easy to imagine using a digital video camera (camcorder), USB camera, or IEEE1394 camera.

  Also, the connection method between the cradle and the camera is not limited to USB.

  For example, it can be easily considered that video is easily transferred by connecting with a wider-band unique interface.

  In the present embodiment, an example is described in which the direct operation of the buttons and switches provided in the camera 110 is suppressed by the processing in step S408. However, it is possible to easily imagine an embodiment in which the shutter is released by the direct operation of the buttons and switches provided in the camera 110 as in the case of the operation by the dedicated remote controller.

  In this case, as with the description of the manual shutter release operation according to the present embodiment, the captured video is recorded by both the image storage unit 2-13 of the camera and the image storage unit 2-25 of the cradle. Saved in.

  Furthermore, it is considered that the user's intention is more strongly reflected in the shutter operation by the switch or button operation on the camera than the shutter operation by the remote controller. Therefore, it can be easily imagined that an LED display or an LCD display on a camera or a cradle appeals that the storage area is insufficient for more reliable video storage.

  In the present embodiment, an example is described in which video captured by the camera 110 is temporarily stored in the image storage unit 2-13 of the camera 110 itself. However, it is also conceivable that the image is directly transferred from the image compression unit 2-12 to the cradle via the external IF control unit 2-16 without going through the image storage unit 2-13 of the camera 110 itself.

  In this case, it is easy to manage storage and deletion of the captured video on the cradle side without being restricted by the capacity limitation of the image storage unit 2-13 of the camera 110 itself.

[Second Embodiment]
In the second embodiment, as in the first embodiment, an example in which a video communication device configured to be detachable from the imaging unit appropriately performs video communication and video storage according to the type and situation of the imaging operation will be described. .

  The same is true in that the imaging unit is configured by a widely used digital camera, and the video communication device is configured as a cradle for the digital camera.

  In the present embodiment, the result of automatic shooting, the result of video shooting requested by the communication function, and the result of shooting by manual shooting are stored in the video data as information on the respective shooting causes. Based on the information in the video data, the image data is stored in an appropriate storage destination with an appropriate storage attribute at a timing other than imaging. This is the main feature of this embodiment.

  In the present embodiment, the network connection mode, hardware configuration, and the operation of each software are the same as described in the first embodiment.

  However, the video data storing operation at the time of video shooting described in the operation flow of FIGS. 7 and 14 and the camera 110 and the camera removing operation of FIG. 3 are different from those of the first embodiment.

  In the present embodiment, the following items are executed in the video data storing operation at the time of video shooting described with reference to FIGS. 7 and 14 and the operation flow of the camera 110. That is, (a) remote shooting performed by a camera control command from an external device, (b) automatic shooting performed by sensor event or motion detection, and (c) manual shutter release by a button on the camera 110, etc. Make a distinction. Then, after being incorporated in the file format of the video data, the video data is stored in the image storage unit 2-25 of the cradle with a temporary storage designation.

  Here, the file format of the video data is the JFIF file format if it is a JPEG still image (photo video), and the mp4 file format (ISO 14496: part-1) if it is an MPEG-4 moving image video. .

  In the JFIF file format, in the application specific field, the identification of the photographing factor is described following the identifier indicating the cradle.

  In the mp4 file format, similarly, the user data ("udat" box) describes the distinction of the photographing factor following the identifier indicating the cradle.

  In the camera removal operation (step S345) in FIG. 3 in the present embodiment, video data temporarily stored in the image storage unit 2-25 of the cradle 101 in addition to sending a warning to the connected operation display terminal. Is transferred to an appropriate storage destination with an appropriate storage attribute.

  That is, the storage destination and the storage attribute are selected based on the photographing factor distinction information included in the video data.

  The selection of the storage destination and the storage attribute may be the same as in the first embodiment.

  With the above configuration, the video communication apparatus configured to be detachable from the imaging unit can appropriately perform video communication and video storage according to the type and situation of the imaging operation.

  In the present embodiment, the imaging unit is configured by a widely used digital camera, and the video communication device is configured as a cradle for the digital camera.

  In the present embodiment, the result of automatic shooting, the result of video shooting requested by the communication function, and the result of shooting by manual shooting are stored in the video data as information on the respective shooting causes. Based on the information in the video data, the image is stored in an appropriate storage destination with an appropriate storage attribute when the camera 110 is removed.

  In the present embodiment, when the camera 110 is removed from the cradle 101, the storage destination of the video data stored in the cradle is determined, but this is not limited to the removal time.

  For example, the storage destination determination process may be executed by a periodic operation using a timer.

  Further, the storage destination determination process may be executed by a cradle operation command from the operation display terminal.

  In this embodiment, an example in which the shooting factor distinction is stored in the cradle's original format when the JPEG still image (photo image) is stored in the JFIF file format is described for the sake of simplicity. However, it can be easily imagined that the application specific field portion is stored in the EXIF format.

  In this case, the photographing factor distinction can be recognized even by a general photo browser or image viewer corresponding to the EXIF format.

  In addition, in this embodiment, an example in which only shooting factor distinction is incorporated into video data has been described. However, when a plurality of shooting factors are duplicated, those shooting factors are incorporated into video data in parallel and are stored. It can be easily imagined.

  For example, in the video data obtained as a result of simultaneously requesting remote shooting and automatic shooting, it is considered that the video data is more important than normal remote shooting and automatic shooting. Therefore, in addition to storing the video in the cradle, a notification means such as a mail notification or a mobile phone notification is separately executed to notify the administrator or the operation manager.

  In this embodiment, for the sake of simplicity, an example in which a storage destination and storage attributes are selected is described as in the first embodiment. However, selection of a storage destination and storage attributes is not limited to this. It is not limited.

  These items may be set by the cradle setting command (6) as cradle setting items.

  Also, shooting factors are not limited to automatic shooting, remote shooting, and manual shooting. For example, photographing at the timing when the camera 110 is attached to and detached from the cradle 101 is also conceivable. Similarly, the timing for determining the storage destination of the video data stored in the cradle is not limited to the camera 110 removal timing. For example, the timing when the remaining amount of the storage area in the cradle becomes below a certain level, the timing when the storage destination determination command is received from the operation display terminal, and the like can be considered.

  It can be easily imagined that these options are combined and set by the cradle setting command (6).

  In the present embodiment, an example in which the photographing factor distinction is incorporated into the file format of the video data is described, but this is not limited to the file format.

  For example, it can be easily imagined that shooting factor distinction is incorporated as attribute information on a file system or database. On the other hand, there may be a case where shooting factor distinction is incorporated into video data itself, such as a watermark.

  Further, not only the storage attribute but also the photographing factor distinction may be reflected in the communication.

  For example, when a video is delivered by the HTTP method, it is easy to imagine providing a photographing factor distinction as HTTP header information.

  In the present embodiment, an example is described in which the cradle side determines the storage destination and the storage attribute only for the video shot in combination with the cradle. However, a means for determining a storage destination and a storage attribute may be provided for a video photographed by the camera 110 alone.

  The embodiment of the present invention can be realized by, for example, a computer executing a program. Also, means for supplying a program to a computer, for example, a computer-readable recording medium such as a CD-ROM recording such a program, or a transmission medium such as the Internet for transmitting such a program is also applied as an embodiment of the present invention. Can do. The above program can also be applied as an embodiment of the present invention. The above program, recording medium, transmission medium, and program product are included in the scope of the present invention.

It is the figure which showed the typical usage pattern using this invention. It is the figure which showed an example of the functional block structure of a camera and a cradle. It is a flowchart which shows the schematic flow of a cradle. It is a flowchart which shows the monitoring mode initialization process and the cradle mode initialization process. It is a flowchart which shows the process of a session command. It is a flowchart which shows the process of a camera control command. It is a flowchart which shows the process of a camera control command and a camera browse command. It is a flowchart which shows the process of a camera setting command. It is a flowchart which shows the process of a cradle browse command and a cradle setting command. It is a figure which shows the packet data format of a command. It is a flowchart which shows the camera side process when a camera is removed. It is a figure which shows the operation panel surface of a camera, and a cradle setting operation screen. It is a figure which shows the screen of an operation display terminal. It is a flowchart which shows the process at the time of sensor event generation | occurrence | production.

Explanation of symbols

101: Cradle 102, 103: Operation display terminal 110: Digital camera 120: NAS
150: Network

Claims (16)

A video communication device configured to be detachable from the imaging unit,
A shooting classification means for identifying the type of video shooting operation;
A storage method selection means for selecting a storage method of the captured video;
A video communication apparatus comprising: a storage execution unit that stores video.   The shooting classification means includes at least remote shooting for shooting based on a shooting request from another device connected to the network, manual shooting for shooting by operating a button or a switch of the imaging unit, and automatic shooting based on the judgment of the video communication device. The video communication apparatus according to claim 1, wherein any one of shooting is classified.   The video communication apparatus according to claim 1, wherein the storage execution unit is a shooting attribute simultaneous storage execution unit that stores a type of video imaging operation together with a video.   4. The video communication apparatus according to claim 3, wherein the shooting attribute simultaneous storage execution unit is a file shooting attribute simultaneous storage execution unit that incorporates a type of video imaging operation into a video file.   5. The video communication apparatus according to claim 4, wherein the file shooting attribute simultaneous storage execution unit is incorporated in a file format.   5. The video communication apparatus according to claim 4, wherein the file shooting attribute simultaneous storage execution unit is incorporated in a file system attribute or a database attribute.   4. The video communication apparatus according to claim 3, wherein the photographing attribute simultaneous storage execution unit is incorporated in a communication attribute.   The video communication apparatus according to claim 3, wherein the shooting attribute simultaneous storage execution unit incorporates a plurality of types of video imaging operations together when a plurality of types of video imaging operations overlap.   The video communication apparatus according to claim 1, wherein the save execution unit operates to save a file attribute at the same time as saving the video itself.   The video communication apparatus according to claim 1, wherein the storage execution unit is a composite storage execution unit including an operation of another file at a storage destination.   11. The video communication apparatus according to claim 10, wherein the composite storage execution unit deletes another file.   The video communication apparatus according to claim 1, wherein the storage execution unit stores the data in another device connected to a network.   The video communication apparatus according to claim 1, wherein the storage destination and storage attribute of the video data are changed at a second timing other than the imaging timing.   The video communication apparatus according to claim 13, wherein the second timing is at least one of an attachment / detachment timing of the imaging unit and a timing when the accumulation amount reaches a certain amount. A video communication method using a video communication device configured to be detachable from an imaging unit,
A shooting categorization process that identifies the type of video imaging operation;
A storage method selection step for selecting a storage method of the captured video;
A video communication method comprising: a storage execution step for storing video. A program for causing a computer to execute video communication using a video communication device configured to be detachable from an imaging unit,
On the computer,
Shooting classification procedure for identifying the type of image capturing operation,
A storage method selection procedure for selecting a storage method for the captured video;
A program for executing a storage execution procedure for storing video.

Images