JP2006025376A - Imaging apparatus and processing server - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To improve convenience relating to imaging by utilizing for a processing in mobile equipment a processing result that complicated processing relating to imaged video is performed without adding any function to the mobile equipment including an animation imaging function to damage small-sizing and weight reduction. <P>SOLUTION: Image information imaged by an imaging section 11 of a camera integrated recording and reproducing device (mobile equipment) 10 is transmitted through a network 60 to a server 70 by a transmitting/receiving section 15. In the server, it is judged by recognizing processing by an object recognition processing section 72 whether a desired object projected in a reference image stored in a registration image database 73 beforehand is imaged at present, and a control command according to a result of the judgement is sent back. For example, if the desired object is not imaged at present, a control command is generated to perform an action such as zooming-out or panning/tilting, and the desired object is searched. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an imaging apparatus and a processing server for imaging a desired target object.

  In recent years, mobile devices having a moving image capturing function such as a digital video camera and a mobile phone with a moving image capturing function have become popular, and everyone can easily enjoy moving image capturing.

  Further, for example, in Patent Document 1 below, images are always taken by a surveillance camera or the like, for example, a predetermined subject (pet) is automatically identified by an image processing unit, and behavior information indicating the behavior of the subject is recorded. A pet monitoring system that can be used is disclosed. In addition to ensuring that imaging is always performed by the imaging means, a sensor is installed in the vicinity of the imaging means, and imaging is performed only when the sensor detects that a pet that can be a subject is within the imaging range. A configuration to do so is also disclosed.

Further, for example, in Patent Document 2 below, a CCD apparatus having a fisheye lens with a wide viewing angle, a transmission means for transmitting an image captured by the CCD apparatus, and an image from the transmission means via the Internet or the like are received. There is disclosed a remote image recognition system that is configured by a computer device, and that allows the computer device to convert a video image (curved surface image) captured by a CCD device into a planar image and output it.
Japanese Unexamined Patent Publication No. 2003-85 (FIGS. 1, 2, paragraphs 0016-0029) Japanese Patent Laying-Open No. 2003-69990 (FIG. 1, paragraphs 0015-0030)

  However, when performing continuous image capturing using a mobile device (for example, a digital video camera) having a conventional moving image capturing function, the person (user) who captures the image may participate in the event for tracking the subject. There is a problem that the opportunity to become a subject becomes very small. In addition, for example, in an event where a large number of persons move around in a complicated manner (for example, an athletic meet), there is a possibility of losing sight of the target subject by visual observation alone. Even if it is added, the certainty of capturing the target subject is expected to be low. On the other hand, in order to reduce the size and weight required for mobile devices and reduce costs, it is not preferable to add new high-performance processing means for performing complex processing to mobile devices. .

  In addition, according to the techniques disclosed in Patent Documents 1 and 2 described above, it is possible to supply video captured by a camera to a predetermined computer via a network or the like, and to process the computer. There is no suggestion of using this processing result to change the imaging mode of the imaging unit or to provide useful information to a user who uses the imaging unit.

  In order to solve the above-described problems, the present invention enables complex processing related to a captured image to be performed without adding a function that impairs reduction in size and weight to a mobile device having a moving image capturing function, and the processing result. It is an object of the present invention to provide an imaging apparatus and a processing server for improving convenience related to imaging by reflecting the above in processing in a mobile device.

In order to achieve the above object, according to the present invention, imaging means;
Shooting information creation means for creating information relating to shooting by the imaging means;
Signal transmission means for transmitting the photographing information created by the photographing information creating means and ID information for specifying the imaging device or the photographer to a predetermined server;
Control information obtained as a result of processing performed using the imaging information by the predetermined server, and signal receiving means for receiving from the predetermined server,
An imaging apparatus configured to control its operation according to the control information is provided.

  Furthermore, according to the present invention, in addition to the above-described invention, there is provided an imaging apparatus characterized in that the imaging information includes an image signal captured by the imaging means.

Furthermore, according to the present invention, in addition to the above invention, reference information creating means for creating reference information;
Reference information transmitting means for transmitting the reference information to the predetermined server,
The control information is obtained by a process using the reference information and transmission information in the predetermined server, and an imaging apparatus is provided.

Furthermore, according to the present invention, in addition to the above invention, the image signal picked up by the image pickup means is recorded on a recording medium.
An image pickup apparatus characterized in that an image signal included in the shooting information transmitted to the predetermined server is an image signal obtained by taking an image with the image pickup unit and having a reduced amount of information with respect to the image signal used for recording. Provided.

In order to achieve the above object, according to the present invention, a processing server capable of communicating with an imaging device,
A reference information database for storing reference information together with the ID information identifying the imaging device or its user;
Shooting information receiving means for receiving shooting information generated by the imaging device and accompanied by ID information from the imaging device;
Control information creating means for calling up the reference information corresponding to the received ID information and creating control information by processing using the reference information and the imaging information;
Control information transmitting means for transmitting the control information to the imaging device;
A processing server is provided.

  An imaging apparatus and a processing server according to the present invention have the above-described configuration, and are related to a captured image without adding a function that impairs reduction in size and weight to an imaging apparatus (mobile device) having a moving image imaging function. By performing complicated processing and reflecting the processing result in the processing in the imaging apparatus, there is an effect that convenience related to imaging is improved. In particular, the target subject recognition processing (image recognition processing) is left to the server, and a control command corresponding to the processing result is received from the server, whereby the imaging device identifies the subject related to imaging and searches for the subject. Tracking is possible.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  First, an outline of the present invention will be described. The present invention provides a server that performs complicated processing such as a subject recognition function for specifying a target subject (desired subject) when capturing a moving image with a camera-integrated recording / reproducing apparatus (for example, a digital video camera). In other words, only this processing result can be received from the server and used. That is, the camera-integrated recording / reproducing apparatus can acquire the processing result of the subject recognition function (for example, face recognition processing, contour recognition processing, etc.) with the help of the server while maintaining the small size and light weight.

<First Embodiment>
First, a first embodiment of the present invention will be described. FIG. 1 is a diagram showing an example of a system configuration in the first embodiment of the present invention. FIG. 1 shows a camera-integrated recording / reproducing device (imaging device, mobile device) 10, a pan head (imaging device support device) 50, a network 60, and a server (image recognition processing server) 70. Although only one camera-integrated recording / reproducing apparatus 10 is shown here, the server 70 can perform control and management related to a plurality of camera-integrated recording / reproducing apparatuses 10. The camera-integrated recording / reproducing apparatus 10 and the camera platform 50 may be collectively referred to as an imaging side or an imaging system.

  A camera-integrated recording / playback apparatus 10 shown in FIG. 1 includes an imaging unit 11, a signal processing unit 12, a recording / playback unit 13, a transmission information signal generation unit 14, a transmission / reception unit 15, various sensors 16, a zoom unit 17, and a microprocessor 18. , An operation unit 19, a display unit 20, a connection unit 21, and an internal bus 25 for connecting these components. Here, a description will be given by taking as an example a camera-integrated recording / reproducing apparatus 10 such as a digital video camera capable of recording information acquired by imaging on a recording medium and reading and reproducing the information from the recording medium. However, it is not always necessary to have a playback function or a recording function, and it may be a camera-integrated recording apparatus that does not have a playback function, a network camera that does not have a recording / playback function, a surveillance camera, or the like. In addition, as the camera-integrated recording / reproducing apparatus 10 shown in FIG. 1, a mobile phone having a moving image capturing function can be used.

  The imaging unit 11 is a means for imaging an external scenery or a person (subject) that is configured by a lens or the like. The signal processing unit 12 is a unit that performs processing related to the signal output from the imaging unit 11, and includes, for example, a unit that converts an optical signal into an electrical signal. In other words, the imaging unit 11 and the signal processing unit 12 are imaging units that take an image of an external scenery or a person and output the imaging information (including moving image information, still image information, and audio information) as an electrical signal. Although not shown here, an audio acquisition unit that acquires external audio and generates an audio signal synchronized with the imaging information may be provided in accordance with imaging by the imaging unit 11.

  A signal (a signal including imaging information) processed by the signal processing unit 12 is output to the recording / reproducing unit 13 and the transmission information signal generating unit 14. For the sake of clarity, the signal processing by the recording / reproducing unit 13 is referred to as signal processing A, and the signal processing by the transmission information signal generating unit 14 and the transmitting / receiving unit 15 is referred to as signal processing B.

  The recording / reproducing unit 13 performs signal processing A on the signal supplied from the signal processing unit 12 to convert the signal into a recording signal to a recording medium (tape, disk, memory, etc.), and the converted signal It is means for recording on a recording medium. That is, the recording / reproducing unit 13 records the imaging information on a predetermined recording medium.

  On the other hand, the transmission information signal generation unit 14 is a means for performing signal processing B on the signal supplied from the signal processing unit 12 so that imaging information and other information can be transmitted to the server 70 through the network 60. is there. The transmission information signal generation unit 14 generates a transmission information signal having a predetermined format based on the signal supplied from the signal processing unit 12, and outputs the generated transmission information signal to the transmission / reception unit 15.

  The transmission / reception unit 15 receives the above-described transmission information signal from the transmission information signal generation unit 14, transmits the transmission information signal to the server 70 through the predetermined network 60, and transmits a predetermined command (described later) from the server 70. Zoom control command, pan control command, tilt control command, etc.). The communication for the transmission / reception unit 15 to connect to the network 60 is preferably wireless communication, but may be wired communication.

  The various sensors 16 are external environment information acquisition functions for performing imaging suitable for an external environment such as focus adjustment and aperture adjustment of a captured image. In the present invention, it is possible to mount arbitrary functions as the various sensors 16.

  The zoom unit 17 is a means for adjusting zoom-in and zoom-out. In addition, it is desirable that, for example, the focus adjustment is automatically performed in conjunction with the zoom-in and zoom-out by the zoom unit 17.

  The microprocessor 18 is a control means for performing control and signal control of each component of the camera-integrated recording / reproducing apparatus 10. It should be noted that by executing a predetermined program by the microprocessor 18, various controls relating to the camera-integrated recording / reproducing apparatus 10 can be performed.

  The operation unit 19 is a means for the user of the camera-integrated recording / reproducing apparatus 10 to perform manual operation. With this operation unit 19, for example, the user can issue an instruction to start or end imaging with the camera-integrated recording / reproducing apparatus 10. The display unit 20 is a monitor for displaying an image captured by the imaging unit 11 and a reproduced image of information recorded on a predetermined recording medium, and can be realized by, for example, a liquid crystal display or a viewfinder. It is.

  The connection unit 21 is a connection interface that enables connection with an external device. For example, the connection unit 21 can be realized by an inter-device connection interface such as IEEE1394 or USB. Here, it is connected to an electric circuit in the camera platform 50 that supports the camera-integrated recording / reproducing apparatus 10.

  The camera platform 50 connected to the connection portion 21 of the camera-integrated recording / reproducing apparatus 10 is electrically connected to the camera-integrated recording / reproducing apparatus 10 and serves as a support means for supporting the camera-integrated recording / reproducing apparatus 10. It also has a function. The pan head 50 has a drive unit 51. The drive unit 51 is based on a drive signal (specifically, a pan control signal or a tilt control signal described later) supplied from the camera-integrated recording / reproducing device 10 via the connection unit 21. 10 is a means capable of changing the imaging direction. For example, the drive unit 51 includes a motor that can rotate the main body of the camera-integrated recording / reproducing apparatus 10 in the horizontal direction or the vertical direction based on the drive signal.

  On the other hand, the network 60 is a communication medium that relays communication between the camera-integrated recording / reproducing apparatus 10 and the server 70, and is realized by, for example, the Internet or a LAN. Note that the network 60 is not limited to a wide area network, and may be configured such that the camera-integrated recording / reproducing apparatus 10 and the server 70 are directly connected via, for example, an IEEE 1394 cable or a USB cable.

  The server 70 also includes a communication unit 71, a subject recognition processing unit 72, a registered image database 73, and a command generation unit 74. The communication unit 71 is a means for communicating with the camera-integrated recording / reproducing apparatus 10 via the network 60. With this communication unit 71, the server 70 receives the transmission information signal from the camera-integrated recording / reproducing device 10 and transmits the predetermined command generated by the command generating unit 74 to the camera-integrated recording / reproducing device 10. It becomes possible to do.

  The subject recognition processing unit 72 is a means for performing image analysis of the image information captured by the camera-integrated recording / reproducing apparatus 10 included in the transmission information signal and image analysis of the reference image to specify the person of the subject. . In the subject recognition processing unit 72, for example, subject face recognition processing is performed from the subject image included in the transmission information signal, and is included in the reference image registered in the registered image database 73 and the transmission information signal. A comparison process with the subject image is performed, and it is determined whether or not the subject matches the person shown in the reference image. Note that the subject recognition processing unit 72 desirably has a high recognition processing function, and recognizes a target subject even with low-resolution image information, and determines a target subject from image information in which a large number of objects are captured. It is desirable to implement a function capable of reliably recognizing, and in particular, it is desirable to implement a face recognition technology with high recognition reliability and reliability.

  The registered image database 73 is a database for storing a reference image that is referred to when the subject recognition processing unit 72 specifies a subject person. Note that the reference image needs to be stored in advance in the registered image database 73 before the subject recognition processing unit 72 specifies the subject person. Further, a plurality of reference images may be registered in the registered image database 73. For example, the reference image is registered in the registered image database 73 as schematically shown in FIG.

  The command generation unit 74 is a unit that generates a command for controlling an imaging mode in the camera-integrated recording / reproducing apparatus 10 in accordance with a processing result related to person identification by the subject recognition processing unit 72. Specifically, the command generation unit 74 generates a zoom control command (zoom-in signal and zoom-out signal), a pan control command, and a tilt control command (pan control signal and tilt control signal).

  Next, reference image registration processing to the registered image database 73 that needs to be performed before subject identification of the subject in the subject recognition processing unit 72 will be described with reference to the flowchart of FIG. FIG. 2 is a flowchart showing an example of processing on the camera-integrated recording / reproducing apparatus side when registering a reference image in the registered image database according to the first embodiment of the present invention.

  First, in the camera-integrated recording / reproducing apparatus 10, a reference image registration start operation is performed by the user (step S101). Specifically, the registration start operation is an operation for selecting an image to be registered as a reference image. For example, the user captures a subject to be registered as a reference image, thereby acquiring an image in which the subject is captured, or displaying an image recorded in advance on the recording medium on the display unit 20 while the desired subject is displayed. It is possible to select an appropriate captured image as a reference image.

  When an image to be registered as a reference image is selected in step S101, an image ID and a device ID are added to the reference image (steps S103 and S105). This image ID is added so that a specific image can be identified even when a plurality of images are registered in the server 70 as reference images. It is possible to identify an image in which each of the images is captured, that is, identify each of a plurality of subjects. The device ID is information for identifying the camera-integrated recording / reproducing device 10, and by adding the device ID, the plurality of camera-integrated recording / reproducing devices 10 are selected on the server 70 side, and the reference image is selected. Can be managed.

  When a transmission operation is performed in the camera-integrated recording / reproducing apparatus 10 (“Yes” in step S107), information on a set of reference image, image ID, and device ID (reference image + image ID + device ID information) ) Is transmitted to the server 70 (step S109). The server 70 that has received the information of reference image + image ID + device ID performs reference image registration processing based on these information.

  FIG. 3 is a diagram schematically showing a state in which the reference image is registered in the registered image database according to the first embodiment of the present invention. In the registered image database 73 of the server 70, reference images are managed for each device ID (device IDs: 0001, 0002... Shown in FIG. 3). Further, in relation to each device ID, a reference image is managed for each image ID (image IDs shown in FIG. 3: N001, N002, N003...). Therefore, for example, a desired reference image is specified from the set of image ID and device ID so that the reference image data001 is specified from the set of device ID: 0001 and image ID: N001.

  When the registration of the reference image is completed, the server 70 returns registration completion information to the camera-integrated recording / reproducing apparatus 10. If registration of the reference image cannot be completed, error occurrence information is returned to the camera-integrated recording / reproducing apparatus 10. When the camera-integrated recording / reproducing apparatus 10 receives the registration completion information from the server 70 (“Yes” in step S111), the preparation for the server assistance function is completed (step S113). On the other hand, when the registration completion information cannot be received from the server 70 even if a predetermined time has elapsed since the transmission of the reference image + image ID + device ID information (when time is over), or error occurrence information is received from the server 70 If so ("Yes" in step S115), a message is displayed using the display unit 20 or the like to notify that (step S117), and the reference image + image ID + device ID information is transmitted again. To be done.

  With the processing shown in the flowchart of FIG. 2 above, in the registered image database 73 of the server 70, a plurality of reference images can be registered for the same device (the same camera-integrated recording / reproducing apparatus 10), and the image ID and The reference image can be specified by the two IDs of the device ID. As a result, it is possible to access the reference image associated with the device ID only from the camera-integrated recording / reproducing apparatus 10 having the same device ID, and the necessary reference image can be selected by the image ID. Become.

  In the reference image registration process described above, the mode in which the reference image is registered from the camera-integrated recording / reproducing apparatus 10 has been described. However, the reference image can be registered by accessing the server 70 from a PC or the like. It is also possible to do so. In addition, here, as one piece of information associated with the reference image, a device ID for identifying the camera-integrated recording / reproducing apparatus 10 is used, but a user ID for identifying the user of the camera-integrated recording / reproducing apparatus 10 is used. In this way, the same user having a plurality of camera-integrated recording / reproducing devices 10 can be registered by the same user regardless of which camera-integrated recording / reproducing device 10 is used by using the user ID. The reference image can be accessed.

  Next, an outline of operations of the camera-integrated recording / reproducing apparatus 10 and the server 70 during imaging by the camera-integrated recording / reproducing apparatus 10 will be described with reference to FIG. FIG. 4 is a sequence chart showing a flow relating to processing at the time of imaging by the camera-integrated recording / reproducing apparatus 10 in the first embodiment of the present invention. It is assumed that the reference image has already been registered in the registered image database 73 of the server 70 and that preparation for server assistance has been completed.

  When the imaging operation is started in the camera-integrated recording / reproducing apparatus 10, imaging information to which the image ID and the device ID are added is transmitted from the camera-integrated recording / reproducing apparatus 10 to the server 70 in real time (step S401). ). The image ID to be added is determined according to the target subject (reference image to be used) selected by the user.

  The server 70 identifies the reference image from the image ID and the device ID, and performs image analysis of the imaging information received from the camera-integrated recording / reproducing device 10 to reflect the subject existing in the imaging information and the reference image. A comparison process is performed to determine whether or not the current subject matches (step S403). Then, according to the comparison processing result, a control command for controlling the operation related to the camera-integrated recording / reproducing apparatus 10 is generated (step S405), and the control command is transmitted to the camera-integrated recording / reproducing apparatus 10. (Step S407).

  The camera-integrated recording / reproducing apparatus 10 that has received the control command from the server 70 performs various operations such as specifying a subject and changing an imaging mode such as zoom and pan / tilt by performing an operation based on the control command. It becomes possible. For example, when information including a pan control command and a tilt control command is received from the server 70, these commands are transmitted to the drive unit 51 of the camera platform 50 through the connection unit 21 as a drive signal such as a pan control signal or a tilt control signal. The supplied drive unit 51 performs a pan operation (moving the imaging direction in the horizontal direction) and a tilt operation (moving the imaging direction in the vertical direction) based on these drive signals. For example, when information including a zoom control command is received from the server 70, this command is supplied to the zoom unit 17, and operations such as zooming in and zooming out are performed.

  The operation shown in the above-described sequence chart of FIG. 4 will be described in more detail with reference to FIGS. 5 and 6 for the camera-integrated recording / reproducing apparatus 10 and the server 70, respectively.

  First, the operation of the camera-integrated recording / reproducing apparatus 10 will be described. FIG. 5 is a flowchart showing the operation of the camera-integrated recording / reproducing apparatus according to the first embodiment of the present invention. When imaging is started in the camera-integrated recording / reproducing apparatus 10, the imaging information is processed by signal processing A (processing by the recording / reproducing unit 13) and signal processing B (information signal generating unit for transmission 14 and transmission / reception). Processing by the unit 15). In the signal processing B, the transmission information signal generator 14 adds an image ID and device ID for specifying the reference image to the imaging information, and transmits the information to the server 70 through the network 60. Is transmitted from the transmission / reception unit 15 to the server 70 (step S501: corresponding to step S401 in FIG. 4).

  Note that as the imaging information included in the transmission information signal, the captured moving image information can be used as it is, and still image information captured from the captured moving image information can also be used. is there. The transmission of the transmission information signal to the server 70 (that is, the transmission of the imaging information) is preferably performed periodically. For example, the transmission information signal is generated periodically and the server at the MPEG i-picture interval. 70 can be configured to be transmitted.

  Then, the camera-integrated recording / reproducing apparatus 10 continuously transmits imaging information to the server 70 and enters a standby state for transmission of a control command from the server 70 (step S503). When the transmission / reception unit 15 receives a control command from the server 70, the microprocessor 18 interprets the control command and performs an operation corresponding to the control command (step S505: step in FIG. 4). Corresponding to S409). The operation at this time completely depends on the control command generated by the server 70. A specific example of the control command and the operation related to the control command will be described later.

  As described above, the operation based on the control command from the server 70 is continued until the end operation is performed by the user. For example, the end operation (the end operation of the imaging or the end operation of the server assistance function) is performed by the user. In the case (“Yes” in step S507), the operation ends.

  Next, the operation of the server 70 will be described. FIG. 6 is a flowchart showing the operation of the server in the first embodiment of the present invention. The server 70 receives the imaging information transmitted by the process of step S501 in the camera-integrated recording / reproducing apparatus 10, and recognizes the image ID and the device ID from the received imaging information (step S601). Then, referring to the information stored in the registered image database 73, the reference image is searched and specified from the image ID and the device ID (step S603).

  When the reference image is specified, the subject recognition processing unit 72 of the server 70 performs image recognition of the captured image included in the imaging information and performs a comparison process with the specified reference image. For example, the image recognition technique recognizes the contours and faces of both the human image shown in the captured image and the human image in the reference image, and performs a process of comparing them (step S605: FIG. 4). Corresponding to step S403).

  If the comparison result in step S605 matches (that is, if the subject shown in the reference image is also shown in the image of the imaging information), an OK message corresponding to “comparison result = match” is sent. Generate (step S607). On the other hand, if the comparison result in step S605 does not match (that is, if the subject shown in the reference image is not shown in the image of the imaging information), a control command corresponding to “comparison result = mismatch” is generated. (Step S609: corresponding to Step S405 in FIG. 4). In the case of “comparison result = match”, it is possible to do nothing instead of generating an OK message, and to generate a control command that continues imaging of the subject. It is also possible.

  Then, the server 70 that has generated the OK message and the control command sends an OK message or control command to the camera-integrated recording / reproducing apparatus 10 (camera-integrated recording / reproducing apparatus 10 specified by the device ID) that has received the imaging information. (Step S611: corresponding to step S407 in FIG. 4).

  Next, a specific control command and an operation of the camera-integrated recording / reproducing apparatus 10 based on the control command will be described. Basically, the form of the control command generation processing in the server 70 differs depending on whether or not the subject shown in the reference image is shown in the image of the imaging information.

  If it is determined in step S403 of FIG. 4 (step S605 of FIG. 6) that the subject shown in the reference image is also shown in the image of the imaging information, the target subject is already imaged. Since it exists in the direction and is being imaged, no particular processing is required. Therefore, the server 70 does not have to generate and transmit control commands and messages.

  Further, as shown in steps S607 and S611 of the flowchart of FIG. 6, the server 70 can also generate and transmit an OK message. The camera-integrated recording / reproducing apparatus 10 that has received the OK message, for example, displays information indicating that the target subject is shown on the captured image currently captured on the display unit 20 (for example, OK characters or By superimposing a symbol or the like, it is possible to notify the user that the target subject is being imaged.

  It is also possible to perform automatic tracking processing of the target subject so that the target subject does not go out of the frame and is always imaged. In this automatic tracking process, a control command is generated so that the target subject is always imaged in the image of the imaging information. For example, the server 70 checks the position of the subject in the image of the imaging information, generates a pan control command or a tilt control command so that the target subject is always reflected in the center of the image of the imaging information, and By transmitting to the body shape recording / reproducing apparatus 10, the subject can be tracked. In addition, the server 70 may detect and predict the movement of the subject and generate a pan control command or a tilt control command when the subject is about to be out of frame so that the subject is always imaged. Is possible.

  Further, for example, the server 70 can generate a display control command for highlighting a target subject and transmit it to the camera-integrated recording / reproducing apparatus 10. In this case, by executing the display control command, for example, the display unit 20 can perform processing such as displaying an arrow mark indicating the position of the target subject in the currently captured image. Become.

  On the other hand, if it is determined in step S403 in FIG. 4 (step S605 in FIG. 6) that the subject shown in the reference image is not shown in the image of the imaging information, the current target subject is imaged. In this state, the subject needs to be searched. At this time, the server 70 generates and transmits a control command related to the search for the subject.

  A zoom-out control command, a pan control command, a tilt control command, or the like can be used as a control command for searching for a subject. For example, the server 70 can generate a zoom-out control command and send it to the camera-integrated recording / reproducing apparatus 10. The zoom unit 17 of the camera-integrated recording / reproducing apparatus 10 performs zoom-out processing based on the zoom-out control command, so that the imaging range is widened, and the target subject may be framed in the image of the imaging information. is there.

  Further, for example, the server 70 can generate a pan control command and a tilt control command and transmit them to the camera-integrated recording / reproducing apparatus 10. These commands are sent to the camera platform 50 through the connection unit 21, and the drive unit 51 of the camera platform 50 performs a process of rotating the imaging direction in the horizontal direction or the vertical direction. As a result, the imaging direction changes and the imageable space is scanned, and a target subject may be found in the image of the imaging information. Note that it is preferable that the subject search processing (control command generation processing and transmission processing related to the subject search) in the server 70 is performed until a target subject is found.

  In addition, when the subject reflected in the reference image is also reflected in the imaging information image, the subject reflected in the reference image is reflected in the imaging information image in the same manner as when the OK message is transmitted. If not, it is possible to simply generate and send an NG message. Also in this case, for example, in the display unit 20 of the camera-integrated recording / reproducing apparatus 10, information indicating that the target subject is not reflected on the currently captured image (for example, NG characters and symbols, etc.) ) Can be informed to the user that the target subject has not been imaged. As a result, the user can take an image of the target subject by performing an operation of changing the imaging direction on another person or the like.

  Moreover, it is also possible to add a billing system to the system that uses the server described above. For example, when prepaid information is held in a memory or the like in the camera-integrated recording / reproducing apparatus 10 and the server 70 determines that the subject shown in the reference image is also shown in the image of the imaging information, When a control command is generated and transmitted, a billing signal corresponding to the amount of information of the control signal including the control command is transmitted from the server 70 to the camera-integrated recording / reproducing apparatus 10, and the camera-integrated The recording / reproducing apparatus 10 can be configured to receive the billing signal and reduce the amount indicated by the billing signal from the prepaid balance. When the prepaid balance becomes zero, the subject recognition service that uses the server 70 is temporarily suspended. Note that the above-described billing system is an example, and any billing system or billing method (such as a pay-as-you-go system or time characteristics) can be used.

  As described above, according to the first embodiment described above, the camera-integrated recording / reproducing apparatus 10 uses the server 70 having a subject recognition function, and performs recognition processing and recognition results of a target subject. By letting the server 70 perform the command generation processing based on it, the target subject can be recognized or automatically tracked without adding a function that impairs the size and weight of the camera-integrated recording / reproducing apparatus 10, or the target subject It is possible to search for a subject when is not imaged.

<Second Embodiment>
In the above-described first embodiment, the transmission information signal generation unit 14 and the transmission / reception unit 15 are built in the camera-integrated recording / reproduction device 10. However, in the second embodiment, the camera 1 The body type recording / reproducing apparatus 10 is an apparatus having only an imaging function, a recording function, and a reproducing function, as in a conventional digital video camera, and the functions of the transmission information signal generation unit 14 and the transmission / reception unit 15 shown in FIG. 50 is provided. Therefore, for example, the present invention can be realized by connecting a later-described pan head 90 (see FIG. 7) to a conventional digital video camera.

  FIG. 7 is a diagram illustrating an example of a system configuration according to the second embodiment of the present invention. FIG. 7 shows a camera-integrated recording / reproducing apparatus 80, a pan head 90, a network 60, and a server 70. 1 is different from the system configuration shown in FIG. 1 in that the transmission information generation unit 14 and the transmission / reception unit 15 included in the camera-integrated recording / playback apparatus 10 shown in FIG. The point is included in the table 90. The imaging information and other information supplied to the transmission information signal generation unit 91 and the transmission / reception unit 92 for the signal processing B, the control command received from the server 70, and the like are connected via the connection unit 21. Data is exchanged between the camera-integrated recording / reproducing apparatus 80 and the camera platform 90.

  According to the configuration of FIG. 7, as described above, for example, a conventional digital video camera with a reduced size and weight is used as the camera-integrated recording / reproducing apparatus 80, and the camera platform 90 is simply connected to the digital video camera. Thus, the same operation and effect as those of the first embodiment described above can be realized. In the configuration shown in FIG. 7, the same operation as that described in the first embodiment (for example, the operation of the flowchart shown in FIGS. 2, 5, and 6 or the operation of the sequence chart shown in FIG. 4) is performed. Is possible.

  The present invention performs complex processing on a captured image without adding a function that impairs size reduction and weight reduction to an imaging device (mobile device) having a moving image imaging function, and the processing result is obtained in the imaging device. Reflecting it in the process has an effect of improving the convenience of imaging, and is applied to a technique for imaging a desired desired subject. In particular, the present invention can be used in a technique for specifying a desired subject from a large number of persons in a place where a large number of persons exist such as an event venue. Further, the present invention can be used as a device utilization and lending system according to the present invention or a billing system using a subject recognition service.

It is a figure which shows an example of the system configuration | structure in the 1st Embodiment of this invention. It is a flowchart which shows the example of a process by the side of a camera-integrated recording / reproducing apparatus at the time of registration of the reference image to the registration image database in the 1st Embodiment of this invention. It is a figure which shows typically the state by which the reference image was registered into the registration image database in the 1st Embodiment of this invention. It is a sequence chart which shows the flow which concerns on the process at the time of the imaging by the camera integrated recording / reproducing apparatus in the 1st Embodiment of this invention. It is a flowchart which shows operation | movement of the camera integrated recording / reproducing apparatus in the 1st Embodiment of this invention. It is a flowchart which shows operation | movement of the server in the 1st Embodiment of this invention. It is a figure which shows an example of the system configuration | structure in the 2nd Embodiment of this invention.

Explanation of symbols

10, 80 Camera integrated recording / playback device (imaging device, mobile device)
DESCRIPTION OF SYMBOLS 11 Image pick-up part 12 Signal processing part 13 Recording / reproducing part 14, 91 Transmission information signal generation part 15, 92 Transmission / reception part 16 Various sensors 17 Zoom part 18 Microprocessor 19 Operation part 20 Display part 21 Connection part 25 Internal bus 50, 90 Clouds Stand (Imaging equipment support device)
51 drive unit 60 network 70 server (image recognition processing server)
71 Communication Unit 72 Subject Recognition Processing Unit 73 Registered Image Database 74 Command Generation Unit

Claims (5)

Imaging means;
Shooting information creation means for creating information relating to shooting by the imaging means;
Signal transmission means for transmitting the photographing information created by the photographing information creating means and ID information for specifying the imaging device or the photographer to a predetermined server;
Control information obtained as a result of processing performed using the imaging information by the predetermined server, and signal receiving means for receiving from the predetermined server,
An imaging apparatus configured to control its operation according to the control information.   The imaging apparatus according to claim 1, wherein the imaging information includes an image signal captured by the imaging unit. A reference information creating means for creating reference information;
Reference information transmitting means for transmitting the reference information to the predetermined server,
The imaging apparatus according to claim 1, wherein the control information is obtained by processing using the reference information and transmission information in the predetermined server. Recording means for recording the image signal imaged by the imaging means on a recording medium;
The image signal included in the imaging information to be transmitted to the predetermined server is an image signal that is captured by the imaging unit and has an information amount reduced with respect to the image signal used for recording. The imaging device described in 1. A processing server capable of communicating with an imaging device,
A reference information database for storing reference information together with the ID information identifying the imaging device or its user;
Shooting information receiving means for receiving shooting information generated by the imaging device and accompanied by ID information from the imaging device;
Control information creating means for calling up the reference information corresponding to the received ID information and creating control information by processing using the reference information and the imaging information;
Control information transmitting means for transmitting the control information to the imaging device;
Having a processing server.

Images