JP7140177B2 - camera, camera control method, control device, control device control method, system and system control method - Google Patents

Description

The present technology relates to a camera , a camera control method, a control device , a control device control method , a system, and a system control method .

When you want to shoot a close-up from the start to the finish line, such as during short-distance track and field training, it is costly to put a camera on the lane, so multiple cameras are installed along the course to shoot. At that time, I would like to check the video immediately to check the form, etc., but conventionally, it is played back by the camera body one by one, or it is imported to a personal computer etc. and played back one file at a time. However, it takes time and effort to reproduce images captured by the camera. In addition, when athletes pass through the imaging range of each camera, it would be desirable to view the video as a camera-switched video automatically, but there was no means for doing so.

For example, Patent Literature 1 describes a technique that uses a plurality of cameras to accurately determine the ranking in a foot race. However, with the technique described in Patent Document 1, it is not possible to record everything from the start to the goal and reproduce it immediately.

JP-A-2006-339703

An object of the present technology is to make it possible to satisfactorily confirm images captured by a plurality of cameras that sequentially capture moving subjects.

The concept of this technology is
It consists of a plurality of cameras and a confirmation device connected to the plurality of cameras by wire or wirelessly,
The camera above
an imager;
memory;
When a start trigger signal is received from the confirmation device, a process of counting a frame number from a frame corresponding to the timing of receiving the trigger signal; a process of writing the image data of each frame in the period in which the counted frame number is associated with the counted frame number into the memory, and information of the frame number associated with the image data of each frame written into the memory. to the confirmation device, and when a transfer request with a frame number is received from the confirmation device, the image data of the frame specified by the frame number is read from the memory and transferred to the confirmation device. It has a control unit that controls the
The above confirmation device is
a display;
Based on the process of transmitting a start trigger signal to the plurality of cameras and the frame number information associated with the image data of each frame written in each memory sent from the plurality of cameras, a process of transmitting a transfer request accompanied by a frame number to a predetermined camera selected from the plurality of cameras; receiving image data of a frame designated by the frame number transferred from the predetermined camera; A multi-camera system comprising a control unit for controlling processing for displaying an image from a camera on the display.

In the present technology, a multi-camera system consists of a plurality of cameras and confirmation devices connected to the plurality of cameras by wires or wirelessly. For example, a plurality of cameras may divide the range in which the subject moves linearly and capture the images.

A camera includes an imager, a memory, and a controller. The controller controls the process of counting the frame number from the frame corresponding to the reception timing of the trigger signal when the start trigger signal is received from the confirmation device. Further, the control unit controls the process of writing the image data of each frame in the period in which the moving subject is present among the image data obtained by imaging with the imager in the memory in association with the frame number.

Further, the control unit controls the process of sending the frame number information associated with the image data of each frame written in the memory to the confirmation device. Further, when a transfer request with a frame number is received from the confirmation device, the control unit controls the process of reading the image data of the frame designated by the frame number from the memory and transferring it to the confirmation device.

For example, the image data of each frame is intra-frame-compressed and written into the memory, and the intra-frame-compressed image data of the frame specified by the frame number is transferred to the confirmation device. good. As a result, the amount of data can be reduced and the transfer can be performed smoothly. Also, the image data of each frame may be loop-recorded in the memory at least for a period longer than a period in which a moving subject exists within the imaging range of the imager. This makes it possible to save memory capacity.

The verification device has a display and a control. The control unit controls processing for transmitting start trigger signals to the plurality of cameras. Further, the control unit selects a predetermined number from a plurality of cameras based on the information of the frame number associated with the image data of each frame written in each memory, which is sent from the plurality of cameras. The process of sending a transfer request with a frame number to the camera is controlled. The control unit also controls the processing of receiving image data of a frame designated by a frame number transferred from a predetermined camera and displaying an image based on this image data on the display.

For example, it may further include an operation unit for operating the playback frame position. In this case, for example, the operation unit may be configured by a touch panel arranged on the screen of the display. In this case, for example, the display may display a scroll bar for manipulating the playback frame position. This makes it possible to easily and simply operate the reproduction frame position.

As described above, in the present technology, in a plurality of cameras, the frame number is counted from the frame corresponding to the reception timing of the start trigger signal from the confirmation device, and the image data of each frame during the period in which the subject exists is associated with the frame number. When the confirmation device reproduces the frame image of the predetermined frame number, a transfer request accompanied by the frame number is selectively transmitted to the camera having the image data of the frame. An image based on the image data sent from is displayed. Therefore, the confirmation device can satisfactorily confirm images captured by a plurality of cameras that sequentially capture images of a moving subject.

According to the present technology, it is possible to satisfactorily check images captured by a plurality of cameras that sequentially capture a moving subject. Note that the effects described in this specification are merely examples and are not limited, and additional effects may be provided.

1 is a block diagram showing a configuration example of a multi-camera system as an embodiment; FIG. It is a figure which shows the installation state of several cameras. It is a block diagram which shows the structural example of a camera. It is a block diagram which shows the structural example of a confirmation apparatus. FIG. 4 is a diagram showing an example of frame number counting performed in each camera and recording frames in each camera; FIG. 10 is a diagram showing an example of a camera switching table; FIG. FIG. 10 is a diagram showing an example of a screen for reproducing an image (moving image content) captured by multi-cameras, displayed on the panel of the confirmation device; FIG. 10 is a diagram showing a sequence example of communication with each camera during playback on the confirmation device; FIG. 10 is a diagram showing another example of a camera switching table; FIG. 11 is a block diagram showing another configuration example of the multi-camera system; FIG. 11 is a block diagram showing another configuration example of the multi-camera system; FIG. 11 is a block diagram showing another configuration example of the multi-camera system;

DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, modes for carrying out the invention (hereinafter referred to as "embodiments") will be described. The description will be made in the following order.
1. Embodiment 2. Modification

<1. Embodiment>
[Configuration example of multi-camera system]
FIG. 1 shows a configuration example of a multi-camera system 10A as an embodiment. This multi-camera system 10A has a plurality of cameras (video cameras), ie, a camera (camera A) 101-A, a camera (camera B) 101-B, and a camera (camera C) 101-C. is doing. The multi-camera system 10A also has a confirmation device 102 that is a mobile terminal such as a smart phone or a tablet, or a personal computer.

The cameras 101-A, 101-B, 101-C and the confirmation device 102 are connected to a wired or wireless LAN. For example, the confirmation device 102 constitutes a master device, and each of the cameras 101-A, 101-B, 101-C constitutes a slave device. FIG. 2 shows the installation state of cameras 101-A, 101-B, and 101-C. The cameras 101-A, 101-B, and 101-C are arranged so as to capture images by dividing the range in which the subject moves linearly, for example, like a 100m runner running on a straight course. In this case, cameras 101-A, 101-B, and 101-C are arranged side by side along the course. As a result, the cameras 101-A, 101-B, and 101-C can capture images from the beginning to the end of the race. In this case, the imaging ranges of adjacent cameras are made to overlap somewhat.

The confirmation device 102 can trigger each camera to start and end imaging in accordance with a user operation. In this case, the confirmation device 102, which is the master device, issues trigger signals (commands) for starting and ending imaging to each camera. Each camera receives this trigger signal via a control interface (control I/F) constituting a communication part, and operates according to the instruction. A control interface for each camera is built in the camera. Further, the confirmation device 102 has a panel (display), and after the photographing is finished, the captured image of each camera can be confirmed on this panel.

Cameras 101-A, 101-B, and 101-C each include an imager and a memory for writing image data obtained by imaging with this imager. In this case, in the memory, image data of each frame (for example, the frame rate is 60 Hz) of a period in which a moving subject exists among the image data obtained by imaging with the imager is intra-frame compression, this In the embodiment, it is written with JPEG compression.

When the cameras 101-A, 101-B, and 101-C receive the start trigger signal from the confirmation device 102, they count the frame number from the frame corresponding to the reception timing of this trigger signal. For example, the frame number of the first frame is "1", and the frame numbers of subsequent frames are incremented sequentially.

As described above, the image data written in the memories of the cameras 101-A, 101-B, and 101-C are associated with frame numbers. In the memories of the cameras 101-A, 101-B, and 101-C, the image data of each frame is loop-recorded in units of at least the period in which a moving subject exists within the imaging range of the imager. It should be noted that the loop recording is not necessarily required, and the image data of each frame may be encoded by AVC or the like and written to the memory. Each of the cameras 101-A, 101-B, 101-C sends to the confirmation device 102 information on the frame number associated with each frame of image data written in the memory.

Each of the cameras 101-A, 101-B, and 101-C stops writing (recording) operations to the memory when receiving the end trigger signal from the confirmation device 102 (imaging operations do not necessarily have to be stopped). not, but the imaging operation may also be stopped). When each of the cameras 101-A, 101-B, and 101-C receives a transfer request with a frame number from the confirmation device 102, the image data of the frame designated by this frame number is read from the memory and confirmed. Transfer to device 102 .

The confirmation device 102 sends a start trigger signal to each camera in response to the user's imaging start operation. In addition, the confirmation device 102 sends an end trigger signal to each camera in response to the user's imaging end operation. The confirmation device 102 has an operation unit for operating the playback frame position. The user can operate the reproduction frame position from this operation section.

When reproducing a frame image of a predetermined frame number, the confirmation device 102 selectively transmits a transfer request accompanied by the frame number to the camera having the image data of that frame. In this case, the confirmation device 102 selects the camera to which the transfer request should be sent based on the frame number information associated with the image data of each frame written in the memory from each camera.

The confirmation device 102 receives the image data of the frame designated by the frame number transferred from the camera that sent the transfer request as described above, and displays the image based on this image data on the panel (display). In this case, the confirmation device 102 can receive image data of consecutive frames by continuously transmitting transfer requests of consecutive frame numbers, and can reproduce moving images.

"Camera configuration example"
FIG. 3 shows a configuration example of the cameras 101 (101-A, 101-B, 101-C). The camera 101 has a CPU 111 , a memory 112 , an imager/lens section 113 , a camera signal processing section 114 and a codec processing section 115 . The camera 101 also has a panel processing unit 116 , a panel 117 , a wired communication processing unit 118 , a wired LAN terminal 119 , a wireless communication processing unit 120 and an antenna 121 .

A CPU 111 controls the operation of each unit of the camera 101 . The memory 112 stores control software and data, and constitutes a work area for the CPU 111 and the like. The memory 112 also constitutes a frame buffer that loop-records captured image data.

The imager/lens unit 113 is composed of an imaging lens and an imager, images a subject, and obtains an imaging signal. The camera signal processing unit 114 processes the imaging signal obtained by the imager/lens unit 113 to generate image data (captured image data) corresponding to the subject. The codec processing unit 115 performs JPEG compression processing on the image data of each frame obtained by the camera signal processing unit 114 . In the frame buffer of the memory 112, image data of each frame during a period when a moving object exists is loop-recorded. It should be noted that whether or not there is a moving subject is detected by, for example, the CPU 111 performing motion detection processing on the captured image data.

The panel processing unit 116 drives the panel 117 based on the image data obtained by the camera signal processing unit 114 to display the captured image on the panel 117 . A panel 117 is configured by an LCD, an organic EL panel, or the like. The panel 117 has a touch panel function, and if necessary, the panel 117 also displays a UI for user operations.

The wired communication processing unit 118 performs wired communication with an external device, which is the confirmation device 102 in this embodiment, through the wired LAN terminal 119 . The wireless communication processing unit 120 wirelessly communicates with an external device, which is the confirmation device 102 in this embodiment, through the antenna 121 . Either wireless communication or wired communication is selectively performed.

"Configuration example of confirmation device"
FIG. 4 shows a configuration example of the confirmation device 102 . The confirmation device 102 has a CPU 131 , a memory 132 , a codec processing section 133 and a graphics processing section 134 . The confirmation device 102 also has a panel processing unit 135 , a panel 136 , a wired communication processing unit 137 , a wired LAN terminal 138 , a wireless communication processing unit 139 and an antenna 140 .

The CPU 131 controls operations of each unit of the confirmation device 102 . The memory 132 stores control software and data, and constitutes a work area for the CPU 131 and the like. The memory 132 also temporarily records image data of each frame transferred from the camera 101 (see FIG. 3).

The memory 132 also stores frame number information associated with image data of each frame written in the memory of each camera, which is sent from each camera. This information is used to specify the camera having the image data of the frame when reproducing the frame image of the predetermined frame number as described above.

The codec processing unit 133 reads the image data of each frame temporarily recorded in the frame buffer of the memory 132 and decompresses it for image display. The panel processing unit 135 drives the display panel 136 based on the image data obtained by decompression processing by the codec processing unit 133 and displays an image on the panel 136 . The panel 136 is composed of an LCD, an organic EL panel, or the like. The panel 136 has a touch panel function, and if necessary, a UI for user operation is also displayed on the panel 136 .

The wired communication processing unit 137 performs wired communication with an external device, the camera 101 in this embodiment, through the wired LAN terminal 138 . The wireless communication processing unit 139 wirelessly communicates with an external device, the camera 101 in this embodiment, through the antenna 140 . Either wireless communication or wired communication is selectively performed.

"Frame number counting and recording frame example by start trigger"
FIG. 5 shows an example of frame number counting performed in each camera when a start trigger signal is sent from the confirmation device 102 to each camera, and an example of recording frames in each camera. The range of recorded frames for each camera corresponds to the frames included during the presence of a moving object in the respective camera's field of view.

At time t1, the confirmation device 102 sends a start trigger signal (recording instruction signal) to each camera, for example, based on a user's operation. Upon receipt of this start trigger signal, each camera becomes ready for recording and counts the frame number from the frame corresponding to this time t1. In this case, the frame number of the first frame is "1", and the frame number is incremented for each frame thereafter. As a result, the same frame number is assigned to frames at the same time in each camera.

Rather than recording (writing) all frames of image data into the frame buffer of memory 112, each camera records only each frame of image data during the presence of a moving subject. This allows power reduction and frame buffer savings in memory 112 .

In the illustrated example, the camera (camera A) 101-A takes frames with frame numbers from "1" to "497" as recording frames, and associates the image data of each frame with the frame number in the frame buffer of the memory 112. At the same time, recording frame number information indicating that the recording start frame number is "1" and the recording end frame number is "497" is sent to the confirmation device 102.

In the illustrated example, the camera (camera B) 101-B uses frames with frame numbers from "496" to "501" as recording frames, and stores the image data of each frame in the frame buffer of the memory 112 as a frame number. Along with recording in correspondence, recording frame number information indicating that the recording start frame number is “496” and the recording end frame number is “501” is sent to the confirmation device 102 .

In the illustrated example, the camera (camera C) 101-C uses frames with frame numbers from "499" to "600" as recording frames, and stores the image data of each frame in the frame buffer of the memory 112 as a frame number. Along with recording in correspondence, recording frame number information indicating that the recording start frame number is “499” and the recording end frame number is “600” is sent to the confirmation device 102 .

The confirmation device 102 generates and holds a camera switching table as shown in FIG. 6 based on the recording frame number information from each camera.

Although not shown, after a predetermined time from when the start trigger signal (recording instruction signal) is sent to each camera, for example, after 10-odd seconds in the case of a sprint of 100m, for example, after a user's operation, Based on this, the confirmation device 102 sends an end trigger signal (recording stop signal) to each camera. Each camera enters a record-disabled state upon reception of this end trigger signal.

The recordable state in each camera may be set in advance at a predetermined time after the start trigger signal (recording instruction signal) is sent. In this case, the confirmation device 102 does not need to send an end trigger signal (recording stop signal) to each camera. In addition, the exposure phases of the cameras do not necessarily have to match due to genlock or the like. Also, there may be timing fluctuations until the start trigger signal (recording instruction signal) from the confirmation device 102 reaches each camera. However, if the exposure phase and trigger timing are aligned, camera switching during playback can be smoothly transitioned.

"Example of user interface on confirmation device"
FIG. 7 shows an example of a screen displayed on the panel 136 of the confirmation device 102 for reproducing an image (moving image content) captured by multi-cameras. In this example, the playback frame position corresponds to the recording period of the camera (camera A) 101-A, and its captured image 300 is displayed. On this screen, a UI screen for user operation is superimposed on the captured image.

On this screen, normal playback operations such as playback, pause, fast-forward, rewind, and frame-by-frame forwarding of images captured by the selected camera can be performed by user operations from the playback operation unit 301 on which playback icons are displayed. It can be carried out. Here, the playback icon is also provided with a scroll bar, and by scrolling with a finger, forward/backward frame forwarding, fast forwarding/rewinding are possible.

The user can perform playback operations as a series of images from the start to the goal without being conscious of multiple cameras. Camera switching is automatically performed by the confirmation device 102 according to the playback frame position (playback frame number position). At this time, the confirmation device 102 refers to the above-described camera switching table (see FIG. 6). The switchover occurs during the period of overlapping frame positions between the two cameras, eg near the middle thereof. Note that the switching timing information may also be saved in a file so that it can be used for automatic editing of the main line moving image.

The camera switching position may be determined with an offset in advance, for example, at the moment when the leading player is captured by two adjacent cameras at the same time, or two frames after that timing. It is also conceivable to use information obtained by detecting a wireless tag or an ID on clothes with a camera, and it is also possible to switch the mode at the moment when a specified individual is captured by face recognition or the like. Of course, it is applicable not only to people but also to car races and the like.

"Communication sequence between confirmation device and each camera"
The sequence diagram of FIG. 8 shows an example of the sequence of communication with each camera during playback on the confirmation device 102 . Here, an example of communication when displaying images frame by frame is shown.

The confirmation device 102 requests the camera (camera A) 101-A to transfer the image data of the frame #495 (in this case, JPEG compression-encoded). In response to this, the camera (camera A) 101 -A reads the image data of the #495 frame in its own frame buffer and transfers it to the confirmation device 102 . As a result, the confirmation device 102 displays an image based on the image data of the #495 frame on the panel 136 .

Next, similarly, the confirmation device 102 requests the camera (camera A) 101-A to transfer the image data of the frame #496. In response to this, the camera (camera A) 101 -A reads the image data of the #496 frame in its own frame buffer and transfers it to the confirmation device 102 . As a result, the confirmation device 102 displays an image based on the image data of the frame #496 on the panel 136 .

Next, the confirmation device 102 performs a switching decision based on the camera switching table (see FIG. 6), and switches to (camera B) 101-B. The confirmation device 102 requests the camera (camera B) 101-B to transfer the image data of the frame #497. In response to this, the camera (camera B) 101 -B reads the image data of the #497 frame in its own frame buffer and transfers it to the confirmation device 102 . As a result, the confirmation device 102 displays an image based on the image data of the #497 frame on the panel 136 . The following operations are the same.

"Example of improving display latency"
In the above description, an example is shown in which image data of a predetermined frame is obtained from the predetermined camera each time an image of a predetermined frame from a predetermined camera is displayed on the confirmation device 102 . In this case, especially in the case of wireless LAN connection, it is assumed that the display latency will be extended depending on the condition of the communication path.

In order to improve this display latency, it is conceivable to provide a frame buffer in the memory 132 (see FIG. 4) of the confirmation device 102 and download the playback content of each camera to the frame buffer in advance. After this buffering, playback is performed after being closed in the confirmation device 102, so the display latency is improved without being affected by the condition of the communication path.

As described above, in the multi-camera system 10A shown in FIG. 1, each camera counts the frame number from the frame corresponding to the reception timing of the start trigger signal from the confirmation device 102, The image data is written in the memory 112 in association with the frame number, and when the confirmation device 102 reproduces the frame image of the predetermined frame number, the frame number is selectively transferred to the camera having the image data of that frame. A request is sent, and an image based on the image data sent from the predetermined camera is displayed on the confirmation device 102 . Therefore, the confirmation device 102 can satisfactorily confirm the captured images of the respective cameras that sequentially capture the moving subject.

In this case, the confirmation device 102 side grasps the moving image frame numbers in all the cameras based on the trigger criteria, and intra-frame compression is performed in the camera, so that the confirmation terminal 102 side communicates only the desired frames with the camera. By doing so, it can be acquired with low latency and low transmission bandwidth. In addition, since intraframe-compressed data is reproduced, less processing is required on the confirmation terminal 102 side, and reproduction can be performed at a stress-free display latency/frame rate.

<2. Variation>
In the above-described embodiment, each camera sends recording frame number information including the recording start frame number and the recording end frame number to the confirmation device 102, and the confirmation device 102 generates based on the recording frame number information from each camera. An example is shown in which a camera switching table (see FIG. 6) is stored and camera switching is performed by referring to this camera switching table.

However, the camera switching table is not limited to one generated based on the recording frame number information in this way. For example, FIG. 9(a) shows a camera switching system when a moving image file is encoded in a GOP structure such as AVC instead of intra-frame compression such as JPEG as in the above-described embodiment. An example of a table is shown. In this case, verification device 102 uses the GOP number and the frame number within it to designate the frame to be displayed.

In this case, each camera, when a start trigger signal (recording instruction signal) is sent from the confirmation device 102, encodes the frame at that timing, for example, assuming that the GOP number is #1 and the frame number is #1. Each camera records in the frame buffer of the memory 112 at least image data of each GOP including image data of each frame during the period in which a moving subject exists. Then, each camera assigns the GOP number and frame number "subject IN GOP/frame #" at the start frame of the period in which a moving subject exists in the imaging range of the imager, and the GOP number and frame number "subject OUT" at the end frame. GOP/frame #” information is sent to the verification device 102 .

Also, for example, FIG. 9B shows an example of a camera switching table when each camera is time-code synchronized. In this case, verification device 102 uses the time code to designate the frame to be displayed.

In this case, each camera records at least the image data of each frame during the period in which a moving subject exists in the frame buffer of the memory 112 together with the time code. Then, each camera sends to confirmation device 102 the time code "Subject IN Timecode" at the start frame and the time code "Subject OUT Timecode" at the end frame of the period in which a moving subject exists in the imaging range of the imager.

Further, in the above-described embodiment, an example is shown in which the frame rate of the captured image data of the cameras 101-A, 101-B, and 101-C is 60 Hz. The present technology can be similarly applied when the frame rate of the image data captured by the cameras 101-A, 101-B, and 101-C is other than the above. can be applied in the same way.

Also, in the above-described embodiment, an example in which there are three cameras has been shown. This technology can be similarly applied to two or four or more cameras.

Also, in the above embodiment, an example in which each camera has a control interface is shown. However, the camera does not have a control interface, and it is conceivable to provide control equipment outside the camera.

FIG. 10 shows a configuration example of a multi-camera system 10B in that case. In FIG. 10, parts corresponding to those in FIG. 1 are denoted by the same reference numerals. Unlike the multi-camera system 10A shown in FIG. 1, the cameras 101-A, 101-B, and 101-C do not have a control interface (control I/F). Outside the cameras 101-A, 101-B, and 101-C, a control device (control device A) 101-A having the same function as the control interface (control I/F), a control device (control A control device (control device B) 101-B and a control device (control device C) 101-C are provided.

Further, in the above-described embodiment, an example in which confirmation device 102 is provided separately from cameras 101-A, 101-B, and 101-C has been shown. However, it is also conceivable that the confirmation device 102 is not provided and one of the cameras 101-A, 101-B, and 101-C also serves as the confirmation device. FIG. 11 shows a configuration example of the multi-camera system 10C in that case. In FIG. 11, parts corresponding to those in FIG. 1 are denoted by the same reference numerals.

Although the multi-camera system 10C shown in FIG. 11 corresponds to the multi-camera system 10A shown in FIG. 1, it goes without saying that the multi-camera system 10B shown in FIG. 10 can be configured similarly. Although detailed description is omitted, FIG. 12 shows a configuration example of the multi-camera system 10D in that case.

Moreover, this technique can also take the following structures.
(1) Consisting of a plurality of cameras and a confirmation device connected to the plurality of cameras by wire or wirelessly,
The camera above
an imager;
memory;
When a start trigger signal is received from the confirmation device, a process of counting a frame number from a frame corresponding to the timing of receiving the trigger signal; a process of writing the image data of each frame in the period in which the counted frame number is associated with the counted frame number into the memory, and information of the frame number associated with the image data of each frame written into the memory. to the confirmation device, and when a transfer request with a frame number is received from the confirmation device, the image data of the frame specified by the frame number is read from the memory and transferred to the confirmation device. It has a control unit that controls the
The above confirmation device is
a display;
Based on the process of transmitting a start trigger signal to the plurality of cameras and the frame number information associated with the image data of each frame written in each memory sent from the plurality of cameras, a process of transmitting a transfer request accompanied by a frame number to a predetermined camera selected from the plurality of cameras; receiving image data of a frame designated by the frame number transferred from the predetermined camera; A multi-camera system comprising a control unit for controlling a process of displaying an image by the display on the display.
(2) The multi-camera system according to (1), wherein the plurality of cameras divides and captures a range in which the subject moves linearly.
(3) an imager;
memory;
When a start trigger signal is received from a confirmation device, a process of counting a frame number from a frame corresponding to the reception timing of the trigger signal; A process of writing the image data of each frame in the existing period in association with the counted frame number to the memory, and the information of the frame number associated with the image data of each frame written in the memory. and a process of reading image data of a frame specified by the frame number from the memory and transferring it to the confirmation apparatus when a transfer request with a frame number is received from the confirmation apparatus. A camera with controls to control.
(4) Intra-frame-compressed image data of each frame is written in the memory, and intra-frame-compressed image data of the frame specified by the frame number is transferred to the confirmation device. ).
(5) The memory according to (3) or (4), wherein the image data of each frame is loop-recorded in units of at least a period longer than the period in which the moving subject is present in the imaging range of the imager. camera.
(6) A method of processing an imager and a camera with memory, comprising:
counting a frame number from a frame corresponding to the timing of receiving the trigger signal when a start trigger signal is received from the confirmation device;
a step of writing image data of each frame of a period in which a moving subject exists among the image data obtained by imaging with the imager in the memory in association with the counted frame number;
sending frame number information associated with each frame of image data written in the memory to the verification device;
A camera processing method comprising, upon receipt of a transfer request with a frame number from the confirmation device, reading image data of a frame designated by the frame number from the memory and transferring the image data to the confirmation device.
(7) a display;
Based on the processing of transmitting start trigger signals to a plurality of cameras and the frame number information associated with the image data of each frame written in the respective memories sent from the plurality of cameras, a process of transmitting a transfer request with a frame number to a predetermined camera selected from a plurality of cameras; receiving image data of a frame designated by the frame number transferred from the predetermined camera; A confirmation device comprising a control unit that controls processing for displaying an image on the display.
(8) The confirmation device according to (7), further comprising an operation unit for operating a reproduction frame position.
(9) The confirmation device according to (8), wherein the operation unit is configured by a touch panel arranged on the screen of the display.
(10) The confirmation device according to (9), wherein a scroll bar for operating the playback frame position is displayed on the display.
(11) A processing method for a confirmation device having a display,
sending a start trigger signal to a plurality of cameras;
a frame number assigned to a predetermined camera selected from the plurality of cameras based on frame number information associated with image data of each frame written in each memory sent from the plurality of cameras; sending a transfer request with
A processing method for a confirmation device, comprising a step of receiving image data of a frame designated by the frame number transferred from the predetermined camera and displaying an image based on the image data on the display.
(12) comprising a plurality of cameras and a confirmation device connected to the plurality of cameras by wire or wirelessly;
The camera above
an imager;
memory;
a process of writing image data of each frame of a period in which a moving subject exists among the image data obtained by imaging with the imager into the memory; a control unit for controlling processing for sending to a confirmation device, and processing for reading image data of the reproduction frame from the memory and transferring it to the confirmation device when a transfer request accompanied by reproduction frame information is received from the confirmation device; prepared,
The above confirmation device is
a display;
a process of transmitting a transfer request accompanied by reproduction frame information to a predetermined camera selected from the plurality of cameras based on the frame period information transmitted from the plurality of cameras; A multi-camera system comprising a control unit that receives image data of the reproduction frame and controls processing for displaying an image based on the image data on the display.
(13) The multi-camera system according to (12), wherein the frame period information is information indicated by a frame number, GOP number and frame number, or time code.
(14) an imager;
memory;
A process of writing image data of each frame during a period in which a moving subject exists among the image data obtained by imaging with the imager into the memory, and confirming frame period information of the image data written into the memory. a control unit for controlling a process of sending to an apparatus, and a process of reading image data of the reproduced frame from the memory and transferring the image data of the reproduced frame to the confirming apparatus when receiving a transfer request with reproduced frame information from the confirming apparatus; camera.
(15) a display;
a process of transmitting a transfer request accompanied by reproduction frame information to a predetermined camera selected from the plurality of cameras based on the frame period information transmitted from the plurality of cameras; A confirmation device comprising a control unit that receives image data of a reproduction frame and controls processing for displaying an image based on the image data on the display.

10A, 10B, 10C, 10D... Multi-camera system 101, 101-A, 101-B, 101-C... Camera 102... Confirmation device 103-A, 103-B, 103-C... Control device 111 CPU
112... Memory 113... Imager/lens section 114... Camera signal processing section 115... Codec processing section 116... Panel processing section 117... Panel 118... Wired communication processing section 119. Wired LAN terminal 120 Wireless communication processing unit 121 Antenna 131 CPU
132... Memory 133... Codec processing unit 134... Graphic processing unit 135... Panel processing unit 136... Panel 137... Wired communication processing unit 138... Wired LAN terminal 139... Wireless communication processing unit 140 Antenna

Claims (17)

a process of writing image data of a period in which a moving subject exists among image data obtained by the imager into a memory;
a process of transmitting to an external device frame information indicating a frame of image data written in the memory and representing a frame of image data during a period in which the moving subject exists ;
When receiving from the external device a transfer request including frame information indicating any one of the frames of the image data during the period in which the moving subject exists, transfer of the frame indicated by the received frame information A camera having a control unit that controls a process of reading image data from the memory and transferring the image data to the external device. The camera according to Claim 1, wherein the frame information is information indicated by a frame number, a GOP number and a frame number, or a time code. 3. The camera according to claim 1, wherein the control unit performs control so that the image data and the frame information are associated with each other and written into the memory. The control unit, when receiving a trigger signal from the external device, controls a process of counting a frame number from a frame corresponding to the reception timing of the trigger signal, and controls a process of counting a frame number from a frame corresponding to the reception timing of the trigger signal, thereby obtaining an image of a period in which the moving subject exists. 4. The camera according to any one of claims 1 to 3, wherein the data and the counted frame numbers are associated with each other and controlled to be written in the memory. image data of each frame is intra-frame-compressed and written into the memory;
Intraframe-compressed image data of the frame indicated by the frame information is transferred to the external device.
A camera according to any one of claims 1 to 4. In the memory, the image data of each frame is loop-recorded in units of at least a period of time during which the moving subject is present in the imaging range of the imager.
A camera according to any one of claims 1 to 4. a step of writing image data of a period in which a moving subject exists among image data obtained by the imager into a memory;
a step of transmitting to an external device frame information indicating a frame of image data written in the memory and representing a frame of image data during a period in which the moving subject exists ;
When receiving from the external device a transfer request including frame information indicating any one of the frames of the image data during the period in which the moving subject exists, transfer of the frame indicated by the received frame information and a procedure of reading image data from the memory and transferring the image data to the external device. a process of receiving, from each of a plurality of cameras, frame information indicating a frame of image data during a period in which a moving subject exists ;
Based on the frame information received from each of the plurality of cameras, one of the frames of the image data during the period in which the moving subject exists is indicated to a first camera among the plurality of cameras. a process of transmitting a transfer request for the image data including frame information;
A control device having a control unit for controlling a process of displaying on a display the image data of the frame indicated by the transmitted frame information, which is transferred from the first camera. The control unit controls image data obtained by an imager of the first camera during a first period in which a moving subject exists and image data obtained by an imager of a second camera different from the first camera. when there is a period that overlaps with a second period in which a moving subject exists in the image data obtained, at a timing near the center of the overlapping period, by the first camera and the second camera The image data obtained by the first camera is changed from the image data obtained by the first camera at the timing when the moving subjects start to be photographed at the same time, or at the timing after a predetermined frame after the timing when the moving subjects start to be photographed at the same time. 9. The control device according to claim 8 , wherein said display is controlled to switch and display image data obtained by said camera. The control unit controls to hold the information about the switching timing in a memory.
A control device according to claim 9 . 11. The control device according to any one of claims 8 to 10, wherein the plurality of cameras capture images by dividing a moving range of the subject. further comprising an operation unit capable of performing an operation for reproducing image data transferred from at least one of the plurality of cameras;
12. A control device according to any one of claims 8 to 11. 13. The control device according to claim 12, wherein the operation unit is configured by a touch panel arranged on the screen of the display. 14. The control device according to claim 13, wherein the display displays a scroll bar for manipulating the position of the frame to be reproduced. a step of receiving, from each of a plurality of cameras, frame information indicating frames of image data during a period in which a moving subject is present ;
Based on the frame information received from each of the plurality of cameras, one of the frames of the image data during the period in which the moving subject exists is indicated to a first camera among the plurality of cameras. a procedure for transmitting a transfer request for the image data including frame information;
and displaying, on a display, the image data of the frame indicated by the transmitted frame information, which is transferred from the first camera. comprising a plurality of cameras and a control device connected to the plurality of cameras by wire or wirelessly,
The camera is
a process of writing image data of a period in which a moving subject exists among image data obtained by the imager into a memory;
a process of transmitting to the control device frame information indicating a frame of image data written in the memory and representing a frame of image data during which the moving subject exists ;
When receiving from the control device a transfer request including frame information indicating any one of the frames of the image data during the period in which the moving subject exists, transfer of the frame indicated by the received frame information a control unit that controls a process of reading out image data from the memory and transferring the image data to the control device ;
The control device is
a process of receiving, from each of the plurality of cameras, frame information indicating a frame of image data during a period in which the moving subject exists ;
Based on the frame information received from each of the plurality of cameras, one of the frames of the image data during the period in which the moving subject exists is indicated to a first camera among the plurality of cameras. a process of transmitting a transfer request for the image data including frame information;
A system comprising a control unit that controls a process of displaying on a display the image data of the frame indicated by the transmitted frame information, which is transferred from the first camera. A control method for a system comprising a plurality of cameras and a control device connected to the plurality of cameras by wire or wirelessly,
The control unit of the camera
a process of writing image data of a period in which a moving subject exists among image data obtained by the imager into a memory;
a process of transmitting to the control device frame information indicating a frame of image data written in the memory and representing a frame of image data during which the moving subject exists ;
When receiving from the control device a transfer request including frame information indicating any one of the frames of the image data during the period in which the moving subject exists, transfer of the frame indicated by the received frame information controlling a process of reading image data from the memory and transferring it to the control device ;
The control unit of the control device,
a process of receiving, from each of the plurality of cameras, frame information indicating a frame of image data during a period in which the moving subject exists ;
Based on the frame information received from each of the plurality of cameras, one of the frames of the image data during the period in which the moving subject exists is indicated to a first camera among the plurality of cameras. a process of transmitting a transfer request for the image data including frame information;
A system control method for controlling a process of displaying on a display image data of a frame indicated by the transmitted frame information, which is transferred from the first camera.

Images