JP3062166B2 - Image recording device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image recording apparatus for encoding and recording an image.

[0002]

2. Description of the Related Art For example, in a power generation facility or a public facility, the situation of the facility is photographed by a camera for security, and the photographed image is transmitted to an image recording device and recorded.
When an object (person) that moves unusually is found in an image recording apparatus, the movement is recorded, and a high-definition image is recorded to identify the object (person). I have.

In general, when a moving image is recorded by using the MPEG-1 system, it becomes a data stream of about 1 Mbps, and a storage medium of about 450 Mbytes per hour is required. Also, MPE
The number of pixels of G-1 is about 360 × 240 and is an object (person)
There is not enough resolution to identify the. Therefore, it is conceivable to adopt the MPEG-2 system in order to obtain a resolution sufficient to characterize an object (person).

[0004]

However, although this MPEG-2 has a higher resolution, a transmission device for transmitting an image from a storage medium and a site requires a larger capacity and an expensive device. Therefore, in order to record the motion of an object (person), a method of recording a moving image at a moderate resolution and recording a high-definition still image as necessary can be considered. For example, a high-definition image is obtained by dividing an image into four, encoding each as a still image, and transmitting the still image.

However, in actuality, there is a delay time between the encoding side and the decoding side.
This is slightly later than the scene that required a high-definition image. In addition, since the transmission of moving images is stopped while still images are being transmitted, it is possible to appropriately determine the timing of transmitting high-definition still images and suppress transmission and recording of meaningless still images. is necessary.

It is an object of the present invention to provide an image recording apparatus capable of appropriately recording a still image required for monitoring.

[0007]

According to a first aspect of the present invention, there is provided an image recording apparatus for encoding, transmitting, and recording an image, comprising: a camera unit for capturing a moving image; and a moving image from the camera unit. Coding means for blocking and coding an image, temporarily recording a moving image from the camera unit, and blocking and coding a specific image as a still image; and a code coded by the coding means. Transmitting means for transmitting encoded data, decoding means for decoding moving image encoded data and still image encoded data from the transmitting means, and whether an image in a block decoded by the decoding means is in a still state. Moving object detecting means for detecting a moving object by noise removal processing and moving object inclusion processing if the moving object is determined to be a moving state; and a moving object detected by the moving object detecting means A still image encoding timing determining unit that transmits a request signal for requesting the encoding unit to encode a still image when the coordinates of an area including a predetermined condition are satisfied; and the moving image encoded data. And recording means for recording the encoded still image data.

In the image recording apparatus according to the first aspect of the present invention, a moving image photographed by the camera unit and encoded by the encoding unit is transmitted to the decoding unit via the transmission unit. When a moving object is detected from the moving image decoded by the decoding unit by the noise removal process and the moving object inclusion process by the moving object detection unit, the still image encoding timing determination unit determines the coordinates of the moving object in advance. When a predetermined condition is satisfied, a request signal for encoding a still image is output to the encoding unit via the transmission unit. The encoding unit creates still image encoded data in accordance with the request signal and transmits the still image encoded data to the recording unit. Thereby, useless transmission of a still image is suppressed.

An image recording apparatus according to a second aspect of the present invention
In the invention of claim 1, the still image encoding timing determining means includes: a coordinate history storing means for recording a history of coordinates of an area including a moving object detected by the moving object detecting means; and a coordinate history storing means. And a coordinate judging unit for judging a still image encoding timing based on a change in the coordinate history of the area including the recorded moving object.

An image recording apparatus according to a second aspect of the present invention comprises:
In addition to the effect of the first aspect, the still image encoding timing determination means determines the generation timing of the request signal for still image encoding from the history of the coordinates of the moving object.

An image recording apparatus according to a third aspect of the present invention comprises:
In the invention according to claim 1 or 2, the encoding means comprises: a first time code adding section for adding a first time code to a moving image before encoding inputted from the camera section; An input image buffer for temporarily recording a moving image with a time code added thereto, a moving image encoding unit for blocking and encoding a moving image from the camera unit, and a moving image output from the moving image encoding unit A second time code adding unit for adding a second time code to the encoded data, and storing a correspondence relationship between the first time code and the second time code, and When a request signal for still image encoding based on the second time code is received, the first signal corresponding to the second time code is received.
A time code corresponding storage means for outputting a time code of, and taking out a part of the moving image data from the input image buffer based on the first time code from the time code corresponding storage means, forming a block as a still image and encoding And a still image encoding unit.

In the image recording apparatus according to the third aspect of the present invention, in addition to the operation of the first or second aspect of the present invention, when the moving image is stored in the input image buffer for temporarily storing the moving image, the first And the time code of I2 is added to the moving image encoded by the moving image encoding unit. Then, the correspondence between the above two time codes is associated with the time code correspondence storage means, and a moving image corresponding to the time determined by the still image encoding timing determination means is appropriately extracted from the input image buffer and the still image is correctly encoded. Become

An image recording apparatus according to a fourth aspect of the present invention comprises:
In the invention according to any one of claims 1 to 3,
The still image encoding timing determination means is provided with a man-machine interface means for inputting a determination condition of a region including a moving object.

According to a fourth aspect of the present invention, in addition to the operation of the first aspect of the present invention, in addition to the operation of the first to third aspects, the man-machine interface means moves the still image coding timing determining means to the still image coding timing determining means. The judgment condition of the area including the object is input.

According to a fifth aspect of the present invention, there is provided an image recording apparatus comprising:
In the invention of claim 4, the man-machine interface means includes a display means for displaying a moving image decoded by the decoding means on a screen, and a moving object by specifying an area on the screen of the display means. Pointing means for inputting an area determination condition.

In the image recording apparatus according to a fifth aspect of the present invention, in addition to the effect of the fourth aspect of the present invention, the moving image decoded by the decoding means is displayed on the display means. Then, the pointing unit specifies an area in the video on the screen that is a determination condition of the still image encoding timing determination unit,
The mark of the specified area is displayed on the moving image. This mark portion is the determination condition of the still image encoding timing determination means.

An image recording apparatus according to a sixth aspect of the present invention comprises:
6. The pointing device according to claim 5, wherein the display unit superimposes a mark of an area including the moving object detected by the moving object detection unit on the moving image decoded by the decoding unit and displays the mark on a screen, When the mark is designated by the means, the still image encoding timing determining means outputs the still image encoding request signal.

In the image recording apparatus according to a sixth aspect of the present invention, in addition to the operation of the fifth aspect, a mark of an area including the moving object detected by the moving object detecting means in the moving image decoded by the decoding means. Is displayed on the screen, and a mark of an area including the moving object displayed by the moving object detecting means is designated on the screen, thereby inputting coordinate data serving as a determination condition of the still image coding timing determining means. I do.

An image recording apparatus according to a seventh aspect of the present invention comprises:
2. The still image encoding apparatus according to claim 1, wherein when the still image encoding request signal is input from the still image encoding timing determining unit, the recording unit transmits the still image encoded data from the encoding unit and the moving image before and after the still image encoded data. The image encoding data is recorded collectively.

In the image recording apparatus according to a seventh aspect of the present invention, in addition to the effect of the first aspect of the present invention, the recording means temporarily records the moving image and outputs the still image from the still image encoding timing determining means. When a request signal for requesting image encoding is input, encoded moving image data before and after the input of the request signal is taken out and recorded together with still image data.

An image recording apparatus according to the invention of claim 8 is:
In the invention according to any one of claims 1 to 7,
The moving object detecting means detects a moving object using moving image data from the encoding means, instead of the moving image data decoded by the decoding means.

According to an eighth aspect of the present invention, in addition to the operation of any one of the first to seventh aspects, the moving object detecting means is provided not by the decoding means but by the encoding means. The moving object is detected by using the moving image data from.

According to a ninth aspect of the present invention, an image recording apparatus comprises:
In an image recording apparatus that encodes, transmits, and records an image, a camera unit that captures a moving image, and a moving image from the camera unit is temporarily stored in an input image buffer with a time code added thereto, and is stored in the input image buffer. Encoding means for encoding a moving image and a specific image from the input image buffer as a still image, and recording means for recording still image encoded data encoded by the encoding means, Transmitting means for transmitting the moving picture encoded data encoded by the encoding means, and decoding for decoding the encoded moving picture encoded data from the encoding means transmitted through the transmitting means; Means, a display means for displaying a moving image decoded by the decoding means, and a request for encoding a still image with a designated time code to the encoding means via the transmission means, Wherein further comprising an operation input means for transmitting a request signal for recording on the recording means.

In the image recording apparatus according to the ninth aspect of the present invention, the recording unit is integrated with the camera unit and the encoding unit, and the user looks at the display unit at a remote location and determines the timing of recording as a still image. In the input image buffer of the recording means, a moving image from the camera unit is temporarily recorded with a time code added. When a request signal for encoding a still image including a time code is sent from the operation input unit to the encoding unit, the encoding unit encodes the still image corresponding to the time code and records the still image in the recording unit according to the request signal. .

[0025]

[0026]

[0027]

[0028]

[0029]

Embodiments of the present invention will be described below. FIG. 1 is a configuration diagram of an image recording apparatus according to a first embodiment of the present invention.

In FIG. 1, an input video signal captured by a camera unit 101 is encoded by an encoding unit 102 and sent to a transmission unit 103. The camera unit 101 is capable of capturing a high-definition still image. Encoding means 10
Reference numeral 2 denotes a block in which the moving image from the camera unit 101 is encoded and transmitted to the transmission unit 103. In addition, camera unit 1
01 is temporarily recorded, and when there is a request signal for still image coding from the still image coding timing determination means H102, the requested moving image is specified and the specific image is specified. As a still image, is encoded and transmitted to the transmission unit 103. Transmission means 103
For example, a LAN, infrared communication means, a telephone line, and a wireless telephone line have a transmission capacity of several tens Kbps to several Mbps. This transmission capability has a limit in resolution when moving image data is transmitted as it is, but it can be confirmed that a moving object exists.

The coded moving picture data and the coded still picture data from the transmission means 103 are recorded in the recording means H103, and the coded moving picture data is decoded by the decoding means 104.
Is input to

The decoding means 104 decodes the encoded data sent from the transmission means 103 to create a reproduced image signal. In the moving object detecting means H101, the decoding means 1
An area including a moving object in the moving image is detected based on the moving image data sent from the moving image data. That is, the moving object detection unit H101 determines whether the image in the block decoded by the decoding unit 104 is in a stationary state or a moving state, and detects a moving object from the determination result.

Still picture coding timing determining means H102
Then, when the area of the moving object detected by the moving object detecting means H101 exceeds a predetermined size, a request signal for requesting still image coding to the coding means 102 is transmitted through the transmitting means 103. . Encoding means 1
02 creates still image encoded data according to the request signal and transmits the encoded still image data to the recording unit H103 via the transmission unit 103. Thus, useless transmission of a still image is suppressed.

FIG. 2 is a block diagram showing an example of the configuration of the encoding means 102. First, an input video signal sent from the camera unit 101 is converted from an analog signal to a digital signal by the A / D unit 201. The digitized video signal passes through a switch 202 for determining whether or not to encode the frame, and is then input to a format conversion unit 203. The format conversion unit 203 converts the RGB signal into a YCbCr signal, and converts the image size into a YCbCr signal.
06.

The image size converter 204 applies a low-pass filter to the input video signal, down-samples the image signal to reduce the image size, and inputs the reduced image size to the moving image encoder 205. The moving image encoding unit 205 encodes the input video signal as a moving image, attaches a time code, and inputs the encoded data to the multiplexing unit 210.

On the other hand, when the encoding control unit 209 receives a request signal for requesting still image encoding from the still image encoding timing determining unit H 102, it turns on the switch 207 and outputs a signal from the input image buffer 206. , A frame that matches the time code of the retransmission request signal is selected and encoded by the still image encoding unit 208, and the encoded data is multiplexed by the multiplexing unit 210 with the encoded data from the moving image encoding unit 205. I do.

The encoded data multiplexed by the multiplexing unit 210 is sent to the transmission line 103 via the output buffer 211. The encoding control unit 209 also controls the output buffer 21
A coding parameter is determined by using the buffer amount of 0 and the coding results of the moving picture coding unit 205 and the still picture coding unit 208 to control the coding amount.

FIG. 3 is a block diagram showing an example of the configuration of the moving picture coding unit 205 of the coding means 102. In FIG. 3, the moving image signal from the image size conversion unit 204 is
It is input to the blocking unit 301 of the moving picture coding unit 205, where it is divided into macroblocks. The moving image signal divided into macroblocks is input to the subtractor 302, and a difference from the predicted image signal is obtained to generate a prediction residual signal.

One of the prediction residual signal and the moving picture signal from the blocking section 301 is selected by a mode selection switch 303, and is subjected to a discrete cosine transform by a DCT (discrete cosine transform) section 304. DCT part 3
The DCT coefficient data obtained in step 04 is quantized in the quantization section 305. The signal quantized by the quantization unit 305 is split into two, and one of the signals is subjected to variable-length encoding by a variable-length encoding unit 313.

On the other hand, the other of the signals quantized and bifurcated by the quantization unit 305 is quantized by the inverse quantization unit 306 and the IDCT (inverse discrete cosine transform) unit 307.
After sequentially receiving a process reverse to the process of the DCT unit 304, the adder 308 adds the signal to the signal input via the switch 311 to generate a locally decoded signal. This local decoded signal is stored in the frame memory 309 and input to the motion compensation unit 310. The motion compensating unit 310 generates a predicted image signal, and the mode selecting unit 312
Send necessary information to

The mode selection unit 312 selects a macroblock for inter-frame coding and a macroblock for intra-frame coding based on prediction information from the motion compensation unit 310 for each macroblock. When performing intra-frame coding (intra coding), the mode selection switch information M is set to A, and the switch information S is set to A. When performing inter-frame coding (inter coding), the mode selection switch information M is set to B, and the switch information S is set to B. The mode selection switch 303 switches the switch based on the mode selection switch information M, and the switch 311 switches the switch based on the switch information S.

Here, the modes include an intra mode (INTRA), an inter mode (INTER), and a non-coding mode (NOT_CODED), which are associated with each macroblock, and the INTRA macroblock is subjected to intra-frame coding. The INTER macroblock is an image area to be inter-coded, and the NOT_CODED macroblock is an image area that does not need to be coded.

FIG. 4 is a block diagram showing an example of the configuration of the still image encoding unit 208 of the encoding means 102. The still image encoding unit 208 is activated by the encoding control unit 209 when a request signal for still image encoding is received from the still image encoding timing determination unit H102. When the still image coding unit 208 is activated, the moving image signal is taken into the blocking unit 401, and the blocking unit 401 divides the moving image signal into macro blocks.

The moving image signal divided into macro blocks is subjected to a discrete cosine transform by a DCT (discrete cosine transform) unit 402. The DCT coefficient data obtained by the DCT unit 402 is quantized by the quantization unit 403. The quantized signal is variable-length coded by a variable-length coding unit 404 and sent to the multiplexing unit 210. The multiplexing unit 210 multiplexes the encoded data from the moving image encoding unit 205 with the encoded data.
The coded data multiplexed in is transmitted to the transmission line 103 via the output buffer 211.

FIG. 5 is a block diagram showing an example of the configuration of the decoding means 104. The coded data sent from the transmission unit 103 is first stored in the input buffer 501 once, and the multiplexing / demultiplexing unit 502 separates the coded video data and the coded still image data, and decodes each of them. 503 and a still image decoding unit 504.
The moving picture decoding unit 503 decodes the coded moving picture data to create a reproduced picture signal. On the other hand, the still image decoding unit 5
In step 04, the still image data is decoded to create a reproduced image signal.

FIG. 6 is a block diagram showing an example of the configuration of the moving picture decoding unit 503 of the decoding unit 104 and the moving object detection unit H101. The encoded video data separated by the demultiplexing unit 502 of the decoding unit 104 is input to the variable-length decoding unit 601 of the video decoding unit 503.
The variable-length decoding unit 601 decodes the encoded video data separated by the demultiplexing unit 502 into a variable-length code of information of each syntax.

In the variable length decoding unit 601, if the mode of the macroblock is INTRA, the mode changeover switch 6
Select 07 off. The quantized DCT coefficient information decoded by the variable length decoding unit 601 is inversely quantized by the inverse quantization unit 602, and the IDCT unit 603 performs inverse discrete cosine transform processing to generate a reproduced image signal. This reproduced image signal is stored in the frame memory 605 as a reference image.

On the other hand, when the variable length decoding unit 601 determines that the mode of the macroblock is INTER or NOT_CODED, the mode changeover switch 607 is selected to be on. The quantized DCT coefficient information decoded by the variable length decoding unit 601 is inversely quantized by the inverse quantization unit 602, and the IDCT unit 6
At step 03, an inverse discrete cosine transform process is performed, and the result is output to the adder 604. Further, based on the motion vector information decoded by the variable length decoding unit 601, the motion compensation unit 606 performs motion compensation on the reference image, and adds the added image by the adder 604 to generate a reproduced image signal. This reproduced image signal is stored in the frame memory 605 as a reference image.

On the other hand, in the moving object detecting means H101, the subtractor H112 finds the sum of absolute differences (SAD) between the reproduced image signal at the time of the INTRA macroblock and the image signal of the frame memory one frame before. In the static / movement determining unit H111, the mode information, the motion vector information, the DCT coefficient information, and the difference absolute value sum (SAD) obtained by the subtractor H112, decoded in the variable length decoding unit 601.
Then, a still / moving decision is made for each macroblock in the frame. The moving object determination unit H113 determines a moving object.

FIG. 7 is a flowchart showing the operation of the moving object detecting means H101. In the moving object detecting means H101,
As shown in FIG. 7, a macroblock static / moving determination is performed for each frame (S101), and thereafter a determination of a moving object is performed (S102). Are performed by the macroblock still / movement determination unit H111 and the moving object determination unit H112, respectively.

FIG. 8 is a specific flowchart of the macroblock still / movement determination (S101) of FIG. Where i and j
Represents the addresses of the vertical and horizontal macroblocks in the frame, respectively, and V_NMB and H_NMB represent the numbers of macroblocks in the vertical and horizontal directions in the frame. The two-dimensional array M [i] [j] is an array for storing information as to whether each macroblock is a moving macroblock. TRUE indicates a moving macroblock, and FALSE indicates a still macroblock. LOOP1 and LOOP2 indicate that processing is repeated between them. For example, in the case of LOOP1,
Steps S201 to S209 are repeatedly performed until i satisfies 0 to V_NMB-1. Also,
LOOP2 indicates that steps S202 to S208 are repeated until j satisfies 0 to H_NMB-1.

First, the mode information MODE from the variable length decoding unit 601 is determined for each macroblock (S20).
3). If MODE is INTRA, the sum of absolute differences (SAD) between the reproduced image signal of the macro block and the frame memory of one frame before is calculated and compared with the threshold value T0 (S
204). If the sum of absolute differences (SAD) is larger than the threshold value T0, the macroblock is determined to be a moving macroblock, and TRUE is substituted for M [i] [j] (S
206). If the sum of absolute differences (SAD) is equal to or smaller than the threshold value T0, the macroblock is determined to be a still macroblock, and FALSE is substituted for M [i] [j] (S20).
7).

In the judgment of step S203, MODE is set to INTER.
Then, from the motion vector information and DCT coefficient information from variable length decoding section 103, the sum of absolute values of motion vectors of the macroblock Σ | MV | and the sum of absolute values of DCT coefficients Σ | CO
FF | is calculated and compared with the respective thresholds T1 and T2 (S
205). If the absolute sum of motion vectors Σ | MV | and DC
If the sum of absolute values of the T coefficients Σ | COFF | is smaller than the threshold values T1 and T2, the macroblock is determined to be a still macroblock, and FALSE is substituted for M [i] [j] (S20).
7). Otherwise, the macroblock is determined to be a moving macroblock, and TRUE is substituted for M [i] [j] (S206).

In the determination of step S203, MODE is NOT_CO
If it is DED, the macro block is determined to be a still macro block, and FALSE is substituted for M [i] [j] (S20).
7).

Next, in the moving object determination unit H113 of the moving object detection means H101, the macro block static / movement determination unit H1
A moving object is determined from the 11 static / movement determination information for each macro block. FIG. 9 is a flowchart showing step S102 in FIG.
6 is a flowchart showing the processing content of a moving object determination process in FIG.

As shown in FIG. 9, the moving object determination process
Noise removal processing (S301) and moving object inclusion processing (S30)
2). Noise removal processing (S3
01), in order to prevent erroneous detection as a moving macroblock due to fluctuation of a small object in the background image or noise at the time of image capture, even if a macroblock is determined to be a moving macroblock, the surrounding 8 macros When all the blocks are stationary, the moving macro block is removed.

In the moving object inclusion process (S302), a process for detecting the smallest rectangle that includes the region where the adjacent moving macroblock exists is detected from the result of the still / movement determination after removing the noise. Through this process, a rectangle that includes the moving object can be found.

FIG. 10 shows the noise removal processing (S30) of FIG.
It is a flowchart of the specific processing content of 1). As in the case of FIG. 8, i and j represent the vertical and horizontal macroblock addresses in the frame, respectively, and V_NMB and H_NMB
Represents the number of macroblocks in the vertical and horizontal directions in the frame. The two-dimensional array M [i] [j] is an array for storing information on whether each macroblock is a moving macroblock or not.
TRUE indicates a moving macroblock, and FALSE indicates a still macroblock. LOOP1 and LOOP2 indicate that processing is repeated between them. For example, in the case of LOOP1, step S4 is performed until i satisfies 0 to V_NMB-1.
01 to step S408 are repeatedly performed. Also, in the case of LOOP2, this indicates that steps S402 to S407 are repeatedly performed until j satisfies 0 to H_NMB-1.

First, the result of static / dynamic determination for each macroblock is examined (S403). If the value of the two-dimensional array M [i] [j] is F
ALSE, that is, if it is a still macroblock, do nothing in that macroblock and go to the next macroblock. On the other hand, if the value of the two-dimensional array M [i] [j] is TRUE, that is, if it is a moving macroblock, the static / moving determination results of eight macroblocks around the macroblock are checked (S405), and all are FALSE, that is, the still macroblock. If it is a block, the macroblock is determined to be noise, and rewritten to a still macroblock (S406). If at least one of the surrounding eight macroblocks has a TURE, it is not determined to be noise, and the process moves to the next macroblock. In addition, about the outside of the screen,
It is assumed to be a still macroblock.

FIG. 11 shows the moving object inclusion processing (S3) in FIG.
It is a flowchart of the specific processing content of No. 02). Where n
Is a counter indicating the number of moving objects, and S1 to S4
Is a parameter indicating a range for searching for a rectangle including a moving object, S1 and S2 are the start and end points of a vertical address, and S3 and S4 are the start and end points of a horizontal address. First, initialization is performed so that the entire frame is designated as a search range (S501). Next, a function Rectangular for searching for the smallest rectangle that includes the moving object in the specified search range is called (S502).

FIGS. 12 to 15 show flowcharts of the processing contents of the function Rectangular. Function Rectangular
Is a two-dimensional array M in which the search ranges S1 to S4, the number n of moving objects, and the result of static / dynamic determination of each macroblock are stored.
[i] and [j] are input, and one-dimensional arrays B1 to B4 storing the rectangular addresses of the search result and the number n of the moving objects are output.

Here, the one-dimensional array HV is a work array for creating a histogram of the number of moving macroblocks in the vertical direction, and the one-dimensional array HH is a histogram of the number of moving macroblocks in the horizontal direction. It is a work arrangement to perform. The variable VFLAG is TRUE when the value of the histogram in the horizontal direction is not 0, and FALSE when the value is 0.
Is changed so that the variable HFLAG is
TRUE if the vertical histogram value is not 0
The flag is changed to be FALSE when the value is 0. Further, LOOP1 to LOOP6 indicate that the processing is repeated between them.

In FIG. 12, a work array HV for creating a histogram of the number of moving macroblocks in the vertical direction is shown.
The range of S1 to S2, which is the search range of [i], is initialized with a value of 0 (S601). Next LOOP1 (S602 to S607)
And LOOP2 (S603 to S606), a histogram is created of the number of moving macroblocks in the vertical direction in the search range. That is, the value of the static / moving determination result M [i] [j] for each macroblock is compared (S604), and if the value is TURE (moving macroblock), HV [i] is increased by one.
(S605), and do nothing if FALSE.

Next, a continuous portion other than 0 is searched from the histogram in the vertical direction. First, the flag VF
LAG is set to FALSE (S608). And FIG.
As shown in (5), it is checked whether the histogram HV [i] is not 0 and VFLAG is FALSE in the order of the search range S1 to S2 (S610). This condition is applied to the start point of a continuous portion where the histogram is not zero. Therefore, since it is a candidate for the starting point in the vertical direction of the rectangle being searched for, the address i is stored in the one-dimensional array B1 [n], and VFLAG is set to TURE (S611).

Next, if the histogram HV [i] is 0 or
At the end point of the search range, it is checked whether VFLAG is true (S612). The condition corresponding to this condition is the end point of a continuous portion where the histogram is not zero.
Therefore, since it is a candidate for the vertical end point of the rectangle being searched, if the histogram HV [i] is 0, 1
The address i-1 is stored in the two-dimensional array B2 [n] (S61).
4) If not, the address i is stored in the one-dimensional array B2 [n] (S615). And VFLAG again FALSE
(S616).

FIG. 14 is a continuation of the flowchart of FIG.
This time, S is a search range of the work array HV [j] for creating a histogram of the number of horizontal moving macroblocks.
The range from 3 to S4 is initialized with the value 0 (S617). next
In the double loop of LOOP4 and LOOP5, a histogram of the number of horizontal moving macroblocks in the search range is created. In other words, the static / movement determination result M [k] for each macroblock
The value of [j] is compared (S620), and if the value is TURE (moving macroblock), HH [j] is incremented by 1 (S62).
1) If FALSE, do nothing. Then, a continuous portion other than 0 is searched from the horizontal histogram. First, the flag HFLAG is set to FALSE (S6
24).

Next, it is checked whether or not the histogram HH [j] is not 0 and the HFLAG is FALSE in the order of the search ranges S3 to S4. (S626) The condition that satisfies this condition is the start point of a continuous portion where the histogram is not zero. Therefore, since it is a candidate for the horizontal start point of the rectangle being searched, the address j is stored in the one-dimensional array B3 [n], and HFLAG is set to TURE (S627).

Next, as shown in FIG.
It is checked whether or not HH [j] is 0 or the end point of the search range, and whether or not HFLAG is TURE (S628). The condition corresponding to this condition is the end point of a continuous portion where the histogram is not zero. Therefore, since it is a candidate for the horizontal end point of the rectangle being searched, if the histogram HH
If [j] is 0, the address j-1 is stored in the one-dimensional array B4 [n].
Is stored (S630), otherwise, the one-dimensional array
The address j is stored in B4 [n] (S631). And
HFLAG is set to FALSE again (S632).

Here, the search using one histogram in the vertical direction and the horizontal direction has been completed.
It is checked whether or not [n] to B4 [n] matches the search ranges S1 to S4 (S633). If they match, there is no more search range, so the smallest rectangle is found. Can be determined (S634). Then, the number n of the moving objects is increased by one (S635), and the process proceeds to the search for the next moving object.

The search result B1 [n] to B4 [n] is within the search range S
If they do not match 1 to S4, there are still a plurality of moving objects in the range of the search result, and the search results B1 [n] to
B4 [n] is transferred to S1 to S4 (S637), and again
The function Rectangular is called (S637). In this way, the function Rectangular outputs the one-dimensional arrays B1 to B4 storing the rectangular addresses of the search result and the number n of the moving objects to the still image encoding timing means H102.

FIG. 16 is a block diagram showing an example of the configuration of the still image decoding section 504 of the decoding means 104. The still image encoded data separated by the demultiplexing unit 502 of the decoding unit 104 is
04 is input to the variable length decoding unit 701. The variable-length decoding section 701 decodes the encoded still image data from the demultiplexing section 502 into a variable-length code of information of each syntax. Quantization decoded by variable length decoding section 701
The DCT coefficient information is inversely quantized by the inverse quantization unit 702 and the IDC
In the T unit 703, an inverse discrete cosine transform process is performed. As a result, a reproduced image signal is generated.

FIG. 17 is a flowchart showing an example of the processing performed by the still image coding timing determining means H102. S1, S2, S3, S4 are moving object detecting means H10
2 represents the coordinates of a rectangle containing the moving object detected. The width of the rectangle | S2-S1 | is a predetermined value L1
And whether the height | S4−S3 | exceeds a predetermined value L2 (S801), and if so, a request signal for requesting still image coding is encoded via the transmission means 103. To the encoding control unit 209 of the encoding unit 102
(S802).

The encoding control section 209 of the encoding means 102
Receives a request signal for requesting still image encoding from the still image encoding timing determination unit H102, selects a frame that matches the time code of the request signal from the input image buffer 206, and allows the still image encoding unit 208 Encoded and multiplexed by the multiplexing unit 210 and output buffer 211
In addition, the encoded still image data is transmitted via the transmission path 103. The transmitted still image encoded data is stored in the recording unit H103 and is decoded by the decoding unit 104 as necessary.

Next, the recording means H103 is
3 is for recording the encoded moving image data and the encoded still image data transmitted from the recording device H. The encoded data recorded in the recording device H103 is freely decoded by the decoding device 104, and You can see it. The recording unit H103 is configured by a permanent storage unit such as a hard disk device, an optical recording device, a magnetic tape device, and a flash memory.

In the above description, the still image encoding timing determination means H102 determines that the width of the rectangle containing the moving object exceeds the predetermined value L1 and the height exceeds the predetermined value L2. A request signal for requesting still image encoding is output to a still image code when the moving speed falls below the threshold value in a situation where a moving object should be moving at a speed equal to or higher than a certain threshold value. A request signal for conversion may be output.

FIG. 18 is a block diagram of the still image coding timing determining means H102 in that case. The still image encoding timing determination unit H102 includes a coordinate history storage unit 901 that records a history of coordinates of a region including the moving object detected by the moving object detection unit H101, and a moving object recorded in the coordinate history storage unit 901. And a coordinate determination unit 902 for determining the timing of still image coding based on a change in the coordinate history of the region including the coordinate image.

The coordinate history storage means 901 stores the coordinates of the area including the moving object sent from the moving object detecting means H101. The coordinates of the area including the moving object sent from the moving object detecting means H101 are S1, S2, S3, S
It is represented by four numerical values of 4, and a plurality of areas are detected for each frame. Therefore, the coordinate history storage means 901
1, S2, S3, and S4 are assigned to the arrays S1 [k] [l] and S2, respectively.
[k] [l], S3 [k] [l], and S4 [k] [l].

Here, k is the number of areas including the moving object included in one frame, l is the number of the history, l = 0 represents the current frame, and l = 1 represents the previous frame. The coordinate determination means 902 determines whether S1 [k] [l], S2 [k] [l], S3 [k].
Using [l] and S4 [k] [l], the timing of the still image encoding request is determined.

FIG. 19 is a flow chart showing the processing contents of the coordinate judging means 902. The coordinate determination unit 902 causes the LOOP1 to sequentially perform processing for the number k (k = 1 to n) of the area including the moving object (S901, S904). Using an array to represent the center coordinates of the region including the k-th moving object, the center coordinates CV [k] [0] and CH [k] [0] in the current frame and the center coordinates in the previous frame CV [k] [1], CH
[k] [1] is calculated (S902). CV [k] [1] is the coordinate in the vertical direction, and CH [k] [1] is the coordinate in the horizontal direction.

Next, the absolute value of the difference between the coordinate value of the current frame and the coordinate value of the immediately preceding frame is calculated, and the change in the vertical direction is smaller than a predetermined value DV and the change in the horizontal direction is calculated. If the value is smaller than the predetermined value DH (S903), a request signal for requesting still image encoding is transmitted to the still image encoding means H102 (S905), and the processing exits from the loop.

As described above, in a situation where the moving object should be moving at a speed equal to or higher than a certain threshold, when the moving speed falls below the threshold, the image is encoded as a still image. Since the request signal for still image encoding is output not only based on the simple coordinates of the moving object but also based on the movement of the moving object, the moving object can be properly grasped.

In the above description, the encoding means 102
The time code is added to the moving image coded data by the moving image coding unit 205 of the format conversion unit 20.
3, a time code may be added.

That is, FIG. 20 is a block diagram showing the structure of the encoding means 102 in that case. The first means for adding a time code to the encoding means 102 shown in FIG. Time code adding unit 21
4. A second time code adding unit 212 for adding a term code in the moving picture coding unit 205 and a time code correspondence storage unit 213 are additionally provided.

The first time code adding unit 214 and the second time code adding unit 212 obtain the time from a clock (not shown), and convert the data output from the format conversion unit 203 and the moving image encoding unit 205 into time. Add code. The output data to which the time code is added by the format conversion unit 23 is divided into two, one of which is the input image buffer 212.
And the other is sent to the image size converter 204.

The time code added to the same frame by first time code adding section 214 (first time code
) And the time code (second time) added by the second time code adding unit 214, and the first time indicates the time stored in the input image buffer 212, The time 2 indicates the time when the moving picture coding unit 205 creates and transmits the moving picture coding data.

The moving picture coding unit 205 stores the first time added to the moving picture coded data and the second time added to the input data in the time code corresponding storage means 2.
Send to 13. The time code correspondence storage unit 213 stores the correspondence between the two time codes sent from the moving picture coding unit 205 in a correspondence table.

The encoded moving image encoded data output from the moving image encoding unit 205 includes the time code added by the second time code adding unit 212, and is transmitted via the transmission unit 103. The data is transmitted to the decoding means 104 and the storage means H103. Therefore,
The request signal for still image encoding transmitted from the still image encoding timing determination means H102 includes the second time.

When a request signal for still image coding is sent from the still image coding timing determining means H102, the time code correspondence storage means 213 refers to the second time included in the request signal and stores the second time. The second time is converted to the first time based on the correspondence table. Then, the encoding control unit 209 generates a request signal for still image encoding based on the first time.
Send to Accordingly, the image data recorded in the input image buffer 212 is encoded as a still image at the time frame to which the first time code is added and which has no time lag.

As described above, since the data sent to the image size conversion unit 204 requires time for the encoding process in the moving image encoding unit 205, the first time added to the input buffer 206 Although the second time added to the encoded moving image data is shifted, the difference can be compensated, so that an appropriate still image can be encoded.

Next, a second embodiment of the present invention will be described. FIG. 21 is a configuration diagram of an image recording apparatus according to the second embodiment of the present invention. This second embodiment is shown in FIG.
In contrast to the first embodiment shown in FIG. 1, a man-machine interface unit H for inputting a determination condition of an area including a moving object to a still image encoding timing determination unit H102
104 is additionally provided.

In FIG. 21, a man-machine interface H104 is additionally provided. This man-machine interface means H104
In addition to displaying the moving image encoded data decoded by
The determination condition of the area including the moving object can be input on the display screen, and the input determination condition is output to the still image encoding timing determination means H102.

FIG. 22 is an explanatory diagram of the man-machine interface means H104. The man-machine interface unit H104 includes a display unit H104-1 for displaying a moving image decoded by the decoding unit 104 on a screen, and a display unit H
Pointing means H1 for designating an area on the screen of 104-1 and inputting a determination condition of an area including a moving object
04-2.

The display means H104-1 has a display and displays a moving image. Pointing means H104-2
Is a mouse, for example, and is used to specify a rectangular area on the display by a drag operation of the mouse. The area specified by the pointing means H104-2 is, as shown in FIG.
Is displayed over the moving image. As shown in the display screen of FIG. 23, a rectangle H104-3 drawn by a dotted line is a pointing device H104- superimposed and displayed on the screen.
2 is the area specified by

The rectangular area H104-3 designated by the man-machine interface means H104 has a numerical value R
1, R2, R3, and R4, which are sent to the still image coding timing determination means H102. Where R
1, R2 are the start and end points of the vertical address, and R
3, R4 are the start and end points of the address in the horizontal direction. The still image coding timing determination unit H102 that has received the numerical values R1, R2, R3, and R4 representing the rectangular area stores these numerical values, and changes the determination condition of the process S801 in FIG. This is a condition for image coding timing.

(R1 <S1) and (S2 <R2) and (R3 <S3) and (S4 <R4) (1) The judgment condition of the above equation (1) is S1 including a moving object.
The regions represented by S2, S3, and S4 correspond to the above R1, R
It indicates that the region represented by 2, R3 and R4 has been completely entered. If the condition is that the two areas partially overlap, the following equation (2) is used instead of equation (1).

{Max (S1, R1) <min (S2, R2)} and {max (S3, R3) <min (S4, R4)} (2) Also, the area of the portion where the two regions overlap is If the condition is to be equal to or more than a certain value A0, the following equation (3) is used after the above-mentioned overlap is determined.

{Min (S2, R2) -max (S1, R1)} * {min (S4, R4) -max (S3, R3)}> A0 (3) Thus, the second embodiment Then, the decoding means 104
Pointing means H104 for the moving image decoded by
The region is designated by -2, and the designated region is superimposed and displayed on the screen of the moving image. Thus, an area in the video which is a determination condition of the still image encoding timing determination unit H102 is specified on the screen. Since a determination condition for encoding a still image can be specified on the screen of a moving image, the determination condition can be easily and intuitively set.

Next, a third embodiment of the present invention will be described. FIG. 24 is a configuration diagram of an image recording apparatus according to the third embodiment of the present invention. This third embodiment is shown in FIG.
In the second embodiment shown in FIG. 1, a rectangular area containing a moving object detected by the moving object detecting means H101 is transmitted to the man-machine interface means H104.

FIG. 25 is an explanatory diagram of the man-machine interface means H104 of FIG.
Reference numeral 1 denotes a screen in which a mark of an area including the moving object detected by the moving object detecting means H101 is superimposed on the moving image decoded by the decoding means 104 and displayed on the screen.

FIG. 26 shows an example of the display screen. The rectangles H104-4 and H104-5 drawn by dotted lines are
The mark of the area including the moving object detected by the moving object detecting means H101 displayed on the screen is shown. When the pointer H104-6 on the screen displayed by the pointing means H104-2 is moved over the mark in the displayed area and an operation of designating the mark is performed, the rectangular area becomes the numerical values R1, R2, R3, R4, and the still image encoding timing determination means H10
Sent to 2.

Numerical values representing rectangular areas, R1, R2, R
The still image encoding timing determination means H102, which has received the values r3 and r4, stores these numerical values and performs processing S in FIG.
The determination condition of 801 is changed to a condition of still image encoding timing.

As described above, the mark of the area including the moving object detected by the moving object detecting means H101 is superimposed on the moving image decoded by the decoding means 104 and displayed on the screen, and the moving object is included on the screen. By specifying a mark of an area to be processed, coordinate data serving as a determination condition of the still image coding timing determination means H102 is input. Therefore, the determination condition for encoding a still image can be set intuitively based on a test moving object photographed.

Next, a fourth embodiment of the present invention will be described. FIG. 27 is a configuration diagram of an image recording apparatus according to the fourth embodiment of the present invention. In the fourth embodiment, the recording unit H103 includes a still image encoding timing determination unit H
When a request signal for requesting still image encoding from 102 is received, encoded moving image data before and after the still image is recorded.

In FIG. 27, when the recording unit H103 receives a request signal for requesting still image encoding from the still image encoding timing determining unit H102, it records encoded moving image data before and after the request signal is received. Record.

FIG. 28 is a block diagram of the recording means H103. The primary storage control unit H103-1 controls the encoded image data input from the transmission unit 103, and includes a still image buffer H103-2 and a moving image frame buffer H103.
The encoded image data supplied to 103-3 is controlled.

The still image buffer H103-2 temporarily stores a still image. When a new still image is sent, the previous still image is overwritten. The number of moving image frame buffers H103-3 is N (N is 10 to 1).
00), and each frame buffer records a frame coded in the INTRA mode to a frame coded in the next INTRA mode. The frame buffer pointer H103-4 stores the number of the frame buffer in which the moving image data is to be written. Note that a semiconductor memory can be used as the still image buffer H103-2 and the moving image frame buffer H103-3.

When the secondary storage control unit H103-5 receives the still image encoding request signal, the secondary storage control unit H103-5 and the moving image frame buffer H103-2
-3 is stored in the secondary storage unit H10.
3-6. Secondary storage means H103
As -6, a permanent storage means such as a hard disk device, an optical recording device, a magnetic tape device, or a flash memory is used.

FIG. 29 is a flowchart showing the processing contents of the primary storage control unit H103-1. When the encoded image encoded data is input (S1301), it is determined whether the image is a still image or a moving image (S1303). If it is a still image, it is written to the still image buffer H103-2 (S1).
303), in the case of a moving image, it is determined whether or not the mode is the INTRA mode (S1304). If the mode is not the INTRA mode, data is written to the frame buffer indicated by the frame buffer pointer H103-4 (S1305).

On the other hand, in the case of the INTRA mode, once the data is written into the frame buffer indicated by the frame buffer pointer H103-4 (S1306), and the frame buffer pointer H103-4 is updated (S1307). The data is written in the frame buffer indicated by No. 4 (S1306). The frame buffer pointer H103-4 is updated by counting up from 1 to the number N of frame buffers one by one, and returning to 0 when the count reaches N. With this method, it is possible to refer to the images recorded in the past N-1 frame buffers (excluding the buffer currently being recorded).

FIG. 30 is a flowchart showing the processing contents of the secondary storage control unit H103-5. After inputting a request signal for still image coding (S1310), the apparatus sleeps for an appropriate time (S1311). The sleep time is determined by the time until a still image is encoded and transmitted, or the time to record a moving image after the input timing of a request signal for still image encoding, and is usually several seconds to several tens of seconds. Seconds.

Next, the data in the still image buffer H103-2 is copied to the secondary storage means H103-6 (S131).
2) Then, the data of the moving image frame buffer H103-3 is copied to the secondary storage means H103-6 (S13).
13). In the copying of the moving image frame buffer H103-3, the number of the frame is counted up from the frame next to the frame number of the frame buffer pointer H103-4 (most recently recorded) and copied.

As described above, when the recording unit H103 receives the request signal for still image encoding from the still image encoding timing determining unit H102, the recording unit H103 transmits the still image encoded data from the encoding unit 102 and the moving image before and after the still image encoded data. The image encoded data is recorded collectively. Therefore, when a moving object is detected, not only the still image but also the preceding and following moving images are recorded, so that the reliability of confirming the moving object is improved. Further, when no moving object is detected, no moving image is recorded as a moving image, so that not only the capacity of the recording unit H103 can be saved, but also unnecessary moving images need not be seen when surveying the recording result.

Here, the first to fourth embodiments are described.
In the embodiment, the moving object detecting means H101
Is configured to detect the moving object by inputting the moving image data decoded by the decoding unit 104, but instead of the moving image data decoded by the decoding unit 104, The moving object may be detected using the moving image data from the moving image encoding unit 205.

FIG. 31 shows a moving picture coding unit 205 and a moving object detecting means H101 of the coding means 102 in that case.
FIG. 3 is a block diagram of the configuration of FIG. In FIG. 31, the macroblock still / movement determination unit H111 of the moving object detection means H101,
The function of the moving object determination unit H113 is the same as that of the first embodiment shown in FIG. Moving object detecting means H1
01 receives the moving image data from the variable length coding unit 313 of the moving image coding unit 205 of the coding unit 102, and the macroblock still / moving determination unit H111 of the moving object detection unit H101.
Is used to determine the static motion of the macroblock.

Then, when it is determined that the moving macro block is a moving macro block, the moving object determining unit H113 determines the moving object. The data representing the area including the moving object detected by the moving object determination unit H113 is sent to the still image coding timing determination unit H102, and the still image coding request signal from the still image coding timing determination unit H102 is sent. Is sent to the encoding means 102.

As described above, since the moving object detecting means H101 is configured to detect the moving object using information from the encoding means 102, not from the decoding means 104, the moving object detecting means H101 can be used as a camera unit. It becomes possible to install it near 101. That is, the camera unit 10
1. The encoding unit 102, the moving object detection unit H101, and the still image encoding timing determination unit H102 can be integrated. Also, since the time required for the decoding means 104 to decode the moving image data is omitted and the signal enters the moving object detection means H101, the time delay is reduced and the capacity of the input image buffer 206 can be reduced.

Next, a fifth embodiment of the present invention will be described. FIG. 32 is a configuration diagram of an image recording apparatus according to the fifth embodiment of the present invention. In the fifth embodiment, a recording unit H103 includes a camera unit 101 and an encoding unit 102.
In a remote place, the user can use the display means H10.
5 and determine the timing of recording as a still image,
A request for encoding a still image is sent through the operation input unit H106, and the recording unit H103 encodes and records the still image in response to the request.

In FIG. 32, a moving image from a camera unit 101 is input to an encoding unit 102. Encoding means 10
Reference numeral 2 denotes a recording unit which temporarily records and encodes a moving image from the camera unit 101 and decodes the moving image via a transmission unit 103.
04. In the decoding means 104, the transmission means 103
Decoding the encoded video data sent through
The decoded moving image is displayed on the display unit H105.
The display means H105 comprises a video memory and a liquid crystal display.

Then, the operation input means H106 inputs the operation of the user who has watched the video on the display means H105 as the timing for coding the still image, and transmits the still image to the coding means 102 via the transmission means 103. Is transmitted. When there is a request to the encoding unit 102 to encode this still image, the encoding unit 102 encodes the requested image as a still image. The recording unit H103 records the still image encoded data encoded by the encoding unit 102.

The configuration of the encoding means 102 in this case is shown in FIG.
3 is shown. The encoding control unit 209 of the encoding unit 102
When a request signal for still image encoding is received from the operation input unit H106, the switch 207 is turned on, and a frame that matches the time code included in the request signal is selected from the input image buffer 206, and the still image encoding is performed. Part 20
8 for encoding. The encoded still image data is sent to the recording unit H103 and recorded.

In the above description, the encoding unit 102 uses the moving image from the camera unit 101 temporarily recorded in the input image buffer 206 when encoding a still image. The image data directly from the camera unit 101 when the request signal for still image encoding is received from the means H106 may be encoded as a still image.

FIG. 34 is a block diagram of the encoding means 102 in that case. Unlike the case of FIG. 33, the encoding means 10
2 directly receives and encodes image data from the camera unit 101 through the format conversion unit 203. That is, the input image buffer 206 is not provided. As a result, costs can be kept low.

Further, as shown in FIG.
Use one that can adjust the shooting direction and magnification as 1.
It is also possible to control the photographing direction and the magnification by the operation input unit H106. Operation input means H
The input unit 106 inputs an operation signal using a joystick or a keypad, for example.

As described above, according to the fifth embodiment, the camera unit 101, the encoding unit 102, and the recording unit H1
03 can be integrated into a compact configuration,
The compacted part can be remotely operated by the operation input means H106. Further, since the structure in which the camera unit 101, the encoding unit 102, and the recording unit H103 are integrated is similar to the structure of a general digital camera, it is expected that the cost can be reduced by using parts common to these. When a camera unit 101 that can adjust the shooting direction and magnification is used, the camera unit 10
Since the shooting range and magnification of 1 can be remotely controlled, the convenience of shooting is increased.

[0125]

As described above, according to the present invention, not only a moving image of an object (person) moving in the shooting range of the camera unit but also a high-definition still image can be recorded according to predetermined conditions. Thereby, the target object or the person can be specified more accurately. Further, since both the moving image and the still image are recorded as encoded data, the capacity of the recording medium can be reduced to several tens to several hundredths compared to the case of recording the decoded data.

In addition, the timing of encoding a still image can be determined based on the condition of the movement of a moving object, and further, the time lag of a target image encoded as a still image can be eliminated. Further, when a moving object is detected, not only the still image but also the preceding and following moving images are recorded, so that the reliability of the confirmation of the still image is improved.

Further, the camera unit, the encoding means, the moving object detection means, and the still image encoding timing determination means can be integrated, and the integrated and compact part can be remotely operated. Further, since the structure in which the camera unit, the encoding unit, and the recording unit are integrated is similar to the structure of a general digital camera, it is expected that the cost can be reduced by using parts common to these.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of an image recording apparatus according to a first embodiment of the present invention.

FIG. 2 is a block diagram showing a configuration of an encoding unit of the image recording device according to the first embodiment of the present invention.

FIG. 3 is a block diagram illustrating a configuration of a moving image encoding unit of the encoding unit according to the first embodiment of the present invention.

FIG. 4 is a block diagram illustrating a configuration of a still image encoding unit of the encoding unit according to the first embodiment of the present invention.

FIG. 5 is a block diagram showing a configuration of a decoding unit of the image recording apparatus according to the first embodiment of the present invention.

FIG. 6 is a block diagram showing an example of a configuration of a moving image decoding unit and a moving object detection unit of the decoding unit according to the first embodiment of the present invention.

FIG. 7 is a flowchart showing an operation of a moving object detection unit of the image recording apparatus according to the first embodiment of the present invention.

FIG. 8 is a flowchart showing processing contents of a macroblock still / moving determination process in step S101 in FIG. 7;

FIG. 9 is a flowchart showing processing content of a moving object determination process in step S102 in FIG. 7;

FIG. 10 is a flowchart showing the processing content of noise removal processing in step S301 in FIG. 9;

FIG. 11 is a flowchart showing processing contents of a moving object inclusion processing in step S302 in FIG. 9;

FIG. 12 shows a function Re in step S502 in FIG.
9 is a flowchart showing an operation (part 1) of ctangular processing.

FIG. 13 shows a function Re in step S502 in FIG. 11;
9 is a flowchart showing an operation (part 2) of ctangular processing.

FIG. 14 shows a function Re in step S502 in FIG.
9 is a flowchart showing an operation (part 3) of ctangular processing.

FIG. 15 shows a function Re in step S502 in FIG. 11;
9 is a flowchart showing an operation (part 4) of ctangular processing.

FIG. 16 is a block diagram illustrating an example of a configuration of a still image decoding unit of the decoding unit according to the first embodiment of the present invention.

FIG. 17 is a flowchart showing the processing content of a still image encoding timing determination unit according to the first embodiment of the present invention.

FIG. 18 is a block diagram showing another example of the still image encoding timing determination unit according to the first embodiment of the present invention.

FIG. 19 is a flowchart showing the processing contents of a coordinate determination means in FIG. 18;

FIG. 20 is a block diagram showing a configuration of another example of the encoding unit according to the first embodiment of the present invention.

FIG. 21 is a configuration diagram of an image recording apparatus according to a second embodiment of the present invention.

FIG. 22 is a block diagram showing a configuration of a man-machine interface according to the second embodiment of the present invention.

FIG. 23 is an explanatory diagram illustrating an example of a display screen of a man-machine interface according to the second embodiment of the present invention.

FIG. 24 is a configuration diagram of an image recording apparatus according to a third embodiment of the present invention.

FIG. 25 is a block diagram showing a configuration of a man-machine interface according to the third embodiment of the present invention.

FIG. 26 is an explanatory diagram illustrating an example of a display screen of a man-machine interface according to the third embodiment of the present invention.

FIG. 27 is a configuration diagram of an image recording apparatus according to a fourth embodiment of the present invention.

FIG. 28 is a block diagram showing a configuration of a recording unit according to a fourth embodiment of the present invention.

FIG. 29 is a flowchart showing processing contents of a primary storage control unit of a recording unit according to the fourth embodiment of the present invention.

FIG. 30 is a flowchart showing processing contents of a secondary storage control unit of a recording unit according to the fourth embodiment of the present invention.

FIG. 31 is a diagram showing an example in which the moving object detecting unit H101 according to the first to fourth embodiments uses moving image data from an encoding unit instead of moving image data from a decoding unit. FIG. 3 is a block diagram illustrating a configuration for detecting a moving object.

FIG. 32 is a block diagram showing a configuration of an image recording apparatus according to a fifth embodiment of the present invention.

FIG. 33 is a block diagram showing a configuration of an encoding unit according to a fifth embodiment of the present invention.

FIG. 34 is a block diagram showing a configuration of another example of the encoding unit according to the fifth embodiment of the present invention.

FIG. 35 is a block diagram showing a configuration in a case where a camera unit capable of adjusting a shooting direction and a magnification is used as a camera unit according to a fifth embodiment of the present invention.

[Explanation of symbols]

 Reference Signs List 101 Camera unit 102 Encoding unit 103 Transmission unit 104 Decoding unit H101 Moving object detection unit H102 Still image encoding timing determination unit H103 Recording unit 201 A / D unit 202 Switch 203 Format conversion unit 204 Image size conversion unit 205 Moving image code Encoding unit 206 Input image buffer 207 Switch 208 Still image encoding unit 209 Encoding control unit 210 Multiplexing unit 211 Output buffer 212 Second time code addition unit 213 Time code correspondence storage unit 214 First time code addition unit 301 Block Transformation unit 302 Subtractor 303 Mode selection switch 304 DCT unit 305 Quantization unit 306 Inverse quantization unit 307 IDCT unit 308 Adder 310 Motion compensation unit 311 Switch 312 Mode selection unit 313 Variable length coding unit 401 Blocking 402 DCT section 403 Quantization section 404 Variable length coding section 501 Input buffer 502 Demultiplexing section 503 Moving picture decoding section 504 Still picture decoding section 601 Variable length decoding section 602 Inverse quantization section 603 IDCT section 604 Adder 605 frame memory 606 motion compensator 607 switch H111 macroblock static / motion determiner H112 subtractor H113 moving object determiner 701 variable-length decoder 702 inverse quantizer 703 IDCT 901 coordinate history storage 902 coordinate determiner H104 man-machine Interface means H104-1 Display means H104-2 Pointing means H104-3 Area mark H104-4 Area mark H104-5 Area mark H104-6 Pointer H103-1 Primary storage control section H103-2 Still image buffer H10 -3 moving picture frame buffer H103-4 frame buffer pointer H103-5 secondary storage control unit H103-6 secondary storage unit H106 operation input means

──────────────────────────────────────────────────続 き Continued on the front page (72) Inventor Shun Ikeda 8 Shinsugita-cho, Isogo-ku, Yokohama-shi, Kanagawa Pref. Toshiba Corporation Yokohama Office (72) Inventor Yoshihiro Kikuchi 1 No. 1 Komukai-Toshiba-cho, Sai-ku, Kawasaki-shi, Kanagawa Stock (56) References JP-A-10-42275 (JP, A) JP-A-5-56393 (JP, A) JP-A-10-66054 (JP, A) (58) Fields surveyed (Int.Cl. ⁷ , DB name) H04N 5/91-5/956 H04N 7/18 H04N 7/24

Claims (9)

(57) [Claims] An image recording apparatus that encodes, transmits, and records an image, a camera unit that captures a moving image, blocks a moving image from the camera unit, encodes the moving image, and a moving image from the camera unit. Encoding means for temporarily recording a specific image as a still image and encoding the same as a still image, transmitting means for transmitting encoded data encoded by the encoding means, and a moving image code from the transmitting means. Decoding means for decoding the encoded data and the still image encoded data, and a noise removal process if the image in the block decoded by the decoding means is in a still state or a moving state and is in a moving state. A moving object detection means for detecting a moving object by the moving object inclusion processing; and a method in which the coordinates of an area including the moving object detected by the moving object detection means satisfy a predetermined condition. A still image encoding timing determining unit that transmits a request signal for requesting the still image encoding to the encoding unit; and a recording unit that records the moving image encoded data and the still image encoded data. An image recording apparatus characterized in that: 2. The method according to claim 1, wherein the still image encoding timing determining means records coordinate history of a region including the moving object detected by the moving object detecting means, and the coordinate history storing means records the coordinate history in the coordinate history storing means. The image recording apparatus according to claim 1, further comprising: a coordinate determination unit configured to determine a still image encoding timing based on a change in a coordinate history of an area including the moving object. 3. The encoding device according to claim 1, wherein the encoding unit includes a first time code adding unit that adds a first time code to the unencoded moving image input from the camera unit, and a moving image to which the first time code is added. An input image buffer for temporarily recording an image, a moving image encoding unit for blocking and encoding a moving image from the camera unit, and a second moving image encoded data output from the moving image encoding unit. A second time code adding unit for adding a time code, and a correspondence relationship between the first time code and the second time code, and based on the second time code from the still image coding timing determining unit. When a request signal for still image encoding is received, the second
Time code corresponding storage means for outputting a first time code corresponding to the time code, and extracting a part of the moving image data from the input image buffer based on the first time code from the time code corresponding storage means The image recording apparatus according to claim 1, further comprising: a still image encoding unit configured to block and encode a still image. 4. The still image encoding timing determining means according to claim 1, further comprising a man-machine interface means for inputting a condition for determining a region including a moving object. Item 2. The image recording device according to item 1. 5. The man-machine interface means,
Display means for displaying a moving image decoded by the decoding means on a screen, and pointing means for inputting a determination condition of an area including a moving object by designating an area on the screen of the display means. The image recording apparatus according to claim 4, wherein: 6. The display means displays on a screen a mark of a region including the moving object detected by the moving object detection means on a moving image decoded by the decoding means, and displays the mark on the screen by the pointing means. 6. The image recording apparatus according to claim 5, wherein, when the mark is designated, the still image encoding timing determining unit outputs the still image encoding request signal. 7. The still picture encoding data from the encoding means and the moving picture code before and after the still picture encoding data from the still picture encoding timing judging means when the still picture encoding request signal is inputted from the still picture encoding timing judging means. 2. The image recording apparatus according to claim 1, wherein the encoded data is recorded collectively. 8. The moving object detecting means detects a moving object by using moving image data from the encoding means instead of the moving image data decoded by the decoding means. Any one of claims 1 to 7
An image recording device according to the above item. 9. An image recording apparatus for encoding, transmitting, and recording an image, wherein a camera for photographing a moving image and a moving image from the camera are temporarily stored in an input image buffer with a time code added thereto. Encoding means for encoding a moving image from the camera unit and encoding a specific image from the input image buffer as a still image; and recording still image encoded data encoded by the encoding means. Recording means, transmitting means for transmitting moving image encoded data encoded by the encoding means, and encoded moving image encoded data from the encoding means sent through the transmitting means. Decoding means for decoding, display means for displaying a moving image decoded by the decoding means, and coding of a still image in which a time code is designated to the coding means via the transmission means And an operation input means for transmitting a request signal for requesting the recording means to record.