JP2013081013A - Image recording device and method, and image recording program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image recording device and method, and an image recording program capable of selectively recording a desired image including information on a vehicle parked in a parking space and a person getting in and out of the vehicle.SOLUTION: An image recording device has: an operation detector detecting an operation time period that is a time period in which an image of each parking space continuously changes, for each parking space, on the basis of images obtained by an imaging device that photographs a plurality of parking spaces each having a mark blocked by a vehicle; a mark detector detecting images of the mark from respective images at the start and termination of the operation time period, for each parking space; a recognition part recognizing loading of the vehicle to the parking space in the operation time period when the mark is detected at the start and when the mark is not detected at the termination, and recognizing unloading of the vehicle from the parking space in the operation time period when the mark is not detected at the start and when the mark is detected at the termination; and a recording part recording the image obtained by the imaging device in association with the operation time period in which the loading or unloading is recognized by the recognition part.

Description

  The present disclosure relates to an image recording apparatus and method for recording at least a part of a captured image, and an image recording program.

  As a monitoring system for monitoring a parking lot including a plurality of parking areas, a system for controlling image recording based on whether or not a difference is detected between images taken at predetermined time intervals has been proposed ( (See Patent Document 1).

  Further, a technique for detecting whether or not there is a vehicle in each parking area based on whether or not the vehicle blocks an optical path to an optical sensor installed in each parking area has been proposed (see Patent Document 2). Similarly, a technique for determining the presence or absence of a vehicle in each parking area based on whether or not a two-dimensional barcode installed in the parking area can be detected from an image obtained by photographing a plurality of parking areas has also been proposed. (See Patent Document 3).

JP 2003-259339 A Japanese Patent Laid-Open No. 2003-187397 JP 2010-250394 A

  According to the techniques of Patent Documents 2 and 3 described above, it is possible to obtain information indicating whether each parking area is empty or in use, but information for identifying a vehicle that is using the parking area. In addition, it is not possible to obtain information about persons who get on and off individual vehicles.

  On the other hand, when using an image recording device that detects and records a difference in images as in the technique of Patent Document 1, for example, in addition to an image representing a vehicle entry / exit process including a scene in which a person gets on and off a vehicle A huge amount of images may be recorded. This is because it is difficult to narrow down the range of the image to be recorded based only on the feature of the image. For example, it is difficult to discriminate between an image that captures the motion of a person getting on and off the vehicle and an image that captures the motion of a person passing near the vehicle based on the characteristics of the image. For this reason, in order to record an image that captures the movement of a person getting on and off the vehicle, if the condition of the image to be recorded is that there is some movement near the vehicle, the movement of the person passing near the vehicle is included. A very large number of images are also subject to recording.

  It is an object of the present disclosure to provide an image recording apparatus and method, and an image recording program for selectively recording a desired image including a process of entering and leaving a vehicle from a parking lot.

  An image recording apparatus according to one aspect is a period in which the image of each parking area continuously changes based on an image obtained by an imaging apparatus that captures a plurality of parking areas each having a mark blocked by a vehicle. An operation detection unit that detects a certain operation period for each parking area; a mark detection unit that detects an image of the mark for each parking area from images at the start and end of the operation period; and the start When the mark is detected at the time and the mark is not detected at the end, it is determined whether the vehicle has entered the parking area during the operation period, the mark is not detected at the start, and the mark is detected at the end. A detection unit that determines whether the vehicle has left the parking area during the operation period; Rui and a recording unit for recording an image obtained by the imaging device in response to operation period goods issue is discriminated.

  According to another aspect of the image recording method, the image of each parking area is continuously changed based on an image obtained by an imaging device that captures a plurality of parking areas each having a mark blocked by the vehicle. An operation period that is a period is detected for each parking area, an image of the mark is detected for each parking area from images at the start and end of the operation period, and the mark is detected at the start. When the mark is not detected at the end, it is determined whether the vehicle has entered the parking area. When the mark is not detected at the start and the mark is detected at the end, from the parking area The vehicle is released, and the image obtained by the imaging device is recorded corresponding to the operation period in which the entry or departure is determined.

  According to another aspect of the image recording program, the image of each parking area is continuously changed based on an image obtained by an imaging device that captures a plurality of parking areas each having a mark blocked by the vehicle. An operation period that is a period is detected for each parking area, an image of the mark is detected for each parking area from images at the start and end of the operation period, and the mark is detected at the start. When the mark is not detected at the end, it is determined whether the vehicle has entered the parking area. When the mark is not detected at the start and the mark is detected at the end, from the parking area The process of discriminating the exit of the vehicle and recording the image obtained by the imaging device corresponding to the operation period in which the entry or exit is determined To be executed by a computer.

  According to the image recording apparatus and method and the image recording program of the present disclosure, it is possible to selectively record a desired image including the process of entering and leaving the vehicle to the parking lot.

It is a figure which shows one Embodiment of an image recording device. It is a figure explaining the process in which a vehicle arrives in a parking area. It is a figure explaining the process in which a vehicle leaves from a parking area. It is a figure explaining the example which does not discriminate | determine both the warehousing and delivery of a vehicle in an operation period. It is a figure which shows the example of the operation period detected about each parking area. It is a figure which shows another embodiment of an image recording device. It is a figure which shows an example of an operation state database and a period database. It is a figure which shows the hardware structural example of an image recording device. It is a figure explaining a parking area definition database and an operation state database. It is a flowchart (the 1) of an example of the monitoring process of each parking area. It is a flowchart (the 2) of an example of the monitoring process of each parking area. It is a flowchart of an example of a recording control process. It is a flowchart of an example of the process which selectively records the video of recording object. It is a figure explaining a recording process. It is a flowchart of another example of the monitoring process of each parking area.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram illustrating an embodiment of the image recording apparatus 110. Reference numerals E01 to E04 illustrated in FIG. 1 indicate each parking area included in the parking lot 100. Moreover, the code | symbol Q1 shown in FIG. 1 shows the parked vehicle. Moreover, the code | symbol M01-M04 shown in FIG. 1 shows the mark installed in each parking area E01-E04.

  The marks M01 to M04 illustrated in FIG. 1 may be, for example, letters, symbols, figures, and combinations thereof that are hidden by the vehicle, and represent information for identifying the parking areas E01 to E04. A dimensional barcode or a color barcode may be used. These marks M01 to M04 are desirably installed so as to be obscured from the field of view of the imaging device 101 by the vehicles when there are parked vehicles in the parking areas E01 to E04. In addition, the example of FIG. 1 has shown a mode that the mark M04 installed in these parking areas is obstruct | occluded by the vehicle Q1 parked in the parking area E04.

  In the following description, the parking areas E01 to E04 are simply referred to as parking areas. Similarly, when the marks M01 to M04 corresponding to the parking areas E01 to E04 are generically referred to, they are simply referred to as marks.

  The image recording apparatus 110 illustrated in FIG. 1 receives an input of a video V obtained when the imaging apparatus 101 captures a parking lot 100 including a plurality of parking areas E01 to E04. The video V may be, for example, a so-called video including an image obtained by the imaging device 101 performing a shooting operation at a frame rate of about 30 frames per second, or obtained at a frame rate of about 1 frame per second or less. It may be a video.

  Then, the image recording device 110 records an image including information related to the process of entering the vehicle in each parking area or the process of leaving the vehicle from each parking area, included in the video V, as described later.

  The image recording apparatus 110 illustrated in FIG. 1 includes an operation detection unit 111, a mark detection unit 112, a determination unit 113, and a recording unit 114. The video V photographed by the imaging device 101 is input to the motion detection unit 111, the mark detection unit 112, and the recording unit 114.

  The motion detection unit 111 monitors the video V captured by the imaging device 101 for each parking area, so that the motion detection unit 111 detects an operation period that is a period in which the image is continuously changing. The motion detection unit 111 detects, for example, a difference between images captured at a predetermined time interval included in the video V for each region of the image corresponding to the individual parking area, so that the vehicle in each parking area and You may detect the motion of the subject which a person contains. And the motion detection part 111 may detect the period when the difference is detected in the area | region of the image corresponding to an individual parking area as an operation period in the said parking area. In addition, the area | region of the image corresponding to each parking area E01-E10 can be preset by the address etc. of the pixel which shows the four corners of the square frame which designates the range of each parking area, for example.

  The mark detection unit 112 illustrated in FIG. 1 includes the parking area from the region corresponding to the parking area of the start image and the end image of the operation period obtained by the operation detection unit 111 for each individual parking area. Detect the image of the mark placed on the. In addition, when the mark installed in each parking area is a two-dimensional barcode, the mark detection unit 112 may use a two-dimensional barcode reading technique for the mark detection process. Similarly, when the mark installed in each parking area is a color barcode, the mark detection unit 112 may use a color barcode reading technique for the mark detection process.

  Here, the marks M01 to M04 respectively installed in the parking areas E01 to E04 illustrated in FIG. 1 are covered by the imaging device 101 when there are parked vehicles in the parking areas E01 to E04. Therefore, since the image photographed in a state where there is a parked vehicle in the parking area of interest does not include the corresponding mark image, the mark detection unit 112 detects the mark corresponding to the parking area from such an image. The image cannot be detected. On the other hand, since the image shot in a state where there is no parked vehicle in the parking area of interest includes the image of the corresponding mark, the mark detection unit 112 detects the mark corresponding to the parking area from such an image. An image can be detected.

  Therefore, since the mark corresponding to the parking area to which the mark detection unit 112 pays attention cannot be detected from the image at the start of the operation period, there may be a vehicle parked in the parking area at the start of the operation period. I understand. On the contrary, since the mark corresponding to the parking area to which the mark detection unit 112 focuses attention can be detected from the image at the start of the operation period, there is no vehicle parked in the parking area at the start of the operation period. I understand. Similarly, there was a vehicle parked in the parking area at the end of the operation period because the mark corresponding to the parking area to which the mark detection unit 112 notices could not be detected from the image at the end of the operation period. I understand. On the other hand, since the mark corresponding to the parking area to which the mark detection unit 112 focuses attention can be detected from the image at the end of the operation period, it can be understood that there is no parked vehicle in the parking area at the end of the operation period. .

  Based on the detection result obtained by the mark detection unit 112 described above, the determination unit 113 illustrated in FIG. 1 includes a process of entering the parking area or a process of leaving the parking area during the detected operation period. An operation period corresponding to the photographed period is determined.

  Here, the information included in the video V obtained by the imaging device 101 in the process of leaving the vehicle in the parking area and the video V obtained by the imaging device 101 in the process of entering the vehicle from the parking area will be described.

  FIG. 2 is a diagram illustrating a process in which a vehicle enters the parking area. Moreover, FIG. 3 is a figure explaining the process in which a vehicle leaves from a parking area. 2 and 3, reference numerals E01 and E02 indicate parking areas, respectively. Reference numerals M01 and M02 are marks indicating the parking areas E01 and E02, respectively. Moreover, the code | symbol Q1 shows a vehicle and the code | symbol P1, P2 shows a person, respectively.

  2A to 2F are examples of images included in the video V obtained by the imaging device 101 in the process in which the vehicle Q1 enters the parking area E02. In addition, although the imaging device 101 includes the parking areas E01 to E04 in the field of view, the portions corresponding to the parking areas E01 and E02 in the field of view of the imaging device 101 are illustrated in FIGS. Indicated.

  2A to 2C show scenes included in the process in which the vehicle Q1 enters the parking area E02. FIGS. 2D to 2F show scenes where the persons P1 and P2 descend from the vehicle Q1 parked in the parking area E02 and scenes included in the process where the persons P1 and P2 leave the parking area E02.

  In many cases, after a vehicle enters the parking area, a driver or a passenger of the vehicle gets out of the vehicle without delay. For example, during the process in which the vehicle Q1 enters the parking area E02, a period in which the image changes with the movement of the persons P1 and P2 appears after the period in which the image changes with the movement of the vehicle. Since the motion detection unit 111 illustrated in FIG. 1 does not distinguish between the movement of the vehicle Q1 and the motions of the persons P1 and P2, the motion detection unit 111 detects each image illustrated in FIGS. The period during which the image is captured by the camera 101 is detected as one of the operation periods.

  Comparing FIGS. 2A to 2F with attention to the mark M02 installed in the parking area E02, the mark M02 that was visible when the vehicle Q1 started entering is marked with the entry of the vehicle Q1. It can be seen that M02 is blocked by the vehicle Q1. The state where the mark M02 is blocked continues even after the entry of the vehicle Q1 into the parking area E02 is completed and the persons P1 and P2 leave the parking area E02.

  Therefore, when the mark of the parking area of interest is detected from the image at the start of the operation period and the mark is not detected from the image at the end, the determination unit 113 determines the operation period as the parking area. It may be determined as an operation period in which there was a warehousing process.

   On the other hand, FIGS. 3A to 3F are obtained by the imaging device 101 in the process in which a person P1 approaching the vehicle Q1 parked in the parking area E01 gets out of the parking area E01 after getting into the vehicle Q1. 3 is an example of an image included in a displayed video V. Note that the images illustrated in FIGS. 3A to 3F correspond to portions corresponding to the parking areas E01 and E02 in the field of view of the imaging device 101.

  FIGS. 3A and 3B show scenes included in the process in which the person P1 approaches the vehicle Q1 parked in the parking area E01. Further, FIGS. 3C to 3F show scenes included in the process in which the vehicle Q1 on which the person P1 gets out leaves the parking area E01.

  When a vehicle leaves the parking area, the driver or passenger of the vehicle often enters the parking area prior to this. For example, a period in which the image changes as the vehicle Q1 moves appears after the period in which the image changes as the person P1 approaches the vehicle Q1 parked in the parking area E01. Since the motion detection unit 111 illustrated in FIG. 1 does not distinguish between the movement of the vehicle Q1 and the motion of the person P1, the motion detection unit 111 causes each of the images illustrated in FIGS. The photographed period is also detected as one of the operation periods.

  Comparing FIGS. 3A to 3F by paying attention to the mark M01 installed in the parking area E01, when the person P1 approaches the vehicle Q1, the mark M01 blocked by the vehicle Q1 is displayed on the vehicle Q1. It turns out that it becomes visible with movement. And the state where the mark M01 can be seen without being blocked is continued even after the vehicle Q1 has been left from the parking area E01.

  Therefore, when the mark of the parking area of interest is not detected from the image at the start of the operation period and the mark is detected from the image at the end, the determination unit 113 sets the operation period to the parking area. It may be determined as an operation period in which there is a leaving process.

  In this manner, the determination unit 113 determines an operation period in which the vehicle has entered or exited from each operation period detected by the operation detection unit 111, based on the mark detection result by the mark detection unit 112. be able to.

  Here, a case will be described in which the above-described determination unit 113 does not determine whether the vehicle enters or exits during the operation period of interest.

  FIGS. 4A, 4 </ b> B, and 4 </ b> C are diagrams illustrating an example in which neither vehicle entry nor delivery is determined during the operation period. Reference numerals E03 and E04 shown in FIG. 4 each indicate a parking area. In addition, symbols P1, P2, and P3 shown in FIG. 4 indicate a person or a group of persons, respectively. Moreover, the code | symbol Q1 shown in FIG. 4 shows the vehicle parked in the parking area E04, and the code | symbol M03 shows the mark installed in the parking area E03. 4A to 4C correspond to portions corresponding to the parking areas E03 and E04 in the field of view of the imaging device 101.

  Each of the images illustrated in FIGS. 4A to 4C is an example of an image obtained by the imaging apparatus 101 during an operation period detected by the operation detection unit 111 by monitoring with attention paid to the parking area E04. The image illustrated in FIG. 4A is an image when a change in the image corresponding to the movement of the person P1 that appears in the vicinity of the parking area E04, that is, the start point of the operation period described above. In addition, the image illustrated in FIG. 4B is an image taken in the process in which the person P1 and the group of persons P2 pass through the parking area E02, respectively. The image illustrated in FIG. 4C is the time immediately before the change of the image is not detected in the area corresponding to the parking area E04 due to the person group P2 passing through the parking area E04, that is, the above-described image. This is an image at the end of the operation period.

  If the image illustrated in FIG. 4 (A) and the image illustrated in FIG. 4 (C) are compared, since the vehicle Q1 is parked in the parking area E04, from any of these images, It turns out that the image of the mark installed in the parking area E04 cannot be detected. Therefore, the mark detection unit 112 illustrated in FIG. 1 obtains a mark detection result indicating that both the mark detection for the image at the start of the operation period and the mark detection for the image at the end have failed. As described above, the mark detection result indicating that the mark of the parking area of interest is not detected from the image at the start of the operation period and the image at the end of the operation period is a vehicle parked in the parking area throughout the operation period. Indicates that there is. Therefore, the determination unit 113 may determine that the operation period in which such a mark detection result is obtained is an operation period in which neither vehicle entry or exit is determined.

  On the other hand, if the image illustrated in FIG. 4A is compared with the image illustrated in FIG. 4C by paying attention to the parking area E03, the image is installed in the parking area E03 from any of these images. It can be seen that the image of the mark M03 can be detected. Accordingly, the mark detection unit 112 illustrated in FIG. 1 obtains a mark detection result indicating that both the detection of the mark for the image at the start of the operation period and the detection of the mark for the image at the end have succeeded. As described above, the mark detection result indicating that the mark of the parking area of interest is not detected from the image at the start of the operation period and the image at the end of the operation period is a vehicle parked in the parking area throughout the operation period. Indicates that there is no. Therefore, the determination unit 113 may determine that the operation period in which such a mark detection result is obtained is an operation period in which neither vehicle entry or exit is determined.

  The recording unit 114 illustrated in FIG. 1 records an image obtained by the imaging device 101 corresponding to the operation period in which vehicle entry / exit is determined by the determination unit 113 as described above. The recording unit 114 may add a determination result corresponding to each image data when the image obtained by the imaging device 101 is recorded in the operation period determined by the determination unit 113 as the exit process or the entry process. Good. Note that the recording unit 114 includes an image obtained by the imaging device 101 during the operation period determined by the determination unit 113 as the exit process and an image obtained by the imaging device 101 during the operation period determined as the entry process. , It may be recorded without distinction. In the following, the recording unit 114 does not distinguish between the image obtained by the imaging device 101 during the operation period determined as the exit process and the image obtained by the imaging device 101 during the operation period determined as the entry process. A case where recording is performed will be described.

  5A and 5B are diagrams illustrating examples of operation periods detected for the parking areas E01 to E04. The periods indicated by reference numerals # 1 to # 5 shown in FIG. 5 indicate the operation periods detected by the operation detection unit 111 for each parking area. In FIG. 5, the start time and end time of each operation period are indicated by a combination of the codes Ts and Te and the numbers indicating the operation periods, respectively.

  Since the motion detection unit 111 detects the motion period for each of the plurality of parking areas included in the field of view of the imaging apparatus 101, as illustrated in FIG. There is a belt. For example, the operation period # 1 and the operation period # 2 overlap over a time period from the start time Ts2 of the operation period # 2 to the end time Te1 of the operation period. Also, the operation periods # 4 and # 5 overlap with the operation periods # 2 and # 3 over the respective periods.

  The determination unit 113 determines the exit from the parking areas E01 and E02 for the operation periods # 1 and # 4 illustrated in FIG. 5A, respectively, and determines the entry to the parking area E01 for the operation period # 5. In this case, the recording unit 114 records the video during these operation periods as follows. In FIG. 5A, the operation periods # 1, # 4, and # 5 in which the determination unit 113 determines entry or exit are indicated by thick solid lines. On the other hand, in FIG. 5A, the operation periods # 2 and # 3 in which the determination unit 113 did not determine entry or exit are indicated by thick broken lines.

  In this case, for example, the recording unit 114 stores video data corresponding to videos captured by the imaging apparatus 101 in the operation periods # 1, # 4, and # 5 as recording target video data, respectively, on a recording medium such as an optical disk. Record. That is, the recording unit 114 extracts and extracts a recording target portion from the video data corresponding to the video V captured so far by the imaging device 101 based on the start time Ts1 to the end time Te1 of the operation period # 1. The recorded video data is recorded on a recording medium. Subsequently, based on the start time Ts4 to the end time Te4 of the operation period # 4, the recording unit 114 extracts a portion to be recorded from the video data corresponding to the video V captured so far by the imaging device 101, The extracted video data is recorded on a recording medium. Similarly, the recording unit 114 extracts a portion to be recorded from the video data corresponding to the video V photographed so far by the imaging device 101 based on the start time Ts5 to the end time Te5 of the operation period # 5. The extracted video data is recorded on a recording medium.

  As illustrated in FIG. 5A, when the operation periods in which the determination or release is determined by the determination unit 113 do not have time periods overlapping with each other, the recording unit 114 performs the individual operation as described above. Video data can be recorded based on the period. In this case, the recording unit 114 records the video data corresponding to the operation period every time when the determination unit 113 determines the exit or entry, so that the information relating to the exit or entry process to the parking area is recorded. Can be recorded.

  On the other hand, video data corresponding to a period in which there is no movement in any of the parking areas E01 to E04, or a period included only in an operation period in which neither entry nor exit is determined, does not include information related to vehicle entry or exit. . Therefore, such video data may be excluded from the recording target as video data that does not need to be recorded by the recording unit 114. Therefore, for example, video data corresponding to a video shot by the imaging apparatus 101 in the time period from the end time Te1 of the operation period # 1 illustrated in FIG. 5A to the start time Ts4 of the operation period # 4 is recorded. It is not recorded by the unit 114.

  As described above, according to the image recording device 110 of the present disclosure, it is possible to record only video data including information related to the exiting or entering the parking area.

  Here, for example, in a parking area close to an area where many people come and go, such as in the vicinity of the entrance of a shopping center, there is a possibility that the movement of vehicles and persons passing through the parking area frequently appear. According to the image recording apparatus 110 of the present disclosure, it is not determined whether the vehicle has entered or exited the parking area for the operation period detected according to the movement of the vehicle or person. This is because the image recording device 110 of the present disclosure is based on whether the mark of the parking area is detected from the images at the start and end of the operation period detected for each parking area based on the change in the image. This is because warehousing or delivery is determined with high accuracy. Then, based on the determination result, the recording unit 114 performs the above-described recording process, so that only video data in which no movement is observed in any parking area or movement that is neither in or out of the vehicle is captured. The video data can be excluded from the recording target with high accuracy. Accordingly, since video data representing only the movement of a vehicle and a person passing through the parking area can be excluded from the recording target, the video data recorded by the recording unit 114 is enormous regardless of the appearance frequency of such video data. It will not be a big amount.

  Note that the image recording device 110 of the present disclosure detects movement in each parking area and detection of a mark for determining the presence or absence of a parked vehicle in the parking area based on the video V obtained by photographing a plurality of parking areas. It is feasible. Therefore, it is not necessary to separately arrange a sensor for detecting the presence or absence of a vehicle for each parking area. Thus, the image recording apparatus 110 disclosed herein is also useful in that the hardware configuration is simple.

  By the way, an image representing a part of the process of the vehicle entering or leaving the parking area by deciding the time point at which image recording is started by paying attention only to the change in the occultation state of the marks installed in each parking area. Can be selectively recorded.

  However, for example, a scene in which a person gets on a vehicle parked in the parking area is included in a process before the occultation state of the mark installed in the parking area changes. For this reason, an image recording apparatus that starts recording when a mark becomes visible cannot record a scene in which a person gets on a vehicle leaving the parking area. Referring to FIG. 3, the image recording apparatus that starts recording when the mark becomes visible, as illustrated in FIG. 3D, records the image until the mark M01 appears by the movement of the vehicle Q1. Do not start. Therefore, such an image recording apparatus cannot record information relating to the person P1 included in the scene illustrated in FIGS.

  On the other hand, in the image recording device 110 of the present disclosure, when the change appears in the image corresponding to each parking area is the start time of the operation period, and when the operation period is determined to be the departure of the vehicle. It is the recording start time. Therefore, according to the image recording device 110 of the present disclosure, it is possible to record an image including information related to a person who has participated in leaving the vehicle, which appears prior to the movement of the vehicle. Similarly, in the image recording device 110 of the present disclosure, the end of the operation period is when the image corresponding to each parking area is no longer changed, and the recording ends when it is determined that the operation period is warehousing. It is time. Therefore, according to the image recording device 110 of the present disclosure, it is possible to record an image that includes information related to a person involved in the warehousing of the vehicle that appears after completion of the movement of the vehicle.

  As described above, the video data recorded by the image recording apparatus 110 illustrated in FIG. 1 includes the information for identifying the vehicle that has entered or exited any of the parking areas included in the parking lot, and the entry or exit of these vehicles. Contains information about the person involved in the. Therefore, the image recording apparatus 110 disclosed in the present disclosure is extremely useful for tracking a specific vehicle or identifying a person involved in the movement of the vehicle in that such information can be recorded. Useful for.

  Note that the arrangement of the imaging apparatus 101 that inputs the video V to the image recording apparatus 110 of the present disclosure is not limited to the arrangement illustrated in FIG. 2, for example, so that a larger number of parking areas can be accommodated in the field of view. Also good. Moreover, you may arrange | position the several imaging device 101 in the parking lot containing many parking areas so that each may hold the parking area for several vehicles in a visual field. In this way, by capturing a large number of parking areas included in the parking lot by using the plurality of imaging devices 101, the video V with less blind spots can be input to the image recording device 110 regardless of the size of the parking lot. Can do. Moreover, you may input into the image recording device 110 of the image | video V obtained by the some imaging device 101 arrange | positioned so that at least 1 parking area may be included in a visual field in common. By receiving such an input of the video V, the image recording device 110 can record the image data including information related to the entry / exit of the vehicle in at least one parking area without omission.

  By the way, as described above, since the operation detection unit 111 detects the operation period for each parking area, as illustrated in FIG. 5B, the operation in which the entry or exit of the vehicle into the different parking area is determined. The period may overlap with each other. In the example of FIG. 5 (B), a part of the operation period # 1 in which the delivery from the parking area E01 is determined overlaps with a part of the operation period # 4 in which the entry to the parking area E02 is determined. .

  In such a case, when the determination unit 113 determines entry or exit for each operation period, the recording unit 114 records video data corresponding to the video imaged by the imaging device 101 during the operation period. In this case, the video data of the overlapping period is recorded redundantly.

  In the following, an image recording apparatus capable of recording video data without duplication even when there is an overlap of operation periods as described above will be disclosed.

  FIG. 6 is a diagram illustrating another embodiment of the image recording apparatus 110. 6 that are the same as those shown in FIG. 1 are given the same reference numerals, and descriptions thereof are omitted.

  The image recording apparatus 110 illustrated in FIG. 6 includes an operation state database 115 and a period database 116 in addition to the units illustrated in FIG. Further, the recording unit 114 of the image recording apparatus 110 illustrated in FIG. 6 includes a temporary holding unit 117, a combining unit 118, and an extracting unit 119.

  The operation state database 115 illustrated in FIG. 6 holds, for each parking area, operation state information indicating that the vehicle is operating during the operation period detected by the operation detection unit 111 and indicating that the vehicle is stationary at times other than the operation period.

  FIG. 7A is an example of the operation state database 115. The operation state database 115 illustrated in FIG. 7A holds operation state information corresponding to the parking area IDs indicating the parking areas E01 to E04. The operation state database 115 illustrated in FIG. 7A holds the operation state information “operating” corresponding to the parking areas E01 and E03, and the operation state information “stationary” corresponding to the parking areas E02 and E04. Holds “medium”.

  The operation state database 115 corresponds to, for example, the parking area in which the change in the image is detected when the operation detection unit 111 is notified that the change in the image is detected in the process of detecting the operation period. The operation state information may be set to “in operation”. On the other hand, when the motion detection unit 111 notifies that the change in the image is no longer detected for the parking area, the motion state database 115 may set the motion state information of the parking area to “still”. Good. By updating the operation state database 115 in this manner, the movement state information stored in the operation state database 115 corresponding to each parking area causes a movement that appears as a change in image for each parking area at the present time. It can be shown whether or not there is.

  In addition, the period database 116 illustrated in FIG. 6 is provided for each period information including period information including information indicating the start time and end time of each operation period detected by the operation detection unit 111, and image recording is performed. A determination flag indicating that it is necessary is held.

  The period database 116 corresponds to, for example, a period number for identifying the operation period in accordance with the detection of the operation period by the operation detection unit 111, and a parking area ID indicating a parking area related to the operation period and the operation period. Information indicating the start time and end time is held. When the determination unit 113 determines the entry or exit of the vehicle for the operation period, the period database 116 sets a determination flag “record” indicating that the operation period is a recording target to the corresponding period information. Append. On the other hand, when the determination unit 113 determines neither vehicle entry or exit for the operation period, the period database 116 corresponds to a determination flag “recording unnecessary” indicating that the operation period is not a recording target. It is added to the period information.

  FIG. 7B is an example of the period database 116. The period database 116 illustrated in FIG. 7B includes period information corresponding to the operation periods # 1 to # 5 illustrated in FIG. 5 and determination flags corresponding to these operation periods # 1 to # 5. It is out.

  Next, using the information held in the operation state database 115 and the period database 116, the recording unit 114 overlaps video data even when the operation periods detected for a plurality of parking areas have overlapping periods. A recording method will be described.

  For example, referring to FIG. 5B, the operation periods # 2 to # 4 that have already been detected for the parking areas E02 to E04 at the end time Te1 of the operation period # 1 in which warehousing is determined by the determination unit 113. Has started. Therefore, whether or not the video data corresponding to the video V photographed after the end time Te1 of the operation period # 1 is to be recorded can be determined until the end times of these operation periods # 2 to # 4. Can not. On the other hand, at the end time Te2 of the operation period # 2, the determination for all the operation periods detected so far is completed. Therefore, by referring to the determination flag of the period database 116 described above at this point, it is possible to know whether or not the corresponding video data is a recording target for all the operation periods. Note that whether or not all the operation periods have been determined is determined based on, for example, whether or not all of the operation state information corresponding to the parking areas E01 to E04 included in the operation state database 115 is stationary. it can.

  If it is after it is determined whether or not all the operation periods are to be recorded, it is possible to find an operation period that overlaps each other from the operation periods in which the warehousing or the leaving to be recorded is determined.

  The recording unit 114 including the provisional holding unit 117, the coupling unit 118, and the extraction unit 119 illustrated in FIG. 6 can store video data even when the operation periods detected for a plurality of parking areas have overlapping periods. It is an example of the recording part 114 which records without making it overlap.

  A temporary holding unit 117 provided in the recording unit 114 illustrated in FIG. 6 temporarily holds video data corresponding to the video V input from the imaging device 101. The extraction unit 119 extracts the video data held in the temporary holding unit 117 corresponding to the operation period combined by the combining unit 118 as described later and the operation period remaining without being combined. Further, the extraction unit 119 sequentially records the video data extracted from the temporary holding unit 117 on the recording medium 120.

  The temporary holding unit 117 monitors the operation state information corresponding to the parking areas E01 to E04 illustrated in FIG. 1 by referring to the operation state database 115 described above at predetermined time intervals, for example. Then, when at least one of the operation state information stored in the operation state database 115 corresponding to the parking areas E01 to E04 changes to “in operation”, the temporary storage unit 117 displays the video V obtained by the imaging device 101. The holding of video data corresponding to is started. Thereafter, when the operation state information stored in the operation state database 115 corresponding to all parking areas has changed to “still”, the temporary storage unit 117 stops holding the video data. In this way, the temporary holding unit 117 provisionally records video data representing the video V obtained by the imaging device 101 during a period in which there is some movement in at least one parking area included in the field of view of the imaging device 101. It can be held as data.

  Further, the combining unit 118 illustrated in FIG. 6 similarly monitors the operation state information corresponding to the parking areas E01 to E04 by referring to the operation state database 115 described above at, for example, predetermined time intervals. Then, after at least one piece of operation state information in the operation state database 115 is in operation, when the operation state information corresponding to all the parking areas becomes “still”, the combining unit 118 includes the period database 116. Refer to Then, based on the period information in which the determination flag included in the period database 116 is set, the combining unit 118 combines operation periods having overlapping ranges among the operation periods indicated by these period information.

  Referring to the period database 116 illustrated in FIG. 7B, the discrimination flag is set to “record” in the period information # 1, # 4, and # 5 indicated by the period numbers # 1, # 4, and # 5. I understand that. For example, the combining unit 118 illustrated in FIG. 6 may detect an operation period having an overlapping range by comparing the start time and the end time included in the period information.

  For example, the start time Ts1 and end time Te1 of the period information # 1 corresponding to the operation period # 1 shown in FIG. 5B, and the start time Ts4 and end time Te4 of the period information # 4 corresponding to the operation period # 4. Can be seen that some of the two operation periods # 1 and # 4 overlap.

  For the operation periods having overlapping ranges detected in this way, the combining unit 118 may combine the two operation periods by obtaining a period including both of these operation periods, for example.

  Referring to FIG. 5B, the combining unit 118 combines the operation periods # 1 and # 4 from the start time Ts1 of the operation period # 1 to the end time Te4 of the operation period # 4. Obtained as the operation period. On the other hand, since the operation period # 5 shown in FIG. 5B does not overlap with the operation period # 1 and the operation period # 4, the combining unit 118 leaves the operation period # 5 as it is without being combined.

  The combining unit 118 sends the start time and end time of the operation period obtained by the above-described combination and the start time and end time of the operation period left uncombined to the extraction unit 119. You may pass as information which shows the range of video data.

  Based on the information indicating the range of the video data to be extracted obtained in this way, the extraction unit 119 records the video data extracted from the provisional holding unit 117 on the recording medium, whereby the video data without duplication is recorded. Can be recorded. Thereby, efficient use of the recording medium can be achieved.

  In addition, as a recording medium for recording the video data extracted by the extraction unit 119, for example, a recording medium that cannot be rewritten may be prepared to prevent falsification of the recorded video data.

  In addition, the mark detection unit 112 illustrated in FIG. 6 stores the result of the mark detection process performed in accordance with the start and end of each operation period in the above-described period database 116, and thereby via the period database 116. You may pass a detection result to the discrimination | determination part 113. FIG.

  FIG. 7C is another example of the period database 116. Each period information included in the period database 116 illustrated in FIG. 7C includes mark detection at the start and end of each period in addition to the items included in each period information illustrated in FIG. The information which shows the detection result by the part 112 is included.

  Note that, in the period database 116 illustrated in FIG. 7C, the reference sign Ss corresponding to the mark detection result indicates the detection result of the mark detection unit 112 at the start of the operation period. Symbol Se indicates a detection result of the mark detection unit 112 at the end of the operation period.

  For example, the period database 116 may hold the detection result obtained by the mark detection unit 112 at the start of the individual operation period as the detection result Ss of the period information corresponding to the operation period. Similarly, the period database 116 may hold the detection result obtained by the mark detection unit 112 at the end of the individual operation period as the detection result Se of the period information corresponding to the operation period.

  In this way, the mark detection results Ss and Se obtained at the start and at the end corresponding to each operation period can be held in the period database 116.

  In the period information of period number # 1 in the period database 116 illustrated in FIG. 7C, the mark detection at the start is “failure” and the mark detection at the end is “successful” as the mark detection results Ss and Se. It contains information to the effect. In the period information of period numbers # 3 and # 4 in the period database 116, the mark detection at the start is “successful” and the mark detection at the end is “failure” as the mark detection results Ss and Se. Information to the effect. On the other hand, the period information of period number # 2 in the period database 116 includes information indicating that the mark detection at the start time and the end time is “failure” as the mark detection results Ss and Se.

  If such a period database 116 is used, the determination unit 113 performs the determination process for the operation period by comparing the mark detection results Ss and Se corresponding to the operation period at the end of each operation period. Can do. For example, when one of the mark detection result Ss at the start of the operation period and the mark detection result Se at the start of the operation period is “success” and the other is “failure”, the determination unit 113 determines the operation period. Alternatively, it may be determined that one of entry or exit has occurred. On the other hand, when both the mark detection result Ss at the start of the operation period and the mark detection result Se at the start of the operation period are “success” or both are “failure”, the determination unit 113 determines the operation period. It may be determined that neither entering nor leaving has occurred.

  The image recording apparatus 110 according to the present disclosure can be realized using a computer apparatus such as a personal computer, for example.

  FIG. 8 shows an example of the hardware configuration of the computer apparatus 10. 8 that are the same as those shown in FIG. 1 are denoted by the same reference numerals.

  The computer device 10 includes a processor 21, a memory 22, a hard disk device 23, a display device 24, an input device 25, an optical drive 26, and a local area network (LAN) interface 28. . The processor 21, the memory 22, the hard disk device 23, the display device 24, the input device 25, the optical drive 26, and the LAN interface 28 illustrated in FIG. 8 are connected to each other via a bus. The optical drive 26 illustrated in FIG. 8 can be loaded with a recording medium such as an optical disk, and reads and records information recorded on the loaded recording medium. Further, the image recording apparatus 110 illustrated in FIG. 8 includes a processor 21, a memory 22, a hard disk device 23, an optical drive 26, and a recording medium 120. In the image recording apparatus 110 illustrated in FIG. 8, the recording unit 114 includes the optical drive 26 and the recording medium 120.

  The computer apparatus 10 illustrated in FIG. 8 is connected to the LAN 30 via the LAN interface 28. Further, m monitoring cameras C1 to Cm are connected to the LAN 30. These monitoring cameras C <b> 1 to Cm are examples of the imaging device 101. Images taken by these monitoring cameras C1 to Cm are transferred to the image recording apparatus 110 via the LAN 30, the LAN interface 28, and the bus.

  The input device 25 illustrated in FIG. 8 is, for example, a keyboard or a mouse. A user of the image recording device 110 can input an instruction to display the image data recorded in the recording unit 114 on the display device 24 to the image recording device 110 by operating the input device 25. .

  Along with the operating system of the computer device 10, the memory 22 stores an application program for the processor 21 to execute the image recording process described above. The application program includes a program for executing processing for monitoring video for each parking area, which is included in the image recording method disclosed herein. In addition, the process monitored for each parking area includes a process for detecting an operation period for each parking area, a process for detecting a mark in each parking area in conjunction with the detection of the operation period, and a mark detection result by this process. Includes discrimination processing based on The application program for executing the image recording process includes a program for executing a process of selectively recording the range of the video to be recorded specified by the above-described determination result. The application program for executing the above-described image recording process can be recorded and distributed on the recording medium 120, for example. The application program for executing the image recording process is stored in the memory 22 and the hard disk device 23 by loading the recording medium 120 in the optical drive 26 and performing the reading process. Further, an application program for executing image recording processing can be read into the memory 22 and the hard disk device 23 via a network such as the Internet and the LAN interface 28.

  In addition to the application program described above, the provisional holding unit 117 may be realized by securing an area for temporarily holding the video acquired by the monitoring cameras C1 to Cm in the hard disk device 23. Good. Similarly, by using a part of the recording capacity of the hard disk device 23, the operation state databases 115-1 to 115-m and the period databases 116-1 to 116-m are realized corresponding to the monitoring cameras C1 to Cm. May be. The hard disk device 23 illustrated in FIG. 8 further includes a parking area definition database (DB: DataBase) 126. Further, the hard disk device 23 further stores basic image files 128-1 to 128-corresponding to each parking area in order to store a basic image to be compared when detecting movement in each of the n parking areas. n.

  Further, the processor 21 may perform the function of the motion detection unit 111 illustrated in FIG. 1 by executing a program for detecting the motion period for each parking area included in the application program stored in the memory 22. Good. The processor 21 may perform the function of the mark detection unit 112 illustrated in FIG. 1 by executing a program for detecting a mark in each parking area included in the application program stored in the memory 22. In addition, the processor 21 may fulfill the function of the determination unit 113 illustrated in FIG. 1 by executing a determination processing program based on the mark detection result included in the application program stored in the memory 22. The processor 21 may perform the function of the recording unit 114 illustrated in FIG. 1 by executing a program for selective recording processing included in the application program stored in the memory 22. As described above, the processor 21 executes the application program stored in the memory 22, thereby realizing each function included in the image recording apparatus 110 illustrated in FIG. 1.

  FIG. 9 is a diagram illustrating the parking area definition database 126.

  The parking area definition database 126 illustrated in FIG. 9 corresponds to each parking area ID, a camera ID indicating a monitoring camera including the parking area in the field of view, and a two-dimensional bar installed as the mark described above in the parking area. And barcode information indicating the result of reading the code. For example, the parking area definition database 126 illustrated in FIG. 9 indicates that the parking areas E01 to E04 are included in the field of view of the monitoring camera C1. In addition, the parking area definition database 126 further includes information indicating an area corresponding to the parking area in an image obtained by a monitoring camera photographing the parking area corresponding to each parking area ID. . Furthermore, the parking area definition database 126 further includes basic image file names File-1 to File-n indicating the corresponding basic image files 128-1 to 128-n corresponding to the parking area IDs.

  The information indicating the area corresponding to each parking area may be indicated by coordinates indicating the positions of the rectangular vertices A1 to A4 corresponding to the parking area in the image obtained by the imaging device 101, for example. The coordinates of the vertices of the parallelogram indicated by reference signs A1 to A4 in FIG. 2 are an example of information indicating an area corresponding to the parking area E01 in each image. In the parking area definition database 126 illustrated in FIG. 9, the coordinates of each vertex are appended with a subscript combining X and Y indicating the coordinate value and a number indicating the corresponding vertex and a number indicating the parking area. Showed.

  The information included in the parking area definition database 126 described above can be set in advance, for example, when the image recording apparatus 110 is installed. At this time, the basic images in the initial state may be stored in the basic image files 128-1 to 128-n described above. For example, a basic image in an initial state is prepared by cutting out an image of an area corresponding to each parking area from images obtained by the monitoring cameras C1 to Cm when all the parking areas are empty. Also good.

  In the following, a process for discriminating a period in which a video to be recorded is obtained by monitoring the video for each parking area and a process for selectively recording an image discriminated in the course of the monitoring process on a recording medium will be described. .

  FIGS. 10 and 11 are both part of a flowchart of an example of processing for monitoring each parking area. The connectors 1 and 2 shown in the flowchart illustrated in FIG. 10 are combined with the connectors 1 and 2 in the flowchart illustrated in FIG. Also, among the steps shown in FIG. 11, those showing the same processing as the step shown in FIG. 10 are denoted by the same reference numerals and description thereof is omitted.

  The processor 21 performs the processing of steps S301 to S319 illustrated in FIGS. 10 and 11 in parallel for each parking area, thereby performing the motion detection unit 111 and the mark detection unit 112 illustrated in FIGS. 1 and 5. The function of the determination unit 113 may be realized.

  In the following description, a case will be described in which the processor 21 performs processing of each step included in the flowcharts illustrated in FIGS. 10 and 11 while paying attention to the parking area E01. In the initial state when starting the process of monitoring each parking area, the operation state databases 115-1 to 115-m provided using a part of the storage area of the hard disk device 23 illustrated in FIG. Corresponding to the parking area, it holds operation state information “still” indicating that no movement of the subject has been detected. On the other hand, the period databases 116-1 to 116-m provided corresponding to the monitoring cameras C1 to Cm using a part of the storage area of the hard disk device 23 illustrated in FIG. 8 are cleared in the initial state. .

  First, the processor 21 receives the attention area included in the image of the current frame of the video V obtained by the monitoring camera C1 including the parking area E01 in the field of view via the LAN interface 28, and the basic image 128- corresponding to the parking area E01. 1 is compared (step S301). For example, the processor 21 may cut out the attention area from the image of the current frame based on the information indicating the area of the image stored corresponding to the parking area E01 in the parking area definition database 126 from the image of the current frame. . The processor 21 performs a process of comparing the image of the attention area cut out in this way with the basic image 128-1 indicated by the basic image file name stored in the parking area definition database 126 corresponding to the parking area E01. Run.

  When a difference is not detected between the image of the attention area and the basic image 128-1 by the comparison process in step S301 (No determination in step S302), the processor 21 waits for a predetermined time in step S303, and then proceeds to step S301. Return to the process. In this way, the processor 21 repeats the process of comparing the new image of the attention area with the basic image 128-1 until a difference is detected in the comparison process of step S301.

  On the other hand, when a difference is detected between the image of the region of interest and the basic image 128-1 by the comparison process in step S301 (negative determination in step S302), the processor 21 detects the start of the operation period. Determination is made, and the process proceeds to step S304.

  In step S304, the processor 21 changes the operation state information corresponding to the parking area E01 of the operation state database 115-1 corresponding to the monitoring camera C1 to “in operation” indicating that the subject is moving in the parking area. . In addition, the processor 21 registers new period information including the parking area ID indicating the parking area E01 and the start time of the operation period in the period database 116-1 corresponding to the monitoring camera C1. At this time, for example, the processor 21 may give an unused period number in the period database 116-1 to the period information to be registered. In this way, the processor 21 implements the function of specifying the start time of the operation period, which is a part of the function of the operation detection unit 111 illustrated in FIG. 1, by executing the processing of steps S301 to S304. Also good.

  Next, the processor 21 performs a process of reading a two-dimensional barcode from the image of the attention area (step S305). The processor 21 executes the process of step S305, so that the two-dimensional barcode reading result can be obtained as the mark detection result. As described above, the processor 21 executes the process of step S305 to detect a mark according to the start of the operation period, which is a part of the function of the mark detection unit 112 illustrated in FIGS. 1 and 5. May be realized.

  In the process of step S305, when the reading of the two-dimensional barcode from the image of the attention area has succeeded (affirmative determination in step S306), the processor 21 is a vehicle parked in the parking area E01 at the start of the operation period. Judge that there is no. On the other hand, in the process of step S305, when reading of the two-dimensional barcode from the image of the attention area fails (No determination in step S306), the processor 21 is parked in the parking area E01 at the start of the operation period. It is determined that there is a vehicle. As described above, the processor 21 performs the determination process in step S306 based on the processing result in step S305, thereby realizing a function of specifying the presence or absence of a vehicle parked in the parking area at the start of the operation period. it can. This function is a part of the function of the determination unit 113 illustrated in FIGS. 1 and 5.

  If the determination in step S306 is affirmative, the processor 21 proceeds to the process of step S307 in FIG. Note that processing executed by the processor 21 in the affirmative determination route of step S306 will be described later.

  On the other hand, in the case of a negative determination in step S306, the processor 21 performs processing for detecting movement in the parking area E01 by comparing two frames of images extracted at predetermined time intervals from the video V obtained by the monitoring camera C1. This is performed (step S307). In step S307, the processor 21 detects the difference between the two appearing due to the movement of the subject in the parking area E01 by comparing the images of the attention area included in the two-frame images extracted from the video V at predetermined time intervals. May be.

  When a difference due to movement in the parking area E01 is detected between the images of the two target areas to be compared in the process of step S307 (positive determination in step S308), the processor 21 determines that the parking area E01 It is determined that the movement in is ongoing. In this case, the processor 21 returns to the process of step S307. Therefore, as long as a difference due to movement in the parking area E01 is detected in the process of step S307, the processor 21 repeatedly executes the processes of steps S307 and S308.

  Thereafter, when the movement in the parking area E01 is not detected in the process of step S307 (No determination in step S308), the processor 21 determines that the movement in the parking area E01 has ended. In this way, the processor 21 can specify the end point of the operation period in which the movement has continued in the parking area E01. That is, the processor 21 may implement the function of specifying the end point of the operation period, which is a part of the function of the operation detection unit 111 illustrated in FIG. 1, by executing the processes of steps S307 to S308. .

  Then, in the case of a negative determination in step S308, the processor 21 proceeds to the process of step S309. In step S309, the processor 21 performs a process of updating the operation state information held in the operation state database 115-1 corresponding to the parking area E01 to “still”. Further, the processor 21 performs a process of adding the current time as information indicating the end time of the operation period to the period information registered in the period database 116-1 in step S304 described above.

  Next, the processor 21 performs a process of reading a two-dimensional barcode from the image of the attention area in the same manner as in step S305 described above (step S310). In the process of step S310, when the reading of the two-dimensional barcode from the image of the attention area is successful (Yes determination in step S311), the processor 21 determines that the vehicle is parked in the parking area E01 at the end of the operation period. Judge that there is no. In this case, the processor 21 determines that the vehicle has been left in the parking area E01 during the operation period indicated by the period information registered in the period database 116-1 in step S304. Based on this determination, the processor 21 performs a process of setting a determination flag “record” indicating that the video corresponding to the operation period is a recording target in the period information indicating the operation period (step S312). . On the other hand, if the reading of the two-dimensional barcode from the image of the attention area fails in the process of step S310 (No determination in step S311), the processor 21 is parked in the parking area E01 at the end of the operation period. It is determined that there is a vehicle. In this case, the processor 21 determines that the vehicle has not left in the parking area E01 during the operation period indicated by the period information registered in the period database 116-1 in step S304. Based on this determination, the processor 21 performs a process of setting a determination flag “recording unnecessary” indicating that the video corresponding to the operation period is not a recording target in the period information indicating the operation period (step S314). .

  As described above, the processor 21 performs the process of step S312 or step S314 in accordance with the determination result of step S311 in the negative determination route of step S306, so that the function of the determination unit 113 illustrated in FIG. 1 and FIG. Some may be realized. Note that a part of the function of the determination unit 113 realized by the processing of each step described above being performed by the processor 21 is to determine an operation period including a process in which a vehicle parked in the parking area of interest is issued. It is a function to do.

  As described above, in the case of an affirmative determination in step S311, since there is no vehicle parked in the parking area E01, the parking area E01 is in an empty state. In this case, the processor 21 performs a process of updating the basic image 128-1 corresponding to the parking area E01 to an image representing an empty state together with the process of step S312 described above (step S313). On the other hand, in the negative determination route in step S311, the processor 21 performs a process of updating the basic image 128-1 corresponding to the parking area E01 with a new image representing a state in which the vehicle is parked (step S315). For example, the processor 21 may acquire a new basic image 128-1 used in the processes of steps S <b> 313 and S <b> 315 by cutting out the attention area from the current frame image of the video V obtained by the monitoring camera C <b> 1.

  Next, the process of the affirmative determination route in step S306 shown in FIG. 10, that is, the process when there is no vehicle parked in the parking area of interest at the start of the operation period will be described.

  The flowchart shown in FIG. 11 is a flowchart of the affirmative determination route processing of step S306 corresponding to the negative determination route processing of step S306 included in the flowchart shown in FIG. The difference between the processing of the affirmative determination route in step S306 and the processing of the negative determination route in step S306 lies in the processing from step S317 to step S319.

  In step S317 illustrated in FIG. 11, the processor 21 determines whether or not the two-dimensional barcode reading process in step S310 has succeeded at the end of the operation period specified by the processes in steps S307 and S308.

  If the two-dimensional barcode is successfully read in the process of step S310 (Yes determination in step S317), the processor 21 determines that there is no vehicle parked in the parking area E01 at the end of the operation period. . In this case, the processor 21 determines that the vehicle has not been received in the parking area E01 during the operation period indicated by the period information registered in the period database 116-1 in step S304. Based on this determination, the processor 21 performs a process of setting a determination flag “recording unnecessary” indicating that the video corresponding to the operation period is not a recording target in the period information indicating the operation period (step S318). . On the other hand, in the process of step S310, when reading of the two-dimensional barcode from the image of the attention area fails (No determination in step S317), the processor 21 is parked in the parking area E01 at the end of the operation period. It is determined that there is a vehicle. In this case, the processor 21 determines that a vehicle has been received in the parking area E01 during the operation period indicated by the period information registered in the period database 116-1 in step S304. Based on this determination, the processor 21 performs a process of setting a determination flag “record” indicating that the video corresponding to the operation period is a recording target in the period information indicating the operation period (step S319). .

  As described above, the processor 21 performs the processing of step S318 or step S319 in accordance with the determination result of step S317 in the affirmative determination route of step S306, so that the function of the determination unit 113 illustrated in FIG. 1 and FIG. Some may be realized. In addition, a part of function of the determination part 113 implement | achieved when the processor 21 performs the process of each step mentioned above is a function which determines the operation | movement period including the process in which the vehicle entered into the parking area to which attention is paid. .

  Next, the processor 21 performs a process of updating the basic image 128-1 corresponding to the parking area E01 according to the determination result of step S317 (steps S313 and S315). After that, the processor 21 proceeds to step S316 illustrated in FIG. 10 according to the route indicated by the connector 2. As a result, the negative determination route and the positive determination route in step S306 merge.

  In step S316 illustrated in FIG. 10, the processor 21 determines whether or not to continue monitoring the parking area E01. For example, the processor 21 may determine that the monitoring is continued unless an instruction to stop the monitoring input by the operator operating the input device 25 is detected (Yes determination in step S316). In this case, the processor 21 continues the process of monitoring the parking area by returning to the process of step S301. On the other hand, in response to detection of an instruction to stop monitoring, the processor 21 proceeds to a negative determination route in step S316. In this case, the processor 21 ends the process of monitoring the parking area.

  In the process in which the video V obtained by the monitoring camera C1 is input, the processor 21 executes the process described above for the parking areas E02 to E04 in parallel with the process for the parking area E01 described above. Thereby, the processor 21 can accumulate | store the period information containing the discrimination | determination flag which shows the discrimination | determination result about each operation period detected about these parking areas E01-E04 in the period database 116-1. Further, the processor 21 indicates a parking area where there is some movement at each time point included in the process of executing the above-described processes in parallel, based on the operation state information corresponding to each of the parking areas E01 to E04 in the operation state database 115-1. Information can be obtained.

  Hereinafter, a process of selectively recording a desired portion from the video V on the recording medium 120 based on the operation state database 115 and the period database 116 will be described.

  FIG. 12 is a flowchart of an example of the recording control process. The processor 21 illustrated in FIG. 8 performs the processing of steps S321 to S330 included in the flowchart illustrated in FIG. 12 in cooperation with the respective units, so that the function of the recording unit 114 illustrated in FIG. 1 and FIG. Fulfill. Note that the processor 21 may execute the processing of each step shown in FIG. 11 in parallel for each video V obtained by each of the monitoring cameras C1 to Cm. Hereinafter, a case where the processor 21 performs processing on the video V obtained by the monitoring camera C1 will be described as an example.

  In step S321, the processor 21 refers to the operation state database 115-1 to acquire operation state information of the parking areas E01 to E04 included in the field of view of the monitoring camera C1. Next, the processor 21 determines whether or not “in operation” is included in the operation state information acquired in step S321 (step S322).

  When all the operation state information acquired in step S321 is “still” (negative determination in step S322), the processor 21 determines that there is no movement in the visual field of the monitoring camera C1. In this case, the processor 21 returns to the process of step S321 after waiting for a predetermined time in step S323. In this way, the processor 21 monitors the operation state database 115-1 by repeatedly executing the processes of steps S321 to S323.

  In the process of continuing the monitoring process in this way, when at least one of the operation state information acquired in step S321 becomes “in operation” (positive determination in step S322), the processor 21 monitors It is determined that there is some movement within the field of view of the camera C1.

  In this case, the processor 21 proceeds to step S324. Then, in step S324, the processor 21 instructs the hard disk device 23 to start processing for holding the video V obtained by the monitoring camera C1 in the temporary holding unit 117, and thereafter obtains it by the monitoring camera C1. The provisional recording of the video V to be started is started.

  Next, the processor 21 refers to the operation state database 115-1 again to acquire operation state information of the parking areas E01 to E04 included in the field of view of the monitoring camera C1 (step S325). Next, the processor 21 determines whether or not “in operation” is included in the operation state information acquired in step S325 (step S326). When at least one of the operation state information acquired in step S325 is “in operation” (positive determination in step S326), the processor 21 determines that the movement of the monitoring camera C1 within the visual field continues. To do. In this case, after waiting for a predetermined time in step S327, the processor 21 returns to the process in step S325. In this way, the processor 21 monitors the operation state database 115-1 by repeatedly executing the processes of steps S325 to S327.

  In the process of continuing the monitoring process in this way, when all of the operation state information acquired in step S325 becomes “still” (negative determination in step S326), the processor 21 determines the monitoring camera C1. Judge that all movement in the field of view has ended. In this case, the processor 21 proceeds to the process of step S328.

  In step S328, the processor 21 instructs the hard disk device 23 to stop the process of holding the video V obtained by the monitoring camera C1 in the temporary holding unit 117, thereby stopping the provisional recording of the video V. To do.

  After that, the processor 21 extracts the video data to be recorded from the video data held in the temporary holding unit 117 and records the extracted video data based on the period information held in the period database 116-1. Processing is performed (step S329). The processor 21 may cause the recording medium 120 to record the video data corresponding to the video to be recorded via the optical drive 26. The process of step S329 will be described later.

  After the process of step S329 is completed, the processor 21 determines whether or not to continue monitoring, similarly to step 316 shown in FIG. 10 (step S330). In the case of an affirmative determination in step S330, the processor 21 returns to the process in step S321 to continue the recording control process. On the other hand, in response to detection of an instruction to stop monitoring, the processor 21 proceeds to a negative determination route in step S330. In this case, the processor 21 ends the recording control process.

  Next, the process of extracting the recording target video and recording the extracted video shown as step S329 in FIG. 12 will be described.

  FIG. 13 is a flowchart of an example of processing for extracting and recording a video to be recorded. The processing in steps S331 to S335 illustrated in FIG. 13 is an example of the processing in step S329 illustrated in FIG.

  In step S331 illustrated in FIG. 13, the processor 21 first searches the period database 116-1 for period information for which the determination flag “record” is set.

  Next, the processor 21 selects one of the period information obtained in the process of step S331 in the order of the period numbers corresponding to the order of the start time (step S332). Then, the processor 21 sets the extraction start time Ts indicating the start time of the extraction target period and the extraction end time Te indicating the end time of the extraction target period based on the start time and end time included in the selected period information. Setting is made (step S333). Next, the processor 21 determines whether or not any of the operation periods indicated by the unselected period information included in the period information obtained in step S331 has a range that overlaps the above-described extraction target period. Is determined (step S334).

  For example, when the start time included in the period information having the period number after the period information selected in step S332 is earlier than the extraction end time Te, the processor 21 determines that duplication has been detected, and the process of step S334 Proceed to affirmative determination route. In this case, the processor 21 updates the extraction end time Te using the end time included in the period information in which duplication is detected (step S335).

  For example, with reference to FIG. 7B, the processor 21 performs period information indicated by period numbers # 1, # 4, and # 5 by performing the search process of step S331 on the period database 116-1. # 1, # 4, and # 5 are acquired. In step S333, the processor 21 sets the extraction start time Ts and the extraction end time Te using the start time Ts1 and the end time Te1 included in the period information # 1. Next, in step S334, the processor 21 compares the start time Ts4 included in the period information # 4 having the period number # 4 with the above-described extraction end time Te.

  As shown in FIG. 5B, when the start time Ts4 included in the period information # 4 is earlier than the extraction end time Te, the processor 21 extracts the data set using the period information # 1. It is determined that the target period and the operation period # 4 overlap (affirmative determination in step S334). In this case, the processor 21 sets, in step S335, the later of the extraction end time Te and the end time Te4 of the period information # 4 as the extraction end time Te.

  As described above, in response to the affirmative determination in step S334, the processor 21 performs the process in step S335 described above, thereby realizing the function of the combining unit 118 that combines the operation periods having overlapping ranges.

  After performing the process of step S335, the processor 21 returns to the process of step S334. Further, overlapping operation periods may be searched for the updated extraction target range. As described above, by repeating Step S334 to Step S335, it is possible to sequentially combine the operation periods having a range overlapping with the extraction target period set based on the period information selected in Step S332. .

  On the other hand, when an operation period having a range that overlaps the extraction target period is not detected (No determination in step S334), the processor 21 proceeds to the process of step S336. In step S336, the processor 21 extracts video data from the extraction start time Ts to the extraction end time Te in the temporary holding unit 117. For example, the processor 21 may determine the range of video data to be extracted from the video data held in the temporary holding unit 117 based on time information included in the video data. Then, the processor 21 transfers the extracted video data to the optical drive 26 to record the video image data on the recording medium 120. As described above, the processor 21 executes the process of step S336, thereby realizing the function of the extraction unit 119 illustrated in FIG.

  Thereafter, the processor 21 determines whether or not there is unselected period information in the middle of the period information obtained in the search process of step S331 (step S337). When there is unselected period information (affirmative determination in step S337), the processor 21 returns to the process in step S332 to execute the process for the unselected period information.

  As described above, when the processor 21 executes the processes in steps S331 to S337, the video data can be recorded without being overlapped regardless of the overlap of the operation periods detected for each parking area.

  FIG. 14 is a diagram for explaining the recording process. FIG. 14A shows an example of video data held in the temporary holding unit 117. FIG. 14B shows an example of video data recorded on the recording medium 120.

  Reference numerals V1 to V5 shown in FIGS. 14A and 14B respectively denote video data representing videos obtained by the monitoring camera C1 in the operation periods # 1 to # 5 illustrated in FIG. 5B. In addition, the start time and end time of each operation period # 1 to # 5 are shown in combination with symbols Ts and Te and the number of each operation period.

  Through the processing from step S334 to step S335 described above, the processor 21 changes the period from the start time Ts1 of the operation period # 1 to the end time Te4 of the operation period # 4 shown in FIG. Set as the range of video data to be extracted. Then, the processor 21 records the video data in this range extracted from the temporary holding unit 117 on the recording medium via the optical drive 26. In this way, when the operation period # 1 and the operation period # 4 detected for each parking area overlap, the video data corresponding to the period obtained by combining these operation periods is recorded, so that the capacity of the recording medium 120 is increased. Can be used efficiently. In FIG. 14A, the portion of the video data V4 that is not included in the video data V1 is denoted by reference numeral V4 '. In FIG. 14B, video data corresponding to a period in which the operation period # 1 and the operation period # 4 are combined is indicated by reference numeral V1 + V4 '.

  Thus, after the selective recording process is completed, the processor 21 deletes all period information included in the period database 116-1 corresponding to the monitoring camera C1 (step S338). Further, the processor 21 deletes the video data corresponding to the video V obtained by the monitoring camera C1 held in the temporary holding unit 117 (step S339). In this way, after releasing the storage area of the hard disk device 23 used to hold the processed information, the processor 21 ends the process of selectively recording the video data to be recorded.

  Similarly, based on the results obtained by monitoring each parking area included in the field of view of the monitoring cameras C2 to Cm illustrated in FIG. 8, each parking area is obtained from the video V obtained by these monitoring cameras C2 to Cm. It is possible to selectively record an image of a process in which a vehicle enters / exits. Thereby, the information required in order to identify the vehicle parked in the parking lot containing many parking areas and the person who participated in the receipt / exit of the said vehicle can be recorded without excess and deficiency.

  Moreover, the flowchart of the monitoring process of each parking area illustrated in FIGS. 10 and 11 can be modified as described below.

  FIG. 15 is a flowchart of another example of the monitoring process for each parking area. Note that among the steps shown in FIG. 15, those equivalent to the steps shown in FIG. 10 or FIG. 11 are denoted by the same reference numerals, and description thereof is omitted.

  According to the flowchart illustrated in FIG. 15, after performing the process of reading the two-dimensional barcode in step S305, the processor 21 executes the process of step S341 instead of performing the determination process of step S306.

  In step S341, the processor 21 adds information indicating whether or not the two-dimensional barcode read executed in step S305 has been successful to the period information as the mark detection result Ss at the start of the operation period.

  As described above, the processor 21 performs the process of step S341, whereby information indicating the detection result obtained by the mark detection unit 112 at the start of the operation period can be held in the period database 116-1.

  Further, according to the flowchart illustrated in FIG. 15, after performing the process of reading the two-dimensional barcode again in step S310, the processor 21 executes the process of step S342 instead of performing the determination process of step S311. .

  In step S342, the processor 21 adds information indicating whether or not the two-dimensional barcode read executed in step S310 is successful to the period information as the mark detection result Se at the end of the operation period.

  As described above, the processor 21 performs the process of step S342, so that information indicating the detection result obtained by the mark detection unit 112 at the end of the operation period can be held in the period database 116-1.

  When the processor 21 executes the processes in steps S341 and S342 described above, the period database 116-1 including the mark detection results Ss and Se illustrated in FIG. 6B can be formed.

  Next, the processor 21 performs a process of collating the mark detection result Ss at the start time and the mark detection result Se at the end time added to the period database 116-1 as described above (step S343). When the mark detection result Ss at the start time and the mark detection result Se at the end time are different (determination determination in step S343), the processor 21 enters the vehicle in the parking area E01 during the operation period or Judge that there was a shipment. Then, based on this determination, the processor 21 performs a process of setting a determination flag “record” indicating that it is a recording target in the period information corresponding to the operation period (step S312). On the other hand, when the mark detection result Ss at the start time coincides with the mark detection result Se at the end time (affirmative determination in step S343), the processor 21 also stores the vehicle in the parking area E01 during the operation period. Judge that there was no vehicle exit. Then, based on this determination, the processor 21 performs a process of setting a determination flag “recording unnecessary” indicating that it is not a recording target in the period information corresponding to the operation period (step S314). As described above, the processor 21 executes step S312 or step S314 in accordance with the comparison result of the mark detection results Ss and Se at the start time and the end time, whereby the function of the determination unit 113 illustrated in FIG. May be realized.

  In addition, after the process of step S312 or step S314 described above is completed, the processor 21 performs a process of updating the basic image using the image of the attention area newly cut out from the video V obtained by the monitoring camera C1. (Step S344).

  The image recording apparatus 110 of the present disclosure is not limited to the above description. For example, the image recording apparatus 110 according to the present disclosure can be used to receive / store a vehicle in a parking area from a video obtained by a monitoring camera that monitors a parking area including a parking area where a color barcode is installed. It is possible to selectively record an image related to delivery. In addition, the mark installed in each parking area may be a figure that does not include information for identifying each parking area.

DESCRIPTION OF SYMBOLS 100 ... Parking lot; 101 ... Imaging device; 110 ... Image recording device; 111 ... Motion detection part; 112 ... Mark detection part; 113 ... Discrimination part; 114 ... Recording part; ... Temporary holding unit; 118 ... Coupling unit; 119 ... Extraction unit; 120 ... Recording medium; 126 ... Parking area definition database; 128-1 to 128-n ... Basic image file; Memory; 23 ... Hard disk device; 24 ... Display device; 25 ... Input device; 26 ... Optical drive device; 28 ... Local area network (LAN) interface; 30 ... Local area network; C1-Cm ... Surveillance camera; Mark; Q1 ... Vehicle; E01-E04 ... Parking area

Claims (5)

For each parking area, an operation period is a period in which the image of each parking area is continuously changing based on an image obtained by an imaging device that captures a plurality of parking areas each having a mark blocked by a vehicle. An operation detection unit to detect;
From each image at the start and end of the operation period, a mark detection unit that detects the image of the mark for each parking area,
When the mark is detected at the start and the mark is not detected at the end, it is determined whether the vehicle has entered the parking area during the operation period, the mark is not detected at the start, and the mark is detected at the end. When a mark is detected, a determination unit that determines the departure of the vehicle from the parking area during the operation period;
An image recording apparatus comprising: a recording unit that records an image obtained by the imaging device corresponding to an operation period in which entry or exit is determined by the determination unit. The image recording apparatus according to claim 1,
An operation state database that indicates operation in the operation period detected by the operation detection unit, and that stores operation state information indicating that the vehicle is stationary at a time other than the operation period, for each parking area;
Period information including information indicating the start time and end time of each operation period, a determination flag that is provided for each period information and indicates that image recording is necessary, and a period database that is held,
The determination unit sets the corresponding determination flag when determining entry or exit for each operation period,
The recording unit is
The provisional holding unit for temporarily holding an image obtained by the imaging device;
The determination flag included in the period database is set when all the operation state information in the operation state database becomes stationary after at least one operation state information in the operation state database becomes active. Based on the period information, a combining unit that combines operation periods having ranges overlapping each other among the operation periods indicated by the period information,
An extraction unit for extracting an image held in the provisional holding unit corresponding to an operation period combined by the combining unit and an operation period remaining without being combined, and recording the extracted image on another recording medium; An image recording apparatus comprising: The image recording apparatus according to claim 2,
The temporary holding unit holds an image obtained by the imaging device from when at least one operation state information in the operation state database is in operation until all operation state information in the operation state database is stationary. An image recording apparatus. For each parking area, an operation period is a period in which the image of each parking area is continuously changing based on an image obtained by an imaging device that captures a plurality of parking areas each having a mark blocked by a vehicle. Detect
From the images at the start and end of the operation period, the image of the mark is detected for each parking area,
When the mark is detected at the start and the mark is not detected at the end, it is determined whether the vehicle has entered the parking area, the mark is not detected at the start, and the mark is detected at the end. When the vehicle is out of the parking area,
An image recording method comprising: recording an image obtained by the imaging device corresponding to an operation period in which entry or exit is determined. For each parking area, an operation period is a period in which the image of each parking area is continuously changing based on an image obtained by an imaging device that captures a plurality of parking areas each having a mark blocked by a vehicle. Detect
From the images at the start and end of the operation period, the image of the mark is detected for each parking area,
When the mark is detected at the start and the mark is not detected at the end, it is determined whether the vehicle has entered the parking area, the mark is not detected at the start, and the mark is detected at the end. When the vehicle is out of the parking area,
An image recording program for causing a computer to execute a process of recording an image obtained by the imaging device corresponding to an operation period in which entry or exit is determined.

Images