JP2003022494A - Character on moving body recognition system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a system for recognizing characters on a moving body which can freely be moved to a different installation place and carried by an automobile, etc. SOLUTION: This system is equipped with a detection sensor 30 which recognizes a moving body, an image pickup device 31 which picks up an image of the moving body, and a recognition and collation device 32 which inputs the image currently picked up by the image pickup device 31 as a still picture when the detection sensor 30 detects the moving body to recognize character information, compares the recognized character information with information stored in a storage area 41, and stores the recognized character information and still picture in an internal database 409 when the comparison result proves that the both are the same.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a mobile character recognizing system for recognizing character information on a mobile. In various fields including fields such as traffic monitoring and highway tollgate monitoring, character strings on moving bodies such as automobiles and trains, for example, registration numbers on the license plate of the automobile or trains on the side of the train There is a growing need for character recognition devices that automatically recognize numbers and the like. Therefore, it is required to recognize the character information written on the moving body with a small system.

[0002]

2. Description of the Related Art As a character recognition system for a mobile object, a stationary type system which is fixedly installed in advance can be cited. This stationary system is a system in which an image pickup / recognition device for fixedly recognizing an image is installed on a telephone pole, etc., and character string information is processed by a server installed indoors via a network line such as a dedicated line. Is.

FIG. 5 is a diagram showing a conventional system installation state. Here, the state where the character recognition system is attached along the road is shown. In the figure, 2,
3 is a pole installed at the end of the road 5, and 1 is an image pickup device attached to these poles 2 and 3. The imaging device 1 is provided for each lane of the road 5. A and B indicate ranges that can be monitored by each imaging device 1. Reference numeral 4 denotes a moving body recognition device installed at the end of the road 5.

In the system thus constructed,
When a moving body moves from one of the roads, a moving body detection device (not shown) recognizes the moving body. When the moving object is recognized by the moving object detection device, the imaging device 1 is notified of the moving object detection signal. Each image pickup device 1 picks up an image of a moving body passing through a lane that it is in charge of. The captured image enters the recognition device 4, and the recognition device 4 recognizes the character information written on the moving body.

FIG. 6 is a conceptual diagram of a conventional system. The character information (number information, time information, monitoring point information) recognized by the recognition device 4 is collected from each point via the dedicated line 10 and enters the line aggregation device 11. Line aggregation device 11
Transmits the collected data to the server device 12 via the LAN 15. The server device 12 compares and collates the input character information with the information stored in the database 12a.

[0006] From the terminal 13, information regarding the mobile unit (for example, the number of the mobile unit under arrangement) is input in advance,
It is stored in the database 12a. The server device 12 is
The character information input from the line aggregation device 11 and the character information stored in the database 12a are sequentially compared. Here, the input character information is stored in the database 12
If the information matches the information stored in a, the server device 1
2 notifies the terminal device of that fact. The terminal device 14 immediately displays the matching registration number and the like on the display. In this way, the previously registered mobile body number is notified and displayed outside.

FIG. 7 is a block diagram showing a configuration example of a conventional system. The same parts as those in FIG. 6 are designated by the same reference numerals. In the figure, reference numeral 1 denotes an image pickup device for picking up an image of a moving body, and here, a case where four units # 1 to # 4 are installed is shown. Each imaging device 1 includes an LED illumination 1a and a camera 1.
b, a camera control board 1c and an arrester 1d. The LED illumination 1a illuminates a moving body as a subject, and the camera 1b captures an image of the illuminated moving body. The camera control board 1c controls the timing of image capturing by the camera. The arrester 1d is a lightning arrestor for protecting the device from lightning in connection with the image pickup device 1 being fixed.

From each image pickup device 1, an NTSC signal enters the recognition device 4 via an NTSC signal line (shown by a thick solid line in the figure). The thin solid line in the figure is a camera control signal line. The recognition device 4 includes an arrester 4a and a control unit 4b.
And a communication unit 4c, a plurality of recognition units 4d, and a power supply unit 4e. The arrester 4a protects the device from lightning, the control unit 4b controls the entire operation of the recognition device, and the communication unit (router) 4c transmits the recognition result of the recognition device 4, The recognition unit 4d is for recognizing a character from an image captured by the imaging device 1. The power supply unit 4e supplies power to the recognition device 4.
The character information output from the recognition unit 4d is also transmitted with an identification signal indicating which image capturing device captured the character information.

The character information recognized by the recognition section 4d is collected in the line aggregation device 11 via the digital leased line 20. The line aggregation device 11 transfers the collected character information to the server device 12. The server device 12 stores the character information transferred from the line aggregation device 11 in the database 1
It collates with the data previously stored in 2a. This time,
The operation terminal 16 is operated to input necessary commands and the like.
In the server 12, the input character information is stored in the database 1
When it matches with the character information registered in 2a, the information indicating that is shown outside by an image or a sound. As a result, the operator can confirm which moving body is recognized.

[0010]

After the recognition device is installed, there is a demand to change the recognition place or to install and monitor the recognition device only for a short time. In order to meet such a demand, in the above-mentioned conventional system, since it is fixedly installed at a specific place, it is very difficult to change the position of the recognition device after the installation.

If the character recognition system is a transportable and portable system, the above problems can be solved. Here, the portable system means a system that is easy to install and adjust, can be carried by a car, and can be carried by one person.

The present invention has been made in view of the above problems, and an object of the present invention is to provide a mobile character recognizing system which can be freely installed in a different place and can be carried by an automobile or the like.

[0013]

(1) FIG. 1 is a block diagram showing the principle of the present invention. In the figure, 30 is a detection sensor for recognizing a moving body, 31 is an image pickup device for picking up an image of the moving body based on the detection result of the detection sensor 30, and 32 is the image pickup device 31 when the detecting sensor 30 detects the moving body. The image at that time is captured as a still image, the character information is recognized, the recognized character information is compared with the information stored in the storage area, and if the comparison is the same, the recognized character information and the still image are compared. This is a recognition / collation device that stores in a database that stores and. 40 is a recognition / collation device 3
2 is a database that stores character information and still images provided in 2. Reference numeral 41 is a storage area for storing information on a moving body that is registered in advance.

According to this structure, the character information is recognized from the moving body read by the image pickup device 31, the recognized character information is compared with the registered information stored in the storage area 41, and both are recognized. If the information of 1 is matched, the character information and the still image at that time can be stored in the database 40.

(2) The invention according to claim 2 is characterized in that the detection sensor 30 emits an ultrasonic wave toward the moving body and receives the reflected signal from the moving body to detect the moving body. . According to this structure, the detection sensor can be downsized, and a mobile character recognition system that can be carried by an automobile or the like can be provided.

(3) According to the third aspect of the invention, the information stored in the storage area 41 is input separately to the recognition / collation device 32 after being separately prepared in advance and stored in an information storage medium. It is characterized by

With this configuration, the recognition / collation device 3
It is possible to easily store the registration information regarding the moving body in the second storage area 41. In the present invention, the information stored in the storage area 41 is characterized by at least a registration number, a mobile owner name, and a registration date.

According to this structure, it is possible to grasp the information about the moving body. Further, in the present invention, when the registered character information and the read character information match, the map information stored in the database 40 and the hit area are displayed on the display as spots. .

According to this structure, the hit point can be displayed as a spot on the map, and the hit point can be easily grasped. Here, the hit means that the character information registered in advance matches the read character information.

Further, in the present invention, the location of the hit area of the map information is determined by GPS. According to this structure, the location of the hit area can be accurately determined by GPS.

Further, according to the present invention, when the registered character information and the read character information match, the transceiver is notified wirelessly as voice. According to this structure, it is possible to wirelessly notify the transceiver that the registered character information matches the read character information.

Further, in the present invention, the face image of the person inside the moving body which is picked up by the image pickup device is also stored in the database. With this structure, the face of the person inside the moving body is hit when a hit occurs. By accumulating images also in the database 40, it is possible to increase the information acquired regarding the mobile body.

Further, according to the present invention, an image pickup device for constantly picking up an image of the moving body is provided, information displayed by the image pickup device is displayed on the display device, and when the moving body is displayed on the display device, the push button switch is pressed. The feature is that the moving body image at that time is captured as a still image and the character information is recognized from the still image.

According to this structure, the matching of the character information can be processed as a batch process.

[0025]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described in detail below with reference to the drawings. FIG. 2 is a block diagram showing an embodiment of the present invention. The same thing as in Figure 1
The same reference numerals are given. In the figure, 30 is a detection sensor that detects a moving body (not shown), 31 is an imaging device that images the moving body based on the detection result of the detection sensor 30,
When the detection sensor 30 detects a moving body, 32 captures the image of the imaging device 31 at that time as a still image,
The character information is recognized, the recognized character information is compared with the information stored in the storage area 41, and if both comparisons match (hit), the recognized character information and the still image are stored in the database 40. It is a recognition / collation device that accumulates. As the imaging device 31, for example, a television camera is used.

Here, as the detection sensor 30, for example, an ultrasonic type is used. That is, the presence or absence of the moving body is determined by irradiating the moving body with ultrasonic waves and measuring the ultrasonic waves reflected and returned from the moving body. By using such an ultrasonic detection sensor, it is possible to provide a moving body character recognition system in which the device is downsized and which can be carried by an automobile or the like.

Reference numeral 51 is a display for displaying various images, and 52 is an operation unit such as a keyboard and a mouse. 53
Is a video camera for capturing an image of a moving body, and 54 is a digital camera for capturing an image of the moving body. Reference numeral 48 is a floppy (registered trademark) disk as an information storage medium, and 55 is a transceiver that wirelessly receives information notification from the recognition / collation device 32.

In the recognition / collation device 32, 50 is a CPU for controlling the entire operation, 40 is a database for storing character information and still images at the time of hit, and 41 is a storage area for storing pre-registered information. is there. 42 is an interface (INT) for notifying the output of the detection sensor 30 to the CPU 50, 43 is a capture card for receiving the output of the imaging device 31, and 44 is an interface (INT) for receiving the output of the capture card 43 and input to the CPU 50. . The capture card 43 converts the analog image signal into a digital image signal.

Reference numeral 45 is a capture card connected to the video camera 53, and 46 is an interface (INT) which receives the output of the capture card 45 or the output of the digital camera 54 and gives it to the CPU 50. Reference numeral 49 is a push button switch that outputs a signal for capturing a still image, and 47 is a connection portion to which a floppy disk 48 is connected. Although a power supply is required for the circuit shown in the figure to operate, a power supply (not shown) is supplied for this purpose, and an inverter is also prepared for equipment that operates with an AC power supply. The operation of the system configured as described above will be described below.

First, it is premised that the storage area 41 previously stores information about mobile units as registration data. This registration data is read from a host computer provided on the center side, written in an information storage medium such as a floppy disk, and brought to a place in the system for registration. Specifically, the floppy disk 48 in which the registration data is stored is connected to the connection portion 47, and a storage command is given from the operation portion 52. As a result, the registration data stored in the floppy disk 48 is transferred and stored in the storage area 41. In this way, the registration information about the moving body can be easily stored in the storage area 41 of the recognition / collation device 32. If the storage capacity of the floppy disk 48 is insufficient, a large capacity C is used instead of the floppy disk.
A D-RW device can be used. The output of the digital camera 54 is connected to the CPU 50 via an RS422 card (serial interface).

FIG. 3 is a diagram showing a configuration example of registration data. As shown in the figure, number, mobile owner name,
The registration date, history, and other information are stored. By storing the registration data in this way, it becomes possible to grasp the information regarding the mobile body.

The operation of the present invention will be described below with reference to the operation flowchart shown in FIG. (Step S1) Moving Object Detection Moving object detection is performed using the detection sensor 30 described above. The detection sensor 30 constantly emits ultrasonic waves in a predetermined direction, and when a moving body enters the detection area, a reflected signal of the ultrasonic wave returns from the moving body. By detecting this reflection signal, it becomes possible to detect the moving body. (Step S2) Upon receiving the detection signal from the detection sensor 30, the still image capturing CPU 50 captures the image captured by the image capturing device 31 coming from the interface 44 as a still image. Since the imaging device 31 constantly images the subject area, the interface 4
An image picked up by the image pickup device 31 always comes in from 4 on, but the image is usually discarded. Then, after the detection sensor 30 detects the moving body, the image output from the imaging device 31 is captured as a still image after a predetermined time has elapsed. (Step S3) Character string region cutout CPU 50 cuts out a character region from the still image captured in step S2. An existing technology can be used as the algorithm at this time. As a method of cutting out the character area, a method of extracting the character area by sequentially scanning one screen from the upper left to the lower right is adopted. By using such a method, it is possible to detect the character area wherever the character area is in one screen. (Step S4) The character recognition CPU 50 recognizes the character information stored in the cut out character area. As the character recognition algorithm at this time, an existing character recognition algorithm can be used. (Step S5) Preliminarily set character string and collation The CPU 50 compares and collates the input character information with the preset character string stored in the storage area 41. The collation at this time is performed character by character. (Step S6) Storing recognition result in DB When the character information previously stored in the storage area 41 and the character information read by the image pickup device 31 match, the CPU
A database 50 stores character information and still images in the database 40. In this way, the recognized character information is compared with the registered information stored in the storage area 41, and if the two pieces of information match, the character information and the still image at that time are stored in the database 40. You can

In this case, when the character information stored in the storage area matches the read character information, the map information stored in the database 40 and the corresponding hit area are spotted on the map of the display 51. It can be displayed, and the hit point can be easily grasped. Here, the location of the hit area of the map information is determined by GPS (Global P
positioning system).

When the moving image is picked up by the image pickup device 31, usually, in addition to the information about the moving object, a face image of a person is also taken. Therefore, the image of the person inside the moving body can be extracted and stored in the database 40. By doing so, it is possible to increase the information acquired regarding the mobile body.

The operation of the push button switch 49 will now be described. Now, for example, it is assumed that the video camera 53 is used instead of the imaging device 31 to image the moving body. The video camera 53 always shoots and records an imaging area on a built-in video tape. After the image is recorded on the video tape, the tape is read by the video tape reading device and displayed on the display 51.

The operator observes the image displayed on the display 51. Then, if the corresponding moving body is imaged, the push button switch 49 is pressed. As a result, the still image at the time when the moving body comes in is caught. The CPU 50 cuts out a character string area from the caught still image and performs character recognition. in this way,
According to the present invention, it is also possible to process moving bodies as a batch process.

Alternatively, the digital camera 54 can be used to obtain a still image. When the target moving body comes into view, the operator pushes the push button switch 49.
push. This signal is given to the digital camera 54 as a shutter signal, and the digital camera 54 photographs the moving body. The still image taken by the digital camera 54 is given to the CPU 50 via the interface 46. The CPU 50 recognizes character information from a still image by the same procedure as described above, and when hit, stores it in the database 40 together with the still image.

When both images hit, the CPU 5
0 displays the result on the display 51. Thereby, the operator can recognize the registration number of the target moving body. Alternatively, the CPU 50 wirelessly transfers to the transceiver 55 via the modulator 48. As a result, the person holding the transceiver 55 can recognize by voice that the character information is hit.

(Supplementary Note 1) A detection sensor for recognizing a moving body, an image pickup device for picking up an image of the moving body, and a moving body detected by the detection sensor. A recognition / collation device for recognizing the recognized character information and comparing the recognized character information with the information stored in the storage area, and if the comparison of both matches, accumulating the recognized character information and the still image in a built-in database. A mobile character recognition system, comprising:

(Supplementary Note 2) The moving body character recognition according to Supplementary Note 1, wherein the detection sensor emits ultrasonic waves toward the moving body and receives the reflection signal from the moving body to detect the moving body. system.

(Supplementary Note 3) The information stored in the storage area is information that is separately prepared in advance and is stored in an information storage medium and input to the recognition / verification device. Mobile character recognition system.

(Supplementary note 4) The mobile character recognizing system according to supplementary note 1, wherein the information stored in the storage area is at least a registration number, an owner name of the mobile body, and a registration date.

(Supplementary Note 5) When the registered character information matches the read character information, the map information stored in the database and the hit area are displayed on the display as spots. The mobile character recognition system according to attachment 1.

(Supplementary note 6) The mobile character recognizing system according to supplementary note 5, wherein the location of the hit area of the map information is determined by GPS. (Supplementary Note 7) The mobile character recognizing system according to Supplementary Note 5, wherein when the registered character information matches the read character information, the transceiver is wirelessly notified as voice.

(Supplementary Note 8) The mobile character recognizing system according to Supplementary Note 1, wherein the face image of the person inside the moving body captured by the image capturing device is also stored in the database. (Supplementary Note 9) An imaging device for constantly imaging a moving body is provided,
Information captured by the imaging device is displayed on the display device, and when the moving object is displayed on the display device, the push button switch is pressed, the moving object image at that time is captured as a still image, and the character information is recognized from the still image. A mobile character recognition system characterized by:

[0046]

As described above, according to the present invention, the following effects can be obtained. (1) According to the invention described in claim 1, the character information is recognized from the moving body read by the imaging device, and the recognized character information is compared with the registered information stored in the storage area, If both pieces of information match, the character information and the still image at that time can be stored in the database.

(2) According to the second aspect of the invention, it is possible to provide a mobile character recognizing system which can miniaturize the detection sensor and can be carried by an automobile or the like. (3) According to the third aspect of the present invention, it is possible to easily store the registration information regarding the moving body in the storage area of the recognition / collation device.

[Brief description of drawings]

FIG. 1 is a principle block diagram of the present invention.

FIG. 2 is a block diagram showing an embodiment of the present invention.

FIG. 3 is a diagram showing a configuration example of registration data.

FIG. 4 is a flowchart showing an embodiment of the operation of the present invention.

FIG. 5 is a diagram showing a conventional system installation state.

FIG. 6 is a conceptual diagram of a conventional system.

FIG. 7 is a block diagram showing a configuration example of a conventional system.

[Explanation of symbols]

30 detection sensor 31 Imaging device 32 Recognition / collation device 40 databases 41 storage area

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Koichi Abe             4-1, Kamiodanaka, Nakahara-ku, Kawasaki-shi, Kanagawa             No. 1 within Fujitsu Limited F-term (reference) 5B050 BA10 BA11 EA18 GA08                 5B057 AA16 BA02 CA12 CA16 DA11                       DB02                 5B064 AA02 AA07                 5H180 AA01 BB13 CC04 CC11 DD10                       EE10

Claims (3)

[Claims] 1. A detection sensor for recognizing a moving body, an image pickup device for picking up an image of the moving body, and when the detection sensor detects the moving body, the image of the image pickup device at that time is captured as a still image to recognize character information. Then, the recognized character information and the information stored in the storage area are compared, and if the comparisons match, a recognition / collation device for accumulating the recognized character information and a still image in a built-in database is installed. A mobile character recognizing system, which comprises: 2. The moving body character recognition system according to claim 1, wherein the detection sensor emits ultrasonic waves toward the moving body and receives the reflection signal from the moving body to detect the moving body. . 3. The movement according to claim 1, wherein the information stored in the storage area is information that is separately prepared in advance and is stored in an information storage medium and input to the recognition / verification device. Body character recognition system.