KR100698380B1 - Multi-Biometrics System and method through active multi-camera - Google Patents

Abstract

The present invention is a multi-biometric information processing system for recognizing a plurality of biometric information and operation environment information of a person at the same time, the first recognition processing unit for recognizing the face and voice, and the second recognition processing unit for tracking the movement of the person and recognition of the operating environment And a DB storing biometric information of a person in advance, and recognition information received from the first and second recognition processing units, and comparing the biometric information stored in the DB to determine whether to be authenticated. Depending on the format includes an authentication and storage unit for integrated storage in the DB or a separate DB. The apparatus may further include a transmission unit configured to transmit the recognition information including audio and video information in accordance with a predetermined transmission format to be transmitted to the outside.

Multiple biometrics, active recognition, words, authentication, recognition information transmission, camera.

Description

Multi-Biometrics System and method through active multi-camera}

1 to 5 are views for explaining a conventional biometric information recognition system.

6 is a block diagram of a multi-biometric information processing system according to the present invention.

7 is a flow chart of multiple biometric information processing according to the present invention.

8 is an exemplary diagram of a data format of biometric information and environmental information that are integrated and stored in accordance with the present invention.

9 is an exemplary diagram of a data format of information for transmission configured to conform to a predetermined transmission format in accordance with the present invention.

10 is a flowchart of a transmission process of a multiple biometric information processing system according to the present invention;

<Description of the symbols for the main parts of the drawings>

600: face and voice recognition unit 601: camera

602: Image input unit 603: Face area detection unit

604: face tracker 605: microphone

606: Speech recognition unit 610: Motion tracking and environment recognition unit

611: camera 612: video input unit

613: motion tracking unit 614: information extraction unit

615: object recognition unit 620: storage and authentication unit

621: information input unit 622: authentication unit

623: situation recognition unit 624: information storage unit

630: communication unit 631: information input unit

632: packetizer 633: multiplexer

The present invention relates to a biometric information processing system and method, and more particularly, to a system and method for automatically obtaining, recognizing, and transmitting the biometric information to the outside if necessary without the active cooperation of a user using one or more active cameras and microphones. It is about.

As the information society matures, the necessity of security and authentication technologies is required. Accordingly, various approaches to user recognition have been developed. Among them, the biometric information recognition method that recognizes physical characteristics such as face shape, iris, fingerprint, and voice has high reliability, has the advantage that the user does not have to carry additional devices, and can reduce user's rejection and improve convenience. It is an area that is attracting attention in that respect.

Recently, a plurality of methods for recognizing a plurality of biometric information have been disclosed in order to improve reliability or increase recognition efficiency in using only one biometric information. In other words, face recognition is fast but not reliable, and fingerprint authentication is inefficient in database retrieval. Therefore, in order to secure these disadvantages, multiple biometric systems using face, fingerprint, and voice have been developed, and response time and accuracy are improved. Was made.

For example, Korean Patent Laid-Open Publication No. 10-2004-0048115 (A device and method for transmitting and receiving multiple biometric information for authentication in a mobile communication network) discloses an apparatus and a method for transmitting and receiving multiple biometric information for authentication over a mobile communication network. Doing. Looking at the configuration and processing flow of the above disclosed patent with reference to Figures 1 and 2, when the authentication server requests the biometric information (iris, face, vein, hand shape) for authentication, the user using a number of recognition devices in the mobile terminal The biometric information is transmitted to the server, and the authentication server performs authentication based on the information obtained by the user. The authentication is sent back to the user terminal to allow or deny the service.

Meanwhile, Korean Patent Laid-Open Publication No. 10-2004-0048048 (Authentication method and USB authentication key device using multiple biometric information) has a user's multiple biometric information (fingerprint, image, voice) on an authentication device (authentication key) equipped with a USB port. Etc.) is stored in advance, and a method of performing authentication using the USB authentication key is disclosed. As shown in FIG. 3, when the user requires authentication, the user communicates with the authentication system using a USB authentication key. Finally, the authentication system compares biometric information registered in advance of the USB authentication key. Determines whether to allow services. 4 is a block diagram of the above-described patent, which includes means for storing and recognizing facial images, fingerprints, and voice features, and a USB communication unit in the authentication system 110 and the USB key 120, and when necessary, an authentication system ( It can be seen that the characteristics information of the face, fingerprint, and voice stored in the USB key is transmitted to the authentication system through USB communication between the USB key 120 and the USB key 120 to perform the authentication process through mutual contrast.

As another example of the prior art, Korean Patent Laid-Open No. 10-2004-0048114 (Authentication apparatus and method through multiple biometrics in a portable terminal) includes a device capable of photographing at least one of an iris, a face, a vein, and a hand. In case of using a portable terminal, feature information is extracted from the user's multi-biological information (iris, face, vein, hand shape), and the authentication information is determined by matching the extracted feature information with pre-registered feature information. The method of doing so is disclosed. Looking at the processing flow with reference to Figure 5, when the recognition of one biometric information is completed, the above-described patent is performed for the recognition process for the other biometric information, and determines whether to authenticate based on the recognized one or more biometric information.

In the above-described prior art, in order to prevent a decrease in recognition rate caused by using one piece of biometric information, a plurality of pieces of biometric information are used to increase the authentication rate for a person. However, both the method of recognizing a single piece of biometric information and the method of recognizing a plurality of pieces of biometric information require active actions of a person to be recognized, for example, placing a finger on a sensor part, placing a face or eyes, or pronouncing a predetermined word. do. In order for a target person to be authenticated, there is a disadvantage in that various biometric information must be inputted through active operation, or the biometric information must be possessed in advance. In addition, it can give a sense of rejection to the user in that it requires the user's active actions.

Therefore, although the conventional biometric method can be used for user authentication, it is difficult to use in fields other than authentication such as monitoring.

On the other hand, after authentication is performed for a person in a given environment, there may be a case where a personal image of an authenticated person should be transmitted to another system simultaneously with video and audio as necessary. Korean Patent Laid-Open Publication No. 10-2004-0048115 (A device and method for transmitting and receiving multi-biometric information for authentication in a mobile communication network) defines a system for transmitting and receiving biometric information, but the purpose of the above-mentioned patent is limited to authentication. It suggests only transmission, and there is no method and specific data type for simultaneously transmitting video and audio that can be used for monitoring and the like. In addition, there is a disadvantage that the interoperability with the existing system is poor.

Therefore, without the active or active authentication of the user for various applications of the biometric information, that is, authentication or monitoring, the biometric information is correctly recognized and the obtained biometric information is combined with the existing communication system along with the audio and video information. It is very beneficial to provide a system that can transmit and receive while maintaining interoperability.

In order to solve the above-described problems of the prior art, the present invention uses one or more cameras with an automatic tracking function, and the biometric information (voice, face, height, hand gesture) and environmental information (for various persons) without active movement of the person. It provides an efficient system and method for acquiring a person's location, time of entry, and belongings simultaneously, and recognizing the person in real time based on this information, and transmitting the recognized information and the authenticated result to another system. There is.

In order to achieve the above technical problem, the present invention is a multi-biometric information processing system for simultaneously recognizing a plurality of biometric information and operation environment information of a person, a first recognition processing unit for recognizing a face and voice, and tracking and operation of a person A second recognition processor for environment recognition, a DB storing biometric information of a person in advance, recognition information received from the first and second recognition processing units, and compared with the biometric information stored in the DB to determine whether to authenticate The present invention provides a multi-biometric information processing system including an authentication and storage unit for integrally storing the recognition information in the DB or a separate DB according to a predetermined format.

According to another aspect of the invention, it may further include a transmitting unit for generating and transmitting information for transmission including at least a portion of the integrated stored recognition information and configured to conform to a predetermined communication format. The transmission information preferably conforms to the MPEG-4 over MPEG-2 format.

According to another aspect of the present invention, a multi-biometric information transmission system for collecting and transmitting a plurality of biometric information and operating environment information, which is capable of capturing and tracking a moving face image, for obtaining a face image of a person A first camera, a second camera for acquiring a physical feature, an operational state, and an operating environment image of a person, a microphone for collecting a human voice and / or ambient sound, and data from the camera and the microphone Recognition processing and storage unit for generating biometric information and environmental information by recognizing according to algorithm and storing them together, and transmitting unit for configuring and transmitting the recognition information transmitted from the recognition processing and storage unit according to a predetermined communication standard. Provided is a multi-biological information transmission system comprising a.

In addition, the present invention is a multi-biometric information processing method for recognizing a plurality of biometric information and operation environment information of a person at the same time, the biometric step of recognizing basic biometric information including facial and voice characteristics, and tracking and operation of a human An environmental recognition step for environmental recognition, a storage step of integrating and storing the recognition information obtained in the living body and the environment recognition step according to a predetermined format, and transmitting at least a part of the acquired recognition information in accordance with a multimedia communication standard It provides a multi-body information processing method comprising the step of configuring the credit information, the packetizing and multiplexing the transmission information, and transmitting the multiplexed transmission information packet through a wired or wireless communication network.

The technical gist of the present invention uses one or more cameras with an automatic tracking function, and biometric information (voice, face, height, hand gesture) and environmental information (person's location, time of entry, and possession) for various people without active movement of the person. Simultaneously, and based on this information, identify the person's certification and the person's behavior in real time, and transmit the recognized information and the result of the authentication to other systems simultaneously with video and audio signals as needed. It is an efficient way to do it. Of course, it can be equipped with additional sensor equipment, such as a microphone for speech recognition.

 In the present invention, the camera that tracks the movement continuously tracks the movement of the person, and stores the movement position and access time camera information, and the environment-aware camera recognizes the height information of the target person and information about the object owned by the person. Save it. In addition, the face tracking camera continuously tracks a face area using a pan-tilt-zoom (PTZ) function and stores a face image as needed. Finally, based on the tracking information obtained, the character's behavior can be identified.

 After authentication of a person is made in a given environment, there may be a case where the image of the authenticated person must be transmitted to another system simultaneously with video and audio as needed. The inventor of the present invention has developed a transmission / reception system based on an MPEG system in consideration of simultaneous transmission of a video signal and an audio signal. Since it is based on a standard corresponding to digital broadcasting and DMB broadcasting, it is possible to transmit the obtained biometric information through a broadcasting channel.

Hereinafter, the structure of the present invention will be described in detail with reference to the accompanying drawings.

As shown in FIG. 6, the bioinformation processing system of the present invention includes a face and voice recognition unit 600, a motion tracking and environmental recognition unit 610, a storage and authentication unit 620, a communication unit 630, and the like 4. It is divided into four parts, and each of these parts may be integrally formed and separately installed in a predetermined space. When installed separately, each part except the communication unit is connected to the Internet (Socket) or a conventional wired or wireless network.

The cameras 601 and 611 have a pan-tilt-zoom (PTZ) function and receive NTSC images. The camera 601 is used to automatically capture a face portion of a stationary or moving person (hereinafter referred to as a “subject”) in the jurisdiction of the biological information processing system according to the present invention to obtain a good image. The camera 611 tracks movements by photographing portions other than the subject's face, and identifies physical characteristics (eg, height, isometric ratio, hand size, foot size, body shape, etc.) and objects possessed by the subject other than the subject's face. Used to.

Although the camera 601 and the camera 611 are preferably separate cameras, the same single camera may be used. In the case of identifying the physical characteristics of the subject using one camera, it is preferable to first obtain a face image and then to identify physical characteristics and motion characteristics other than the face.

The image input units 602 and 612 are connected to the cameras 601 and 611, respectively, to process an image input from the camera and to control the camera. In the present embodiment, the image input units 602 and 612 receive an image through a frame grabber at a rate of about 30 fps (Frame per second).

The face area detector 603 receives an image from the image input unit 602 coupled to the camera 601 of the face and voice recognition unit 600, and detects a face area through an algorithm such as skin color, SVM, and adaboost.

The face tracking unit 604 tracks a face by using a motion method and a continuous face area detection method, and transmits a feedback signal to the image input unit 602 to continuously track a face image of a subject who is moving the camera 601. Do it.

The voice recognition unit 606 recognizes the voice and words of the target person who enters through the microphone 605, stores them, and transmits them to the storage and authentication unit 620. In addition to storing the voice itself or the voice pattern, the voice recognition unit 606 may check the words spoken by the user through voice recognition, convert them into text, and store and transmit them. Which word is converted into text and stored may be determined in advance according to the use of the biometric information recognition system according to the present invention. For example, when the system of the present invention is used for authentication, a sentence or word can be determined that is easy to extract the subject's voice characteristics, and when used for monitoring, attention may be given according to the installation location (for example, bank, airport, office, waiting room). Words or sentences to be made (eg, "give money", "bribery", "look good", "tax evasion", etc.) may be selected. Of course, it is natural to take an embodiment of converting and storing all sentences and words spoken by a subject for a predetermined time without determining a sentence or word to be text-converted beforehand.

The motion tracker 613 of the motion tracker and environment recognizer 610 distinguishes and tracks objects by using the motion and color energy of the moving object, and based on the result, the camera 611 through the image input unit 612. Ensure that the movement of the subject on the move is consistently good.

The information extraction unit 614 extracts and accumulates environmental information. The information extraction unit 614 uses geometric environment information from a timer (not shown) and the motion tracking unit 613 to display information (a key and a hand shape) of a target person. , Time of entry, location).

The object recognizing unit 615 detects the newly appeared object on the background screen using the PCA and the color information. The object to be grasped includes the object possessed by the subject.

The information acquired and recognized by the face and voice recognition unit 600 and the motion tracking and environment recognition unit 610 described above are transferred to the storage and authentication unit 620 and integratedly stored according to a predetermined data format. Used for authentication.

The information input unit 621 receives information from the recognition units 600 and 610 using a conventional wired / wireless communication method suitable for the system installation environment of the present invention.

The authentication unit 622 performs face authentication using a method such as (K) PCA, 2D PCA, and subject authentication using voice. Authentication is basically performed based on facial images and voice patterns from the face and voice recognition unit 600, but optionally subject body features (height, torso ratio, body shape, hand from the motion tracking and environmental recognition unit 610). Size, etc.) may be taken into consideration. When the biometric information processing system of the present invention is used only for monitoring, the authentication unit 622 is omitted.

The context recognizer 623 recognizes a situation by using information obtained through the object recognizer 615 and the information extractor 614. If abnormal behavior such as a sudden running in a public place is detected during situation recognition, the communication unit 630 transmits the identification information of the subject to the responsible authority.

The information storage unit 624 stores the biometric information and the personal information of the registrant for authentication, or stores the biometric information, the environmental information and the personal information from the recognition units 600 and 610. It is apparent to those skilled in the art that the authentication information and the recognized information may be stored in one DB or each separate DB.

One of the main features of the present invention is to continuously or periodically or intermittently transmit or receive multiple biometric and environmental information to an external institution or system in a format that is compatible with or compatible with existing communication standards. The communication unit 630 plays this role.

The communication unit 630 includes an information input unit 631, a packetizer 632, and a multiplexer 633. The information input unit 631 serves to receive information from the storage and authentication unit 620 and at the same time. It serves to receive input information from an organization or system through the multiplexer 633 and the packetizer 632.

The packetizer 632 adds and packetizes a header for transmitting multiple biometric information and environmental information. Although referred to herein as a packetization unit for convenience, the packetization unit 632 performs depacketization for reception in addition to packetization for transmission.

The multiplexer 633 muxes the packetized information for transmission or demuxes the received data.

The multi-biological information and environmental information processing system according to the present invention recognizes a plurality of biometric information to enhance the identification power, and can also recognize the environmental information around the subject together and transmit it to the outside for authentication as well as other It can be used suitably for the purpose. In addition, the communication unit 630 may receive authentication information or information extraction criteria (for example, a word for text conversion or an environmental state for determining a transmission time) from the outside.

Hereinafter, a method of processing multiple biometric information and environmental information performed by the system of the present invention will be described with reference to FIG. 7.

When an image is input from the camera 601 of the face and voice recognition unit to the image input unit, the face region detection unit 603 detects a face region, and the face tracking unit 604 continuously tracks the face region. The extracted face image is transmitted to the storage and authentication unit 620. At the same time, the voice of the target person acquired from the microphone 605 of the face and voice recognition unit 600 is transmitted to the storage and authentication unit 620.

When the image is input from the camera 611 of the motion tracking and environment recognition unit 610 separately from the face and voice recognition unit 600, the motion of the object in the image is continuously tracked by the motion tracker 613. In the information extraction unit 614, the height of the key, the shape of the hand, the access time and the moving position are recognized and transmitted to the storage and authentication unit 620. In addition, the object is recognized by the object recognizer 615 and transmitted to the authentication and storage unit.

The storage and authentication unit 620 performs authentication by comparing the face information obtained from the face and voice recognition unit 600 with the face information of the person stored in the DB (S700). In addition, authentication is performed based on the voice information obtained from the face and voice recognition unit 600 (S710). If the authentication is successful by one or more authentication methods of the two authentications, it is considered that the authentication for the person is made, and if both fail, it is considered that the authentication is not made (S720).

Once authentication is successful, the key height information obtained from the motion tracking and environmental recognition unit 610 and the voice and face information obtained from the face and voice recognition unit 600 are integrated with the personal information and classified by person (S740). . Optionally, according to the result of the authentication step (S720), it is possible to authenticate whether or not to use the permission for a specific application (S730).

In addition, the storage and authentication unit detects the behavior of the target person based on the access time and location information of the target person acquired by the motion tracking and environmental recognition unit, and information about the object possessed by the person (S750).

The data collected by the above-described step is integrated and stored according to a predetermined data format in step S760 and, if necessary, transmitted to the outside through packetization and multiplexing (S770).

In the embodiment illustrated in FIG. 7, when the authentication of the subject is completed, the biometric and environmental information together with the personal information are stored and transmitted to the outside when necessary, but the multi-biometrics of all the subjects located in the surveillance area of the system without the authentication procedure are provided. Of course, the information and environmental information can be stored and transmitted together with the acquired personal information.

In addition, in the embodiment of FIG. 7, it is determined that only one of the authentication by the face recognition or the authentication by the voice is authenticated. However, at least two of the plurality of biometric information (face, voice, height, isometric ratio, body shape, etc.) The above or all of the authentications must be performed in order to determine the authentication of the subject.

In addition, since the system according to the present invention can recognize environmental information in addition to biometric information, in the case where security is particularly important, even if the subject is a registrant who has been granted permission such as access in advance, the access is allowed only when safety confirmation based on environmental information is performed. It is also possible to implement the type of emitter. In other words, in the case of a control facility such as a bank vault room, if there is a person other than the registrant who is granted access, the registrant may not be allowed to enter.

Hereinafter, an integrated storage format of multiple biometric information and environmental information will be described in detail with reference to FIG. 9. Stored items include environmental information, person information, word information, person location information, and personal information, and other necessary information may be added.

The tag represents the information number, the environmental information is 1, the person information is 2, the word information is 3, and the person position information is 4. The Length field after the tag field indicates the length of each piece of information, and the ID indicates the identification number of the subject. The components of each piece of information are as follows.

(1) Environmental Information

Entrance (Exit) Time

Recognized Object ID: ID assigned to a recognizable object

-Height: the height of the person

(2) person information

-Person image: JPEG face image of detected person

(3) word information

Recognition Word: Binary data in a text file that contains sentences or words spoken by people

(4) person location information

-Person location: Binary data that stores the position (x, y) coordinates that the person moved

(5) personal information

-Person profile: Binary data that stores the person's profile

The multi-biometric information is integrated with the environmental information and transmitted to the communication unit. The transmitted aggregated information is packetized by person, multiplexed and transmitted to another system. If necessary, the integrated information is multiplexed and transmitted together with the video signal and the audio signal. In this case, the environment information is transmitted through a descriptor, and the person information, the word information, and the location information are composed of payloads such as video and audio signals and transmitted.

9 illustrates a syntax configuration of a payload.

In a preferred embodiment of the present invention, the payload is an ID for identifying a person, a person image (ES stream 1), a recognition word (ES stream 2), a person position (ES stream 3), and a video (stored in the information storage unit). ES stream 4) and audio (ES stream 5). Each ES stream is distinguished and stored through 5 byte (0x0000000001) ES identifiers.

Fig. 10 shows an operation procedure of a communication unit composed of an information storage unit, a packet unit, and a multiplexer.

As shown, it is determined whether it is environmental information (S1000), and if it is environmental information, it is stored as a descriptor in PMT information. In the present embodiment, whether or not the environmental information is made by checking the tag number, and if the tag is 1, it is classified as environmental information (see Fig. 8). If the tag is not 1, it is biometric or personal information of the subject, so that the ES_ID is distinguished (S1020), and the payload shown in FIG. 9 is composed (S1030), SL packetization, and FlexMuxing are performed. In operation S1040, PES packetization is performed. Finally, TS packetization is performed (S1050), and multiplexed and transmitted (S1060).

As described above, it is also apparent that the payload may optionally include environmental information (eg, basic information about an emergency situation).

The payload configured in the preferred embodiment of the present invention conforms to the MPEG-4 over MPEG-2 standard, which is the basis of MPEG-2 TS and DMB broadcasting, and transmits and receives biometric and environmental information through a broadcast channel. It is possible.

Although the configuration of the present invention has been described in detail with reference to the accompanying drawings and preferred embodiments in order to facilitate the convenience and understanding of the above description, the present invention is not limited thereto and can be easily modified by those skilled in the art. Or it covers a range of equivalents that can be changed. For example, although the transmission scheme of the system according to the present invention has been described as being in compliance with the MPEG-4 over MPEG-2 standard through the preferred embodiment, the transmission standard is not limited thereto, and various other methods that may be used may be used. Of course, it is obvious that the payload configuration may be modified.

Therefore, the scope of the present invention should be defined by interpretation of the description of the following claims.

As described above, according to the present invention, a plurality of biometric means is used to automatically track a person's motion without detecting an active action of a user, and detect and authenticate multiple biometric information. Therefore, unnecessary time consumption due to authentication can be minimized and recognition rate can be improved.

In addition, the multi-biometric information processing system according to the present invention can identify and authenticate the behavior of a person without recording the whole time, thereby effectively replacing the DVR surveillance system. If the DVR is to be used for surveillance, all scenes must be stored in real time. Therefore, using a large amount of storage and network requires a significant channel. On the other hand, using the present invention, since only the minimum key elements of the person's behavior are detected and authenticated, the capacity of the storage device can be significantly reduced, and the person's behavior can be easily identified. Since the multi-biometric information processing system according to the present invention can identify a person without active operation of the person, it can be effectively used as a monitoring system of an airport or a main facility in addition to the authentication.

In addition, the system of the present invention may transmit multiple biometric information simultaneously with a video signal and an audio signal as needed, and a communication unit may be designed to comply with digital broadcasting and DMB broadcasting standards and transmitted through a broadcasting channel.

Claims (15)

In the multiple biometric information processing system for recognizing a plurality of biometric information and operation environment information of a person at the same time, A first recognition processor recognizing a face and a voice; A second recognition processor for tracking a motion of a person and recognizing a motion environment; DB that stores the biological information of a person in advance, Authentication for receiving recognition information from the first and second recognition processing unit to determine whether to compare with the biometric information stored in the DB, and the authentication and integrated storage in the DB or a separate DB according to a predetermined format and Storage Multi biometric information processing system comprising a. The method of claim 1, A transmitter for generating and transmitting information for transmission including at least a part of the integrated stored recognition information and configured to conform to a predetermined communication format Multiple biometric information processing system further comprising. The method of claim 1, wherein the first recognition processing unit A first camera having a pan-tilt-zoom (PTZ) function to continuously track a face image and acquire a face image based on a good image among them; A microphone for speech recognition, A processor configured to process data from the first camera and the microphone according to a predetermined face recognition and voice recognition algorithm Multi biometric information processing system comprising a. The method of claim 1, wherein the second recognition processing unit A second camera for image acquisition for motion tracking and motion environment detection; A timer for obtaining time information, A processing unit for grasping a motion behavior and an environment of a person based on the image from the second camera and visual information from the timer Multi biometric information processing system comprising a. The method of claim 4, wherein the second recognition processing unit And further extracting body features including human hand shape, height, and isometric ratio. 6. The multi-biometric information processing system according to any one of claims 3 to 5, wherein the first and second cameras are the same camera. The method of claim 1, wherein the integrated stored recognition information is Environment information including visual information, person information including face images, word information describing at least one or more words included in the acquired voice information, location information on the position of a person in a subject area, and personal information. Multi-body information processing system. The method of claim 2, wherein the information for transmission is And a face image, a recognition word, a person's location, video, and audio information. The method of claim 8, wherein the information for transmission is A multiple biometric information processing system compliant with MPEG-4 over MPEG-2 format. The method of claim 2, wherein the transmitting unit A payload generation unit constituting a payload including information for transmission; A packetizer which performs SL packetization, flexmuxing, and PES packetization on the payload; A multiplexer which is connected to the packetizer and performs multiplexing of the packets; Means of communication Multi biometric information processing system comprising a. In the multiple biometric information transmission system for collecting and transmitting a plurality of biometric information and operating environment information, A first camera for capturing and tracking a moving face image and acquiring a face image of a person; A second camera for acquiring a physical feature, an operation state, and an operation environment image of a person; A microphone for collecting human voices or surrounding sounds; Recognition processing and storage for recognizing the data from the camera and the microphone according to a predetermined algorithm to generate biometric information and environmental information, and integrally storing them; Transmitter configured to transmit the recognition information transmitted from the recognition processing and storage in accordance with a predetermined communication standard and transmit it Multi biometric information transmission system comprising a. The method of claim 11, DB for storing the biometric information of the registered person, And an authentication unit for performing an authentication procedure by comparing the biometric information from the recognition processing and storage unit with the biometric information stored in the DB. In the multiple biometric information processing method for simultaneously recognizing a plurality of biometric information and operation environment information of a person, A biometric step of recognizing basic biometric information including face and voice characteristics; An environmental awareness step for tracking a human movement and recognizing a motion environment; A storage step of integrating and storing the recognition information obtained in the living body and environment recognition step according to a predetermined format; Configuring at least a part of the acquired recognition information into transmission information conforming to a multimedia communication standard; Packetizing and multiplexing the transmission information; Transmitting the multiplexed transmission information packet through a wired or wireless communication network. Multi biometric information processing method comprising a The method of claim 13, Preparing a DB for authentication in advance to store a plurality of biometric information for each registrant; An authentication step of determining whether to authenticate by comparing the biometric information obtained in the biometric recognition step and the biometric information stored in the authentication DB Multiple biometric information processing method further comprising. The method of claim 13, wherein the configuring of the transmission information And identification data for identifying a person, and data including a face image, a recognition word, a person's position, video, and audio information to conform to the MPEG-4 over MPEG-2 format.

Images