TWI816609B - Eyewear data system for surveillance - Google Patents

Abstract

An eyewear data system for surveillance comprises smart glasses and a server. The smart glasses comprise a frame; lens mounted on the frame and comprising a display module, and the display module configured to display pre-stored user data; a camera module mounted on the frame, and the camera module configured to capture and output a facial image of a user; and a wireless transmission module in signal transmittable connection with the display module and the camera module. The server connects to the display module and the camera module through the wireless transmission module. The camera module transmits the facial image to the server through the wireless transmission module. The server compares the facial image and a pre-stored image to obtain the pre-stored user data corresponding to the pre-stored image. The server further outputs the pre-stored user data to the display module.

Description

Eye wearable information system for monitoring

The invention relates to an eye-wearable information system for monitoring.

When handling business, bank clerks often need to check personal information with customers, and then access relevant financial information based on the customer's personal information. This process often takes a lot of time. In addition, in the process of retrieving information, the customer's personal information is usually input into the computer. The computer retrieves all the customer's financial information from the system based on the personal information, and then the bank staff filters out the actual information. Required information. This method of data retrieval will not only increase the data transmission volume of the system, but may also allow non-related personnel who are located near the computer to see all the customer's financial information, thereby creating the risk of data leakage.

In view of the above, the present invention provides an eye-wearable information system for monitoring that meets the above needs.

An eye wearable information system according to an embodiment of the present invention includes: a smart glasses, including: a frame; a lens installed on the frame and including a display module, the display module is Displaying a pre-stored user information, wherein the display module is a transparent display, wherein the pre-stored user information includes a first pre-stored user information and a second pre-stored user information, and the first pre-stored user information and The second pre-stored user data respectively corresponds to a first financial service category and a second financial service category; a camera module is provided on the frame, and the camera module is used to capture and output a user's profile Facial image, wherein the camera module includes a lens and a microprocessor that are electrically connected to each other. The microprocessor receives a real-time image obtained by the lens, and the microprocessor determines a face in the real-time image. When the real-time image reaches a preset proportion, the real-time image is used as the facial image, and the facial image includes a pupil image; and a wireless transmission module, the signal is communicably connected to the display module and the camera module, and a server, which is communicatively connected to the display module and the camera module through the wireless transmission module, wherein the camera module transmits the face image to the server through the wireless transmission module, and the server The server compares the facial image with a pre-stored image to obtain the pre-stored user information corresponding to the pre-stored image. The server further outputs the pre-stored user information to the display module and outputs the pre-stored user information. Afterwards, the server further determines whether a pupil diameter is smaller than a normal diameter based on the pupil image. When the server determines that the pupil diameter is smaller than the normal diameter, it outputs a security test information corresponding to the pre-stored user information to the display. module, wherein the security test information includes a correct information and a trap information, wherein the camera module is further used to capture a fingerprint image of an operator and transmit the fingerprint image to the server, and the server is When it is determined that the fingerprint image matches a pre-stored fingerprint image corresponding to the first financial service category, the first pre-stored user data is used as the pre-stored user data output to the display module.

In summary, the eye-wearable information system according to one or more embodiments of the present invention can not only reduce the time required to access customer information, but also reduce the risk of data leakage. In addition, according to the eye-wearable information system shown in one or more embodiments of the present invention, the data transmission volume of the overall system can be reduced by technical means such as outputting user information corresponding to bank clerks, and by judging the user's face The technical means of reducing the proportion of images in real-time images reduces the computing load of the server.

The above description of the present disclosure and the following description of the embodiments are used to demonstrate and explain the spirit and principles of the present invention, and to provide further explanation of the patent application scope of the present invention.

The detailed features and advantages of the present invention are described in detail below in the implementation mode. The content is sufficient to enable anyone skilled in the relevant art to understand the technical content of the present invention and implement it according to the content disclosed in this specification, the patent scope and the drawings. , anyone familiar with the relevant art can easily understand the relevant objectives and advantages of the present invention. The following examples further illustrate the aspects of the present invention in detail, but do not limit the scope of the present invention in any way.

The eye wearable information system shown in the present invention includes a smart glasses (Smart Glasses) and a server. The smart glasses are worn by bank clerks (operators) who assist customers in handling business at bank counters to assist Bank clerks can read customer information in a faster and safer way when handling business. It should be noted that the "smart" refers to glasses whose lenses are transparent displays with display functions and can communicate with the server for data transmission, and then display the transmitted data on the glasses lenses.

Please refer to FIGS. 1 and 2 , which are schematic diagrams of smart glasses for monitoring according to an embodiment of the present invention. The smart glasses 1 shown in the present invention include a frame 11, a lens 12, a camera module 13 and a wireless transmission module 14.

The lens 12 is installed on the frame 11 and includes a display module 121. The display module 121 is used to display a pre-stored user information. As shown in FIG. 1 , the display module 121 may constitute a part of the lens 12 ; however, the display module 121 may also constitute the entire lens 12 . Specifically, the display module 121 can be a transparent display, so that the user can still see the surrounding environment through the lens 12 while displaying data.

The camera module 13 is preferably installed on the frame 11 and is installed on the frame 11 extending in a direction perpendicular to the lens 12. The camera module 13 can also be installed between two lenses 12. position and the lens of the camera module 13 will be higher than the lens 12 (that is, when the user wears the smart glasses 1, the lens of the camera module 13 is approximately located at the user's forehead). In other words, the position of the camera module 13 is based on the principle of not blocking the lens 12, so as to avoid blocking the user's line of sight while capturing images.

The wireless transmission module 14 is communicably connected to the display module 121 and the camera module 13 so that the display module 121 and the camera module 13 can communicate with a server through the wireless transmission module 14 (as shown in Figure 3 Server 2), in which the wireless transmission module 14 can be communicated or electrically connected to the display module 121 and the camera module 13. The wireless transmission module 14 can be a wireless network (Wifi) module, a Bluetooth module, etc., and the invention is not limited thereto. In the smart glasses 1 of the present invention, the wireless transmission module 14 is preferably connected to a local area network (LAN) that can communicate to the server 2, and a communication range of the wireless transmission module 14 It is best not to exceed 3 meters, so when the smart glasses 1 leave the counter area, they cannot connect to the server 2 to prevent the smart glasses 1 from being used by intentional people to steal customer information. The above 3 meters are only examples. , the present invention is not limited to this.

Please refer to FIG. 3 , which is a block diagram of an eye-wearable information system for monitoring according to an embodiment of the present invention. As mentioned above, the eye wearable information system of the present invention includes smart glasses 1 and a bank's server 2, and the display module 121 and camera module 13 of the lens 12 are communicatively connected to the bank's server through the wireless transmission module 14. Device 2.

Specifically, the camera module 13 includes a lens 131 and a microprocessor 132. The lens 131 is electrically connected to the microprocessor 132, and the microprocessor 132 is communicatively connected to the server 2. Therefore, the real-time image captured by the lens 131 Can be transmitted to microprocessor 132 and server 2. The microprocessor 132 obtains the real-time image from the lens 131. The microprocessor 132 first determines whether there is a user's face in the real-time image, and further determines the user's face when determining that the face is present in the real-time image. Whether the proportion in the real-time image reaches a preset proportion (for example, 50%). When the microprocessor 132 determines that the proportion of the user's face in the real-time image reaches a preset proportion, the microprocessor 132 can output the real-time image as a face to the server 2 for subsequent analysis. image.

In other words, when the microprocessor 132 determines that the proportion of the user's face in the real-time image reaches the preset proportion, it means that the user has approached the counter and will ask the bank clerk wearing the smart glasses 1 to assist in handling business. The microprocessor 132 can output the real-time image containing the user's face (hereinafter referred to as the facial image) to the server 2 for subsequent analysis. Accordingly, although the lens 131 will continuously acquire images, the data transmission volume of the wireless transmission module 14 can be effectively reduced by only transmitting facial images when the facial proportion reaches the preset proportion, and the server 2 does not need to Each frame of real-time image acquired by the lens 131 is analyzed, so the calculation load of the server 2 can be reduced.

In addition, the shooting range of the camera module 13 is preferably not greater than 30 degrees. In other words, the shooting range of the camera module 13 is preferably within 15 degrees to the left and right of the center line of the field of view of the lens 131 , that is, the shooting range of the camera module 13 is preferably about 15 degrees to the left and right of the bank clerk wearing the smart glasses 1 Within the range to prevent the camera module 13 from invading other people's privacy or photographing random people, causing the server 2 to analyze useless information.

When the server 2 receives the facial image, the server 2 can compare the facial image with a pre-stored image to obtain a pre-stored user information corresponding to the pre-stored image. Specifically, the server 2 may have a database 21 that stores pre-stored images of faces of multiple users and pre-stored user data corresponding to these users, and the pre-stored user data may include Various financial information such as user name, contact number/address, loan items, loan interest rates, insurance items, financial product purchase records, etc.

When the server 2 determines that the facial image matches one of the pre-stored images in the database 21 (that is, it is determined to be the same user), the server 2 can transmit the pre-stored user data of the corresponding pre-stored image through the wireless transmission module 14 Output to the display module 121, so that the display module 121 displays the pre-stored user information on the lens 12 for the bank clerk wearing the smart glasses 1 to check (as shown in the display module 121 of Figure 2). In addition, the pre-stored user information output to the display module 121 preferably includes a pre-stored seal image or a pre-stored signature image, so that the bank clerk can compare the seal or signature provided by the current user in real time.

In addition, the database 21 may further store one or more abnormal user images, where the abnormal user images are, for example, images of users with bad credit, a history of fraud or misappropriation, etc. Therefore, when the server 2 receives the facial image, it can compare the facial image with one or more abnormal user images stored in the database 21. When the comparison result is that the facial image matches one of the abnormal user images, When the user's image matches, the server 2 can output a warning notification to the display module 121 to notify the bank clerk to pay more attention to the current user.

Alternatively, in the pre-stored images stored in the database 21, for users with poor credit, fraud or misappropriation records, etc., the pre-stored user data may further include the abnormal records. Therefore, when the server 2 outputs the pre-stored user information of the pre-stored image that matches the facial image, it can also output the abnormal record to the display module 121 . In other words, the database 21 can store the abnormality record without saving the abnormal user image, so as to reduce the amount of data stored in the database 21 .

Similarly, the database 21 may further store one or more priority user images, where the priority user image is, for example, an image of a VIP customer. Therefore, when the server 2 receives the facial image, it can compare the facial image with one or more priority user images stored in the database 21. When the comparison result is that the facial image matches one of the priority user images, When the user's image matches, the server 2 can output a priority notification to the display module 121 to notify the bank clerk to prioritize the current user's business and provide discounts applicable to the current user.

Alternatively, in the pre-stored images stored in the database 21, for the priority user, the pre-stored user information may further include transaction records such as financial services frequently used by the priority user and normal transaction amounts. Therefore, when the server 2 outputs the pre-stored user information of the pre-stored image that matches the facial image, it can also output the transaction record of the priority user to the display module 121 . In other words, the database 21 can store the priority user's transaction records without saving the priority user image, so as to reduce the amount of data stored in the database 21 .

In addition, the user's facial image captured by the camera module 13 preferably includes a pupil image. Therefore, after determining the pre-stored user information corresponding to the facial image, the server 2 can then determine whether a pupil diameter is based on the pupil image. Less than a normal diameter to determine whether the user is in a nervous state, where the normal diameter is, for example, 2 mm to 4 mm. The present invention does not limit the actual value of the normal diameter. In other words, when a user steals another person's identity, he or she will usually become more nervous and have a smaller pupil diameter. Therefore, when the server 2 determines that the pupil diameter is smaller than the normal diameter, the server 2 can control the camera module 13 to continuously obtain facial images including pupil images to continuously monitor the current user's emotional state. When the pupil diameter of the continuously acquired pupil image is still smaller than the normal diameter, the server 2 can output a warning notification to the display module 121, or control the display module 121 to continuously display the warning notification to notify the bank clerk when reviewing the current use. Please pay more attention to the information of the applicant.

The server 2 can further selectively output a piece of security testing information corresponding to the pre-stored image to the display module 121 . That is, after the server 2 outputs the warning notification and pre-stores the user information, the server 2 can output the security testing information to the display module 121 . Specifically, the database 21 can store security testing information corresponding to each pre-stored user information, and the security testing information can include correct information, trap information and corresponding questions. Therefore, the bank clerk can determine whether the current user is lying by asking the current user to answer questions for the security test information and based on the above-mentioned continuously acquired pupil images.

The correct information for security testing can be the user name, contact number, address and other basic information of the pre-stored user information. The bank clerk can ask corresponding questions such as "What is your name?" to determine whether the user can answer the question. Correct information.

The trap information of the security testing information can be generated by modifying the pre-stored user data, and the trap information is preferably contrary to the content of the pre-stored user data. For example, if there is no relevant record for the loan project in which the user's information is pre-stored (that is, the user has not applied for a loan), the corresponding question of the trap information can be "What are the loan projects you have applied for?" etc. If the current user answers "I have applied for a loan but forgot the items", "The loan I have applied for is a mortgage", etc., it means that the current user may be lying. Alternatively, if the loan item of the pre-stored user information shows that the user has applied for a loan, the corresponding question of the trap information can be "Have you never applied for a loan?" etc.

Accordingly, the bank clerk can closely monitor the current user based on the current user's answer content and the warning notice displayed by the display module 121, thereby improving the accuracy of identification and avoiding misjudgment.

In another embodiment, the server 2 can further output information corresponding to the user based on the identity of the bank clerk wearing the smart glasses 1 . For convenience of explanation, assume that the pre-stored user data of the same user includes a first pre-stored user data and a second pre-stored user data, and the first pre-stored user data and the second pre-stored user data respectively correspond to a first pre-stored user data. For a financial service category and a second financial service category, the server 2 can output the first pre-stored user information or the second pre-stored user information based on the identity of the bank clerk wearing the smart glasses 1 .

More specifically, in this embodiment, the database 21 stores pre-stored fingerprint images of a plurality of bank clerks and the financial service categories of these bank clerks. Taking the above first and second financial service categories as an example, the first bank clerk is responsible for processing the first financial service category, so the first pre-stored fingerprint image of the first bank clerk corresponds to the first financial service category; the second bank clerk is dedicated to processing The second financial service category, therefore the second pre-stored fingerprint image of the second bank clerk corresponds to the second financial service category.

After transmitting the user's facial image to the server 2, the camera module 13 is further used to take a fingerprint image of the bank clerk wearing the smart glasses 1, and transmit the fingerprint image to the server through the wireless transmission module 14. Device 2. The server 2 can compare the fingerprint image obtained through the camera module 13 with the first and second pre-stored fingerprint images stored in the database 21 . When the server 2 determines that the fingerprint image obtained through the camera module 13 is consistent with the first pre-stored fingerprint image, the first user information of the first financial service category corresponding to the first pre-stored fingerprint image can be output to the display module. 121 of the stored user data.

For example, the pre-stored user data for the same user may include a first pre-stored user data for loan-related data and a second pre-stored user data for insurance-related data. After the server 2 determines that the pre-stored user information corresponding to the user includes loan and insurance-related information based on the user's facial image and before outputting the pre-stored user information, the server 2 can further determine based on the wearing of smart glasses in the above manner. The fingerprint image of banker 1 determines that the banker is a banker of the first bank or a banker of the second bank. When the server 2 determines that the clerk wearing the smart glasses 1 is the first bank clerk, the user's loan-related information (first pre-stored user data) can be output to the display module 121 as the pre-stored user data. Accordingly, the server 2 can only output the actually required data, thereby reducing the data transmission volume of the wireless transmission module 14 .

In another embodiment, in addition to being communicatively connected to the server 2 , the microprocessor 132 can also be connected to the display module 121 via signal transmission to control the display status of the display module 121 . Moreover, the pre-stored fingerprint images stored in the database 21 may further correspond to a pre-stored working position, that is, each pre-stored fingerprint image represents a bank clerk, and the pre-stored working position corresponding to each pre-stored fingerprint image is each bank employee. The clerk’s working location (such as the branch’s address, latitude and longitude, etc.). Therefore, when the server 2 outputs the pre-stored user information, it can also output the pre-stored working position corresponding to the pre-stored fingerprint image of the first bank clerk to the microprocessor 132 .

When receiving the pre-stored working position, the microprocessor 132 can first control the display module 121 not to display the pre-stored user information, and at the same time obtain real-time positioning information from the Global Positioning System (GPS). The microprocessor 132 then determines whether the pre-stored working position is consistent with the real-time positioning information, and when it is determined that the pre-stored working position is consistent with the real-time positioning information, it controls the display module 121 to display the pre-stored user information, wherein the microprocessor 132 determines that the pre-stored working position is consistent with the real-time positioning information. The way to determine whether the real-time positioning information is consistent is to determine whether the distance error between the pre-stored working position and the real-time positioning information is less than 20 meters. When the distance error is less than 20 meters, it is judged that the pre-stored working position is consistent with the real-time positioning information. Accordingly, the security of the pre-stored user data during transmission can be further enhanced.

In addition, when the first bank clerk wearing the smart glasses 1 needs to access the second pre-stored user information of the second financial service category, the first bank clerk can further connect to the terminal device (for example, computer) of the server 2 through communication. ) Enter an access request, where the access request is the first bank clerk's request to access the second pre-stored user information. Then, the server 2 outputs an permission fingerprint input notification to the display module 121 through the wireless transmission module 14 according to the access request, so as to notify the first bank clerk that a second bank clerk with permission to access the second pre-stored user information is required. Provide their fingerprint image, wherein the authorized fingerprint input notification is a notification requesting the second bank clerk to provide the fingerprint image, and the authorized fingerprint input notification preferably also includes a request for the first bank clerk to access the second pre-stored user information. Similar to the above method, the camera module 13 can capture the fingerprint image of the second bank clerk and output the fingerprint image of the second bank clerk to the server 2 . When the server 2 determines that the fingerprint image corresponds to the second financial service category, it means that the second bank clerk has provided the first bank clerk with the permission to access the second pre-stored user information of the second financial service category, so the server 2 is The second pre-stored user information can be output to the display module 121 .

Or, when the second bank clerk wears another smart glasses (hereinafter referred to as the second smart glasses), and the server 2 records each clerk and the model/device number of the smart glasses he wears, The server 2 can output the permission fingerprint input notification to the display module of the second smart glasses through the wireless transmission module of the second smart glasses according to the access request, and capture the second bank by the camera module of the second smart glasses. The fingerprint image of the operator. The camera module of the second smart glasses then outputs the fingerprint image of the second bank clerk to the server 2 through its wireless transmission module. When the server 2 determines that the fingerprint image received from the second smart glasses is consistent with the second pre-stored fingerprint image stored in the database 21, it can output the second pre-stored user data corresponding to the second pre-stored fingerprint image to the display module. Group 121.

In summary, the eye-wearable information system for monitoring according to one or more embodiments of the present invention can not only reduce the time required to access customer information, but also reduce the risk of data leakage. In addition, according to the eye-wearable information system for monitoring shown in one or more embodiments of the present invention, the data transmission volume of the overall system can be reduced by technical means such as outputting user data corresponding to bank clerks, and through judgment The technical means of reducing the proportion of the user's facial image in the real-time image reduces the computing load of the server.

Although the present invention is disclosed in the foregoing embodiments, they are not intended to limit the present invention. All changes and modifications made without departing from the spirit and scope of the present invention shall fall within the scope of patent protection of the present invention. Regarding the protection scope defined by the present invention, please refer to the attached patent application scope.

1:Smart glasses 11:Frame 12:Lens 121:Display module 13:Camera module 131:Lens 132:Microprocessor 14:Wireless transmission module 2:Server 21:Database

1 and 2 are schematic diagrams of smart glasses for monitoring according to an embodiment of the present invention. FIG. 3 is a block diagram of an eye-wearable information system for monitoring according to an embodiment of the present invention.

1:Smart glasses

11: Frame

12: Lenses

121:Display module

13:Camera module

131: Lens

132:Microprocessor

14:Wireless transmission module

2:Server

21:Database

Claims (7)

An eye-wearable information system for monitoring, including: A smart glasses, including: a frame; a lens, installed on the frame and including a display module, the display module is used to display at least part of a pre-stored user information, wherein the display module is A transparent display, wherein the pre-stored user information includes a first pre-stored user information and a second pre-stored user information, and the first pre-stored user information and the second pre-stored user information respectively correspond to a first financial Service category and a second financial service category; a camera module, installed on the frame, the camera module is used to capture and output a facial image of a user, wherein the camera module includes electrical connections with each other A lens and a microprocessor. The microprocessor receives a real-time image obtained by the lens. When the microprocessor determines that a face in the real-time image accounts for a preset proportion of the real-time image, the microprocessor uses the real-time image. The image is the facial image, the facial image includes a pupil image; and a wireless transmission module, the signal is communicatively connected to the display module and the camera module, and a server, through the wireless transmission module The communication is connected to the display module and the camera module, wherein the camera module transmits the facial image to the server through the wireless transmission module, and the server compares the facial image with a pre-stored image. Obtain the pre-stored user information corresponding to the pre-stored image, wherein the camera module is further used to capture a fingerprint image of an operator and transmit the fingerprint image to the server, and the server determines the difference between the fingerprint image and the When a pre-stored fingerprint image corresponding to the first financial service category matches, the first pre-stored user data is used as the at least part of the pre-stored user data, and after outputting the at least part of the pre-stored user data, the server The server further determines whether a pupil diameter is smaller than a normal diameter based on the pupil image. When the server determines that the pupil diameter is smaller than the normal diameter, it outputs a security test information corresponding to the pre-stored user data to the display module, wherein The security testing information includes a correct information and a trap information. The eye-wearable information system for monitoring as described in claim 1, wherein when the server receives an access request corresponding to the second pre-stored user data of the second financial service category, the server The server outputs an authorization fingerprint input notification to the display module. The camera module further captures another fingerprint image of another operator and transmits the other fingerprint image to the server. The server determines the other fingerprint image. When a fingerprint image corresponds to the second financial service category, the second pre-stored user information is output to the display module. The eye-wearable information system for monitoring as described in claim 1, wherein the server further determines whether the facial image of the user matches an abnormal user image or a priority user image, and the server When it is determined that the facial image of the user matches the abnormal user image, a warning notification is output to the display module, and the server outputs a priority user image when it is determined that the facial image of the user matches the priority user image. Notify this display module. The eye-wearable information system for monitoring as described in claim 1, wherein a shooting range of the camera module is not greater than 30 degrees. The eye-wearable information system for monitoring as claimed in claim 1, wherein the at least part of the pre-stored user information output to the display module includes a pre-stored seal image or a pre-stored signature image. The eye-wearable information system for monitoring as described in claim 1, wherein the pre-stored fingerprint image further corresponds to a pre-stored work position, and the server further outputs the pre-stored work when outputting the pre-stored user data. The microprocessor obtains real-time positioning information from a global positioning system. When the microprocessor determines that the pre-stored working position is consistent with the real-time positioning information, it controls the display module to display the pre-stored working position. at least part of the user's information. The eye-wearable information system for monitoring as described in claim 1, wherein the wireless transmission module is connected to a local area network of the server, and a communication range of the wireless transmission module does not exceed 3 meter.

Images