TWI765424B - Driver login apparatus, system and method - Google Patents

Abstract

A driver login apparatus, system and method are provided. The driver login apparatus comprises a network connection unit, an image capturing unit, an image processing unit and a central processing unit. The image capturing unit captures images of a target object to obtain a login information correspondingly. The image processing unit receives and processes the login information to obtain a digital data correspondingly. The central processing unit obtains a driver data through the network connection unit, controls the image capturing unit to photograph the target object, compares the digital data and the driver data to generate a comparison result, and transmits the comparison result through the network connection unit.

Description

Driver login device, system and method

The present invention relates to a personnel management system, in particular to a driver login device, system and method.

Based on the need to take care of the physical and mental fatigue of drivers, companies that provide professional driving services will hope to control the working hours of drivers within a certain range; in addition, based on safety considerations, companies may also consider using a special car. to provide service, thereby avoiding the dangers of unfamiliar vehicle conditions. However, currently the only means of communication between the company and the driver are devices such as telephones or radios, and the results of the communication using these devices alone do not allow the company to determine whether the driver is in a driving/resting state, nor can it be The company confirms the correct pairing between the driver and the vehicle being driven. Therefore, a mechanism that can confirm the working status of the driver is a technology that is currently required in the market.

In view of this, an object of the present invention is to provide a driver login device, a driver login system, and a driver login method, which can use an image capture device to obtain a live image at a specific time, and analyze the image with the database. Compare the data in the vehicle to determine who the driver you see is. By using such a driver login device and driver login system, the company will be able to clearly know the working hours and identity of the driver in the driver's seat.

From one aspect, the description of the present invention provides a driver login device, including: a network connection unit, an image capture unit, an image processing unit, and a central processing unit. The network connection unit is suitable for connecting to the network; the image capture unit captures the target to obtain the corresponding first login information; the image processing unit is electrically coupled to the image capture unit to receive and process the first login information to obtain the corresponding first login information the first digital data; the central processing unit is electrically coupled to the network connection unit, the image capture unit and the image processing unit, which obtains driver data corresponding to the driver through the network connection unit and controls the image capture unit photographing the target object, obtaining the first digital data from the image capturing unit and comparing it with the driver data to generate a first comparison result, and transmitting the first comparison result through the network connection unit.

In one embodiment, the driver profile includes an existing facial image or existing facial profile of the driver. Further, in one embodiment, the target is the driver's face, the first login information is the login image obtained by the image capturing unit photographing the driver's face, and the first digital data is the image processing unit for the login image. The login facial feature data obtained by capturing facial features from the image. Further, in one embodiment, the logged-in facial feature data is transmitted as part of the existing facial feature data.

In one embodiment, when the driver information is the existing facial image of the driver and does not include the existing facial feature data, the central processing unit transmits the existing facial image to the image processing unit and causes the image processing unit to capture Take the features of existing facial images to obtain specific facial feature data. Further, the specific facial feature data is transmitted through the network connection unit and becomes a part of the existing facial feature data.

In one embodiment, the aforementioned image processing unit simultaneously performs fast response matrix image code interpretation and facial feature extraction for the first login information.

From another aspect, the description of the present invention provides a driver login system, including: a servo device and a driver login device, and the driver login device further includes a network connection unit, an image capture unit, an image processing unit unit and central processing unit. The above-mentioned servo device stores driver data corresponding to the driver; the network connection unit is connected to the servo device through a network connection; the image capture unit captures the target object to obtain the corresponding first login information; The central processing unit is electrically coupled to the network connection unit, the image capturing unit and the image processing unit, which is electrically coupled to the image capturing unit to receive and process the first login information to obtain the corresponding first digital data; The network connection unit obtains the driver data through the network connection, controls the image capture unit to photograph the target object, obtains the first digital data from the image capture unit and compares the driver data to generate a first comparison result, and The first comparison result is transmitted to the server device through the network connection unit through the network connection unit.

In one embodiment, the driver profile includes an existing facial image or existing facial profile of the driver. Further, in one embodiment, the target is the driver's face, the first login information is the login image obtained by the image capturing unit photographing the driver's face, and the first digital data is the image processing unit for the login image. The login facial feature data obtained by capturing facial features from the image. Further, in one embodiment, the logged-in facial feature data is sent back to the server and becomes part of the existing facial feature data.

In one embodiment, the driver's login device further captures the target object again after obtaining the first digital data for a predetermined period of time to obtain the corresponding second login information, and captures the second login information and the second login information through image capture. The second digital data converted by the unit or the second comparison result obtained by comparing the driver data with the second digital data is sent to the servo device.

In one embodiment, when the driver information is the existing facial image of the driver and does not include the existing facial feature data, the central processing unit transmits the existing facial image to the image processing unit and causes the image processing unit to capture Take the features of existing facial images to obtain specific facial feature data. Further, the specific facial feature data is sent back to the server and becomes a part of the existing facial feature data.

In one embodiment, the target is a fast response matrix code.

In one embodiment, the aforementioned image processing unit simultaneously performs fast response matrix image code interpretation and facial feature extraction for the first login information.

From another aspect, the description of the present invention provides a method for logging in a driver, including: photographing a target object to obtain corresponding first log-in information; processing the first log-in information to obtain corresponding first digital data; The device obtains driver data corresponding to the driver; compares the first digital data with the driver data to generate a first comparison result; and transmits the first comparison result.

In one embodiment, the driver profile includes an existing facial image or existing facial profile of the driver. Further, the target is the driver's face, the first login information is the login image obtained by photographing the driver's face, and the first digital data is the login face obtained by performing facial feature extraction on the login image. characteristic data.

In one embodiment, when the driver data is an existing facial image of the driver and does not include the existing facial feature data, the features of the existing facial image are further extracted to obtain specific facial feature data. Further, the specific facial feature data is transmitted and becomes a part of the existing facial feature data.

In one embodiment, when processing the first login information to obtain the corresponding first digital data, the method includes: performing fast response matrix image code interpretation and facial feature extraction on the first login information at the same time.

All in all, the driver login device, driver login system and driver login method provided by the description of the present invention can use the image capture device to obtain live images at a specific time, and compare the images with the data in the database after image analysis. Determine who the driver you see is. By using the driver login device and the driver login system, the user can clearly know the working hours and the identity of the driver in the driver's seat. Further, by performing the facial feature capture operation of the image in the driver login device, it is possible to avoid the situation that the facial feature capture result is different due to the difference between the image processing chips of the servo device and the driver login device; and The facial features captured by the driver's login device returned to the server can be provided to other driver's login devices using the same image processing chip, reducing the need for the driver's login device to capture facial features. the number of operations.

Please refer to FIG. 1 , which is a circuit block diagram of a driver login device according to an embodiment of the present invention. As shown in FIG. 1 , the driver login device 10 provided in this embodiment includes a central processing unit 100 , an image processing unit 110 , an image capturing unit 120 and a network connection unit 130 . The central processing unit 100 can be used to execute the operating system and various software to control the circuit units in the driver login device 10 to operate at appropriate times. In other words, the central processing unit 100 is electrically coupled to the image processing unit 110, The image capture unit 120 and the network connection unit 130 are controlled according to the operation system executed by the central processing unit 100 for various information input to the driver login device 10 and input or output requirements generated by each circuit unit during the operation process Instructions are sent to the image processing unit 110 , the image capture unit 120 and the network connection unit 130 .

In this embodiment, the network connection unit 130 is adapted to be connected to various networks, such as an intranet or the Internet, by means of a wired connection or a wireless connection, and to connect via these networks to another device where the required data is stored. When the data needs to be obtained, the central processing unit 100 will send an instruction to the network connection unit 130, and the network connection unit 130 can obtain data from the corresponding device via the network according to the received command (also referred to as driving After obtaining the driver information, the network connection unit 130 will notify the central processing unit 100 and store the obtained driver information in the storage device according to the preset rules or further instructions of the central processing unit 100 (not shown). shown in the drawings) or other internal circuit units provided to the driver login device 10 . As known by those skilled in the art, the driver data can be transferred between the circuit units by arranging the busbars connected to the circuit units inside the driver login device 10 . In order to make the drawings and descriptions more concise and to focus on the technical points proposed by the present invention, the bus bars and the specific connection relationship between them and various circuit units are not drawn in FIG. 1 . However, the related busbar setting technology is already a commonly used technology, so those skilled in the art can design the busbars connected between the circuit units according to the requirements of the technical content proposed by the present invention and use the existing technology in combination. Not much to describe here.

In this embodiment, the image capturing unit 120 is adapted to photograph the target object to obtain the corresponding login information (hereinafter also referred to as the first login information). In different embodiments, different objects can be selected as targets, for example, a mobile device that can display a Quick Response Code (QR Code) or the driver's face area, or multiple objects can be selected at the same time objects as targets. In the following description, it is set that the vehicle on which the QR code is mounted and the driver's face area are simultaneously selected as targets. Based on such a setting, the photographing range of the image capturing unit 120 should cover the vehicle carrying the QR code and the location where the driver's face area often appears. For example, the image capturing unit 120 may include two photographing elements, wherein one photographing element is directed toward a preset height of the driver's seat to capture the image of the driver's face area, and the other photographing element is directed toward a preset height of the driver's seat. A location (such as where a phone or QR code sign is placed) to capture the QR code that appears at this location. In another embodiment, the same photographic element can be used to cover both the vehicle carrying the QR code and the area where the face area appears, for example, the photographic element can photograph the position including the driver's face to the upper body to obtain the face and the face at the same time. Image of QR code listing. Alternatively, in another embodiment, the same photographing element may be used to successively photograph the position of the vehicle carrying the QR code and the position of the driver's face area to obtain corresponding images.

After the image capturing unit 120 captures the target to obtain the corresponding login information, the image processing unit 110 receives the login information and performs appropriate image processing to obtain the corresponding digital data (hereinafter also referred to as the first digital data). Inheriting the above-mentioned settings, since the login information may include a QR code or a driver's face image (hereinafter also referred to as a login image), the image processing unit 110 must be able to interpret the data represented by the QR code and perform facial features on the image. Fetch operation. The data obtained by interpreting the QR code (hereinafter referred to as the login identity data) or/and the facial features obtained by extracting the facial features from the image (hereinafter also referred to as the login facial feature data) are the first digit data respectively. Part of the first digital data will be sent to the central processing unit 100 for comparison with the driver data obtained from the network connection unit 130. The central processing unit 100 obtains the first digital data generated by the image processing unit 110 and the driver data obtained through the network connection unit 130, and then compares the first digital data and the driver data to obtain a corresponding comparison result (also referred to later). Referred to as the first comparison result), and finally transmit the comparison result through the network connection unit 130 for the user to confirm. In another embodiment, a photographic element may be used to directly capture an image first, regardless of whether the photographic element captures the vehicle of the QR code or the driver's face area, and the image is captured after the photographic element captures the image. The processing unit 110 then performs the operation of interpreting the QR code and extracting the facial features on the image at the same time, to see whether the login identity data is obtained by interpreting the QR code first or the login facial feature data is first obtained by retrieving the facial features of the image. , and then transmit the data obtained first to the central processing unit 100 for comparison with the above-mentioned driver data obtained from the network connection unit 130 .

It must be noted that the quantity and content of the driver data obtained by the central processing unit 100 via the network connection unit 130 can be changed according to requirements. In one embodiment, the central processing unit 100 can obtain the driver information corresponding to each driver through the network connection unit 130; in another embodiment, the central processing unit 100 can provide the driver login device 10 where the central processing unit 100 is located. and obtain the driver information related to the driver login device 10 from the database. Furthermore, when obtaining the data related to the driver's login device 10 from the database, the central processing unit 100 may also determine the driver data to be obtained according to the obtainable log-in information. For example, when the driver's login device 10 can only obtain the QR code through the image capturing unit 120, the central processing unit 100 can only obtain the data that can be compared with the login identity data from the database (hereinafter also referred to as Similarly, when the driver's login device 10 can only obtain the login image through the image capture unit 120, the central processing unit 100 can only obtain the login facial feature data from the database and carry out The compared face image (hereafter referred to as existing face image) or facial feature data (hereafter referred to as existing face feature data).

Inheriting the above settings, when the target is a vehicle with a QR code and the driver's face area, the login information will include both the QR code and the login image. Therefore, when obtaining the driver information, it is recommended to obtain both the existing identity data used for comparison with the login identity data and the existing facial image or existing facial feature data used for comparison with the login image. Of course, even if the target includes both the vehicle carrying the QR code and the driver's face area, the driver information obtained by the central processing unit 100 may still include only the existing identity information or only the existing facial image or both There is facial feature data, and the data is compared only according to the content of the obtained driver data to generate the first comparison result.

In detail, when there is existing identity information in the obtained driver information, the central processing unit 100 can compare the login identity information obtained by interpreting the QR code with the existing identity information to confirm whether the driver to log in is not. It is the driver corresponding to this driver profile. Further, if the serial number of the vehicle (such as a vehicle, a plane or a ship, etc.) can be obtained from the driver login device 10 and the corresponding relationship between the driver and the vehicle is also included in the driver data, the central processing unit 100 It can also be judged accordingly whether the driver to be logged in is the driver who should drive the current vehicle. The aforesaid and other results obtained from the comparison or judgment by the central processing unit 100 (hereinafter collectively referred to as the first comparison result) can be sent back to the device for obtaining the driver information via the network connection unit 130 .

On the other hand, when there is an existing facial image in the obtained driver profile but there is no corresponding existing facial feature data, the central processing unit 100 may transmit the existing facial image to the image processing unit 110 , and the image processing unit 110 performs a facial feature extraction operation (eg, using a convolutional neural network) to extract the corresponding facial features (also referred to as specific facial feature data hereinafter) from this existing facial image ); after obtaining the logged-in facial feature data and the specific facial feature data in the same way, the central processing unit 100 can compare the logged-in facial feature data with the specific facial feature data and generate a corresponding comparison result. On the contrary, when there is existing facial feature data in the obtained driver data, the central processing unit 100 can directly compare the logged-in facial feature data with the existing facial feature data after obtaining the logged-in facial feature data, and generate a the corresponding comparison results.

Further, in addition to the aforementioned first comparison result, the login image acquired by the image capturing unit 120 or the login facial feature data or specific facial feature data acquired by the image processing unit 110 can be returned. into the database and used as the driver data for subsequent driver login device 10 or other driver login devices.

Please refer to FIG. 2 , which is a schematic diagram of a driver login system according to an embodiment of the present invention. In this embodiment, the driver login system includes a driver login device 10 and a server device 20 , and a network connection is generated between the driver login device 10 and the server device 20 through a network 25 to transmit information therebetween.

In this embodiment, the servo device 20 stores driver data that can be provided to the driver login device 10, and each driver data includes the existing identity data IDD, the existing facial image corresponding to the same driver IMG and existing facial features data FEA. Among them, the existing identity data IDD can be transferred into a QR code representing the same content and provided to the corresponding driver for download and use, the existing facial image IMG includes the corresponding driver's face image, and the facial feature data FEA includes Various feature value groups related to the face image of the corresponding driver are obtained (the details will be described later). In the servo device 20, at least one of the three sub-data of the existing identification data IDD, the existing facial image IMG and the existing facial feature data FEA of each driver data should not be an empty set.

In one embodiment, when the driver logs in to the device 10 and needs to obtain the driver data, the central processing unit 100 may directly request the server device 20 to obtain each driver data stored therein through the network connection unit 130 . In another embodiment, in order to reduce the requirement of data transmission, the central processing unit 100 may first provide the device number DN of the driver's login device 10 to the server device 20 through the network connection unit 130 , and the server device 20 may receive the device number DN according to the received data. The device number DN of the device number DN provides one or more pieces of driver data DATA(s) corresponding to the device number DN to the driver login device 10 . The circuit blocks and detailed operation of the driver login device 10 have been described above in detail according to FIG. 1 , and will not be repeated here.

Further, since the same image may generate different image features when using different image processing chips for feature extraction, initially, only one or more pieces of existing data can be stored in the servo device 20 for each driver data. There is a facial image IMG without storing any existing facial feature data FEA. Therefore, when the driver login device 10 is the first to access a certain piece of driver information, the central processing unit 100 will use the image processing unit 110 to process the existing facial image due to the lack of the existing facial feature data FEA IMG and generate corresponding specific facial feature data S_FEA. Finally, each specific facial feature data S_FEA generated by the driver logging in device 10 will be transmitted to the servo device 20 and merged into the driver data, eventually becoming the existing facial features of the driver data A part of the data FEA (that is, a sub-data of the facial feature data FEA).

Of course, in order for the driver login system to be compatible with driver login devices using different image processing chips, it is recommended to associate each sub-data in the existing facial feature data FEA with the image processing chip that generates the sub-data. That is, each sub-data generated by the image processing chip of type A can be classified in one X group, and each sub-data generated by the image processing chip of type B can be classified in another Y group. Therefore, as long as the central processing unit 100 also provides the model parameter TYPE for indicating the image processing chip when requesting data, the servo device 20 can provide the driver with the sub-data generated by the image processing chip of the same model according to the model parameter TYPE Log in to the device 10 for use. With this structure, as long as the driver login device 10 has access to a certain driver profile, the sub-data (specific facial feature data S_FEA) generated during the access can be merged into this driver profile. Afterwards, it can be directly used by any subsequent driver login devices that use the same type of image processing chip as the driver login device 10 , and it is no longer necessary to repeat the image feature capturing operation.

Further, if it is necessary to know whether the driver has performed the above-mentioned log-in operation or not privately replaced the personnel, the user can add a timing device to the driver log-in device 10 or the servo device 20, and the timing device can be After the driver's login device 10 obtains the first digital data or the servo device 20 obtains the first comparison result for a predetermined period of time, the driver's login device 10 is restarted to capture the target object and obtain the corresponding login information again (hereinafter referred to as the second login information), and compares the second login information, the digital data converted from the second login information by the image processing unit 110 (hereinafter referred to as the second digital data), and/or using the driver data and the second digital data The obtained comparison result (hereinafter referred to as the second comparison result) is transmitted to the servo device 10 for recording and confirmation.

According to the above description, the present invention can be integrated into a driver login method. In the embodiment shown in FIG. 3 , the target is first photographed to obtain the corresponding first login information (step S300 ), and the first login information is processed to obtain the corresponding first digital data (step S302 ). Obtain driver data corresponding to each driver (step S304 ), then compare the first digital data with the obtained driver data to generate a first comparison result (step S306 ), and transmit the first comparison result to for subsequent use (step S308). For the detailed description of the related art, reference may be made to the content disclosed in the previous embodiments, which will not be repeated here.

According to the above, the driver login device and the driver login system provided by the description of the present invention can use the image capture device to obtain live images at a specific time, and compare the images with the data in the database to determine what is seen. who is the driver. By using the driver login device and the driver login system, the user can clearly know the working hours and the identity of the driver in the driver's seat. Further, by performing the facial feature capture operation of the image in the driver login device, it is possible to avoid the situation that the facial feature capture result is different due to the difference between the image processing chips of the servo device and the driver login device; and The facial features captured by the driver's login device returned to the server can be provided to other driver's login devices using the same image processing chip, thus reducing the need for the driver's login device to perform facial features. The number of fetch operations.

10: Driver login device 20: Servo device 25: Internet 100: Central Processing Unit 110: Image processing unit 120: Image capture unit 130: Network connection unit DATA(s): Driver data DN: device number FEA: Facial Profile IDD: Existing Identity Data IMG: Existing facial images S_FEA: specific facial feature data S300-S308: Implementation steps of an embodiment of the present invention TYPE: model parameter

FIG. 1 is a circuit block diagram of a driver login device according to an embodiment of the present invention. FIG. 2 is a schematic diagram of a driver login system according to an embodiment of the present invention. FIG. 3 is a flowchart of a driver login method according to an embodiment of the present invention.

10: Driver login device

100: Central Processing Unit

110: Image processing unit

120: Image capture unit

130: Network connection unit

Claims (11)

A driver login system is characterized by comprising: a servo device storing a driver data corresponding to a driver, wherein the driver data includes an existing facial image or an existing facial feature of the driver data; and a driver login device, comprising: a network connection unit, connected to the servo device through a network connection; an image capture unit, photographing a target to obtain a corresponding first login information; an image processing unit electrically coupled to the image capture unit to receive and process the first login information to obtain a corresponding first digital data; and a central processing unit electrically coupled to the network connection unit , the image capture unit and the image processing unit, the central processing unit obtains the driver information from the servo device through the network connection unit through the network connection, and controls the image capture unit to shoot the target object , obtain the first digital data from the image capture unit and compare it with the driver data to generate a first comparison result, and use the network connection unit through the network connection to compare the first comparison result The result is sent back to the servo device, wherein, when the driver data includes the existing facial feature data, the central processing unit directly compares the first digital data with the existing facial feature data to generate the first digital data. A comparison result; wherein, when the driver data includes the existing facial image of the driver and does not include the existing facial feature data, the central processing unit transmits the existing facial image to the image The processing unit makes the image processing unit capture the features of the existing facial image to obtain a specific facial feature data, and the specific facial feature data is returned to the servo device and becomes the existing facial feature data part of. The driver login system according to claim 1, wherein the target is the driver's face, the first login information is a login image obtained by the image capturing unit photographing the driver's face, and The first digital data is a login facial feature data obtained by the image processing unit performing facial feature extraction on the login image. The driver login system according to claim 1, wherein the driver login device further captures the target object again after a preset time for obtaining the first digital data to obtain a corresponding second login information, and sends the The second login information, a second digital data converted from the second login information by the image capture unit, or a second comparison result obtained by comparing the driver data with the second digital data are sent to the the servo. The driver login system according to claim 1, wherein the target is a quick response matrix code. The driver login system according to claim 1, wherein the image processing unit simultaneously performs quick response matrix image code interpretation and facial feature extraction for the first login information. A driver login device is characterized by comprising: a network connection unit, suitable for connecting to a network; an image capture unit, for photographing a target to obtain a corresponding first login information; an image processing unit, electrically coupled to the image capture unit to receive and process the first login information to obtain a corresponding first digital data; and a central processing unit electrically coupled to the network connection unit, the image capture unit unit and the image processing unit, the central processing unit obtains the image corresponding to a driver through the network connection unit a driver data, control the image capture unit to photograph the target, obtain the first digital data from the image capture unit and compare it with the driver data to generate a first comparison result, and use the The network connection unit transmits the first comparison result, wherein the driver data includes an existing face image or an existing face feature data of the driver; wherein, when the driver data includes the existing face In the case of facial feature data, the central processing unit directly compares the first digital data with the existing facial feature data to generate the first comparison result; wherein, when the driver data includes the driver's existing facial feature data When the facial image does not include the existing facial feature data, the central processing unit transmits the existing facial image to the image processing unit and causes the image processing unit to capture the features of the existing facial image to obtain A specific facial feature data, and the specific facial feature data is sent back to the server and becomes a part of the existing facial feature data. The driver login device according to claim 6, wherein the target is the driver's face, the first login information is a login image obtained by the image capturing unit photographing the driver's face, and The first digital data is a login facial feature data obtained by the image processing unit performing facial feature extraction on the login image. The driver login device according to claim 6, wherein the image processing unit simultaneously performs quick response matrix image code interpretation and facial feature extraction for the first login information. A driver login method, comprising: photographing a target to obtain a corresponding first login information; processing the first login information to obtain a corresponding first digital data; Obtaining a driver data corresponding to a driver from a servo device via the network; comparing the first digital data with the driver data to generate a first comparison result; and transmitting the first comparison result via the network The comparison result is sent to the servo device, wherein the driver data includes an existing facial image or an existing facial feature data of the driver; wherein, when the driver data includes the existing facial feature data , directly comparing the first digital data with the existing facial feature data to generate the first comparison result; wherein, when the driver data includes the existing facial image of the driver and does not include the existing facial feature data When facial feature data, the feature of the existing facial image is extracted to obtain a specific facial feature data, and the specific facial feature data is returned to the servo device and becomes a part of the existing facial feature data a part. The driver login method according to claim 9, wherein the target is the driver's face, the first login information is a login image obtained by photographing the driver's face, and the first digital data A login facial feature data obtained for facial feature extraction of the login image. The driver login method according to claim 9, wherein when processing the first login information to obtain the corresponding first digital data, the method includes: simultaneously performing a quick response matrix image code interpretation and facial recognition for the first login information Feature extraction.

Images