KR20220042445A - Means of transportation commuting control method and device, electronic device, medium and vehicle - Google Patents

Abstract

The present invention provides a method for collecting a face image of an occupant of a transportation means by an image collecting module, specifying the identity information of the occupant based on the face image, measuring the body temperature data of the occupant by a body temperature measuring module, A method and apparatus for controlling commuting in a transportation means, comprising: establishing a correspondence relationship between a measurement time of body temperature data, information related to the transportation means, and the identification information and the body temperature data, and storing and processing the correspondence relationship; It's about vehicles.

Description

Means of transportation commuting control method and device, electronic device, medium and vehicle

The present invention is the priority of a Chinese patent application filed with the Chinese Intellectual Property Office on February 14, 2020, the application number is 202010092833.0, and the title of the invention is "Method and Apparatus for Controlling Commuting for Transportation, Electronic Devices, Media, and Means of Transportation" claim, and the entire content of the application is incorporated herein by reference.

FIELD OF THE INVENTION The present invention relates to the field of transportation technology, and more particularly, to a method and apparatus for controlling commuting in transportation, electronic devices, media and vehicles.

In the means of transportation, people are usually densely packed. In particular, it is important to control commuting for transportation means for special groups such as students or during periods of epidemics of infectious diseases such as influenza and pneumonia.

The present invention provides a technical proposal for commuting control of transportation means.

According to one aspect of the present invention,

collecting a face image of a vehicle occupant by an image collecting module, and specifying identification information of the occupant based on the face image;

measuring body temperature data of the passenger by a body temperature measuring module;

There is provided a commuting control method for transportation means, comprising: establishing a correspondence relationship between a measurement time of the body temperature data, related information of the transportation means, and the identification information and the body temperature data, and storing and processing the correspondence relationship.

According to one aspect of the present invention,

a collection and identification module for collecting a face image of a vehicle occupant by an image collecting module, and specifying identification information of the occupant based on the face image;

a temperature measurement module for measuring body temperature data of the passenger by the body temperature measurement module;

and an establishment and storage module for establishing a correspondence relationship between the measurement time of the body temperature data, the transportation means related information, and the identification information and the body temperature data, and storing and processing the correspondence relationship; do.

According to one aspect of the present invention,

an image collection module for collecting face images of passengers;

a body temperature measurement module for measuring body temperature data of the passenger;

specifying the identity information of the occupant based on the face image, establishing a correspondence relationship between the measurement time of the body temperature data and related information of the transportation means, the identification information and the body temperature data, and storing the correspondence relationship; Provided is a vehicle equipped with an electronic device for

According to an aspect of the present invention, there is provided one or more processors, and a memory for storing and processing executable instructions, wherein the one or more processors are configured to call the executable instructions stored in the memory to execute the method. Electronic devices are provided.

According to one aspect of the present invention, there is provided a computer-readable storage medium storing computer program instructions, wherein when the computer program instructions are executed by a processor, the computer-readable storage medium realizes the method.

According to one aspect of the present invention, there is provided a computer program including computer readable code, wherein when the computer readable code operates in an electronic device, a processor of the electronic device executes instructions for realizing the method. to provide.

In an embodiment of the present invention, a face image of a passenger in a transportation means is collected by an image collecting module, identification information of the passenger is specified based on the face image, and body temperature data of the passenger is measured by a body temperature measurement module, A correspondence relationship is established between the measurement time of the body temperature data, the relevant information of the transportation means, the identification information, and the body temperature data, and the correspondence relationship is stored and processed. Thereby, it is possible to contribute to the timely acquisition of the occupant's body temperature data by the person concerned (eg, guardian, school, contact person) of the occupant, and to facilitate retrospective investigation based on the stored data later, in particular It has an important meaning for infection prevention measures during epidemics of infectious diseases such as influenza and pneumonia.

It should be understood that the above general description and the following detailed description are illustrative and interpretative only, and do not limit the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS Other features and aspects of the present invention will become apparent by describing exemplary embodiments in detail below with reference to the drawings.

BRIEF DESCRIPTION OF THE DRAWINGS The drawings included as a part of the specification show embodiments according to the present invention, and together with the specification are used in the description of the technical solutions of the present invention.
1 is a flowchart illustrating a method for controlling commuting by means of transportation according to an embodiment of the present invention.
2 is a schematic diagram of a mounting position of the image collection module and the body temperature measurement module in the method for controlling commuting by means of transportation according to an embodiment of the present invention.
3 shows another schematic diagram of the mounting positions of the image collection module and the body temperature measuring module in the method for controlling commuting by means of transportation according to an embodiment of the present invention.
4 shows a schematic diagram of a body temperature monitoring system by means of transportation according to an embodiment of the present invention.
5 is a block diagram of a transportation means commuting control device according to an embodiment of the present invention.
6 is a block diagram of an electronic device 800 according to an embodiment of the present invention.
7 is a block diagram of an electronic device 1900 according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Various exemplary embodiments, features and aspects of the present invention will be described in detail below with reference to the drawings. In the drawings, the same reference numerals indicate elements having the same or similar functions. Although the drawings have shown various aspects of the embodiments, the drawings are not necessarily drawn to scale unless otherwise noted.

The term "exemplary" herein means "an example, used as an embodiment, or explanatory." Here, any embodiment described as “exemplary” should not be understood as being preferable or superior to other embodiments.

The term “and/or” in the present specification merely describes a relation between related objects, and indicates that three relations are possible. For example, A and/or B may represent three cases, such as a case where only A exists, a case where both A and B exist, and a case where only B exists. In addition, the term "one or more" in the present specification indicates any one of a plurality or any combination of at least two of the plurality. For example, including at least one of A, B, and C may indicate including any one or a plurality of elements selected from the group consisting of A, B, and C.

In addition, numerous specific details are set forth in the following specific embodiments in order to better illustrate the present invention. It should be understood by those skilled in the art that the present invention may be practiced without any specific details. In some embodiments, detailed descriptions of methods, means, elements, and circuits known to those skilled in the art are omitted in order to emphasize the spirit of the present invention.

1 is a flowchart illustrating a method for controlling commuting by means of transportation according to an embodiment of the present invention. The execution subject of the transportation means commuting control method may be a transportation means commuting control device. For example, the transportation means commuting control device may be mounted on the transportation means. For example, the transportation means commuting control method may be executed by a terminal device or other processing device. The terminal device may be a user equipment (UE), a portable device, a user terminal, a terminal, a portable device, a computing device, an in-vehicle device, or the like. In some possible embodiments, the method of transportation commuting control may be realized by a processor invoking computer readable instructions stored in a memory. As shown in Fig. 1, the method for controlling commuting by means of transportation includes steps (S11) to (S13).

In step S11, a face image of the vehicle occupant is collected by the image collecting module, and identification information of the occupant is specified based on the face image.

The means of transportation in the embodiment of the present invention may be a public transportation institution or a private transportation means. For example, the means of transportation may be an automobile (eg, a school bus, a pickup bus, an online dispatcher, a bus), a subway, a train, a ship, an airplane, or the like. A vehicle occupant may include any person riding in the transportation means, for example, may include non-drivers (eg, passengers, crew members, etc.) boarding the transportation means, or may include the driver of the transportation means do.

In an embodiment of the present invention, the image acquisition module is an RGB (Red (red), Green (green), Blue (blue)) camera, RGBD (Red (red), Green (green), Blue (blue), Depth (depth) )) a camera, a binocular infrared camera, an infrared thermal camera module, and the like. A biometric detection function can be exhibited by using a binocular infrared camera, RGBD camera, or the like.

In one possible embodiment, upon detecting that the human body approaches the image collection module or the body temperature measurement module, the image collection module may collect a facial image of the vehicle occupant. For example, a distance sensor or a pyroelectric infrared sensor is disposed in the vicinity of the image collection module or the body temperature measurement module, and whether there is a human body approaching the image collection module or the body temperature measurement module by a distance sensor or a pyroelectric infrared sensor may be detected.

In an embodiment of the present invention, a facial feature is extracted from the facial image by a second neural network, the facial feature is further combined with a pre-established facial feature library, and the facial feature corresponding to the facial image is based on the combination result. The identification information (that is, the identification information of the passenger) may be specified. The second neural network may be trained in advance based on the face image group having face keypoint label information to learn face localization and facial feature extraction capabilities. The facial key points may include key points of parts such as a forehead, eyes, eyebrows, mouth, nose, and face outline. The number of face keypoints may be 21, 106, 240, or the like. The embodiment of the present invention is not limited to the structure of the second neural network, and for example, a Back Propagation (BP) neural network, a convolutional neural network, and a Radial Basis Function (RBF). ) may include, but are not limited to, neural networks, perceptron neural networks, linear neural networks, feedback neural networks, and the like.

In one possible embodiment, after collecting a face image of a transportation means occupant by the image collecting module, the method provides a mask to the occupant when detecting that the occupant is not wearing a mask based on the face image and issuing third presentation information for presenting to be worn. In this embodiment, when it is detected that the occupant is not wearing a mask based on the face image, third presentation information for suggesting that the occupant wears a mask is issued, so that transmission of infectious diseases in the means of transportation is possible. can be reduced.

As an example of this embodiment, the third presentation information may be issued by at least one of a voice module, a display module, and a light emitting module installed in the transportation means. For example, the sound module may include a speaker or a buzzer, the display module may include a display screen, and the like, and the light emitting module may include a light emitting diode (LED) or the like. For example, a voice saying "wear a mask" may be uttered by the voice module, or a text message saying "wear a mask" may be displayed by the display module. When the person in charge of the transportation means (eg, a driver of a school bus, a teacher in a school bus, a driver or conductor of a bus, a crew member of a train, an airplane, etc.) receives the third presentation information, for example, the occupant By timely processing, such as refusing to enter the means of transportation without wearing a mask, the possibility of transmission of infectious diseases in the means of transportation can be reduced.

In one possible embodiment, the specifying of the identity information of the occupant based on the face image as described above may include detecting that the occupant is wearing a mask based on the face image, so that the non-hidden face of the face image is specifying a location of a key point, extracting a feature of the face image based on a non-hidden face key point, and specifying identification information of the passenger based on the extracted feature of the face image. In this embodiment, when it is detected that the occupant is wearing a mask based on the face image, face identification can be performed based on a non-hidden face region of the face image. For example, for a face wearing a mask, key points such as a forehead, eyes, eyebrows, and facial contour may be used to identify a face position and extract facial features, and further identify identification. According to this embodiment, when the occupant is wearing a mask, face identification can be performed without the occupant taking off the mask, so that non-perceptual face identification can be realized, and the possibility that the occupant is infected with an infectious disease can be reduced. there is.

In one possible embodiment, after collecting the face image of the vehicle occupant by the image collecting module, the method detects that the occupant is wearing a mask based on the face image, As the identification information of the passenger cannot be identified based on the face region, second presentation information is issued to present the passenger to take off the mask, or the passenger wears the mask based on the face image Further comprising: issuing second presentation information upon detecting that there is, and re-collecting the face image of the occupant by the image collecting module, and specifying the identity information of the occupant based on the face image again and specifying identification information of the passenger based on the collected face image.

In this embodiment, when it is detected that the occupant is wearing a mask based on the face image, if identification information of the occupant cannot be identified based on the non-hidden face region of the face image, the mask is provided to the occupant may be presented to be removed, re-collected face images of the occupant, and face identification may be performed based on the re-collected face images. In this embodiment, when the identification information of the occupant can be identified based on the non-hidden facial region of the face image, since there is no need to instruct the occupant to take off the mask, face identification and Temperature measurement can be realized, and the passing speed of passengers can be increased.

In this embodiment, when detecting that the occupant is wearing a mask based on the face image to quickly complete face identification, directly presenting the occupant to take off the mask, re-collecting the occupant's face image, You may make it face identification based on the re-collected face image.

In one example of this embodiment, after specifying the identification information of the occupant, the method further includes issuing third presentation information for presenting the occupant to wear a mask. In this example, after the occupant takes off the mask and succeeds in face identification, the occupant is suggested to reapply the mask, thereby reducing the possibility of transmission of infectious diseases in the means of transportation.

In step S12, the body temperature data of the passenger is measured by the body temperature measuring module.

In addition, in the embodiment of the present invention, the execution order of steps S11 and S12 is not limited. For example, step S11 and step S12 may be executed simultaneously, or step S11 may be executed first, and then step S12 may be executed, or step S12 may be executed preferentially, and Step S11 may be executed.

In one possible embodiment, the body temperature measuring module may be a non-contact body temperature measuring module. As a result, cross-infection can be reduced and passenger transit efficiency can be increased.

As an example, the body temperature measurement module may have a thermography body temperature detector. In the natural world, objects whose temperature is higher than absolute zero (-273°C) emit electromagnetic waves. Infrared radiation is the most common form of existence of electromagnetic waves. The thermography body temperature detector collects an infrared signal radiated from an object, converts the infrared signal into an electrical signal, further converts the electrical signal into a temperature by a signal processing system, and outputs a thermography image that is easily identifiable by the naked eye can do. In this way, the thermography body temperature detector can realize non-contact temperature measurement.

The temperature measurement error of the thermography body temperature detector in an actual environment is about ±1°C, and furthermore, it is higher than this. For this reason, in order to improve temperature measurement precision, in an example, the said body temperature measurement module may have a temperature calibration device, for example, a black body. The black body may be mounted on the opposite side of the thermographic body temperature detector, whereby it can be ensured that the radiation target surface of the black body appears in the image of the thermography body temperature detector. The thermography body temperature detector can perform real-time temperature measurement and calibration based on the temperature value set in the black body so that the precision of temperature measurement satisfies the requirement of ±0.3°C. The blackbody can be used when connected to a power source, and there is no need to connect to the Internet.

In another example, the body temperature measurement module may include an infrared thermometer for measuring the temperature of the forehead or the temperature of the wrist.

In one possible embodiment, the image collection module and/or the body temperature measurement module is mounted outdoors of the transportation means, or the image collection module and/or the body temperature measurement module is mounted inside the transportation means. 2 is a schematic diagram of a mounting position of the image collection module and the body temperature measuring module in the method for controlling commuting by means of transportation according to an embodiment of the present invention. As shown in FIG. 2 , the image collection module and the body temperature measurement module may be mounted at the point indicated by reference numeral 21 in FIG. 2 . That is, the image collection module and the body temperature measurement module may be mounted in the vicinity of the door, for example, on the left side of the door. 3 is another schematic diagram of a mounting position of the image collection module and the body temperature measurement module in the method for controlling commuting by means of transportation according to an embodiment of the present invention. As shown in FIG. 3 , the image collection module and the body temperature measurement module may be mounted at the point indicated by reference numeral 22 in FIG. 3 . That is, the image collection module and the body temperature measurement module may be mounted on a door. In an example, the image collection module and/or the body temperature measurement module may be mounted indoors. For example, the image collection module and/or the body temperature measurement module may be mounted at a location of a card reader for entry/exit of the transportation means. For example, when the means of transportation is a bus, the image collection module and/or the body temperature measurement module may be mounted at a location of a bus boarding card reader. One or more sets of image collection modules and the body temperature measurement module may be mounted on one transportation means.

In another possible embodiment, the image collection module and the body temperature measurement module may be mounted at the starting point of boarding of the transportation means. For example, when the means of transportation is a school bus, the image collection module and the body temperature measurement module may be mounted on a platform of a school bus, for example, at an entrance of a school. When the means of transportation is a bus or a train, the image collection module and the body temperature measurement module may be mounted in a groove. When the means of transportation is a subway, the image collection module and the body temperature measurement module may be mounted on a subway ticket gate. When the means of transportation is an airplane, the image collection module and the body temperature measurement module may be mounted on a boarding gate.

In one possible embodiment, after collecting the face image of the vehicle occupant by the image collecting module, the method includes detecting whether the occupant in the face image is wearing a hat, and detecting whether the occupant is wearing the occupant's hat. Accordingly, the method further includes issuing first presentation information for presenting the occupant to remove the hat or expose the forehead. In this embodiment, the first presentation information may be issued by a voice module or a display module installed in the transportation means. In this embodiment, when it is detected that the occupant is wearing the hat based on the face image, first presentation information is issued to present the occupant to remove the hat, thereby supporting rapid execution of face identification.

As an example of this embodiment, the above detecting whether the occupant in the face image is wearing a hat is not able to identify the identity information of the occupant based on the non-hidden facial region of the face image, or, detecting whether the occupant in the face image is wearing a hat according to the unsuccessful measurement of the temperature of the occupant's forehead. In this example, when the identification information of the occupant cannot be identified based on the non-hidden face region of the face image, or when the temperature of the occupant's forehead cannot be successfully measured, the occupant in the face image wears a hat It is detected whether the occupant is wearing a hat, and further, when it is detected that the occupant is wearing a hat, the occupant may be presented to take off the hat or expose the forehead. It is possible to identify the identity information of the occupant based on the non-hidden face region of the face image, and if the temperature of the occupant's forehead is successfully measured, it is necessary to present the occupant to take off the hat or expose the forehead there is no Thereby, face identification and temperature measurement can be realized without operation by the occupant, and the passing speed of the occupant can be increased.

As an example of this embodiment, detecting whether the occupant in the face image is wearing a hat includes detecting whether the occupant in the face image is wearing a hat by a first neural network. The first neural network is previously trained by a first training image group and/or a second training image group, and label information indicating whether a hat is worn is attached to the training image of the first training image group, Label information of the key point of the hat is attached to the training image of the second training image group. In this example, after collecting the face image, a first neural network for detecting a hat may be previously trained by the first neural network to detect whether an occupant in the face image is wearing a hat. The first neural network may be trained in an end-to-end manner. The training image of the second training image group may be a training image including a hat (eg, a school hat) of a preset style. For example, when the means of transportation is a school bus and the occupant is a student, the school cap worn by the student usually has a certain standard and shape, so a key point is set based on the standard and shape of the school cap, and the first neural The first neural network may be trained based on label information of key points of the school cap so that the network learns the detection capability of the school cap. In the embodiment of the present invention, the structure of the first neural network is not limited. In this example, by training the first neural network using the first training image group, the first neural network can learn various types of hat detection capabilities. In addition, by training the first neural network using the second training image group, it is possible to learn the detection ability of a hat (eg, a school hat) of a preset style in the first neural network.

In one possible embodiment, the body temperature measuring module includes a non-contact body temperature measuring module. Before measuring the body temperature data of the occupant by the body temperature measuring module, the method includes exposing a forehead or a wrist where the temperature is measured to the occupant according to detecting that the human body approaches the body temperature measuring module, and and/or issuing fourth presentation information for presenting the temperature-measured forehead or wrist region to access the body temperature measurement module. In this embodiment, a distance sensor or a pyroelectric infrared sensor may be disposed in the vicinity of the body temperature measuring module to detect whether there is a human body approaching by the distance sensor or the pyroelectric infrared sensor. In this embodiment, the fourth presentation information may be issued by a voice module or a display module installed in the transportation means. In this embodiment, when it is detected that the human body approaches the body temperature measuring module, the fourth presentation information is issued to expose the forehead or wrist where the temperature is measured to the occupant to access the body temperature measuring module, thereby promptly measuring the temperature. can support implementation.

In one possible embodiment, after measuring the body temperature data of the occupant by the body temperature measurement module, the method includes issuing fifth presentation information for presenting an abnormal body temperature according to the body temperature data not being within a preset body temperature range. additionally include For example, the preset body temperature range is 37.3°C or less. In this embodiment, the fifth presentation information may be issued by at least one of a voice module, a display module, and a light emitting module installed in the transportation means.

In this embodiment, when the body temperature data is not within a preset body temperature range, by issuing fifth presentation information for presenting an abnormal body temperature, the person in charge of the transportation means (eg, a driver of a school bus or a teacher in a school bus) , a bus driver or conductor, crew members of trains, airplanes, etc.) can timely process, for example, refusing the passenger to enter the means of transportation. Thereby, it is possible to lower the probability that a person with a body temperature or higher appears in the transportation means, and it is possible to reduce the possibility of transmission of infectious diseases in the transportation means.

In one possible embodiment, the means of transportation is a vehicle, the image collection module and the body temperature measurement module are mounted on a door or roof or B-pillar of the means of transportation, and the method is such that the detection result is determined that the occupant in the face image is masked At least one of preset conditions including detecting that the passenger is not wearing It further includes controlling not to unlock the door or not to open the door as instructed.

For example, in a scene in which occupant information is registered in advance, such as a school bus, online dispatch, or share bus, if the occupant in the face image collected by the image collection module is not a pre-registered occupant, the door is not unlocked or , or the door may be controlled not to be opened. As the identification result of the face image indicates that the passenger is prohibited from riding, the door is not unlocked or the door is controlled not to be opened, thereby reducing the possibility of a passenger's boarding mistake. When it is detected that the occupant in the face image is not wearing a mask, or the detected body temperature data exceeds a preset body temperature range, the transportation means by controlling the door not to unlock or open the door It can reduce the possibility of transmission of infectious diseases in

In step S13, a correspondence relationship between the measurement time of the body temperature data, information related to the transportation means, the identification information, and the body temperature data is established, and the correspondence relationship is stored and processed.

In a possible embodiment, the relevant information of the means of transportation includes at least one of location-specific information, route information, driver information and identification information of the means of transportation. For example, when the means of transportation is a vehicle, the identification information of the means of transportation may include the number of the license plate of the means of transportation. When the means of transportation is a bus, the identification information of the means of transportation may include a system number of the means of transportation, for example, 801A. When the means of transportation is an airplane, the identification information of the means of transportation may include a flight number of the means of transportation. When the means of transportation is a train, the specific information of the means of transportation may include a train number and a car number of the means of transportation. The driver information may be information that can uniquely identify the driver, such as the driver's identification number, photo, name, and face image.

In one possible embodiment, storing the correspondence relation described above comprises storing the correspondence relation in a memory of the means of transportation.

In another possible embodiment, storing the correspondence relation described above includes sending the correspondence relation to a server, and storing the correspondence relation by the server. In this embodiment, by storing the correspondence relation by the server, it is possible to facilitate retrospective investigation based on the data stored in the server later.

In one possible embodiment, after storing and processing the correspondence relationship, the method includes: acquiring a query request including identification information of a query target passenger; based on the identification information of the query target passenger, the query target Based on the information related to the means of transportation the passenger has boarded and the time of the passenger to be queried for boarding the means of transportation, and the information related to the means of transportation in which the passenger to be queried boarded, boarding the same means of transportation at the same time as the passenger to be queried The method further includes specifying identification information of a passenger of the query target passenger, which is one passenger. In this embodiment, the query request may further include a time range for requesting the query. For example, the time range for requesting a query may be determined according to the onset time of the query target passenger and the length of the incubation period of the disease. In this embodiment, the query target occupant may be a occupant with confirmed infection with a specific infectious disease, and based on the data stored after the occupant's infection is confirmed, investigation, management and control of the occupant's own whereabouts, passengers and their whereabouts can do.

In an embodiment of the present invention, a face image of a passenger in a transportation means is collected by an image collecting module, identification information of the passenger is specified based on the face image, and body temperature data of the passenger is measured by a body temperature measurement module, Establishing a correspondence relationship between the measurement time of the body temperature data, the transportation related information, and the identification information and the body temperature data, and storing and processing the correspondence relationship, the person concerned (e.g., guardian, school, contact person) of the occupant ) can contribute to timely acquisition of body temperature data of passengers, facilitate retrospective investigation based on data memorized later, and have important implications during epidemics of infectious diseases such as influenza and pneumonia.

In one possible embodiment, after establishing the above-described correspondence relationship between the measurement time of the body temperature data, the relevant information of the transportation means, and the identity information and the body temperature data, the method includes: If not, the method further includes transmitting sixth presentation information including the correspondence relationship to one or more of a guardian terminal, a school terminal, and a contact terminal corresponding to the passenger. In this embodiment, when the body temperature data is not within a preset body temperature range, the sixth presentation information is transmitted to one or more of a guardian terminal, a school terminal, and a contact terminal corresponding to the occupant. The occupant's guardian, school, and contact person may timely acquire body temperature data of the occupant.

For example, the means of transportation is a school bus, and the occupant is a student. When the body temperature data of the occupant is not within a preset body temperature range, the sixth presentation information may be transmitted to a guardian terminal and a school terminal corresponding to the occupant. Thereby, since the guardian and the school side can acquire the body temperature data of the student in a timely manner, health monitoring can be performed for a special group such as students during epidemics of infectious diseases such as influenza and pneumonia.

As an example of this embodiment, as the body temperature data is not within the preset body temperature range, transmitting the sixth presentation information of one or more of a guardian terminal, a school terminal, and a contact terminal corresponding to the occupant is the body temperature. As the data is not within the preset body temperature range, the presenting terminal corresponding to the passenger is specified based on at least one of the location specifying information of the transportation means and the measurement time of the body temperature data, and the presenting terminal corresponding to the passenger is including at least one of a guardian terminal, a school terminal, and a contact terminal corresponding to the passenger, and transmitting sixth presentation information to the presentation terminal. In one example, when the measurement time of the body temperature data is school time in the morning, or when the location specifying information of the transportation means is close to the student's home, the guardian terminal is specified as the presentation terminal, and the sixth presentation information is first presented to the guardian terminal may be sent, so that guardians receive the information presented in a timely manner so that they can take the student home.

In this embodiment, when the occupant is an adult, the occupant may be an emergency contact number set in advance by the occupant.

In one possible embodiment, after establishing a correspondence relationship between the measurement time of the body temperature data, the relevant information of the transportation means, and the identity information and the body temperature data, the method includes: When the difference is equal to or greater than a predetermined value, the method further includes transmitting sixth presentation information to at least one of a guardian terminal, a school terminal, and a contact terminal corresponding to the occupant. In this embodiment, the body temperature history of the occupant may be an average of body temperatures in a state in which the occupant is in good health, or may be the previous body temperature of the occupant. For example, the student's body temperature at school may be compared with the student's body temperature at school, and if the difference is equal to or greater than a predetermined value, it may be regarded as the body temperature or higher, and the sixth presentation information may be transmitted to the guardian terminal and the school terminal.

In another possible embodiment, after establishing the above-described correspondence relationship between the measurement time of the body temperature data, the relevant information of the transportation means, and the identity information and the body temperature data, a guardian terminal, a school terminal, and a contact person corresponding to the occupant The sixth presentation information may be directly transmitted to one or more of the terminals. That is, the sixth presentation information may be transmitted to one or more of a guardian terminal, a school terminal, and a contact terminal corresponding to the occupant, regardless of whether the body temperature data is within a preset body temperature range. For example, when the transportation means is a school bus and the passenger is a student, after establishing a correspondence relationship between the measurement time of the body temperature data, related information of the transportation means, and the identification information and the body temperature data, a guardian and a school The sixth presentation information may be transmitted to the guardian terminal and the school terminal so that the side can acquire the student's body temperature data in a timely manner.

In addition, as described above, the application scene of body temperature monitoring by means of transportation has been described using the epidemic period of infectious diseases such as influenza and pneumonia as an example, but those skilled in the art can understand that the present invention is not limited to this. Embodiments of the present invention can be implemented in any of a long period after the outbreak of a serious infectious disease, a period of high incidence of infectious diseases such as influenza, and the like. Naturally, it is also possible to monitor body temperature by means of transportation using the method according to an embodiment of the present invention even during periods of non-pandemic epidemics. For example, a student's body temperature may be monitored over a long period of time by a school bus, and an employee's body temperature may be monitored over a long period of time by a commuting bus.

4 shows a schematic diagram of a body temperature monitoring system by means of transportation according to an embodiment of the present invention. As shown in FIG. 4 , the body temperature monitoring system by means of transportation includes an operation management control center 41 , a data access platform 42 , a guardian terminal 43 , a school bus terminal 44 , and a school terminal. (45) is provided. The data access platform 42 may store the measurement time of the passenger's body temperature data, information related to transportation means, and the correspondence between the passenger's identity information and the passenger's body temperature data. After the specific infectious disease of a specific occupant is confirmed, the operation management control center 41 may conduct research and analysis on the whereabouts of the occupant himself, the passenger, and the whereabouts of the occupant based on the data stored in the data access platform 42 . Each number of the guardian terminal 43, the school bus terminal 44, and the school terminal 45 may be 1 or more. The guardian terminal 41 may be a mobile phone, a tablet computer, a wearable smart device (eg, a smart watch), or the like. The guardian terminal 41 may be equipped with an App (Application) for irradiating the student's body temperature. In addition, the guardian terminal 41 may acquire the 5th presentation information through this App. The school terminal 45 may include a computer in a school classroom, a teacher's mobile phone, a tablet computer, a wearable smart device, and the like. Teachers may examine student body temperature data through a webpage on a computer in the school classroom. The school bus terminal 44 may include a multi-channel detection module 441 , a signal processing module 442 , a communication module 443 , and a display module 444 . The multi-channel detection module 441 may include an image collection module and a body temperature monitoring module, and the signal processing module 442 may perform processing based on the face image and body temperature data collected by the multi-channel detection module 441 Also, the communication module 443 may communicate with the data access platform 42 , the guardian terminal 43 , and the school terminal 45 . The signal processing module 442 may analyze the driver's behavior in the driving state, for example, whether the driver is tired, is on a phone call, or is taking his hand off the steering wheel. After the school bus has stopped, you may check the rest of the people on the school bus to ensure that all students have gotten off the bus.

It can be understood that the embodiments of each method mentioned in the present invention may be combined with each other to form embodiments as long as the principles and logic are not violated. Since there is a limit to the amount, a detailed description is omitted in the present invention.

A person skilled in the art will know that in the above method according to a specific embodiment, the description order of each step does not strictly limit the execution order to limit the execution process, and the specific execution order of each step is determined by its function and possible implicit logic can be understood to be

In addition, the present invention further provides a transportation means commuting control device, an electronic device, a computer-readable storage medium, and a program. All of these are used to realize any of the transportation means commuting control methods provided in the present invention. For the corresponding technical solution means and effects, reference may be made to the description of the corresponding method, and detailed description thereof will be omitted.

5 is a block diagram of a transportation means commuting control device according to an embodiment of the present invention. As shown in FIG. 5 , the transportation means commuting control device collects the facial image of the transportation vehicle occupant by the image collection module, and a collection and identification module for specifying the identification information of the occupant based on the facial image (51), a temperature measurement module (52) for measuring the body temperature data of the occupant by the body temperature measurement module, and correspondence between the measurement time of the body temperature data, information related to the transportation means, and the identification information and the body temperature data and an establishment and storage module (53) for establishing a relationship and storing the corresponding relationship.

In one possible embodiment, the relevant information of the transportation means includes at least one of location specifying information, route information, driver information, and identification information of the transportation means.

In a possible embodiment, the image collection module and/or the body temperature measurement module are mounted outdoors of the transportation means,

or

The image collection module and/or the body temperature measurement module are mounted inside the transportation means.

In one possible embodiment, the means of transportation is a vehicle, the image collection module and the body temperature measurement module are mounted on a door or roof or B-pillar of the means of transportation, and the device detects a result of the detection of the occupant in the face image using a mask. Satisfies one or more of preset conditions, including detecting that the passenger is not wearing According to the order, it further includes a control module for controlling not to unlock the door or not to open the door.

In one possible embodiment, the device includes a detection module for detecting whether the occupant is wearing a hat in the face image, and according to detecting that the occupant is wearing a hat, removes the hat from the occupant or the forehead and a first presentation module for issuing first presentation information for presenting to be exposed.

In one possible embodiment, as the detection module is unable to identify the identity information of the occupant based on the non-hidden facial region of the face image, or according to the unsuccessful measurement of the temperature of the occupant's forehead, the face It is used to detect whether an occupant in an image is wearing a hat.

In one possible embodiment, the detection module is used for detecting whether the occupant in the face image is wearing a hat by means of a first neural network, wherein the first neural network is configured in advance with a first training image group and/or a second training image group It is trained by an image group, and label information indicating whether a hat is worn is attached to the training image of the first training image group, and label information of key points of the hat is attached to the training image of the second training image group is attached.

In a possible embodiment, the collection and identification module 51 detects that the occupant is wearing a mask based on the face image, so as to specify the location of a non-hidden face key point of the face image, and It is used to extract a feature of the face image based on a face key point that is not present, and to specify identification information of the passenger based on the extracted feature of the face image.

In one possible embodiment, the device detects that the occupant is wearing a mask based on the face image, and is unable to identify the identity information of the occupant based on the non-hidden facial region of the face image. , second presentation for issuing second presentation information for presenting the occupant to remove the mask, or upon detecting that the occupant is wearing the mask based on the face image further comprising a module, re-collecting the facial image of the occupant by the image collection module, and the collection and identification module 51 is used to specify the identity information of the occupant based on the re-collected facial image do.

In one possible embodiment the device further comprises a third presentation module for issuing third presentation information for presenting the occupant to wear a mask.

In one possible embodiment, the body temperature measuring module includes a non-contact body temperature measuring module, and the device exposes a forehead or a wrist for temperature measurement to the occupant according to detecting that a human body approaches the body temperature measuring module, and and/or a fourth presentation module for emitting fourth presentation information for presenting the temperature-measured forehead or wrist to access the body temperature measurement module.

In a possible embodiment, the device further comprises a fifth presentation module for issuing fifth presentation information for presenting an abnormal body temperature according to the body temperature data being not within a preset body temperature range.

In one possible embodiment, the device transmits sixth presentation information including the correspondence relationship to one or more of a guardian terminal, a school terminal, and a contact terminal corresponding to the passenger according to the body temperature data being not within a preset body temperature range It further includes a transmission module for

In one possible embodiment, as the body temperature data is not within a preset body temperature range, the transmitting module provides a presentation terminal corresponding to the occupant based on at least one of the location specific information of the transportation means and the measurement time of the body temperature data. Specifically, the presentation terminal corresponding to the occupant includes at least one of a guardian terminal, a school terminal, and a contact terminal corresponding to the occupant, and is used to transmit the sixth presentation information to the presentation terminal.

In one possible embodiment, the device includes an acquisition module for acquiring a query request including identification information of the occupant to be queried, and related information of the transportation means in which the occupant is queried based on the identity information of the occupant to be queried; Based on a first specifying module for specifying a boarding time for a transportation means of the query target passenger, and related information on the transportation means in which the query target passenger boarded, boarding the same transportation means at the same time as the query target passenger It further includes a second specific module for specifying identification information of a passenger of the query target passenger who is a passenger.

An embodiment of the present invention further provides a vehicle, comprising an image collecting module for collecting a face image of the vehicle, a body temperature measuring module for measuring body temperature data of the occupant, and identification information of the occupant based on the face image and establishes a correspondence relationship between the measurement time of the body temperature data, the vehicle related information, the identification information, and the body temperature data, and provides a vehicle equipped with an electronic device for storing and processing the correspondence relationship.

In one possible embodiment, the vehicle-related information includes at least one of location-specific information, route information, driver information, and identification information of the vehicle.

In one possible embodiment, the image collection module and/or the body temperature measurement module is mounted outdoors of the transportation means, or the image collection module and/or the body temperature measurement module is mounted inside the vehicle.

In this embodiment, since the image collection module and the body temperature measurement module are mounted outdoors or indoors of the vehicle, one set of the image collection module and the body temperature measurement module corresponds to one transportation means, so that body temperature monitoring by the vehicle is performed. It can be done easily.

In one possible embodiment, the image collection module and the body temperature measurement module are mounted on a door or roof or B-pillar of the transportation means, and the electronic device further determines that the detection result is that the face image is not wearing a occupant in a mask. In response to satisfying at least one of preset conditions including detecting that the vehicle is detected, the detected body temperature data exceeds a preset body temperature range, and the identification result of the face image indicates that the passenger is prohibited from riding, the door It is used to control the door not to unlock or open the door.

In this embodiment, the infectious disease in the vehicle is controlled so that the door is not unlocked or the door is not opened by detecting that the face image mask is not worn, or when the detected body temperature data exceeds a preset body temperature range. can reduce the possibility of transmission. As the identification result of the face image indicates that the occupant is prohibited from riding, the possibility of the occupant's boarding mistake may be reduced by controlling not to unlock the door or not to open the door.

In one possible embodiment, the electronic device further comprises:

detecting whether a passenger in the face image is wearing a hat,

upon detecting that the occupant is wearing the hat, it is used to issue first presentation information for presenting the occupant to remove the hat or expose the forehead.

In this embodiment, when it is detected that the occupant is wearing the hat based on the face image, first presentation information is issued to present the occupant to remove the hat, thereby supporting rapid execution of face identification.

In one possible embodiment, the electronic device is

As the passenger's identity information cannot be identified based on the non-hidden face region of the face image, or the temperature measurement of the passenger's forehead cannot be successfully measured, the passenger in the face image wears a hat; It is used to detect whether or not

In this embodiment, the identity information of the passenger can be identified based on the non-hidden face region of the face image, and when the temperature of the passenger's forehead is successfully measured, the passenger takes off the hat or exposes the forehead You don't have to offer to do it. Thereby, face identification and temperature measurement can be realized without operation by the occupant, and the passing speed of the occupant can be increased.

In one possible embodiment, the electronic device is

It is detected by a first neural network whether the occupant in the face image is wearing a hat, and the first neural network is previously trained by a first training image group and/or a second training image group, wherein the first Label information indicating whether a hat is worn is attached to the training image of the training image group, and label information of the key point of the hat is attached to the training image of the second training image group.

In this embodiment, by training the first neural network by the first training image group, it is possible to make the first neural network learn the detection capability of various types of hats. In addition, by training the first neural network using the second training image group, it is possible to learn the detection ability of a hat (eg, a school hat) of a preset style in the first neural network.

In one possible embodiment, the electronic device is

As it is detected that the passenger is wearing a mask based on the face image, a location of a non-hidden face key point of the face image is specified, and a feature of the face image is extracted based on the non-hidden face key point, ,

It is used to specify identification information of the passenger based on the extracted features of the face image.

According to this embodiment, when the occupant is wearing a mask, face identification can be performed without the occupant taking off the mask, so that non-perceptual face identification can be realized, and the possibility that the occupant is infected with an infectious disease can be reduced. there is.

In one possible embodiment, the electronic device further comprises:

detecting that the occupant is wearing a mask based on the face image, and issuing second presentation information for presenting the occupant to take off the mask based on a face region that is not hidden in the face image; or , or upon detecting that the occupant is wearing a mask based on the face image, it is used to issue second presentation information,

re-collecting the face image of the passenger by the image collecting module;

The specifying of the identity information of the passenger based on the face image includes specifying the identity information of the passenger based on the re-collected face image.

In this embodiment, since identification information of the passenger cannot be identified based on the non-hidden face region in the face image, there is no need to present the passenger to take off the mask, so that the face Identification and temperature measurement can be realized, and the passing speed of passengers can be increased.

In one possible embodiment, the electronic device further comprises:

Used to issue third presentation information for presenting the anthem occupant to wear a mask.

In this embodiment, it is possible to reduce the possibility of transmission of infectious diseases in the means of transportation by suggesting that the occupant removes the mask and re-wears the mask after the face identification is successful.

In one possible embodiment, the body temperature measuring module includes a non-contact body temperature measuring module,

The electronic device further comprises:

A fourth method for exposing a forehead or wrist for temperature measurement to the occupant and/or presenting a forehead or wrist for temperature measurement to access the body temperature measurement module upon detecting that the human body approaches the body temperature measurement module It is used to issue presentation information.

In this embodiment, when it is detected that the human body approaches the body temperature measuring module, the fourth presentation information is issued to expose the forehead or wrist where the temperature is measured to the occupant to access the body temperature measuring module, thereby promptly measuring the temperature. can support implementation.

In one possible embodiment, the electronic device further comprises:

When the body temperature data is not within a preset body temperature range, it is used to issue fifth presentation information for presenting an abnormal body temperature.

In this embodiment, when the body temperature data is not within the preset body temperature range, by issuing fifth presentation information for presenting an abnormal body temperature, the person in charge of the transportation means (eg, a school bus driver or a school bus teacher, It is possible for the driver or conductor of a bus, or a crew member of a train, airplane, etc.) to timely process, for example, refusing the passenger to enter the means of transportation. Thereby, it is possible to lower the probability that a person with a body temperature or higher appears in the transportation means, and it is possible to reduce the possibility of transmission of infectious diseases in the transportation means.

In one possible embodiment, the electronic device further comprises:

As the body temperature data is not within the preset body temperature range, it is used to transmit the sixth presentation information including the correspondence relationship to one or more of a guardian terminal, a school terminal, and a contact terminal corresponding to the passenger.

In this embodiment, when the body temperature data is not within a preset body temperature range, the sixth presentation information is transmitted to one or more of a guardian terminal, a school terminal, and a contact terminal corresponding to the occupant. The occupant's guardian, school, and contact person may timely acquire body temperature data of the occupant.

In one possible embodiment, the electronic device is

As the body temperature data is not within a preset body temperature range, a presentation terminal corresponding to the passenger is specified based on at least one of the location specifying information of the transportation means and a measurement time of the body temperature data, and presentation corresponding to the passenger The terminal includes at least one of a guardian terminal corresponding to the passenger, a school terminal, and a contact terminal,

It is used to transmit the sixth presentation information to the presenting terminal.

In this embodiment, first, by transmitting the presentation information to a person close to the means of transportation, it contributes to timely handling of the abnormal body temperature of the occupant.

In one possible embodiment, the electronic device further comprises:

obtaining a query request including identification information of the passenger to be queried;

specifying, based on the identification information of the query target passenger, related information of the transportation means in which the query target passenger boarded, and a boarding time of the query target passenger;

It is used to specify identification information of a passenger of the query target passenger, who is a passenger who boarded the same transportation means at the same time as the query target passenger, based on the related information of the transportation means in which the query target passenger boarded.

In this embodiment, the query target occupant may be a occupant with confirmed infection with a specific infectious disease, and based on the data stored after the occupant's infection is confirmed, the occupant's own whereabouts, passengers and their whereabouts can be investigated, managed and controlled can

In some embodiments, functions or modules of the apparatus according to the embodiments of the present invention may be used to implement the methods described in the embodiments of the methods described above, and the specific realization and technical effects thereof will be described in the embodiments of the methods described above. Reference may be made to the description, and a detailed description will be omitted here for the sake of simplification.

An embodiment of the present invention further provides a computer readable storage medium having computer program instructions stored thereon, wherein when the computer program instructions are executed by a processor, the computer readable storage medium realizes the method. The computer readable storage medium may be a nonvolatile computer readable storage medium or a volatile computer readable storage medium.

In an embodiment of the present invention, there is further a computer program including computer readable code, wherein when the computer readable code operates in an electronic device, the processor of the electronic device executes instructions for realizing the method. provides

In an embodiment of the present invention, there is further a computer program product for storing computer readable instructions, which, when the instruction is executed, causes the computer to execute the operation of the transportation means commuting control method according to any one of the above embodiments. provides

In an embodiment of the present invention, there is further provided one or more processors and a memory for storing executable instructions, wherein the one or more processors are configured to invoke the executable instructions stored in the memory to execute the method. Electronic devices are provided.

The electronic device may be provided as a terminal, server, or other type of device.

6 is a block diagram of an electronic device 800 according to an embodiment of the present invention. For example, the electronic device 800 may be a mobile phone, a computer, a digital broadcasting terminal, a message transmitting/receiving device, a game console, a tablet type device, a medical device, a fitness device, a terminal such as a personal digital assistant.

Referring to FIG. 6 , the electronic device 800 includes a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , and an input/output (I/O) interface. 812 , a sensor component 814 , and a communication component 816 .

The processing component 802 typically controls the overall operation of the electronic device 800 , such as operations related to display, phone calls, data communication, camera operations, and recording operations. The processing component 802 may include one or more processors 820 executing instructions to carry out all or some steps of the method. Further, processing component 802 may include one or more modules for interaction with other components. For example, processing component 802 may include a multimedia module for interaction with multimedia component 808 .

The memory 804 is configured to store various types of data to support operation in the electronic device 800 . These data include, for example, instructions, contact data, phone book data, messages, pictures, videos, and the like of any application program or method that operates on the electronic device 800 . Memory 804 may include, for example, static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable programmable read only memory (EPROM), programmable read only memory (PROM), read only memory ( ROM), a magnetic memory, a flash memory, a magnetic disk, or an optical disk, etc., can be realized by various types of volatile or nonvolatile storage devices, or combinations thereof.

The power component 806 supplies power to each component of the electronic device 800 . Power component 806 may include a power management system, one or more power sources, and other components related to power generation, management, and distribution for electronic device 800 .

The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and a user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). When the screen includes a touch panel, it may be realized as a touch screen that receives an input signal from a user. The touch panel includes one or more touch sensors to detect touches, slides and gestures on the touch panel. The touch sensor may be configured to detect a boundary of a touch or slide operation as well as a duration and pressure associated with the touch or slide operation. In some embodiments, multimedia component 808 includes a front camera and/or a rear camera. When the electronic device 800 enters an operation mode, for example, a photographing mode or an imaging mode, the front camera and/or the rear camera may receive external multimedia data. Each front camera and rear camera may have a fixed optical lens system, or a focal length and optical zoom capability.

The audio component 810 is configured to output and/or input an audio signal. For example, the audio component 810 includes one microphone MIC, and the microphone MIC is when the electronic device 800 is in an operation mode, for example, a call mode, a recording mode, and a voice recognition mode. , configured to receive an external audio signal. The received audio signal may be further stored in memory 804 or transmitted via communication component 816 . In some embodiments, the audio component 810 further includes a speaker for outputting an audio signal.

I/O interface 812 provides an interface between processing component 802 and a peripheral interface module, which may be a keyboard, click wheel, button, or the like. These buttons may include, but are not limited to, a home button, a volume button, a start button, and a lock button.

The sensor component 814 includes one or more sensors for evaluating the condition of each side of the electronic device 800 . For example, the sensor component 814 may detect an on/off state of the electronic device 800 , eg, a relative positioning of components such as a display device and a keypad of the electronic device 800 , the sensor component 814 further indicates a change in the position of the electronic device 800 or a component in which the electronic device 800 is located, the presence or absence of contact between the user and the electronic device 800, the orientation or acceleration/deceleration of the electronic device 800, and the electronic device 800 ) can be detected. The sensor component 814 may include a proximity sensor configured to detect the presence of a nearby object in the absence of any physical contact. The sensor component 814 may further include a photosensor for use in imaging applications, such as CMOS or CCD image sensors. In some embodiments, the sensor component 814 may further include an acceleration sensor, a gyro sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to realize wired or wireless communication between the electronic device 800 and another device. The electronic device 800 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof, for example. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system through a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a near field communication (NFC) module to facilitate near field communication. For example, the NFC module may be realized by radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, the electronic device 800 includes one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processors (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs). , implemented by a controller, microcontroller, microprocessor or other electronic element, and may be used to carry out the method.

In the exemplary embodiment, there is further provided a non-volatile computer readable storage medium, for example, a memory 804 including computer program instructions, the computer program instructions being stored in the processor 820 of the electronic device 800 . If executed by the above method can be executed.

7 is a block diagram of an electronic device 1900 according to an embodiment of the present invention. For example, the electronic device 1900 may be provided as a server. Referring to FIG. 7 , an electronic device 1900 includes a processing component 1922 including one or more processors and a memory 1932 for storing instructions executable by the processing component 1922 , for example, an application program. Includes memory resources represented by . The application program stored in the memory 1932 may include one or more modules each corresponding to one instruction group. Further, processing component 1922 is configured to execute the method by executing instructions.

The electronic device 1900 further includes a power component 1926 configured to perform power management of the electronic device 1900 , a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and input/output (I) /O) interface 1958. Electronic device 1900 may operate based on an operating system stored in memory 1932 , for example, Windows Server ^® , Mac OS X ^® , Unix ^® , Linux ^® , FreeBSD ^® or the like.

In the exemplary embodiment, there is further provided a non-volatile computer readable storage medium, eg, a memory 1932 containing computer program instructions, the computer program instructions comprising: a processing component 1922 of the electronic device 1900 . If executed by , the method can be executed.

The invention may be a system, method and/or computer program product. The computer program product may include a computer readable storage medium having computer readable program instructions for realizing each aspect of the present invention in a processor.

The computer-readable storage medium may be a tangible device capable of storing and storing instructions used in an instruction execution device. The computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electronic storage device, a semiconductor storage device, or any suitable combination of the above. More specific examples (non-exhaustive list) of computer-readable storage media include portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory); Static random access memory (SRAM), portable compact disk read-only memory (CD-ROM), digital versatile disk (DVD), memory stick, floppy disk, such as a punched card or slot in which instructions are stored; such mechanical encoding devices, and any suitable combination of the above. As used herein, a computer-readable storage medium is an instantaneous signal itself, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating via waveguides or other transmission media (eg, optical pulses passing through optical fiber cables). ), or an electrical signal transmitted via a wire.

The computer readable program instructions described herein may be downloaded to each computing/processing device from a computer readable storage medium, or may be downloaded to an external computer via a network, for example, the Internet, a local area network, a wide area network and/or a wireless network. Alternatively, it may be downloaded to an external storage device. The network may include copper transport cables, fiber optic transport, wireless transport, routers, firewalls, switchboards, gateway computers and/or edge servers. A network adapter card or network interface in each computing/processing device receives a computer readable program command from the network, transmits the computer readable program command, and stores the computer readable program command in a computer readable storage medium in each computing/processing device.

The computer program instructions for carrying out the operations of the present invention may include assembler instructions, instruction set architecture (ISA) instructions, machine language instructions, machine dependent instructions, microcode, firmware instructions, state setting data or an object-oriented programming language such as Smalltalk, C++, etc.; and source code or target code written in any combination of one or more programming languages including a general procedural programming language such as "C" language or a similar programming language. The computer readable program instructions may execute entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partly on a remote computer, or It may run entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any kind of network, including a local area network (LAN) or a wide area network (WAN), or (eg, an Internet service provider via the Internet) may be connected to an external computer. In some embodiments, state information from computer readable program instructions is used to customize electronic circuitry, such as, for example, a programmable logic circuit, a field programmable gate array (FPGA) or a programmable logic array (PLA), the electronic circuit Each aspect of the present invention may be realized by executing computer readable program instructions by

Although each aspect of the present invention has been described herein with reference to a flowchart and/or block diagram of a method, apparatus (system) and computer program product according to an embodiment of the present invention, each block in the flowchart and/or block diagram, and the flowchart and It should be understood that all combinations of blocks in the block diagram may be realized by computer readable program instructions.

These computer readable program instructions are provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing device, and when these instructions are executed by the processor of the computer or other programmable data processing device, one or more of the flowcharts and/or block diagrams The device may be manufactured to realize the functions/actions specified in the block. These computer readable program instructions may be stored in a computer readable storage medium, and may cause a computer, a programmable data processing apparatus, and/or other apparatus to operate in a specific manner. Thereby, a computer-readable storage medium having instructions stored thereon includes a product having instructions for realizing each aspect of a function/action specified in one or more blocks of a flowchart and/or a block diagram.

The computer readable program instructions may be loaded into a computer, other programmable data processing device, or other device, and cause the computer, other programmable data processing device, or other device to execute a series of operational steps, thereby creating a process executed by the computer. . In this way, the functions/operations specified in one or more blocks of the flowchart and/or block diagram are realized by instructions executed in a computer, other programmable data processing device, or other device.

Flowcharts and block diagrams in the drawings represent realizable system architectures, functions, and operations of systems, methods, and computer program products according to a plurality of embodiments of the present invention. In this regard, each block in the flowchart or block diagram may represent a single module, program segment, or portion of an instruction, wherein the module, program segment or portion of the instruction includes one or more executable instructions for realizing a specified logical function. includes In some alternative implementations, the functions indicated in the blocks may be realized in a different order from the order in the drawings. For example, two consecutive blocks may be executed substantially in parallel, or may be executed in the reverse order depending on the function involved. In addition, each block in a block diagram and/or a flowchart and a combination of blocks in a block diagram and/or a flowchart may be realized by a dedicated system based on hardware for executing designated functions or operations, or dedicated hardware and a computer It should also be noted that it may be realized by a combination of commands.

This computer program product may be specifically realized by hardware, software, or a combination thereof. In a selectable embodiment, the computer program product is embodied as a computer storage medium, and in another selectable embodiment, the computer program product is embodied as a software product such as, for example, a Software Development Kit (SDK).

As mentioned above, although each embodiment of this invention was described, the said description is only exemplary, and is not exhaustive, and is not limited to each disclosed embodiment, either. Various modifications and changes will be apparent to those skilled in the art without departing from the scope and spirit of each described embodiment. The terminology selected in this specification is to preferably interpret the principle of each embodiment, practical application, or technical improvement over existing technology, or to help other skilled artisans understand each embodiment disclosed herein.

Claims (18)

Collecting a face image of a vehicle occupant by an image collection module, and specifying identification information of the occupant based on the face image;
measuring body temperature data of the passenger by a body temperature measuring module;
and establishing a correspondence relationship between the measurement time of the body temperature data and related information of the transportation means, and the identification information and the body temperature data, and storing and processing the correspondence relationship. The method of claim 1,
The relevant information of the means of transportation includes at least one of location specific information, route information, driver information, and identification information of the means of transportation, and/or
wherein the image collection module and/or the body temperature measurement module are mounted outdoors of the transportation means, or the image collection module and/or the body temperature measurement module is mounted indoors of the transportation means. 3. The method of claim 2,
The transportation means is a vehicle, and the image collection module and the body temperature measurement module are mounted on a door or roof or B-pillar of the transportation means,
the method
The detection result includes detecting that the occupant of the face image is not wearing a mask, the detected body temperature data exceeds a preset body temperature range, and the identification result of the face image indicates that the occupant is prohibited from riding In response to satisfying one or more of the preset conditions, the method further comprising controlling not to unlock the door or not to open the door. 4. The method according to any one of claims 1 to 3,
After collecting the face image of the vehicle occupant by the above-described image collecting module, the method
detecting whether a passenger in the face image is wearing a hat;
and in response to detecting that the occupant is wearing the hat, issuing first presentation information for presenting the occupant to remove the hat or expose a forehead. 5. The method of claim 4,
Detecting whether the occupant in the face image is wearing a hat
As the passenger's identity information cannot be identified based on the non-hidden face region of the face image, or the temperature measurement of the passenger's forehead cannot be successfully measured, the passenger in the face image wears a hat; A method of commuting control of a means of transportation, comprising detecting whether there is. 6. The method according to claim 4 or 5,
Detecting whether the occupant in the face image is wearing a hat
detecting whether the occupant in the face image is wearing a hat by a first neural network, wherein the first neural network has been previously trained by a first training image group and/or a second training image group; The training image of the first training image group has label information indicating whether a hat is worn, and the training image of the second training image group is attached with label information of the key point of the hat. . 7. The method according to any one of claims 1 to 6,
Specifying the identification information of the passenger based on the face image
When it is detected that the occupant is wearing a mask based on the face image, the position of a non-hidden face key point of the face image is specified, and a feature of the face image is extracted based on the non-hidden face key point. and,
Based on the extracted feature of the face image, the method of commuting control for transportation means comprising specifying the identification information of the passenger. 7. The method according to any one of claims 1 to 6,
After collecting the face image of the vehicle occupant by the above-described image collecting module, the method
Detecting that the occupant is wearing a mask based on the face image, and also not being able to identify the identity region of the occupant based on a non-hidden facial region of the face image, so that the occupant takes off the mask issuing second presentation information for presenting a face mask, or upon detecting that the occupant is wearing a mask based on the face image, issuing second presentation information;
Further comprising re-collecting the facial image of the passenger by the image collection module,
Wherein the specifying of the identity information of the occupant based on the face image includes specifying the identity information of the occupant based on the re-collected face image. 9. The method of claim 8,
After specifying the identification information of the occupant, the method further comprises issuing third presentation information for presenting the occupant to wear a mask. 10. The method according to any one of claims 1 to 9,
The body temperature measuring module includes a non-contact body temperature measuring module,
Before measuring the body temperature data of the occupant by the body temperature measuring module, the method exposes a forehead or a wrist where the temperature is measured to the occupant by detecting that the human body approaches the body temperature measuring module, and and/or issuing fourth presentation information for presenting a temperature-measured forehead or wrist region to access the body temperature measurement module. 11. The method according to any one of claims 1 to 10,
After measuring the body temperature data of the occupant by the body temperature measurement module, the method further includes issuing fifth presentation information for presenting abnormal body temperature according to the body temperature data not being within a preset body temperature range and/or
After establishing the above-described correspondence relationship between the measurement time of the body temperature data, the relevant information of the transportation means, and the identity information and the body temperature data, the method includes: according to the body temperature data not within a preset body temperature range, Transmitting the sixth presentation information including the correspondence relation to one or more of a guardian terminal, a school terminal, and a contact terminal corresponding to the commuting control method for transportation means. 12. The method of claim 11,
As the body temperature data is not within the preset body temperature range, transmitting the sixth presentation information to one or more of a guardian terminal, a school terminal, and a contact terminal corresponding to the passenger
As the body temperature data is not within a preset body temperature range, a presentation terminal corresponding to the occupant is specified based on at least one of the location specifying information of the transportation means and a measurement time of the body temperature data, and presentation corresponding to the occupant The terminal includes at least one of a guardian terminal corresponding to the passenger, a school terminal, and a contact terminal;
Transmitting sixth presentation information to the presentation terminal, the transportation means commuting control method. 13. The method according to any one of claims 1 to 12,
After storing the correspondence relation, the method
obtaining a query request including identification information of the passenger to be queried;
specifying, based on the identity information of the query target passenger, related information of the transportation means in which the query target passenger boarded, and a boarding time of the query target passenger;
Further comprising specifying identification information of a passenger of the query target passenger, who is a passenger who boarded the same transportation means at the same time as the query target passenger, based on the related information of the transportation means in which the query target passenger boarded, Transportation Commuter Control Methods. a collection and identification module for collecting a face image of a vehicle occupant by an image collecting module, and specifying identification information of the occupant based on the face image;
a temperature measurement module for measuring body temperature data of the passenger by the body temperature measurement module;
and an establishment and storage module for establishing a correspondence relationship between the measurement time of the body temperature data, the transportation means related information, and the identification information and the body temperature data, and storing and processing the correspondence relationship. one or more processors;
a memory for storing and processing executable instructions;
The electronic device, wherein the one or more processors are configured to invoke executable instructions stored in the memory to execute the method of claim 1 , for commuting control. A computer readable storage medium having computer program instructions stored thereon, wherein when the computer program instructions are executed by a processor, the method for controlling commuting by means of transportation according to any one of claims 1 to 13 is realized. . As a vehicle,
an image collection module for collecting face images of passengers;
a body temperature measurement module for measuring body temperature data of the passenger;
specifying the identity information of the occupant based on the face image, establishing a correspondence relationship between the measurement time of the body temperature data, related information of the vehicle, the identification information and the body temperature data, and storing the correspondence relationship; A vehicle equipped with electronic equipment. 14. A computer program comprising computer readable code, wherein when the computer readable code operates in an electronic device, instructions for causing a processor of the electronic device to realize the transportation means commuting control method according to any one of claims 1 to 13 running a computer program.

Images