CN111797757A - Smoking behavior monitoring method and system - Google Patents
Smoking behavior monitoring method and system Download PDFInfo
- Publication number
- CN111797757A CN111797757A CN202010623372.5A CN202010623372A CN111797757A CN 111797757 A CN111797757 A CN 111797757A CN 202010623372 A CN202010623372 A CN 202010623372A CN 111797757 A CN111797757 A CN 111797757A
- Authority
- CN
- China
- Prior art keywords
- cigarette
- video image
- smoking behavior
- human body
- smoking
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000000391 smoking effect Effects 0.000 title claims abstract description 109
- 230000006399 behavior Effects 0.000 title claims abstract description 83
- 238000000034 method Methods 0.000 title claims abstract description 61
- 238000012544 monitoring process Methods 0.000 title claims abstract description 44
- 235000019504 cigarettes Nutrition 0.000 claims abstract description 111
- 238000003860 storage Methods 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 10
- 238000012545 processing Methods 0.000 claims description 10
- 238000001514 detection method Methods 0.000 claims description 6
- 238000000605 extraction Methods 0.000 claims description 3
- 238000002485 combustion reaction Methods 0.000 claims description 2
- 230000001815 facial effect Effects 0.000 claims 1
- 239000000779 smoke Substances 0.000 description 22
- 230000009471 action Effects 0.000 description 6
- 239000003571 electronic cigarette Substances 0.000 description 6
- 238000012216 screening Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 2
- 238000003331 infrared imaging Methods 0.000 description 2
- 238000012806 monitoring device Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/56—Extraction of image or video features relating to colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
- G06V20/53—Recognition of crowd images, e.g. recognition of crowd congestion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30232—Surveillance
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Human Computer Interaction (AREA)
- Geometry (AREA)
- Image Analysis (AREA)
Abstract
The invention is suitable for the technical field of intelligent monitoring, and provides a smoking behavior monitoring method, which comprises the following steps: acquiring a video image, identifying the face characteristics of a target person and the characteristics of cigarettes according to the video image, identifying the position of the mouth of a human body from the face characteristics, judging whether one end of each cigarette is positioned in the mouth of the human body, and if so, smoking behavior exists; if the smoking behavior exists, extracting the face features of the target person corresponding to the mouth, and marking the cigarette and the face corresponding to the mouth in the video image; then, the video image and the position information corresponding to the content of the video image are both sent to a remote server or a mobile terminal, and conversation can be carried out with a target person through the remote server or the mobile terminal; the intelligent monitoring and the remote monitoring of smoking behaviors are realized, and the intelligent degree is improved.
Description
Technical Field
The invention belongs to the technical field of intelligent monitoring, and particularly relates to a smoking behavior monitoring method and system.
Background
Because smoking behavior is harmful to the health of smokers and people around the smokers, and hidden dangers such as safe production, fire and the like can be generated when smoking is performed in a smoking banned area, indoor smoking is concerned by governments of various countries and is banned by corresponding policy; in 2018, China firstly proposes, researches and sets up legal regulations for smoking ban in national public places, and comprehensively enforces smoking ban in public places within three years;
the conventional smoke alarm only monitors the concentration of smoke to realize fire prevention, but is easy to give out a false alarm and fail to give out a false alarm in public areas such as teahouses, KTVs and the like where fire easily occurs but a lot of smokers exist; therefore, a technical scheme capable of accurately performing smoke alarm in places with more smoking personnel is needed, supervision is realized by means of an artificial intelligence technology, the aim of effectively controlling smoke is achieved, harm of second-hand smoke is avoided, and meanwhile, safety accidents are reduced;
the existing smoke control technical means mainly use a smoke sensor as a main part, the smoke sensor and an alarm device are installed in a smoke banning place, and when the smoke sensor detects smoke, an alarm is generated;
however, smoke control by means of smoke sensors has serious problems of missed detection and false detection, when the indoor environment is slightly open, smoke generated by smoke of one or a few people is less, the smoke sensors cannot detect the smoke and the smoke sensors miss detection, and compared with the smoke sensors for general fire fighting, the smoke sensors special for smoke control have extremely high sensitivity in order to detect a small amount of smoke, so that false judgment is serious;
traditional smoking control means, after detecting smog, although the alarm can report to the police, managers can't in time be forensics to its efficient management, does not form an effectual closed loop, leads to smoking control effect limited to still can produce and miss reports, wrong report.
Disclosure of Invention
The invention aims to provide a smoking behavior monitoring method and a smoking behavior monitoring system, and aims to solve the technical problems that the smoking behavior is not accurately detected and the user experience is influenced because the prior art cannot provide a smoking behavior monitoring method.
In one aspect, the present invention provides a method for monitoring smoking behaviour, comprising the steps of:
acquiring a video image;
recognizing the face characteristics of a target person and the characteristics of cigarettes according to the video image, and recognizing the position of the mouth of the human body from the face characteristics;
judging whether one end of the cigarette is positioned in the mouth of the human body, if so, smoking behavior exists;
if the smoking behavior exists, extracting the human face features of the target person corresponding to the mouth, and marking the cigarette and the human face corresponding to the mouth of the human body in the video image.
Preferably, the method further comprises:
and judging whether one end of the cigarette is moved into the mouth of the human body or not, and if so, smoking behavior exists.
Further preferably, the recognizing the human face feature of the target person and the cigarette feature according to the video image previously comprises:
processing the video image to judge whether human-shaped features exist, and if so, taking a human body corresponding to the human-shaped features as the target person;
further comprising: presetting the characteristics of the cigarette, wherein the characteristics of the cigarette comprise the shape, the length, the diameter or the color of the burnt part of the cigarette.
Preferably, the method further comprises:
detecting whether the temperature of any end of the cigarette exceeds a preset cigarette burning temperature, if so, smoking behavior exists, and marking the cigarette in the video image.
Further preferably, the method further comprises:
detecting whether the temperature of any end of the cigarette exceeds a preset cigarette burning temperature or not, if so, smoking behavior exists, recognizing the palm of a human body clamping the cigarette, and marking the palm in the video image;
after the palm of the human body holding the cigarette is identified, the method further comprises the following steps: recognizing the human face characteristics of the human body clamping the cigarettes according to the palm of the human body clamping the cigarettes, extracting the human face characteristics, and marking the human face of the human body clamping the cigarettes in the video image.
Further preferably, the method comprises:
if the smoking behavior exists, correspondingly sending out an alarm prompt;
further comprising: respectively counting the number of the target figures and the number of the extracted face features, and sending the number and the face features to a remote server or a mobile terminal;
and the remote server or the mobile terminal sends out an alarm prompt after receiving the face features.
Further preferably, the method further comprises:
sending the video image and the position information corresponding to the content of the video image to a remote server or a mobile terminal; and carrying out conversation with the target person through the remote server or the mobile terminal.
In another aspect, the invention provides a smoking behaviour monitoring system comprising:
the acquisition module acquires a video image;
the recognition module is used for recognizing the face characteristics of a target person and the characteristics of cigarettes according to the video image and recognizing the position of the mouth of the human body from the face characteristics;
the judging module is used for judging whether one end of the cigarette is positioned in the mouth of a human body or not, and if so, smoking behavior exists;
the extraction marking module is used for extracting the face features of the target person corresponding to the mouth if the smoking behavior exists and marking the cigarette and the face corresponding to the mouth in the video image;
the infrared temperature detection module is used for detecting whether the temperature of any end of the cigarette exceeds the preset cigarette combustion temperature or not;
the characteristic presetting module is used for presetting the characteristics of the cigarette, wherein the characteristics of the cigarette comprise the shape, the length, the diameter or the color of a burnt part of the cigarette;
the on-site voice playing talkback module is used for carrying out conversation with a target person and correspondingly sending out an alarm prompt when the smoking behavior exists;
the remote server receives the number of the target characters, the extracted number of the human face features, the video images and the position information corresponding to the content of the video images, and sends out an alarm prompt and carries out conversation with the target characters;
and the mobile terminal receives the number of the target characters, the extracted number of the human face features, the video images and the position information corresponding to the content of the video images, and sends out an alarm prompt and carries out conversation with the target characters.
In another aspect, the invention provides a non-transitory computer-readable storage medium having stored thereon computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform the above-described method of monitoring smoking behavior.
In another aspect, the invention provides a computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions which, when executed by a processor, cause the processor to perform the above-described method of monitoring smoking behaviour.
The invention has the beneficial effects that: recognizing the face characteristics of the target person and the characteristics of the cigarette according to the video image, recognizing the position of the mouth of the human body from the face characteristics, judging whether one end of the cigarette is positioned in the mouth of the human body, and if so, smoking behavior exists; if the smoking behavior exists, extracting the face features of the target person corresponding to the mouth, and marking the cigarette and the face corresponding to the mouth in the video image; then, the video image and the position information corresponding to the content of the video image are both sent to a remote server or a mobile terminal, and conversation can be carried out with a target person through the remote server or the mobile terminal; the intelligent monitoring and the remote monitoring of smoking behaviors are realized, and the intelligent degree is improved.
Drawings
Fig. 1 is a flowchart of an implementation of a method for monitoring smoking behavior according to an embodiment of the present invention;
fig. 2 is a flowchart of an implementation of a smoking behavior monitoring method according to a second embodiment of the present invention;
fig. 3 is a flowchart of an implementation of a method for monitoring smoking behavior according to a third embodiment of the present invention;
fig. 4 is a flowchart of an implementation of a method for monitoring smoking behavior according to a fourth embodiment of the present invention;
fig. 5 is a flowchart of an implementation of a method for monitoring smoking behavior according to a fifth embodiment of the present invention;
fig. 6 is a schematic structural diagram of a smoking behavior monitoring system according to a sixth embodiment of the present invention;
fig. 7 is a schematic structural diagram of a smoking behavior monitoring device according to a seventh embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The following detailed description of specific implementations of the present invention is provided in conjunction with specific embodiments:
the first embodiment is as follows:
fig. 1 shows an implementation flow of a smoking behavior monitoring method provided in an embodiment of the present invention, and for convenience of description, only the relevant parts related to the embodiment of the present invention are shown, which are detailed as follows:
step S101, acquiring a video image;
in the embodiment of the invention, the video image can be acquired from a video storage server or acquired through a camera.
Step S102, processing the video image to judge whether human-shaped characteristics exist;
in the embodiment of the invention, the processing of the video image comprises screening the content of the video image to put forward human-shaped features.
Step S103, taking a human body corresponding to the human shape characteristics as a target person;
in the embodiment of the invention, the action track of the target person is mainly detected so as to be capable of being detected in time when the target person takes a smoking action.
Step S104, recognizing the human face characteristics of the target person and the characteristics of the cigarettes, and recognizing the position of the mouth of the human body from the human face characteristics;
in the embodiment of the invention, the human face characteristics of the target person and the characteristics of the cigarette are recognized according to the video image, and the characteristics of the cigarette need to be preset before are recognized, wherein the characteristics of the cigarette comprise the shape, the length, the diameter or the color of the burnt part of the cigarette.
Step S105, judging whether one end of the cigarette is positioned in the mouth of the human body, and if so, smoking behavior exists;
in the embodiment of the invention, the accuracy of smoking behavior monitoring can be improved well by judging whether the mouth of the monitored person contains cigarettes or not so as to avoid misjudgment.
Step S106, if a smoking behavior exists, extracting the face characteristics of the target person corresponding to the mouth, and marking the cigarette and the face corresponding to the mouth of the human body in the video image;
in an embodiment of the invention, the cigarette and the human face corresponding to the mouth of the human body are marked in the video image so that a monitoring person can directly view the smoking behavior of the smoking person in the target person or the behavior of pre (preparation) smoking from a video playing device.
Example two:
fig. 2 shows an implementation flow of the smoking behavior monitoring method provided in the second embodiment of the present invention, and for convenience of description, only the relevant parts of the second embodiment of the present invention are shown, which are detailed as follows:
step S201, acquiring a video image;
in the embodiment of the invention, the video image can be acquired from a video storage server or acquired through a camera.
Step S202, processing the video image to judge whether human-shaped characteristics exist;
in the embodiment of the invention, the processing of the video image comprises screening the content of the video image to put forward human-shaped features.
Step S203, taking a human body corresponding to the human shape characteristics as a target character;
in the embodiment of the invention, the action track of the target person is mainly detected so as to be capable of being detected in time when the target person takes a smoking action.
Step S204, recognizing the human face characteristics of the target person and the characteristics of the cigarettes, and recognizing the position of the mouth of the human body from the human face characteristics;
in the embodiment of the invention, the human face characteristics of the target person and the characteristics of the cigarette are recognized according to the video image, and the characteristics of the cigarette need to be preset before are recognized, wherein the characteristics of the cigarette comprise the shape, the length, the diameter or the color of the burnt part of the cigarette.
Step S205, detecting whether the temperature of any end of the cigarette exceeds the preset burning temperature of the cigarette;
in the embodiment of the invention, the temperature of the cigarette is detected through the infrared imaging equipment, and further specifically, the temperature of any end of the cigarette is detected, so that the phenomenon that a person holding the cigarette but not smoking the cigarette is judged by mistake can be avoided; furthermore, the temperature of the cigarette during burning is lower than the temperature generated when the electronic cigarette works according to the common knowledge, so that the person who smokes the electronic cigarette is not judged as a smoker; wherein, the burning temperature of the central part of the cigarette is generally 800-900 ℃, the burning temperature of the wrapping paper reaches 200-300 ℃, and the temperature of the electronic cigarette is generally only about 350 ℃.
Step S206, if yes, smoking behavior exists, and the cigarette is marked in the video image;
in an embodiment of the invention, the cigarettes are marked in the video image so that a monitoring person can directly view the smoking behavior of the smoking person in the target person from the video playing device.
Example three:
fig. 3 shows an implementation flow of the smoking behavior monitoring method provided by the third embodiment of the present invention, and for convenience of description, only the relevant parts of the third embodiment of the present invention are shown, which are detailed as follows:
step S301, acquiring a video image;
in the embodiment of the invention, the processing of the video image comprises screening the content of the video image to put forward human-shaped features.
Step S302, processing the video image to judge whether human-shaped characteristics exist;
in the embodiment of the invention, the processing of the video image comprises screening the content of the video image to put forward human-shaped features.
Step S303, taking a human body corresponding to the human shape characteristics as a target character;
in the embodiment of the invention, the action track of the target person is mainly detected so as to be capable of being detected in time when the target person takes a smoking action.
Step S304, identifying the human face characteristics of the target person and the characteristics of the cigarettes, and identifying the position of the mouth of the human body from the human face characteristics;
in the embodiment of the invention, the human face characteristics of the target person and the characteristics of the cigarette are recognized according to the video image, and the characteristics of the cigarette need to be preset before are recognized, wherein the characteristics of the cigarette comprise the shape, the length, the diameter or the color of the burnt part of the cigarette.
Step S305, detecting whether the temperature of any end of the cigarette exceeds the preset burning temperature of the cigarette;
in the embodiment of the invention, the temperature of the cigarette is detected through the infrared imaging equipment, and further specifically, the temperature of any end of the cigarette is detected, so that the phenomenon that a person holding the cigarette but not smoking the cigarette is judged by mistake can be avoided; furthermore, the temperature of the cigarette during burning is lower than the temperature generated when the electronic cigarette works according to the common knowledge, so that the person who smokes the electronic cigarette is not judged as a smoker; wherein, the burning temperature of the central part of the cigarette is generally 800-900 ℃, the burning temperature of the wrapping paper reaches 200-300 ℃, and the temperature of the electronic cigarette is generally only about 350 ℃.
And S306, if so, smoking behavior exists, the palm of the human body clamping the cigarette is identified, and the human face features of the human body clamping the cigarette are identified and extracted according to the palm of the human body clamping the cigarette.
And step S307, marking the palm and the face of the human body holding the cigarette in the video image.
In the embodiment of the invention, the palm and the face of the human body holding the cigarette are marked in the video image so that the monitoring personnel can directly view the smoking behavior of the smoking personnel in the target person from the video playing equipment.
Example four:
fig. 4 shows an implementation flow of a smoking behavior monitoring method provided by a fourth embodiment of the present invention, which is different from the first, second, third, and fourth embodiments in that the method further includes:
in step S401, if smoking behavior exists, an alarm prompt is correspondingly sent out;
in the embodiment of the invention, the acousto-optic alarm is arranged on the site corresponding to the video image content to remind smokers to stop smoking.
In step S402, the number of the target persons and the number of the extracted face features are respectively counted and are sent to a remote server or a mobile terminal together with the face features;
in the embodiment of the invention, the number of the human face features represents the number of persons smoking, and the number of the target persons represents the number of persons in the position area corresponding to the content of the video image.
In step S403, the remote server or/and the mobile terminal sends out an alarm prompt after receiving the face features;
in the embodiment of the invention, the remote learning of the smoking behavior can be realized, and the intelligent degree is improved.
Example five:
fig. 5 shows an implementation flow of the smoking behavior monitoring method provided by the fifth embodiment of the present invention, which is different from the first, second, third, fourth, and fifth embodiments in that the method further includes:
in step S501, both the video image and the position information corresponding to the content of the video image are sent to a remote server or a mobile terminal;
in step S502, a conversation is made with the target person through the remote server or with the mobile terminal.
In the embodiment of the invention, the remote acquisition of the video image of the smoking behavior and the acquisition of the specific position of the smoker can be realized, so that the intelligent degree is greatly improved;
recognizing the face characteristics of the target person and the characteristics of the cigarette according to the video image, recognizing the position of the mouth of the human body from the face characteristics, judging whether one end of the cigarette is positioned in the mouth of the human body, and if so, smoking behavior exists; if the smoking behavior exists, extracting the face features of the target person corresponding to the mouth, and marking the cigarette and the face corresponding to the mouth in the video image; then, the video image and the position information corresponding to the content of the video image are both sent to a remote server or a mobile terminal, and conversation can be carried out with a target person through the remote server or the mobile terminal; the intelligent monitoring and the remote monitoring of smoking behaviors are realized, and the intelligent degree is improved.
Further preferably, when smoking behavior is detected, the remote server gives an alarm to the system management desk and the current patrol attendant mobile phone, and reports the current detailed information, the floor and specific position of the smoking attendant, the number of the smoking attendant, the smoking picture shot by the smoking attendant and the like. Meanwhile, a speaker at a position corresponding to the smoking behavior is detected to automatically play pre-recorded 'no smoking' and other related voices. After the automatic voice is played, the smoking behavior stops, and the whole smoking control process is a paragraph; if the smoking behavior does not stop after the automatic voice is played, the manager can call the smoking personnel through the system management desk, and meanwhile, the patrol personnel on duty can go to a specific position to check after receiving the alarm information so as to further stop the smoking behavior; the picture without people and the picture without people but smoking can be temporarily stored for a certain time so as to be convenient for a manager to check, and the temporary storage time can be set in the system.
Example six:
fig. 6 shows a structure of a smoking behavior monitoring system according to a sixth embodiment of the present invention, and for convenience of description, only the parts related to the embodiment of the present invention are shown, including:
an obtaining module 601, which obtains a video image;
the recognition module 602 is used for recognizing the human face features of the target person and the cigarette features according to the video image and recognizing the position of the mouth of the human body from the human face features;
the judging module 603 judges whether one end of the cigarette is positioned in the mouth of the human body, and if so, smoking behavior exists;
an extraction and marking module 604, which extracts the face features of the target person corresponding to the mouth if the smoking behavior exists, and marks the cigarette and the face corresponding to the mouth in the video image;
an infrared temperature detection module 605 for detecting whether the temperature of any end of the cigarette exceeds a preset cigarette burning temperature;
a characteristic presetting module 606 for presetting the characteristics of the cigarette, wherein the characteristics of the cigarette comprise the shape, the length, the diameter or the color of the burnt part of the cigarette;
the on-site voice playing intercom module 607 is used for carrying out conversation with a target person and correspondingly sending out an alarm prompt when smoking behaviors exist;
the remote server 608 receives the number of the target persons, the extracted number of the face features, the video images and the position information corresponding to the content of the video images, and sends out an alarm prompt and carries out a conversation with the target persons;
and the mobile terminal 609 receives the number of the target persons, the extracted number of the face features, the video images and the position information corresponding to the content of the video images, and sends out an alarm prompt and carries out conversation with the target persons.
Example seven:
fig. 7 shows a structure of a smoking behavior monitoring device according to a seventh embodiment of the present invention, and for convenience of description, only the parts related to the embodiment of the present invention are shown, including:
one or more processors 110 and a memory 120, where one processor 110 is illustrated in fig. 7, the processor 110 and the memory 120 may be connected by a bus or other means, and where fig. 7 illustrates a bus connection.
The memory 120 is a non-volatile computer-readable storage medium, and may be used to store a non-volatile software program, a non-volatile computer-executable program, and modules, such as program instructions corresponding to the information recommendation method based on real-time triggering of a critical scenario in the embodiment of the present invention. The processor 110 executes various functional applications and data processing of the apparatus 10 by executing the nonvolatile software programs, instructions and units stored in the memory 120, that is, implements the information recommendation method based on the real-time triggering of the key scenario in the above method embodiments.
The memory 120 may include a storage program area and a storage data area, wherein the storage program area may store an application program required for operating the device, at least one function; the storage data area may store data created according to the use of the device 10, and the like. Further, the memory 120 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, memory 120 optionally includes memory located remotely from processor 110, which may be connected to device 10 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
One or more units are stored in the memory 120, and when executed by the one or more processors 110, perform the information recommendation method based on the real-time triggering of the key scenario in any of the above-described method embodiments, for example, perform the above-described method steps S100 to S300 in fig. 1.
Example eight:
eighth embodiment of the present invention provides a non-transitory computer-readable storage medium storing computer-executable instructions, which are executed by one or more processors, for example, to perform the above-described method steps S101 to S106 in fig. 1, or method steps S201 to S206 in fig. 2, or method steps S301 to S307 in fig. 3, or method steps S401 to S403 in fig. 4, or method steps S501 to S502 in fig. 5.
By way of example, non-volatile storage media can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), electrically erasable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in many forms such as Synchronous RAM (SRAM), dynamic RAM, (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The disclosed memory components or memory of the operating environment described herein are intended to comprise one or more of these and/or any other suitable types of memory.
Example nine:
an embodiment ninth of the present invention provides a computer program product, which includes a computer program stored on a non-volatile computer-readable storage medium, where the computer program includes program instructions, and when the program instructions are executed by a processor, the processor is caused to execute the information recommendation method based on the real-time triggering of the key scenario of the above method embodiment. For example, the above-described method steps S101 to S106 in fig. 1, or the method steps S201 to S206 in fig. 2, or the method steps S301 to S307 in fig. 3, or the method steps S401 to S403 in fig. 4, or the method steps S501 to S502 in fig. 5 are performed.
The above-described embodiments are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the embodiment.
Through the above description of the embodiments, those skilled in the art will clearly understand that the embodiments may be implemented by software plus a general hardware platform, and may also be implemented by hardware. With this in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer electronic device (which may be a personal computer, a server, or a network electronic device, etc.) to execute the methods of the various embodiments or some parts of the embodiments.
Conditional language such as "can," "might," or "may" is generally intended to convey that a particular embodiment can include (yet other embodiments do not include) particular features, elements, and/or operations, among others, unless specifically stated otherwise or otherwise understood within the context as used. Thus, such conditional language is not generally intended to imply that features, elements, and/or operations are in any way required for one or more embodiments or that one or more embodiments necessarily include logic for deciding, with or without student input or prompting, whether such features, elements, and/or operations are included or are to be performed in any particular embodiment.
What has been described herein in the specification and drawings includes examples of information recommendation methods and apparatuses capable of providing real-time triggering based on a key scenario. It will, of course, not be possible to describe every conceivable combination of components and/or methodologies for purposes of describing the various features of the disclosure, but it can be appreciated that many further combinations and permutations of the disclosed features are possible. It is therefore evident that various modifications can be made to the disclosure without departing from the scope or spirit thereof. In addition, or in the alternative, other embodiments of the disclosure may be apparent from consideration of the specification and drawings and from practice of the disclosure as presented herein. It is intended that the examples set forth in this specification and the drawings be considered in all respects as illustrative and not restrictive. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.
Claims (10)
1. A method of monitoring smoking behaviour, the method comprising the steps of:
acquiring a video image;
recognizing the face characteristics of a target person and the characteristics of cigarettes according to the video image, and recognizing the position of the mouth of the human body from the face characteristics;
judging whether one end of the cigarette is positioned in the mouth of the human body, if so, smoking behavior exists;
if the smoking behavior exists, extracting the human face features of the target person corresponding to the mouth, and marking the cigarette and the human face corresponding to the mouth of the human body in the video image.
2. The method of monitoring smoking behavior of claim 1, further comprising:
and judging whether one end of the cigarette is moved into the mouth of the human body or not, and if so, smoking behavior exists.
3. The method of claim 1, wherein the identifying of the facial features of the target person and the cigarette features from the video images comprises:
processing the video image to judge whether human-shaped features exist, and if so, taking a human body corresponding to the human-shaped features as the target person;
further comprising: presetting the characteristics of the cigarette, wherein the characteristics of the cigarette comprise the shape, the length, the diameter or the color of the burnt part of the cigarette.
4. The method of monitoring smoking behavior of claim 1, further comprising:
detecting whether the temperature of any end of the cigarette exceeds a preset cigarette burning temperature, if so, smoking behavior exists, and marking the cigarette in the video image.
5. The method of monitoring smoking behavior of claim 1, further comprising:
detecting whether the temperature of any end of the cigarette exceeds a preset cigarette burning temperature or not, if so, smoking behavior exists, recognizing the palm of a human body clamping the cigarette, and marking the palm in the video image;
after the palm of the human body holding the cigarette is identified, the method further comprises the following steps: recognizing the human face characteristics of the human body clamping the cigarettes according to the palm of the human body clamping the cigarettes, extracting the human face characteristics, and marking the human face of the human body clamping the cigarettes in the video image.
6. A method of monitoring smoking behaviour as claimed in claim 1 or 2 or 4 or 5, wherein said method includes:
if the smoking behavior exists, correspondingly sending out an alarm prompt;
further comprising: respectively counting the number of the target figures and the number of the extracted face features, and sending the number and the face features to a remote server or a mobile terminal;
and the remote server or the mobile terminal sends out an alarm prompt after receiving the face features.
7. The method of monitoring smoking behaviour of claim 6, further comprising:
sending the video image and the position information corresponding to the content of the video image to a remote server or a mobile terminal; and carrying out conversation with the target person through the remote server or the mobile terminal.
8. A smoking behavior monitoring system. It is characterized by comprising:
the acquisition module acquires a video image;
the recognition module is used for recognizing the face characteristics of a target person and the characteristics of cigarettes according to the video image and recognizing the position of the mouth of the human body from the face characteristics;
the judging module is used for judging whether one end of the cigarette is positioned in the mouth of a human body or not, and if so, smoking behavior exists;
the extraction marking module is used for extracting the face features of the target person corresponding to the mouth if the smoking behavior exists and marking the cigarette and the face corresponding to the mouth in the video image;
the infrared temperature detection module is used for detecting whether the temperature of any end of the cigarette exceeds the preset cigarette combustion temperature or not;
the characteristic presetting module is used for presetting the characteristics of the cigarette, wherein the characteristics of the cigarette comprise the shape, the length, the diameter or the color of a burnt part of the cigarette;
the on-site voice playing talkback module is used for carrying out conversation with a target person and correspondingly sending out an alarm prompt when the smoking behavior exists;
the remote server receives the number of the target characters, the extracted number of the human face features, the video images and the position information corresponding to the content of the video images, and sends out an alarm prompt and carries out conversation with the target characters;
and the mobile terminal receives the number of the target characters, the extracted number of the human face features, the video images and the position information corresponding to the content of the video images, and sends out an alarm prompt and carries out conversation with the target characters.
9. A non-transitory computer-readable storage medium having stored thereon computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform the method of monitoring smoking behavior of any one of claims 1-7.
10. A computer program product, characterized in that the computer program product comprises a computer program stored on a non-volatile computer-readable storage medium, the computer program comprising program instructions which, when executed by a processor, cause the processor to carry out the method of monitoring smoking behaviour according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010623372.5A CN111797757A (en) | 2020-06-30 | 2020-06-30 | Smoking behavior monitoring method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010623372.5A CN111797757A (en) | 2020-06-30 | 2020-06-30 | Smoking behavior monitoring method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111797757A true CN111797757A (en) | 2020-10-20 |
Family
ID=72810008
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010623372.5A Pending CN111797757A (en) | 2020-06-30 | 2020-06-30 | Smoking behavior monitoring method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111797757A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112686150A (en) * | 2020-12-30 | 2021-04-20 | 深兰人工智能芯片研究院（江苏）有限公司 | Smoking detection method and device, electronic equipment and storage medium |
| CN113392710A (en) * | 2021-05-19 | 2021-09-14 | 上海可深信息科技有限公司 | Intelligent recognition method and system for smoking behavior |
| CN115440015A (en) * | 2022-08-25 | 2022-12-06 | 深圳泰豪信息技术有限公司 | Video analysis method and system capable of being intelligently and safely controlled |
| WO2023273132A1 (en) * | 2021-06-30 | 2023-01-05 | 浙江商汤科技开发有限公司 | Behavior detection method and apparatus, computer device, storage medium, and program |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107545225A (en) * | 2016-06-23 | 2018-01-05 | 杭州海康威视数字技术股份有限公司 | A kind of method, apparatus and electronic equipment for detecting vehicle carried driving person's unlawful practice |
| CN108734125A (en) * | 2018-05-21 | 2018-11-02 | 杭州杰视科技有限公司 | A kind of cigarette smoking recognition methods of open space |
| CN109711307A (en) * | 2018-12-19 | 2019-05-03 | 中科天网（广东）科技有限公司 | A kind of smoking evidence collecting method based on recognition of face |
| CN110503006A (en) * | 2019-07-29 | 2019-11-26 | 恒大智慧科技有限公司 | A kind of community smoking management-control method, system and its storage medium |
| CN110705383A (en) * | 2019-09-09 | 2020-01-17 | 深圳市中电数通智慧安全科技股份有限公司 | Smoking behavior detection method and device, terminal and readable storage medium |
| CN212343978U (en) * | 2020-06-30 | 2021-01-12 | 图为信息科技(深圳)有限公司 | Smoking behavior monitoring devices's pronunciation circuit of talkbacking |
-
2020
- 2020-06-30 CN CN202010623372.5A patent/CN111797757A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107545225A (en) * | 2016-06-23 | 2018-01-05 | 杭州海康威视数字技术股份有限公司 | A kind of method, apparatus and electronic equipment for detecting vehicle carried driving person's unlawful practice |
| CN108734125A (en) * | 2018-05-21 | 2018-11-02 | 杭州杰视科技有限公司 | A kind of cigarette smoking recognition methods of open space |
| CN109711307A (en) * | 2018-12-19 | 2019-05-03 | 中科天网（广东）科技有限公司 | A kind of smoking evidence collecting method based on recognition of face |
| CN110503006A (en) * | 2019-07-29 | 2019-11-26 | 恒大智慧科技有限公司 | A kind of community smoking management-control method, system and its storage medium |
| CN110705383A (en) * | 2019-09-09 | 2020-01-17 | 深圳市中电数通智慧安全科技股份有限公司 | Smoking behavior detection method and device, terminal and readable storage medium |
| CN212343978U (en) * | 2020-06-30 | 2021-01-12 | 图为信息科技(深圳)有限公司 | Smoking behavior monitoring devices's pronunciation circuit of talkbacking |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112686150A (en) * | 2020-12-30 | 2021-04-20 | 深兰人工智能芯片研究院（江苏）有限公司 | Smoking detection method and device, electronic equipment and storage medium |
| CN113392710A (en) * | 2021-05-19 | 2021-09-14 | 上海可深信息科技有限公司 | Intelligent recognition method and system for smoking behavior |
| WO2023273132A1 (en) * | 2021-06-30 | 2023-01-05 | 浙江商汤科技开发有限公司 | Behavior detection method and apparatus, computer device, storage medium, and program |
| CN115440015A (en) * | 2022-08-25 | 2022-12-06 | 深圳泰豪信息技术有限公司 | Video analysis method and system capable of being intelligently and safely controlled |
| CN115440015B (en) * | 2022-08-25 | 2023-08-11 | 深圳泰豪信息技术有限公司 | Video analysis method and system capable of being intelligently and safely controlled |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111797757A (en) | Smoking behavior monitoring method and system | |
| CN109769099B (en) | Method and device for detecting abnormality of call person | |
| Willis | The killing consensus: Police, organized crime, and the regulation of life and death in urban Brazil | |
| CN110909715B (en) | Method, device, server and storage medium for identifying smoking based on video image | |
| CN110795963A (en) | Monitoring method, device and equipment based on face recognition | |
| CN109493555A (en) | A kind of campus dormitory building safety defense monitoring system based on intelligent monitoring technology | |
| CN106375956A (en) | Electronic fence method and device for mobile terminal | |
| CN110705383A (en) | Smoking behavior detection method and device, terminal and readable storage medium | |
| CN104217557B (en) | Fire protection warning method and system | |
| CN206421480U (en) | Intelligent building door system | |
| CN107845174A (en) | A kind of kindergarten's gate control system and method based on cloud computing | |
| CN107578597A (en) | Mobile terminal smog monitoring method, device and storage medium | |
| CN107959748A (en) | Automatic alarm method and device | |
| CN104282185A (en) | Intelligent fire escaping experiencing system of building firefighting | |
| CN113393347B (en) | Method and device for preventing cheating in online examination | |
| Markovitz | A Spectacle of Slavery Unwilling to Die: Curbing Reliance on Racial Stereotyping in Self-Defense Cases | |
| CN111311056A (en) | Drug addict risk monitoring method | |
| CN101431731A (en) | Automatic catching device for illegal voice telephone and short message number based on user mobile phone | |
| Panizza | Forms of moral impossibility | |
| CN212343978U (en) | Smoking behavior monitoring devices's pronunciation circuit of talkbacking | |
| CN106887109A (en) | A kind of domestic intelligent safety alarm system | |
| CN210038881U (en) | Anti-following face recognition management system | |
| CN110659603A (en) | Data processing method and device | |
| CN113034870A (en) | Electronic monitoring system based on image recognition | |
| CN106331902A (en) | Building talkback system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |