CN108961669A - The safe early warning method and device, storage medium, server of net about vehicle - Google Patents

The safe early warning method and device, storage medium, server of net about vehicle Download PDF

Info

Publication number
CN108961669A
CN108961669A CN201810798079.5A CN201810798079A CN108961669A CN 108961669 A CN108961669 A CN 108961669A CN 201810798079 A CN201810798079 A CN 201810798079A CN 108961669 A CN108961669 A CN 108961669A
Authority
CN
China
Prior art keywords
net
vehicle
early warning
driver
danger classes
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810798079.5A
Other languages
Chinese (zh)
Inventor
李晗
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Xiaoyi Technology Co Ltd
Original Assignee
Shanghai Xiaoyi Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Xiaoyi Technology Co Ltd filed Critical Shanghai Xiaoyi Technology Co Ltd
Priority to CN201810798079.5A priority Critical patent/CN108961669A/en
Publication of CN108961669A publication Critical patent/CN108961669A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/0202Child monitoring systems using a transmitter-receiver system carried by the parent and the child
    • G08B21/0205Specific application combined with child monitoring using a transmitter-receiver system
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174Facial expression recognition
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/0202Child monitoring systems using a transmitter-receiver system carried by the parent and the child
    • G08B21/0225Monitoring making use of different thresholds, e.g. for different alarm levels
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/0202Child monitoring systems using a transmitter-receiver system carried by the parent and the child
    • G08B21/0233System arrangements with pre-alarms, e.g. when a first distance is exceeded
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18Status alarms
    • G08B21/182Level alarms, e.g. alarms responsive to variables exceeding a threshold
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A kind of the net about safe early warning method of vehicle and device, storage medium, server, the safe early warning method include: to obtain the video image of camera shooting, it is about interior that the camera is installed on net when passenger takes net about vehicle;The video image is identified, to determine the status information of driver;According at least to the status information assigning degrees of hazard of the driver;Early warning is sent according to the danger classes.According to the technical solution of the present invention, security risk, effective guarantee passenger safety are evaded in the safety that net about vehicle can be improved.

Description

The safe early warning method and device, storage medium, server of net about vehicle
Technical field
The present invention relates to internet about driving skills arts, and safe early warning method and device more particularly to a kind of net about vehicle are deposited Storage media, server.
Background technique
Net about vehicle is the abbreviation of online order taxi.Passenger can directly be reserved by mobile device online, net Passenger is about transported to destination from designated place after driver's order of vehicle.Currently, net about vehicle be in flourish in (for example, Taxi, special train, windward driving, express etc.), meet the diversified trip requirements of user, offers convenience for Public Traveling.
However, in reality, net about vehicle there are the problem of also can not be ignored.Although the driver of net about vehicle and vehicle are to need to step on Note and qualification examination, but net about vehicle may still have very big risk, and the safety of passenger is not protected effectively Barrier and prevention.
Summary of the invention
Present invention solves the technical problem that being how to improve the safety of net about vehicle, to evade security risk as far as possible, effectively Ensure passenger safety.
In order to solve the above technical problems, the embodiment of the present invention provides a kind of safe early warning method of net about vehicle, the net is about The safe early warning method of vehicle includes: to obtain the video image of camera shooting, the camera peace when passenger takes net about vehicle It is about interior loaded on net;The video image is identified, to determine the status information of driver;According at least to the shape of the driver State information assigning degrees of hazard;Early warning is sent according to the danger classes.
Optionally, described that the video image is identified, to determine that the status information of driver includes: in the video In image, recognition of face is carried out to preset steering position range, with the face information of the determination driver;According to the face Information tracks the driver, with the status information of the determination driver.
Optionally, the status information includes following one or more: the facial expression of the driver, limb action and In the about interior position of the net.
Optionally, the status information assigning degrees of hazard according at least to the driver includes: to obtain sound from microphone Frequency according to and identify obtain audio-frequency information, it is about interior that the microphone is installed on the net;According to the status information of the driver And audio-frequency information determines the danger classes.
Optionally, the audio-frequency information includes at least one of the following: content keyword, audio frequency parameter.
Optionally, it is described according to the danger classes send early warning include: when the danger classes be higher than it is preset When the first estate, early warning is sent to the about vehicle operation platform of the kith and kin's client and net with the passenger associated.
Optionally, it is described according to the danger classes send early warning include: when the danger classes be higher than it is preset When the second grade, early warning is sent to public alarm platform and net about vehicle operation platform, second grade is higher than first etc. Grade.
Optionally, it is described according to the danger classes send early warning include: when the danger classes be higher than it is preset When the tertiary gradient, early warning is sent to the vehicle on public alarm platform, net about vehicle operation platform and the net about vehicle periphery, The tertiary gradient is higher than the second grade.
Optionally, it is described according to the danger classes send early warning include: when the danger classes be higher than it is preset When the fourth estate, the flame-out simultaneously opening car door of the net about vehicle is controlled, the fourth estate is higher than the tertiary gradient.
Optionally, the safe early warning method of the net about vehicle further include: when the camera is closed, notice net about vehicle Operation platform.
Optionally, the safe early warning method of the net about vehicle further include: preset when the real-time routes of the net about vehicle deviate Recommended route when, to the real-time routes of the about vehicle of net described in kith and kin's client push with the passenger associated.
In order to solve the above technical problems, the embodiment of the present invention also provides a kind of safety early warning device of net about vehicle, comprising: obtain Modulus block is suitable for obtaining the video image of camera shooting, the camera is installed on net about vehicle when passenger takes net about vehicle It is interior;Identification module, suitable for being identified to the video image, to determine the status information of driver;Determining module is suitable at least According to the status information assigning degrees of hazard of the driver;Sending module is suitable for sending early warning according to the danger classes.
Optionally, the identification module includes: identification submodule, is suitable in the video image, to preset driving Position range carries out recognition of face, with the face information of the determination driver;Submodule is tracked, is suitable for according to the face information The driver is tracked, with the status information of the determination driver.
Optionally, the status information includes following one or more: the facial expression of the driver, limb action and In the about interior position of the net.
Optionally, the determining module includes: to obtain identification submodule, suitable for obtaining audio data from microphone and identifying Audio-frequency information is obtained, it is about interior that the microphone is installed on the net;Submodule is determined, suitable for believing according to the state of the driver Breath and audio-frequency information determine the danger classes.
Optionally, the audio-frequency information includes at least one of the following: content keyword, audio frequency parameter.
Optionally, the sending module includes: the first sending submodule, is suitable for being higher than preset the when the danger classes When one grade, early warning is sent to the about vehicle operation platform of the kith and kin's client and net with the passenger associated.
Optionally, the sending module includes: the second sending submodule, is suitable for being higher than preset the when the danger classes When two grades, early warning is sent to public alarm platform and net about vehicle operation platform, second grade is higher than described first Grade.
Optionally, the sending module includes: third sending submodule, is suitable for being higher than preset the when the danger classes When three grades, early warning, institute are sent to the vehicle on public alarm platform, net about vehicle operation platform and the net about vehicle periphery The tertiary gradient is stated higher than second grade.
Optionally, the sending module includes: the 4th sending submodule, is suitable for being higher than preset the when the danger classes When four grades, the flame-out simultaneously opening car door of the net about vehicle is controlled, the fourth estate is higher than the tertiary gradient.
Optionally, the safety early warning device of the net about vehicle further include: notification module, suitable for being closed when the camera When, notice net about vehicle operation platform.
Optionally, the safety early warning device of the net about vehicle further include: pushing module, suitable for working as the real-time of the net about vehicle When route deviates preset recommended route, to the real-time road of the about vehicle of net described in kith and kin's client push with the passenger associated Line.
In order to solve the above technical problems, the embodiment of the present invention also provides a kind of storage medium, it is stored thereon with computer and refers to The step of order, the computer instruction executes the safe early warning method of above-mentioned net about vehicle when running.
In order to solve the above technical problems, the embodiment of the present invention also provides a kind of server, including memory and processor, institute The computer instruction for being stored with and being run on memory on the processor is stated, the processor runs the computer instruction The above-mentioned net of Shi Zhihang about the safe early warning method of vehicle the step of.
Compared with prior art, the technical solution of the embodiment of the present invention has the advantages that
The embodiment of the present invention provides a kind of safe early warning method of net about vehicle, comprising: when passenger takes net about vehicle, obtains The video image of camera shooting, it is about interior that the camera is installed on net;The video image is identified, to determine department The status information of machine;According at least to the status information assigning degrees of hazard of the driver;Early warning is sent according to the danger classes Prompt.The technical solution provided through the embodiment of the present invention can use camera shooting video image, identify and determine driver's Status information, and then determine that passenger whether there is dangerous and danger classes according to the status information of driver, and according to danger etc. Grade sends early warning, can largely improve the safety of net about vehicle, to evade security risk as far as possible, effective guarantee multiplies Objective safety.
Further, it obtains audio data from microphone and identifies and obtain audio-frequency information, the microphone is installed on the net It is about interior;The danger classes is determined according to the status information of the driver and audio-frequency information.It mentions through the embodiment of the present invention The technical solution of confession can determine the state of the driver in conjunction with the audio-frequency information that the video image and microphone of camera obtain Information, can more accurate assigning degrees of hazard, further increase the safety of net about vehicle, to evade security risk as far as possible, have Effect ensures passenger safety.
Further, when the danger classes is higher than preset second grade, to public alarm platform and net about vehicle operation Platform sends early warning, and second grade is higher than the first estate.The technical solution provided through the embodiment of the present invention, works as danger When danger is higher ranked, public alarm platform and net about vehicle operation platform can be notified, reduce security risk.
Detailed description of the invention
Fig. 1 is a kind of flow diagram of the safe early warning method of net about vehicle of the embodiment of the present invention;
Fig. 2 is a kind of structural schematic diagram of the safety early warning device of net about vehicle of the embodiment of the present invention.
Specific embodiment
It will be appreciated by those skilled in the art that as described in the background art, there is very big risk in existing net about vehicle, to the peace of passenger For complete, lack effective guarantee and prevention.
The embodiment of the present invention provides a kind of safe early warning method of net about vehicle, comprising: when passenger takes net about vehicle, obtains The video image of camera shooting, it is about interior that the camera is installed on net;The video image is identified, to determine department The status information of machine;According at least to the status information assigning degrees of hazard of the driver;Early warning is sent according to the danger classes Prompt.
The technical solution provided through the embodiment of the present invention can use camera shooting video image, identify and determine department The status information of machine, and then determine that passenger whether there is dangerous and danger classes according to the status information of driver, and according to danger Dangerous grade sends early warning, can largely improve the safety of net about vehicle, to evade security risk as far as possible, effectively protects Hinder passenger safety.
It is understandable to enable above-mentioned purpose of the invention, feature and beneficial effect to become apparent, with reference to the accompanying drawing to this The specific embodiment of invention is described in detail.
Fig. 1 is a kind of flow diagram of the safe early warning method of net about vehicle of the embodiment of the present invention.It is described with reference to Fig. 1 Safe early warning method may comprise steps of:
Step S101 obtains the video image of camera shooting when passenger takes net about vehicle, and the camera is installed on Net is about interior;
Step S102 identifies the video image, to determine the status information of driver;
Step S103, according at least to the status information assigning degrees of hazard of the driver;
Step S104 sends early warning according to the danger classes.
Specifically, the driver of the net about vehicle and vehicle are by registration and qualification examination.If examined by qualification Core, then net about vehicle can be included in net about vehicle system by net about vehicle operation platform.Further, the net about vehicle can connect to public Alarm platform.
Preferably, the net about vehicle operation platform can connect each net about vehicle to form car networking system, it might even be possible to The wider array of car networking system of coverage area is formed with the vehicle in other private vehicles or other car operation platforms, so that vehicle Each vehicle in net system can with other vehicle interactive information or complete other function.
Further, net about vehicle operation platform can install camera in each net for being included in net about vehicle system about car, with It exercises supervision to the net about vehicle of operation, the driving behavior of specification net Yue Che driver reduces unexpected occur.Furthermore, it is possible to take precautions against The risk by bus of net about vehicle.
More specifically, in step s101, after driver's order, driver can be connected to passenger, passenger in designated place It gets on the bus, takes net about vehicle.When passenger takes net about vehicle, the about interior video image of camera shooting net can star.
Wherein, the camera can be common camera (for example, it is 120 degree that it, which images wide-angle), be also possible to panorama Camera (for example, it is 180 degree or 360 degree etc. that it, which images wide-angle).To cut operating costs, common camera can be used, is clapped Take the photograph the video image of driver.To increase coverage, full-view camera can be used, under the premise of obtaining passenger's agreement, is clapped Take the photograph the video image of driver and passenger.
Further, the net about vehicle operation platform can recommend default route for driver and passenger.The client of the passenger End can be associated with the client of kith and kin.
Further, the default route that the net about vehicle operation platform can select passenger pushes to the client of the passenger End, alternatively, the client of the passenger can obtain the default route that the passenger selectes from the net about vehicle operation platform.When It, can be to associated parent when the client of the passenger detects that the real-time routes of the net about vehicle deviate preset recommended route The real-time routes of net about vehicle described in the client push of friend.
In step s 102, the video image can be identified using image recognition technology, to determine default drive Sail the status information of the driver and driver on position.
Specifically, preset steering position range can be directed to, recognition of face is carried out using face recognition technology, with To the face information of the driver.
Later, it can use feature tracking technology, continue the micro- expression for capturing driver;It can use humanoid detection techniques inspection The information such as the limb action of driver are surveyed, to obtain the status information of driver.
Wherein, the status information of the driver may include the facial expression of driver, limb action and the net about Interior position.
It, can be using fusion local binary patterns (Local Binary as a non-limiting embodiment Patterns, abbreviation LBP) and the facial expression recognition algorithm of local rarefaction representation determine the expression of customer.For example, the driver Facial expression can be it is gentle, ferocious, extreme excited, terrified, angry, etc..
As another non-limiting embodiment, the limbs that can detecte out the driver using humanoid detection techniques are dynamic It can be defence movement, attack, capitulation movement etc..
Preferably, the video image can also be identified using image recognition technology, to determine the state of passenger Information.The status information of the passenger may include the facial expression of passenger, limb action and in the passenger in net about vehicle Interior position.
Further, the net about car can install the audio frequency apparatuses such as microphone.The microphone can be with the camera shooting Head is integrated equipment, is also possible to the independent audio frequency apparatus independently of the camera.
The microphone can receive the about interior audio data of the net.The audio data may include the sound of driver The audio-frequency information of frequency information and passenger, by identifying that the audio data can detecte out acoustic information and the passenger of driver Acoustic information, to further determine that the status information of the driver.
Wherein, the audio-frequency information (for example, acoustic information) may include the content keyword information that passenger issues.
As a unrestricted example, the passenger, which can issue, to be reprimanded class content keyword, calls for help class content pass Keyword or threatening class content keyword or other content keyword.For example, " shameless!", " help!" etc. sound.
Further, the audio-frequency information can also include the audio parameter informations such as intonation, sound size.For example, working as When passenger encounters Personal Risk, sound may be the sharp sound or droning powerless trembling voice of higher volume, this In no longer illustrate one by one.
It in step s 103, can be according to the status information of the driver (for example, facial expression, limb action, seating position Set) determine the danger classes of passenger.
As a non-limiting embodiment, when it is implemented, the dangerous situation that passenger can be likely encountered is divided into Multiple preset danger classes.
For example, the expression of preset the first estate may have slight dangerous, preset second grade indicate degree of danger it is higher, The preset tertiary gradient indicates to indicate to exist there are poor risk, the preset fourth estate to be in extreme danger.
Further, if identify the facial expression of the driver be it is gentle, limb action shows that driver is driving, It can so determine passenger without danger.
As a change case, if identify the facial expression of the driver be it is ferocious, limb action shows driver It " gazes around " in driving process, then danger classes can be determined as to preset the first estate.
As another change case, if being of wretched appearance based on the facial expression that the video image identification goes out the driver , limb action show driver physical without departing from preset steering position, while the audio data detection based on microphone go out take charge of The sound of machine be excited but the sound of passenger be calm it is gentle, then danger classes can be determined as to preset second etc. Grade.
As another change case, if being ferocious based on the facial expression that the video image identification goes out the driver , limb action shows that driver physical is tilted to the right, and deviates preset steering position, while the inspection of the audio data based on microphone It is frightening for measuring the sound of driver, and detects that the passenger has issued content keyword (for example, " prithee!") etc. Class of seeking help sound, then danger classes can be determined as to the preset tertiary gradient.
As another change case, if being insolent ruthless based on the facial expression that the video image identification goes out the driver Strict, limb action shows that driver physical is tilted to the right, and deviates preset steering position;The facial expression of passenger is helpless to fear 's;It is droning terrified that the audio data detection based on microphone, which goes out the sound of driver, simultaneously, and passenger issues sharp " rescue Life " sound, then danger classes can be determined as to the preset fourth estate.
It will be appreciated by those skilled in the art that in actual implementation, preset danger classes and the corresponding spy of each danger classes Reference breath can change more embodiments out, and which is not described herein again.
In step S104, if it is determined that danger classes then can send early warning according to the danger classes.
When it is implemented, when determining danger classes is higher than preset the first estate, and when being lower than preset second grade, Early warning can be sent to the about vehicle operation platform of the kith and kin's client and net with the passenger associated.
Wherein, preset second grade is higher than described preset the first estate.
As an alternate embodiment, when the danger classes is higher than preset second grade, and lower than described preset When the tertiary gradient, early warning can be sent to public alarm platform and the net about vehicle operation platform, second grade is high In described the first estate.Wherein, preset second grade is higher than preset described the first estate.
As another alternate embodiment, when the danger classes is higher than the preset tertiary gradient, and it is default lower than described The fourth estate when, can to the public alarm platform, net about vehicle operation platform send early warning.Further, if institute It states net about vehicle to be in car networking system, then can also send early warning to the vehicle on the net about vehicle periphery.Wherein, described The preset tertiary gradient is higher than preset second grade.
As another alternate embodiment, if the net about vehicle is in car networking system, when described danger etc. When grade is higher than the preset fourth estate, the flame-out simultaneously opening car door of the net about vehicle can be controlled by car networking system.
Wherein, the preset fourth estate is higher than the preset tertiary gradient.
It will be appreciated by those skilled in the art that above-described embodiment is in practical applications, it can be with R. concomitans, to reduce passenger as far as possible By bus security risk.
Preferably, when the camera is artificially closed, net about vehicle operation platform can be notified, so that the net about vehicle Operation platform can learn that the camera is artificially closed, and the driver of the net about vehicle is notified to reopen the camera shooting Head further strengthens the management to net about vehicle.
It should be noted that the situation if the driver of the net about vehicle faces a danger, the embodiment of the present invention equally may be used Identify that driver is in dangerous shape with the data information (such as video image and audio data) based on camera and microphone acquisition State still can issue early warning information.
For example, the passenger of the net about vehicle is ruffian, and when attempting injury driver, technical solution provided in an embodiment of the present invention Equally early warning can be sent according to the status information of driver, as far as possible guarantee driver safety.
By upper, the technical solution provided through the embodiment of the present invention can shoot video image in favor of camera, be conducive to wheat Gram wind obtains audio data, and determines security level according to recognition result, when security level is more than preset security level, hair Early warning is sent, so as to largely improve the safety of net about vehicle, to evade security risk as far as possible, effective guarantee multiplies Objective safety.
Fig. 2 is a kind of structural schematic diagram of the safety early warning device of net about vehicle of the embodiment of the present invention.The net about vehicle Safety early warning device 2 (hereinafter referred to as safety early warning device 2) can be used for implementing method and technology scheme shown in above-mentioned Fig. 1.Tool For body, the safety early warning device 2 may include: to obtain module 21, identification module 22, determining module 23 and sending module 24。
More specifically, the acquisition module 21 is suitable for obtaining the video of camera shooting when passenger takes net about vehicle Image, it is about interior that the camera is installed on net;The identification module 22 is suitable for identifying the video image, with determination The status information of driver;The determining module 23 is suitable for the status information assigning degrees of hazard according at least to the driver;It is described Sending module 24 is suitable for sending early warning according to the danger classes.
Further, the identification module 22 may include: identification submodule 221, be suitable in the video image, to pre- If steering position range carry out recognition of face, with the face information of the determination driver;Submodule 222 is tracked, basis is suitable for The face information tracks the driver, with the status information of the determination driver.
Wherein, the status information may include following one or more: the facial expression of the driver, limb action with And the position about interior in the net.
Further, the determining module 23 may include: to obtain identification submodule 231, be suitable for obtaining audio from microphone Data and identify obtain audio-frequency information, it is about interior that the microphone is installed on the net;It determines submodule 232, is suitable for according to institute The status information and audio-frequency information for stating driver determine the danger classes.
Wherein, the audio-frequency information may include at least one of following: content keyword, audio frequency parameter.
Further, the sending module 24 may include: the first sending submodule 241, be suitable for when the danger classes is high When preset the first estate, early warning is sent to the about vehicle operation platform of the kith and kin's client and net with the passenger associated.
As an alternate embodiment, the sending module 24 may include: the second sending submodule 242, be suitable for working as institute When stating danger classes higher than preset second grade, early warning, institute are sent to public alarm platform and net about vehicle operation platform The second grade is stated higher than described the first estate.
As another alternate embodiment, the sending module 24 may include: third sending submodule 243, suitable for working as When the danger classes is higher than the preset tertiary gradient, to public alarm platform, net about vehicle operation platform and the net about vehicle The vehicle on periphery sends early warning, and the tertiary gradient is higher than second grade.
As another alternate embodiment, the sending module 24 may include: the 4th sending submodule 244, suitable for working as When the danger classes is higher than the preset fourth estate, the flame-out simultaneously opening car door of the net about vehicle is controlled, the fourth estate is high In the tertiary gradient.
Preferably, the safety early warning device 2 can also include: notification module 25, suitable for being closed when the camera When, notice net about vehicle operation platform.
Preferably, the safety early warning device 2 can also include: pushing module 26, suitable for working as the real-time of the net about vehicle When route deviates preset recommended route, to the real-time road of the about vehicle of net described in kith and kin's client push with the passenger associated Line.
Working principle, more contents of working method about the safety early warning device 2, can be together referring to above-mentioned figure 1 associated description, which is not described herein again.
Further, a kind of storage medium is also disclosed in the embodiment of the present invention, is stored thereon with computer instruction, the calculating Safe early warning method technical solution described in above-mentioned embodiment illustrated in fig. 1 is executed when machine instruction operation.Preferably, the storage Medium may include such as non-volatile (non-volatile) memory or non-transient (non-transitory) memory Equal computer readable storage mediums.The computer readable storage medium may include ROM, RAM, disk or CD etc..
Further, the embodiment of the present invention is also disclosed a kind of server, including memory and processor, on the memory It is stored with the computer instruction that can be run on the processor, the processor executes when running the computer instruction State safe early warning method technical solution described in embodiment illustrated in fig. 1.
Although present disclosure is as above, present invention is not limited to this.Anyone skilled in the art are not departing from this It in the spirit and scope of invention, can make various changes or modifications, therefore protection scope of the present invention should be with claim institute Subject to the range of restriction.

Claims (24)

1. a kind of safe early warning method of net about vehicle characterized by comprising
When passenger takes net about vehicle, the video image of camera shooting is obtained, it is about interior that the camera is installed on net;
The video image is identified, to determine the status information of driver;
According at least to the status information assigning degrees of hazard of the driver;
Early warning is sent according to the danger classes.
2. the safe early warning method of net according to claim 1 about vehicle, which is characterized in that it is described to the video image into Row identification, to determine that the status information of driver includes:
In the video image, recognition of face is carried out to preset steering position range, is believed with the face of the determination driver Breath;
The driver is tracked according to the face information, with the status information of the determination driver.
3. the safe early warning method of net according to claim 1 or 2 about vehicle, which is characterized in that the status information includes It is one or more below: facial expression, limb action and the position about interior in the net of the driver.
4. the safe early warning method of net according to claim 1 about vehicle, which is characterized in that described according at least to the driver Status information assigning degrees of hazard include:
It obtains audio data from microphone and identifies and obtain audio-frequency information, it is about interior that the microphone is installed on the net;
The danger classes is determined according to the status information of the driver and audio-frequency information.
5. the safe early warning method of net according to claim 4 about vehicle, which is characterized in that the audio-frequency information includes following At least one of: content keyword, audio frequency parameter.
6. the safe early warning method of the about vehicle of net described according to claim 1 or 2 or 4 or 5, which is characterized in that described according to institute Stating danger classes transmission early warning includes:
When the danger classes is higher than preset the first estate, transported to the about vehicle of the kith and kin's client and net with the passenger associated It seeks platform and sends early warning.
7. the safe early warning method of net according to claim 6 about vehicle, which is characterized in that described according to the danger classes Sending early warning includes:
When the danger classes is higher than preset second grade, early warning is sent to public alarm platform and net about vehicle operation platform Prompt, second grade are higher than described the first estate.
8. the safe early warning method of net according to claim 7 about vehicle, which is characterized in that described according to the danger classes Sending early warning includes:
When the danger classes is higher than the preset tertiary gradient, to public alarm platform, net about vehicle operation platform and described The vehicle on net about vehicle periphery sends early warning, and the tertiary gradient is higher than second grade.
9. the safe early warning method of net according to claim 8 about vehicle, which is characterized in that described according to the danger classes Sending early warning includes:
When the danger classes is higher than the preset fourth estate, control that the net about vehicle is flame-out and opening car door, the described 4th Grade is higher than the tertiary gradient.
10. the safe early warning method of the about vehicle of net described according to claim 1 or 2 or 4 or 5, it is characterised in that: further include:
When the camera is closed, notice net about vehicle operation platform.
11. the safe early warning method of the about vehicle of net described according to claim 1 or 2 or 4 or 5, which is characterized in that further include:
When the real-time routes of the net about vehicle deviate preset recommended route, pushed away to kith and kin's client with the passenger associated Send the real-time routes of the net about vehicle.
12. a kind of safety early warning device of net about vehicle characterized by comprising
Module is obtained, is suitable for obtaining the video image of camera shooting, the camera is installed on when passenger takes net about vehicle Net is about interior;
Identification module, suitable for being identified to the video image, to determine the status information of driver;
Determining module, suitable for the status information assigning degrees of hazard according at least to the driver;
Sending module is suitable for sending early warning according to the danger classes.
13. the safety early warning device of net according to claim 12 about vehicle, which is characterized in that the identification module includes:
It identifies submodule, is suitable in the video image, recognition of face is carried out to preset steering position range, to determine State the face information of driver;
Submodule is tracked, suitable for being tracked according to the face information to the driver, is believed with the state of the determination driver Breath.
14. the safety early warning device of net according to claim 12 or 13 about vehicle, which is characterized in that the status information packet It includes following one or more: facial expression, limb action and the position about interior in the net of the driver.
15. the safety early warning device of net according to claim 12 about vehicle, which is characterized in that the determining module includes:
Identification submodule is obtained, obtains audio-frequency information suitable for obtaining audio data from microphone and identifying, the microphone installation It is about interior in the net;
Submodule is determined, suitable for determining the danger classes according to the status information and audio-frequency information of the driver.
16. the safety early warning device of net according to claim 15 about vehicle, which is characterized in that the audio-frequency information include with It is at least one of lower: content keyword, audio frequency parameter.
17. the safety early warning device of the about vehicle of net described in 2 or 13 or 15 or 16 according to claim 1, which is characterized in that the hair The module is sent to include:
First sending submodule, be suitable for when the danger classes be higher than preset the first estate when, to the passenger associated Kith and kin's client and net about vehicle operation platform send early warning.
18. the safety early warning device of net according to claim 17 about vehicle, which is characterized in that the sending module includes:
Second sending submodule is suitable for when the danger classes is higher than preset second grade, to public alarm platform and net About vehicle operation platform sends early warning, and second grade is higher than described the first estate.
19. the safety early warning device of net according to claim 18 about vehicle, which is characterized in that the sending module includes:
Third sending submodule is suitable for when the danger classes is higher than the preset tertiary gradient, about to public alarm platform, net Vehicle operation platform and the vehicle on the net about vehicle periphery send early warning, and the tertiary gradient is higher than second grade.
20. the safety early warning device of net according to claim 19 about vehicle, which is characterized in that the sending module includes:
4th sending submodule is suitable for that it is flame-out to control the net about vehicle when the danger classes is higher than the preset fourth estate And opening car door, the fourth estate are higher than the tertiary gradient.
21. the safety early warning device of the about vehicle of net described in 2 or 13 or 15 or 16 according to claim 1, it is characterised in that: also wrap It includes:
Notification module, suitable for when the camera is closed, notifying net about vehicle operation platform.
22. the safety early warning device of the about vehicle of net described in 2 or 13 or 15 or 16 according to claim 1, which is characterized in that also wrap It includes:
Pushing module, suitable for when the net about vehicle real-time routes deviate preset recommended route when, to the passenger associated Kith and kin's client push described in net about vehicle real-time routes.
23. a kind of storage medium, is stored thereon with computer instruction, which is characterized in that the computer instruction executes when running The described in any item nets of claim 1 to 11 about the safe early warning method of vehicle the step of.
24. a kind of server, including memory and processor, be stored on the memory to run on the processor Computer instruction, which is characterized in that perform claim requires any one of 1 to 11 institute when the processor runs the computer instruction The step of safe early warning method of the net stated about vehicle.
CN201810798079.5A 2018-07-19 2018-07-19 The safe early warning method and device, storage medium, server of net about vehicle Pending CN108961669A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810798079.5A CN108961669A (en) 2018-07-19 2018-07-19 The safe early warning method and device, storage medium, server of net about vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810798079.5A CN108961669A (en) 2018-07-19 2018-07-19 The safe early warning method and device, storage medium, server of net about vehicle

Publications (1)

Publication Number Publication Date
CN108961669A true CN108961669A (en) 2018-12-07

Family

ID=64495842

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810798079.5A Pending CN108961669A (en) 2018-07-19 2018-07-19 The safe early warning method and device, storage medium, server of net about vehicle

Country Status (1)

Country Link
CN (1) CN108961669A (en)

Cited By (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108986400A (en) * 2018-09-03 2018-12-11 深圳市尼欧科技有限公司 A kind of third party based on image procossing, which multiplies, drives safety automatic-alarming method
CN109448317A (en) * 2018-12-26 2019-03-08 上海理工大学 Taxi automatic alarm system
CN109859085A (en) * 2018-12-25 2019-06-07 深圳市天彦通信股份有限公司 Safe early warning method and Related product
CN110085007A (en) * 2019-04-17 2019-08-02 万翼科技有限公司 Safety rope, warning device and the alarm method based on safety rope
CN110213516A (en) * 2019-05-22 2019-09-06 未来(北京)黑科技有限公司 Vehicular video recording method, device, storage medium and electronic device
CN110210772A (en) * 2019-06-09 2019-09-06 张子洋 A kind of net about vehicle security management and control implementation method
CN110288796A (en) * 2019-06-21 2019-09-27 浙江大华技术股份有限公司 Vehicle monitoring method and device, storage medium, electronic device
CN110365685A (en) * 2019-07-18 2019-10-22 恒生电子股份有限公司 A kind of data processing method, device, equipment and computer readable storage medium
CN110458604A (en) * 2019-07-17 2019-11-15 中国第一汽车股份有限公司 A kind of net about driver's evaluation method, device, equipment and storage medium
CN110525445A (en) * 2019-08-30 2019-12-03 南京领行科技股份有限公司 A kind of control method of vehicle driving, device, equipment, medium and vehicle
CN110580799A (en) * 2019-06-19 2019-12-17 四川鼎鸿物联网科技有限公司 taxi network taxi appointment driver and passenger speaking automatic pre-judgment alarm system
CN110706700A (en) * 2019-09-29 2020-01-17 深圳市元征科技股份有限公司 In-vehicle disturbance prevention alarm method and device, server and storage medium
CN110766182A (en) * 2018-12-12 2020-02-07 北京嘀嘀无限科技发展有限公司 Safety protection for passengers
CN110992119A (en) * 2019-02-21 2020-04-10 北京嘀嘀无限科技发展有限公司 Method and system for sequencing risk orders
CN110991781A (en) * 2019-02-21 2020-04-10 北京嘀嘀无限科技发展有限公司 Risk order display method and system
CN111132084A (en) * 2019-12-19 2020-05-08 南京领行科技股份有限公司 In-vehicle communication response system, method, device, in-vehicle central control and storage medium
CN111488784A (en) * 2019-10-30 2020-08-04 四川鼎鸿物联网科技有限公司 5G communication open type taxi or network taxi appointment intelligent driving comprehensive management service platform
CN111598641A (en) * 2019-02-21 2020-08-28 北京嘀嘀无限科技发展有限公司 Order risk verification method and system
CN111598370A (en) * 2019-02-21 2020-08-28 北京嘀嘀无限科技发展有限公司 Female safety risk prevention method and system
CN111598373A (en) * 2019-02-21 2020-08-28 北京嘀嘀无限科技发展有限公司 Robbery risk prevention method and system
CN111612200A (en) * 2019-02-25 2020-09-01 北京嘀嘀无限科技发展有限公司 Order security prediction method, device, server and storage medium
CN111696337A (en) * 2019-03-11 2020-09-22 上海飞田通信股份有限公司 Taxi running track monitoring and safety early warning system
CN111832409A (en) * 2020-06-08 2020-10-27 深圳市金溢科技股份有限公司 Face matching method of network car booking, cloud platform and network car booking ETC device
CN111932046A (en) * 2019-05-13 2020-11-13 阿里巴巴集团控股有限公司 Method for processing risk in service scene, computer equipment and storage medium
CN112071309A (en) * 2020-09-17 2020-12-11 苏州上下文人工智能技术研发有限公司 Network appointment car safety monitoring device and system
CN112419661A (en) * 2019-08-20 2021-02-26 北京国双科技有限公司 Danger identification method and device
CN112423406A (en) * 2020-09-23 2021-02-26 大众问问(北京)信息科技有限公司 Network appointment safety supervision method and related equipment
CN112519787A (en) * 2019-08-30 2021-03-19 南京领行科技股份有限公司 Vehicle control system and vehicle
CN113129551A (en) * 2021-03-23 2021-07-16 广州宸祺出行科技有限公司 Method, system, medium and equipment for automatically alarming through micro-expression of driver
CN113538842A (en) * 2020-04-16 2021-10-22 上海汽车集团股份有限公司 Alarm system of network appointment car
CN113591690A (en) * 2021-07-29 2021-11-02 深圳昌恩智能股份有限公司 Running monitoring method for network taxi booking/taxi
TWI758689B (en) * 2017-08-10 2022-03-21 大陸商北京市商湯科技開發有限公司 Method, device, electronic equipment and storage medium for identifying the dangerous actions of persons in the vehicle
CN111832409B (en) * 2020-06-08 2024-04-30 深圳市金溢科技股份有限公司 Face matching method of network vehicle, cloud platform and network vehicle ETC equipment

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010271924A (en) * 2009-05-21 2010-12-02 Ntt Comware Corp System, device, method and program for providing service
CN202294652U (en) * 2011-11-04 2012-07-04 深圳市华盈泰科技有限公司 Automatic recourse safety device in case of vehicle impact
CN203870763U (en) * 2014-05-06 2014-10-08 吉首大学 Simple vehicle emergency calling system
CN105096528A (en) * 2015-08-05 2015-11-25 广州云从信息科技有限公司 Fatigue driving detection method and system
CN106373331A (en) * 2016-09-28 2017-02-01 百度在线网络技术(北京)有限公司 Riding early-warning method and device
CN206003291U (en) * 2016-09-06 2017-03-08 安徽江淮汽车集团股份有限公司 A kind of vehicle failure wireless network warning device
CN206095292U (en) * 2016-08-29 2017-04-12 京东方科技集团股份有限公司 A wearable apparatus
CN107024982A (en) * 2016-12-09 2017-08-08 阿里巴巴集团控股有限公司 A kind of method for safety monitoring of virtual reality device, device and virtual reality device
CN107358484A (en) * 2017-05-27 2017-11-17 上海与德科技有限公司 A kind of net about car monitoring method and system
CN107657236A (en) * 2017-09-29 2018-02-02 厦门知晓物联技术服务有限公司 Vehicle security drive method for early warning and vehicle-mounted early warning system
CN107679636A (en) * 2017-08-29 2018-02-09 明光泰源安防科技有限公司 A kind of driver safety appraisal procedure based on net about car
CN108109338A (en) * 2017-12-27 2018-06-01 南京地平线机器人技术有限公司 Abnormal alarm method, anomaly alarming device and electronic equipment

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010271924A (en) * 2009-05-21 2010-12-02 Ntt Comware Corp System, device, method and program for providing service
CN202294652U (en) * 2011-11-04 2012-07-04 深圳市华盈泰科技有限公司 Automatic recourse safety device in case of vehicle impact
CN203870763U (en) * 2014-05-06 2014-10-08 吉首大学 Simple vehicle emergency calling system
CN105096528A (en) * 2015-08-05 2015-11-25 广州云从信息科技有限公司 Fatigue driving detection method and system
CN206095292U (en) * 2016-08-29 2017-04-12 京东方科技集团股份有限公司 A wearable apparatus
CN206003291U (en) * 2016-09-06 2017-03-08 安徽江淮汽车集团股份有限公司 A kind of vehicle failure wireless network warning device
CN106373331A (en) * 2016-09-28 2017-02-01 百度在线网络技术(北京)有限公司 Riding early-warning method and device
CN107024982A (en) * 2016-12-09 2017-08-08 阿里巴巴集团控股有限公司 A kind of method for safety monitoring of virtual reality device, device and virtual reality device
CN107358484A (en) * 2017-05-27 2017-11-17 上海与德科技有限公司 A kind of net about car monitoring method and system
CN107679636A (en) * 2017-08-29 2018-02-09 明光泰源安防科技有限公司 A kind of driver safety appraisal procedure based on net about car
CN107657236A (en) * 2017-09-29 2018-02-02 厦门知晓物联技术服务有限公司 Vehicle security drive method for early warning and vehicle-mounted early warning system
CN108109338A (en) * 2017-12-27 2018-06-01 南京地平线机器人技术有限公司 Abnormal alarm method, anomaly alarming device and electronic equipment

Cited By (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI758689B (en) * 2017-08-10 2022-03-21 大陸商北京市商湯科技開發有限公司 Method, device, electronic equipment and storage medium for identifying the dangerous actions of persons in the vehicle
CN108986400A (en) * 2018-09-03 2018-12-11 深圳市尼欧科技有限公司 A kind of third party based on image procossing, which multiplies, drives safety automatic-alarming method
CN110766182A (en) * 2018-12-12 2020-02-07 北京嘀嘀无限科技发展有限公司 Safety protection for passengers
CN109859085A (en) * 2018-12-25 2019-06-07 深圳市天彦通信股份有限公司 Safe early warning method and Related product
CN109448317A (en) * 2018-12-26 2019-03-08 上海理工大学 Taxi automatic alarm system
CN111598373A (en) * 2019-02-21 2020-08-28 北京嘀嘀无限科技发展有限公司 Robbery risk prevention method and system
CN111598641A (en) * 2019-02-21 2020-08-28 北京嘀嘀无限科技发展有限公司 Order risk verification method and system
CN111598370A (en) * 2019-02-21 2020-08-28 北京嘀嘀无限科技发展有限公司 Female safety risk prevention method and system
CN110992119A (en) * 2019-02-21 2020-04-10 北京嘀嘀无限科技发展有限公司 Method and system for sequencing risk orders
CN110991781A (en) * 2019-02-21 2020-04-10 北京嘀嘀无限科技发展有限公司 Risk order display method and system
CN111612200A (en) * 2019-02-25 2020-09-01 北京嘀嘀无限科技发展有限公司 Order security prediction method, device, server and storage medium
CN111612200B (en) * 2019-02-25 2023-07-14 北京嘀嘀无限科技发展有限公司 Order security prediction method, device, server and storage medium
CN111696337A (en) * 2019-03-11 2020-09-22 上海飞田通信股份有限公司 Taxi running track monitoring and safety early warning system
CN110085007A (en) * 2019-04-17 2019-08-02 万翼科技有限公司 Safety rope, warning device and the alarm method based on safety rope
CN111932046A (en) * 2019-05-13 2020-11-13 阿里巴巴集团控股有限公司 Method for processing risk in service scene, computer equipment and storage medium
CN110213516A (en) * 2019-05-22 2019-09-06 未来(北京)黑科技有限公司 Vehicular video recording method, device, storage medium and electronic device
CN110210772A (en) * 2019-06-09 2019-09-06 张子洋 A kind of net about vehicle security management and control implementation method
CN110580799A (en) * 2019-06-19 2019-12-17 四川鼎鸿物联网科技有限公司 taxi network taxi appointment driver and passenger speaking automatic pre-judgment alarm system
CN110288796A (en) * 2019-06-21 2019-09-27 浙江大华技术股份有限公司 Vehicle monitoring method and device, storage medium, electronic device
CN110458604A (en) * 2019-07-17 2019-11-15 中国第一汽车股份有限公司 A kind of net about driver's evaluation method, device, equipment and storage medium
CN110365685A (en) * 2019-07-18 2019-10-22 恒生电子股份有限公司 A kind of data processing method, device, equipment and computer readable storage medium
CN112419661A (en) * 2019-08-20 2021-02-26 北京国双科技有限公司 Danger identification method and device
CN110525445A (en) * 2019-08-30 2019-12-03 南京领行科技股份有限公司 A kind of control method of vehicle driving, device, equipment, medium and vehicle
CN112519787A (en) * 2019-08-30 2021-03-19 南京领行科技股份有限公司 Vehicle control system and vehicle
CN110706700A (en) * 2019-09-29 2020-01-17 深圳市元征科技股份有限公司 In-vehicle disturbance prevention alarm method and device, server and storage medium
CN111488784A (en) * 2019-10-30 2020-08-04 四川鼎鸿物联网科技有限公司 5G communication open type taxi or network taxi appointment intelligent driving comprehensive management service platform
CN111132084A (en) * 2019-12-19 2020-05-08 南京领行科技股份有限公司 In-vehicle communication response system, method, device, in-vehicle central control and storage medium
CN111132084B (en) * 2019-12-19 2023-08-08 南京领行科技股份有限公司 In-vehicle communication response system, method and device, vehicle-mounted central control and storage medium
CN113538842A (en) * 2020-04-16 2021-10-22 上海汽车集团股份有限公司 Alarm system of network appointment car
CN111832409A (en) * 2020-06-08 2020-10-27 深圳市金溢科技股份有限公司 Face matching method of network car booking, cloud platform and network car booking ETC device
CN111832409B (en) * 2020-06-08 2024-04-30 深圳市金溢科技股份有限公司 Face matching method of network vehicle, cloud platform and network vehicle ETC equipment
CN112071309A (en) * 2020-09-17 2020-12-11 苏州上下文人工智能技术研发有限公司 Network appointment car safety monitoring device and system
CN112071309B (en) * 2020-09-17 2023-12-01 苏州上下文人工智能技术研发有限公司 Network appointment vehicle safety monitoring device and system
CN112423406A (en) * 2020-09-23 2021-02-26 大众问问(北京)信息科技有限公司 Network appointment safety supervision method and related equipment
CN112423406B (en) * 2020-09-23 2023-07-25 大众问问(北京)信息科技有限公司 Network appointment vehicle safety supervision method and related equipment
CN113129551A (en) * 2021-03-23 2021-07-16 广州宸祺出行科技有限公司 Method, system, medium and equipment for automatically alarming through micro-expression of driver
CN113591690A (en) * 2021-07-29 2021-11-02 深圳昌恩智能股份有限公司 Running monitoring method for network taxi booking/taxi

Similar Documents

Publication Publication Date Title
CN108961669A (en) The safe early warning method and device, storage medium, server of net about vehicle
US11249544B2 (en) Methods and systems for using artificial intelligence to evaluate, correct, and monitor user attentiveness
US20200342241A1 (en) Providing autonomous vehicle assistance
JP6930765B2 (en) Method and device for warning the driver's abnormal condition detected by utilizing the human condition recognition by V2V connection {METHOD AND DEVICE FOR ALERTING ABNORMAL DRIVER SITUATION DATETED BY USING HUMANS'STATTUS RECODE
CN104916138B (en) The processing method of information of vehicles, system, mobile unit and server
CN107705552A (en) A kind of Emergency Vehicle Lane takes behavioral value method, apparatus and system
Ji et al. Poltergeist: Acoustic adversarial machine learning against cameras and computer vision
CN109733391A (en) Control method, device, equipment, vehicle and the storage medium of vehicle
CN107031628A (en) Use the collision avoidance of audible data
CN107564363A (en) A kind of method and apparatus for driving model switching
CN109345829A (en) Monitoring method, device, equipment and the storage medium of unmanned vehicle
CN109101011A (en) Sensor monitoring method, device, equipment and the storage medium of automatic driving vehicle
JP2020508254A (en) Self-driving vehicle training
US10948915B2 (en) Computer-assisted or autonomous driving vehicle incident management method and apparatus
CN107329478A (en) A kind of life detection car, wearable device and virtual reality detection system
EP3588372A1 (en) Controlling an autonomous vehicle based on passenger behavior
US11315349B2 (en) Method, apparatus and device for identifying passenger state in unmanned vehicle, and storage medium
CN106809214A (en) A kind of rear-end collision method for early warning, device and electronic equipment
JP2020126629A (en) Method of monitoring blind spot of motorcycle using smart helmet for motorcycle rider and blind spot monitoring device using the same
EP4042322A1 (en) Methods and systems for using artificial intelligence to evaluate, correct, and monitor user attentiveness
CN109977771A (en) Verification method, device, equipment and the computer readable storage medium of driver identification
JP2009070344A (en) Image recognition device, image recognition method, and electronic control device
CN110525445A (en) A kind of control method of vehicle driving, device, equipment, medium and vehicle
CN109859085A (en) Safe early warning method and Related product
Marcondes et al. In-vehicle violence detection in carpooling: a brief survey towards a general surveillance system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20181207

RJ01 Rejection of invention patent application after publication