CN112115887A - Monitoring method, vehicle-mounted terminal and computer storage medium - Google Patents
Monitoring method, vehicle-mounted terminal and computer storage medium Download PDFInfo
- Publication number
- CN112115887A CN112115887A CN202011003215.0A CN202011003215A CN112115887A CN 112115887 A CN112115887 A CN 112115887A CN 202011003215 A CN202011003215 A CN 202011003215A CN 112115887 A CN112115887 A CN 112115887A
- Authority
- CN
- China
- Prior art keywords
- monitoring task
- target
- monitoring
- vehicle
- task
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 210
- 238000000034 method Methods 0.000 title claims abstract description 46
- 230000000007 visual effect Effects 0.000 claims description 45
- 238000004590 computer program Methods 0.000 claims description 8
- 239000013589 supplement Substances 0.000 claims description 5
- 230000003993 interaction Effects 0.000 abstract description 8
- 230000007613 environmental effect Effects 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000002093 peripheral effect Effects 0.000 description 5
- 238000012790 confirmation Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000006855 networking Effects 0.000 description 4
- 241001465754 Metazoa Species 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000010295 mobile communication Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 241000894007 species Species 0.000 description 2
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 241001061106 Sargocentron rubrum Species 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000002730 additional effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 229920000642 polymer Polymers 0.000 description 1
- 239000000047 product Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0841—Registering performance data
- G07C5/085—Registering performance data using electronic data carriers
- G07C5/0866—Registering performance data using electronic data carriers the electronic data carrier being a digital video recorder in combination with video camera
Abstract
The invention discloses a monitoring method, which is applied to a vehicle-mounted terminal and comprises the following steps: receiving voice information; identifying a monitoring task contained in the voice information, wherein the monitoring task comprises a target characteristic, a motion characteristic and a result feedback mode; and if the monitoring task executing capability is available, starting the data acquisition equipment to execute the monitoring task. The invention can realize the intelligent monitoring of the vehicle on the movable target or the environmental characteristics through voice interaction, and improve the user experience.
Description
Technical Field
The present invention relates to the field of monitoring, and in particular, to a monitoring method, a vehicle-mounted terminal, and a computer storage medium.
Background
The driving environment is generally monitored through the automobile data recorder in the use process of the vehicle. The automobile data recorder records video images and sound of the whole automobile driving process, and can provide evidence for traffic accidents. However, the simple image recording method lacks interaction with users, and the operation experience is general. Meanwhile, the recording mode cannot carry out targeted monitoring on the target which is interested by the user, the recorded content is redundant and lacks key points, so that the user is very troublesome to extract the corresponding recorded segment as required, and needs to watch the video for a long time afterwards.
Disclosure of Invention
The invention aims to provide a monitoring method, a vehicle-mounted terminal and a computer storage medium, which can realize intelligent monitoring through voice interaction and improve user experience.
In order to solve the above technical problem, the present application provides a monitoring method applied to a vehicle-mounted terminal, including:
receiving voice information;
identifying a monitoring task contained in the voice information, wherein the monitoring task comprises a target characteristic, a motion characteristic and a result feedback mode;
and if the monitoring task has the capability of executing the monitoring task, starting data acquisition equipment and executing the monitoring task.
Wherein, the identifying the monitoring task contained in the voice information comprises:
extracting a monitoring task contained in the voice information, wherein the monitoring task comprises a target characteristic, a motion characteristic and a result feedback mode;
judging whether the extracted monitoring task is complete;
if the task is not complete, prompting to adjust the monitoring task;
and if so, judging whether the monitoring task has the capability of executing the monitoring task.
Wherein the determining whether the capability of executing the monitoring task is available includes:
judging whether the target characteristics and the motion characteristics have the capability of acquiring the target characteristics and the motion characteristics, the capability of performing visual analysis on the target characteristics and the capability of executing the result feedback mode;
and if so, the monitoring task executing capability is provided.
Wherein the determining whether the capability of performing visual analysis on the target feature is available comprises:
when the target features do not comprise preset targets, judging whether the image information and other feature information in the target features have the capacity of identifying the image information and other feature information in the target features according to an existing visual analysis model;
if not, acquiring a visual analysis model for analyzing the corresponding characteristics from the server;
and if the acquisition is successful, determining that the target features have the capability of performing visual analysis.
Wherein, judging whether the ability of performing visual analysis on the target feature is provided further comprises:
if the acquisition fails, determining that the target characteristics do not have the capability of performing visual analysis;
prompting for adjustment of the target feature and displaying an optional existing target feature on the screen.
Wherein the determining whether the capability of performing visual analysis on the target feature is available comprises:
when the target feature comprises a preset target, searching image information for identifying the preset target;
searching image information corresponding to the preset target in preset image information stored in the vehicle-mounted terminal and/or the server;
if the image information corresponding to the preset target is not found, prompting to supplement the image information;
and if the image information corresponding to the preset target is found, the step of judging whether the image information and other feature information in the target feature have the capability of identifying the image information and the other feature information according to the existing visual analysis model is carried out.
Wherein judging whether the capability of collecting the target feature and the motion feature is provided comprises:
judging whether the motion characteristics are in the acquisition range of the acquisition equipment or not;
if not, prompting to adjust the motion characteristics, and displaying the optional existing motion characteristics on the screen.
Wherein, data acquisition equipment is the camera, carry out the monitor task includes:
starting the camera and collecting images and/or videos;
carrying out visual analysis on the acquired images and/or videos, and judging whether the target characteristics and/or the motion characteristics of the monitoring task are matched or not;
and if the monitoring task is matched with the monitoring task, feeding back a monitoring result according to a result feedback mode of the monitoring task.
The result feedback mode comprises at least one of message pushing, video and/or picture taking tracking, flashing light reminding, voice reminding, loudspeaker reminding, recording and vehicle ignition pushing to the mobile terminal and/or the vehicle-mounted terminal.
Wherein, before executing the monitoring task, the method further comprises:
generating key information of the monitoring task;
outputting key information of the monitoring task by voice and/or displaying the key information of the monitoring task on a screen;
and after receiving the instruction for confirming the execution of the monitoring task, executing the monitoring task.
The present application further provides a vehicle-mounted terminal, including:
at least one processor;
at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions when executed by the at least one processor causing the device to perform a monitoring method as described above.
The present application further provides a computer storage medium having computer program instructions stored thereon; which computer program instructions, when executed by a processor, implement the monitoring method as described above.
The monitoring method, the vehicle-mounted terminal and the computer storage medium comprise the following steps: receiving voice information; identifying a monitoring task contained in the voice information, wherein the monitoring task comprises a target characteristic, a motion characteristic and a result feedback mode; and if the monitoring task executing capability is available, starting the data acquisition equipment to execute the monitoring task. The invention can realize the intelligent monitoring of the vehicle on the movable target or the environmental characteristics through voice interaction, and improve the user experience.
The foregoing description is only an overview of the technical solutions of the present application, and in order to make the technical means of the present application more clearly understood, the present application may be implemented in accordance with the content of the description, and in order to make the above and other objects, features, and advantages of the present application more clearly understood, the following preferred embodiments are described in detail with reference to the accompanying drawings.
Drawings
Fig. 1 is an application environment diagram of a monitoring method according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart diagram illustrating a monitoring method according to an embodiment of the present invention;
FIG. 3 is a detailed flow chart of a monitoring method according to an embodiment of the present invention;
FIG. 4 is one of schematic structural diagrams of a vehicle-mounted terminal according to an embodiment of the present invention;
fig. 5 is a second schematic configuration diagram of the in-vehicle terminal shown in fig. 4.
Detailed Description
The following description of the embodiments of the present application is provided for illustrative purposes, and other advantages and capabilities of the present application will become apparent to those skilled in the art from the present disclosure.
In the following description, reference is made to the accompanying drawings that describe several embodiments of the application. It is to be understood that other embodiments may be utilized and that mechanical, structural, electrical, and operational changes may be made without departing from the spirit and scope of the present application. The following detailed description is not to be taken in a limiting sense, and the scope of embodiments of the present application is defined only by the claims of the issued patent. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application.
Although the terms first, second, etc. may be used herein to describe various elements in some instances, these elements should not be limited by these terms. These terms are only used to distinguish one element from another.
Also, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes" and/or "including," when used in this specification, specify the presence of stated features, steps, operations, elements, components, items, species, and/or groups, but do not preclude the presence, or addition of one or more other features, steps, operations, elements, components, species, and/or groups thereof. The terms "or" and/or "as used herein are to be construed as inclusive or meaning any one or any combination. Thus, "A, B or C" or "A, B and/or C" means "any of the following: a; b; c; a and B; a and C; b and C; A. b and C ". An exception to this definition will occur only when a combination of elements, functions, steps or operations are inherently mutually exclusive in some way.
Fig. 1 is a schematic application environment diagram of a monitoring method according to an embodiment of the present invention, including a vehicle 11, a vehicle-mounted terminal 12, and a camera 13. It should be understood that the number of vehicles 11, servers 12, and cameras 13 and their mounting positions in fig. 1 are merely illustrative. There may be any number of vehicles 11, servers 12, and cameras 13 associated, as the implementation requires. The in-vehicle terminal is a device installed on a console of an automobile and used for information interaction between a person and the automobile, the in-vehicle terminal 12 and the camera 13 provide a communication link medium through a network, and the network may be a mobile communication network, for example, a wireless fidelity network, a long term evolution network, a 4G network, or a 5G network. The vehicle-mounted terminal 12 receives voice information sent by a user through a microphone, and the camera 13 may be provided with a microphone, connected with a microphone in a vehicle or a mobile phone microphone, or integrated in multiple ways. The vehicle-mounted terminal 12 analyzes and identifies the monitoring task from the voice information, confirms the content of the monitoring task with the user through voice interaction, and feeds back the monitoring result according to a result feedback mode after finding the monitoring target according to the corresponding monitoring task, so that intelligent monitoring is realized, and the timeliness and effectiveness of feedback of the monitoring target can be improved.
Fig. 2 is a flow chart diagram illustrating a monitoring method according to an embodiment of the present invention. As shown in fig. 2, a monitoring method provided for an embodiment of the present invention includes:
step 201: receiving voice information;
step 202: identifying a monitoring task contained in the voice information, wherein the monitoring task comprises a target characteristic, a motion characteristic and a result feedback mode;
step 203: and if the monitoring task executing capability is available, starting the data acquisition equipment to execute the monitoring task.
In this embodiment, after the user sends out the voice information, the voice information can be collected and sent to the vehicle-mounted terminal through the vehicle-mounted microphone, the camera, the microphone of the vehicle-mounted microphone or the mobile phone microphone. The vehicle-mounted terminal analyzes the target characteristics, the motion characteristics and the result feedback mode of the monitoring task contained in the voice information through methods of voice recognition, semantic recognition, keyword matching and the like. And evaluating whether the monitoring task has the capability of executing the monitoring task according to the specific content of the monitoring task. If the vehicle-mounted terminal has the capability of executing the monitoring task, repeating key information of the task to the user, such as target characteristics, motion characteristics and a result feedback mode, and continuously sending language information to send an execution confirmation instruction when the user feels that the vehicle-mounted terminal correctly understands the monitoring task. The vehicle-mounted terminal receiving the task can utilize the camera, the sensor and the computer operation capacity of the vehicle to intelligently analyze the collected vehicle surrounding environment information and present the analysis result to the user through the internet of vehicles. The invention combines the data acquisition capacity of the vehicle and the operational capacity of the vehicle-mounted terminal to complete video analysis and execute monitoring tasks, thereby enabling a user to acquire the monitoring content acquired by the vehicle in time in any networking scene.
In this embodiment, in step 202, when the monitoring task included in the voice information is recognized, the vehicle-mounted terminal firstly analyzes the target feature, the motion feature and the result feedback mode of the monitoring task by using methods such as voice recognition, semantic recognition, keyword matching and the like. For example, when a monitoring task is issued in voice, a prefix "monitoring task" is added to identify the start of the monitoring task, a prefix "target" is added to identify the content of a target feature, a prefix "position" is added to identify the content of a motion feature, and a prefix "feedback" is added to identify the content of a result feedback mode. Specific content is entered after a specific prefix, such as, for example, a user's "location: presence directly in front of the door ", or" position: the camera is currently facing a position occurrence ", or" position: the expression that the driving door and window position on the left side of the vehicle appears' expresses the specific content of the motion characteristics in the monitoring task. After the monitoring task contained in the voice information is extracted, whether the extracted monitoring task is complete or not is judged, namely whether the monitoring task comprises a target characteristic, a motion characteristic and a result feedback mode or not is judged. If the monitoring task is not complete, the user is prompted to adjust the monitoring task to supplement or replace the monitoring task, optional monitoring tasks can be recommended according to the collected part of the monitoring task content, and the user can directly select the monitoring tasks at the vehicle-mounted terminal or the mobile phone terminal. And if the monitoring task is complete, judging whether the monitoring task has the capability of executing the monitoring task.
In this embodiment, when determining whether the capability of executing the monitoring task is available, it may be determined whether the capability of acquiring the target feature and the motion feature, the capability of performing the visual analysis on the target feature, and the capability of executing the result feedback mode are available at the same time. If the above conditions are met, it is determined that the monitoring task has the capability of executing the monitoring task, and step 203 may be continued to start the data acquisition device to execute the monitoring task.
Specifically, in determining whether the ability to visually analyze the target feature is available, the target feature includes a target, a target appearance, a target age, a target category, and the like. And if the target feature contains the preset target, searching image information for identifying the preset target. For example, when the preset target is "wife", the system searches for image information named "wife", or searches for image data of which the registered user is "wife", or the like. Image information corresponding to a preset target can be searched in an image information base stored in the vehicle-mounted terminal and/or the server; if the image information corresponding to the preset target is not found, a notice for prompting the supplement of the image information can be sent to the user; and if the image information corresponding to the preset target is found, judging whether the image information and other characteristic information in the target characteristic have the capability of identifying the image information and other characteristic information according to the existing visual analysis model. If the existing visual analysis model does not have the capacity of identifying image information and other feature information in the target features, the visual analysis model for analyzing the corresponding features is obtained from the server; and if the acquisition is successful, determining that the target features have the capability of performing visual analysis. And downloading the target characteristics which cannot be identified to the cloud end to search the visual model. If the interior of the vehicle is lack of the task visual model, the vehicle can be inquired and downloaded to the cloud, and a user confirmation or payment downloading link can be added according to product requirements in the process. Whether the existing visual model preset in the vehicle is qualified for a visual analysis task is checked, for example, a target characteristic is that a customer wearing a specific person is monitored, the vehicle-mounted terminal visual model is required to be subjected to clothes analysis, the gender analysis model capability is required, the face recognition capability is required for accurately monitoring the specific person, the age analysis capability on the basis that the old, the child, the middle-aged person and the old need faces is monitored and distinguished, and the animal matching model capability is required for monitoring animals. If the visual model required by the monitoring target identification in the monitoring task cannot be downloaded, the user can be prompted by voice that the current monitoring task cannot be completed, the monitoring target is recommended to be replaced, and other related identifiable target characteristics are provided to be displayed on a screen of the vehicle-mounted terminal, so that the user can conveniently select and adjust.
When judging whether possess the ability of gathering target feature and motion feature, judge whether the motion feature is in the collection scope of collection equipment, confirm that the position that the target appears and the space range of motion feature whether in the scope that the camera supports the discernment promptly, if "the door appears directly in the front", or "the camera is present towards the position and appears", or "the left side of the car drives door and window position and appears", the motion feature can be from left to right, or from right to left, limbs touch certain position of vehicle, get close to the vehicle earlier and keep away from etc.. And if the motion characteristics exceed the range which can be acquired by the camera, prompting to adjust the motion characteristics, and displaying optional existing motion characteristics on a screen.
And when judging whether the capability of executing the result feedback mode exists or not, searching whether the result feedback mode of the current monitoring task exists or not in the existing result feedback mode, if so, judging that the capability of executing the result feedback mode exists, and if not, providing a user to adjust the result feedback mode or adding a new result feedback mode in the system. The result feedback mode comprises at least one of message pushing, video and/or picture taking tracking, flashing light reminding, voice reminding, loudspeaker reminding, recording and vehicle ignition. The result feedback mode can be notified through an internet of vehicles APP, or a telephone notification or a short message notification, or an in-vehicle reminder. Or intelligently reminding: the user is reminded in the preferential car in the car, and the user is then reminded through the car networking APP on line not at car networking APP, and the user car networking APP account looks sideways at the preferential degree on line and reminds through little letter, SMS or phone.
In one embodiment, when the acquisition equipment is a camera, the camera can be started by executing the monitoring task, and images and/or videos are acquired; carrying out visual analysis on the acquired images and/or videos, and judging whether the target characteristics and/or the motion characteristics of the monitoring task are matched or not; and if the monitoring task is matched with the monitoring task, feeding back a monitoring result according to a result feedback mode of the monitoring task.
In this embodiment, step 203, before executing the monitoring task, further includes: generating key information of a monitoring task; repeating the monitoring tasks by voice and/or displaying key information of the monitoring tasks on a screen; and after receiving the instruction for confirming the execution of the monitoring task, executing the monitoring task. And the vehicle-mounted terminal combines the target characteristics, the appearance characteristics and the movement characteristics of the task, the matched action and the additional action into a sentence, reads the sentence for the user, and acquires a command for starting execution or cancellation of the voice of the user.
The monitoring method comprises the following steps: receiving voice information; identifying a monitoring task contained in the voice information, wherein the monitoring task comprises a target characteristic, a motion characteristic and a result feedback mode; and if the monitoring task executing capability is available, starting the data acquisition equipment to execute the monitoring task. The invention can realize intelligent monitoring through voice interaction and improve user experience.
Fig. 3 is a specific flowchart illustrating a monitoring method according to an embodiment of the present invention. As shown in fig. 3, before receiving the voice information and performing the monitoring task, the user may select a desired visual analysis model, such as visual recognition models for people, animals, and vehicles, respectively, on the vehicle-mounted terminal interface or the vehicle-associated APP interface. Then downloaded and stored locally for use at any time. Then, the user can issue a monitoring task through voice, and the system analyzes the voice information keywords to identify the specific content of the monitoring task. And then, confirming whether a corresponding visual model exists according to the monitoring task, and setting according to a result feedback mode of the monitoring task. And sending the sorted monitoring task content to a user for confirmation, starting a data acquisition device for acquisition after a user confirmation instruction is obtained, and continuously acquiring a video stream if a camera is started and the angle or the position is adjusted according to the motion characteristic of the target for shooting. Meanwhile, the video stream is analyzed, if the target matches the monitoring task content, a corresponding result feedback mode is executed, for example, a message is pushed to the user, a photo, a video or a text description of the monitoring task can be pushed through the vehicle-connected APP, and a short message or a call can be directly sent to the user, so that the feedback instantaneity is guaranteed. In the task execution process, a user can cancel the task being executed through a vehicle-mounted terminal screen operation interface or the Internet of vehicles APP.
In light of the foregoing, the present invention is particularly applicable to the following scenarios.
Scene one
The user takes the child to drive back to the old in the countryside for years, the parents are busy in housework, and worry simultaneously that the child leaves the sight range, can stop the car in the courtyard, and the front camera of the car faces the family, and the monitoring task is assigned to pronunciation: "love car, add the monitoring task, the goal: child, appearance location: directly in front of the vehicle, feeding back: after the discovery, the telephone notifies me, then starts video tracking, and carries out voice prompt: "father does not allow you to go outside to play to get home. "the vehicle-mounted terminal judges whether the task can be accepted after voice recognition and semantic analysis, if yes, the task is answered" good, i have successfully accepted the task, before you drive the car next time or remotely remove the task, i will monitor the front to capture the target: kids, call you immediately after the target has moved too much, and use the speaker to indicate "dad does not allow you to go outside to catch up home". And then performing camera view movement tracking shooting on the target.
Scene two
The vehicle of the user is often scratched or pasted with small advertisements outside, and the user gives a voice task to the vehicle when leaving: "love car, add the monitoring task, the goal: monitoring car-rowing and advertising advertisers, location of occurrence: contacting the vehicle body, and feeding back: follow up taking pictures and notify me in time. After recognizing voice and performing semantic analysis, the vehicle-mounted terminal judges whether the task can be received or not, if yes, the vehicle-mounted terminal replies that the task has been received and a target stranger is close to a vehicle and is in contact with the vehicle body, the vehicle-mounted terminal automatically takes a picture and sends the picture to inform the user through the internet of vehicles APP. And then starting a camera for monitoring.
Scene three
The user stops the vehicle at a certain client such as a certain restaurant door, and the user does not determine when the client can come out of the restaurant, so that the vehicle is given a monitoring task, namely' love the vehicle, and the monitoring task is added to aim at: customer, red coat jacket, black skirt, long hair, position: restaurant door, feedback: if a suspected target is found, please prompt me with voice. The vehicle replaces the user to perform the monitoring task until the user is found to go out to prompt the user through voice, and therefore time and energy of the user are greatly saved.
The embodiment of the invention fully utilizes the camera and the visual analysis capability of the vehicle, helps the user monitor the interested target and timely records and timely informs the user, increases the process of intelligent analysis compared with the traditional video monitoring, does not need to reprocess and sort the video according to the specific target, can interact with the user by voice, and utilizes the vehicle to create a mobile monitoring analysis tool.
As shown in fig. 4, the present application also provides an in-vehicle terminal 10 applied to a vehicle, including: the processor 102 and the memory 106 storing the computer program, when the processor 102 runs the computer program, the monitoring method implemented includes:
receiving voice information;
identifying a monitoring task contained in the voice information, wherein the monitoring task comprises a target characteristic, a motion characteristic and a result feedback mode;
and if the monitoring task executing capability is available, starting the data acquisition equipment to execute the monitoring task.
In one embodiment, the processor 102 performs the step of identifying the monitoring task contained in the voice message, including:
extracting a monitoring task contained in the voice information, wherein the monitoring task comprises a target characteristic, a motion characteristic and a result feedback mode;
judging whether the extracted monitoring task is complete;
if the task is not complete, prompting to adjust the monitoring task;
and if so, executing a step of judging whether the monitoring task executing capability is available.
In one embodiment, the processor 102 performs the step of determining whether it has the capability to perform the monitoring task, including:
judging whether the target characteristics and the motion characteristics have the capability of acquiring the target characteristics and the motion characteristics, the capability of performing visual analysis on the target characteristics and the capability of executing a result feedback mode;
and if so, the monitoring system has the capability of executing the monitoring task.
In one embodiment, the target feature comprises at least one of a target, a target appearance, a target age, and a target type, and the processor 102 performs the step of determining whether the capability of visual analysis of the target feature is available, including:
when the target characteristics comprise a preset target, searching image information for identifying the preset target;
judging whether the capacity of recognizing image information and other characteristic information in the target characteristic is provided or not according to the existing visual analysis model;
if not, acquiring a visual analysis model for analyzing the corresponding characteristics from the server;
and if the acquisition is successful, determining that the target features have the capability of performing visual analysis.
In one embodiment, the processor 102 performs the step of determining whether the capability of performing the visual analysis on the target feature is available, and further comprises:
if the acquisition fails, determining that the target characteristics do not have the capability of performing visual analysis;
prompting for adjustment of the target feature and displaying an optional existing target feature on the screen.
In one embodiment, the processor 102 performs the step of searching for image information for identifying a preset target, including:
searching image information corresponding to a preset target in preset image information stored in a vehicle-mounted terminal and/or a server;
if the image information corresponding to the preset target is not found, prompting to supplement the image information;
and if the image information corresponding to the preset target is found, judging whether the image information and other characteristic information in the target characteristic have the capability of identifying the image information and other characteristic information according to the existing visual analysis model.
In one embodiment, the processor 102 performs the step of determining whether the capability of acquiring the target feature and the motion feature is available, including:
judging whether the motion characteristics are in the acquisition range of the acquisition equipment or not;
if not, prompting to adjust the motion characteristics, and displaying the optional existing motion characteristics on the screen.
In one embodiment, the acquisition device is a camera, and the processor 102 performs the step of performing the monitoring task, including:
starting a camera, and collecting images and/or videos;
carrying out visual analysis on the acquired images and/or videos, and judging whether the target characteristics and/or the motion characteristics of the monitoring task are matched or not;
and if the monitoring task is matched with the monitoring task, feeding back a monitoring result according to a result feedback mode of the monitoring task.
In one embodiment, the result feedback mode comprises at least one of pushing a message, video and/or photo tracking, flashing light reminding, voice reminding, speaker reminding, recording and vehicle ignition to the mobile terminal and/or the vehicle terminal.
In one embodiment, before the step of performing the monitoring task by the processor 102, the method further includes:
generating key information of a monitoring task;
repeating the monitoring tasks by voice and/or displaying key information of the monitoring tasks on a screen;
and after receiving the instruction for confirming the execution of the monitoring task, executing the monitoring task.
The specific process of executing the above steps by the processor 102 of this embodiment is described in detail in the related description of the embodiment of the monitoring method, and is not described herein again.
Referring to fig. 5, in practical implementation, the in-vehicle terminal 10 includes a memory 102, a storage controller 104, one or more processors 106 (only one of which is shown), a peripheral interface 108, a radio frequency module 150, a positioning module 112, a camera module 114, an audio module 116, a screen 118, and a key module 160. These components communicate with each other via one or more communication buses/signal lines 122.
It is to be understood that the configuration shown in fig. 5 is merely an illustration, and the in-vehicle terminal 10 may include more or less components than those shown in fig. 5, or have a different configuration than that shown in fig. 5. The components shown in fig. 5 may be implemented in hardware, software, or a combination thereof.
The memory 102 may be used to store software programs and modules, such as program instructions/modules corresponding to the monitoring method in the embodiment of the present application, and the processor 106 executes various functional applications and data processing by executing the software programs and modules stored in the storage controller 104, so as to implement the monitoring method described above.
The memory 102 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 102 may further include memory located remotely from the processor 106, which may be connected to the in-vehicle terminal 10 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof. Access to the memory 102 by the processor 106, and possibly other components, may be under the control of the memory controller 104.
In some embodiments, the peripheral interface 108, the processor 106, and the memory controller 104 may be implemented in a single chip. In other examples, they may be implemented separately from the individual chips.
The rf module 150 is used for receiving and transmitting electromagnetic waves, and implementing interconversion between the electromagnetic waves and electrical signals, so as to communicate with a communication network or other devices. Rf module 150 may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a Subscriber Identity Module (SIM) card, memory, and so forth. The rf module 150 may communicate with various networks such as the internet, an intranet, a wireless network, or with other devices via a wireless network. The positioning module 112 is used for acquiring the current position of the in-vehicle terminal 10. Examples of the positioning module 112 include, but are not limited to, a global positioning satellite system (GPS), a wireless local area network-based positioning technology, or a mobile communication network-based positioning technology.
The camera module 114 is used to take a picture or video. The pictures or videos taken may be stored in the memory 102 and transmitted through the radio frequency module 150.
The screen 118 provides an output interface between the in-vehicle terminal 10 and the user. In particular, screen 118 displays video output to the user, the content of which may include text, graphics, video, and any combination thereof. Some of the output results are for some of the user interface objects. It is understood that the screen 118 may also include a touch screen. The touch screen provides both an output and an input interface between the in-vehicle terminal 10 and the user. In addition to displaying video output to users, touch screens also receive user input, such as user clicks, swipes, and other gesture operations, so that user interface objects respond to these user input. The technique of detecting user input may be based on resistive, capacitive, or any other possible touch detection technique. Specific examples of touch screen display units include, but are not limited to, liquid crystal displays or light emitting polymer displays.
The key module 160 also provides an interface for a user to input to the in-vehicle terminal 10, and the user can cause the in-vehicle terminal 10 to perform different functions by pressing different keys.
The vehicle-mounted terminal of the embodiment receives voice information; identifying a monitoring task contained in the voice information, wherein the monitoring task comprises a target characteristic, a motion characteristic and a result feedback mode; and if the monitoring task executing capability is available, starting the data acquisition equipment to execute the monitoring task. The invention can realize intelligent monitoring through voice interaction and improve user experience.
The present application further provides a computer storage medium having computer program instructions stored thereon; the computer program instructions, when executed by a processor, implement the monitoring method as described in the above embodiments.
In practical implementation, the computer storage medium is applied to the vehicle-mounted terminal shown in fig. 4 or fig. 5, so that intelligent monitoring is realized. The above embodiments are merely illustrative of the principles and utilities of the present application and are not intended to limit the application. Any person skilled in the art can modify or change the above-described embodiments without departing from the spirit and scope of the present application. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical concepts disclosed in the present application shall be covered by the claims of the present application.
Claims (12)
1. A monitoring method is applied to a vehicle-mounted terminal and is characterized by comprising the following steps:
receiving voice information;
identifying a monitoring task contained in the voice information, wherein the monitoring task comprises a target characteristic, a motion characteristic and a result feedback mode;
and if the monitoring task has the capability of executing the monitoring task, starting data acquisition equipment and executing the monitoring task.
2. The monitoring method according to claim 1, wherein the recognizing the monitoring task included in the voice message includes:
extracting a monitoring task contained in the voice information, wherein the monitoring task comprises a target characteristic, a motion characteristic and a result feedback mode;
judging whether the extracted monitoring task is complete;
if the task is not complete, prompting to adjust the monitoring task;
and if so, judging whether the monitoring task has the capability of executing the monitoring task.
3. The monitoring method of claim 2, wherein the determining whether the capability to perform the monitoring task is available comprises:
judging whether the target characteristics and the motion characteristics have the capability of acquiring the target characteristics and the motion characteristics, the capability of performing visual analysis on the target characteristics and the capability of executing the result feedback mode;
and if so, the monitoring task executing capability is provided.
4. The method of claim 3, wherein the determining whether the target feature is capable of visual analysis comprises:
when the target features do not comprise preset targets, judging whether the image information and other feature information in the target features have the capacity of identifying the image information and other feature information in the target features according to an existing visual analysis model;
if not, acquiring a visual analysis model for analyzing the corresponding characteristics from the server;
and if the acquisition is successful, determining that the target features have the capability of performing visual analysis.
5. The method of monitoring of claim 4, wherein said determining whether the target feature is capable of visual analysis further comprises:
if the acquisition fails, determining that the target characteristics do not have the capability of performing visual analysis;
prompting for adjustment of the target feature and displaying an optional existing target feature on the screen.
6. The method of claim 3, wherein determining whether the target feature is capable of visual analysis comprises:
when the target feature comprises a preset target, searching image information for identifying the preset target;
searching image information corresponding to the preset target in preset image information stored in the vehicle-mounted terminal and/or the server;
if the image information corresponding to the preset target is not found, prompting to supplement the image information;
and if the image information corresponding to the preset target is found, the step of judging whether the image information and other feature information in the target feature have the capability of identifying the image information and the other feature information according to the existing visual analysis model is carried out.
7. The monitoring method of claim 3, wherein the determining whether the target feature and the motion feature are capable of being collected comprises:
judging whether the motion characteristics are in the acquisition range of the acquisition equipment or not;
if not, prompting to adjust the motion characteristics, and displaying the optional existing motion characteristics on the screen.
8. The monitoring method according to claim 1, wherein the data acquisition device is a camera, and the performing the monitoring task comprises:
starting the camera and collecting images and/or videos;
carrying out visual analysis on the acquired images and/or videos, and judging whether the target characteristics and/or the motion characteristics of the monitoring task are matched or not;
and if the monitoring task is matched with the monitoring task, feeding back a monitoring result according to a result feedback mode of the monitoring task.
9. The monitoring method according to claim 1 or 6, wherein the result feedback manner comprises at least one of pushing a message, video and/or photo tracking, flashing light reminding, voice reminding, speaker reminding, recording and vehicle ignition to a mobile terminal and/or the vehicle-mounted terminal.
10. The monitoring method of claim 1, wherein prior to performing the monitoring task, further comprising:
generating key information of the monitoring task;
outputting key information of the monitoring task by voice and/or displaying the key information of the monitoring task on a screen;
and after receiving the instruction for confirming the execution of the monitoring task, executing the monitoring task.
11. A vehicle-mounted terminal characterized by comprising:
at least one processor;
at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions when executed by the at least one processor causing the device to perform the monitoring method of any one of claims 1 to 10.
12. A computer storage medium having computer program instructions stored thereon; the computer program instructions, when executed by a processor, implement a monitoring method as claimed in any one of claims 1 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011003215.0A CN112115887B (en) | 2020-09-22 | 2020-09-22 | Monitoring method, vehicle-mounted terminal and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011003215.0A CN112115887B (en) | 2020-09-22 | 2020-09-22 | Monitoring method, vehicle-mounted terminal and computer storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112115887A true CN112115887A (en) | 2020-12-22 |
| CN112115887B CN112115887B (en) | 2024-03-29 |
Family
ID=73800952
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011003215.0A Active CN112115887B (en) | 2020-09-22 | 2020-09-22 | Monitoring method, vehicle-mounted terminal and computer storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112115887B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106992009A (en) * | 2017-05-03 | 2017-07-28 | 深圳车盒子科技有限公司 | Vehicle-mounted voice exchange method, system and computer-readable recording medium |
| WO2017166646A1 (en) * | 2016-03-29 | 2017-10-05 | 乐视控股（北京）有限公司 | In-vehicle voice control method and device, and apparatus |
| US20170339339A1 (en) * | 2016-05-20 | 2017-11-23 | International Business Machines Corporation | Device, system and method for cognitive image capture |
| CN107977183A (en) * | 2017-11-16 | 2018-05-01 | 百度在线网络技术（北京）有限公司 | voice interactive method, device and equipment |
| CN110009900A (en) * | 2019-03-12 | 2019-07-12 | 浙江吉利汽车研究院有限公司 | A kind of vehicle monitoring method and system |
| CN110070889A (en) * | 2019-03-15 | 2019-07-30 | 深圳壹账通智能科技有限公司 | Vehicle monitoring method, device and storage medium, server |
| CN111013138A (en) * | 2019-12-11 | 2020-04-17 | 苏州思必驰信息科技有限公司 | Voice control method and device, electronic equipment and storage medium |
-
2020
- 2020-09-22 CN CN202011003215.0A patent/CN112115887B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017166646A1 (en) * | 2016-03-29 | 2017-10-05 | 乐视控股（北京）有限公司 | In-vehicle voice control method and device, and apparatus |
| US20170339339A1 (en) * | 2016-05-20 | 2017-11-23 | International Business Machines Corporation | Device, system and method for cognitive image capture |
| CN106992009A (en) * | 2017-05-03 | 2017-07-28 | 深圳车盒子科技有限公司 | Vehicle-mounted voice exchange method, system and computer-readable recording medium |
| CN107977183A (en) * | 2017-11-16 | 2018-05-01 | 百度在线网络技术（北京）有限公司 | voice interactive method, device and equipment |
| CN110009900A (en) * | 2019-03-12 | 2019-07-12 | 浙江吉利汽车研究院有限公司 | A kind of vehicle monitoring method and system |
| CN110070889A (en) * | 2019-03-15 | 2019-07-30 | 深圳壹账通智能科技有限公司 | Vehicle monitoring method, device and storage medium, server |
| CN111013138A (en) * | 2019-12-11 | 2020-04-17 | 苏州思必驰信息科技有限公司 | Voice control method and device, electronic equipment and storage medium |
Non-Patent Citations (2)
| Title |
|---|
| CHEE YANG LOH; KAI LUNG BOEY; KAI SZE HONG: "Speech recognition interactive system for vehicle", 2017 IEEE 13TH INTERNATIONAL COLLOQUIUM ON SIGNAL PROCESSING & ITS APPLICATIONS (CSPA) * |
| 黄恒一;丁佳乐;黎顺;康郢芮;付三丽;: "简易分析判断语音识别智能车的设计", 物联网技术, no. 05 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112115887B (en) | 2024-03-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3232343A1 (en) | Method and apparatus for managing video data, terminal, and server | |
| US11520824B2 (en) | Method for displaying information, electronic device and system | |
| US10291767B2 (en) | Information presentation method and device | |
| CN106407984B (en) | Target object identification method and device | |
| CN108182626B (en) | Service pushing method, information acquisition terminal and computer readable storage medium | |
| CN109558512A (en) | A kind of personalized recommendation method based on audio, device and mobile terminal | |
| CN108616448B (en) | Information sharing path recommendation method and mobile terminal | |
| CN107305566B (en) | A kind of method and device to search for information matches picture | |
| CN109257498B (en) | Sound processing method and mobile terminal | |
| CN106131133B (en) | Browsing history record information viewing method, device and system | |
| CN109165292A (en) | Data processing method, device and mobile terminal | |
| CN109032491A (en) | Data processing method, device and mobile terminal | |
| CN104331503A (en) | Information push method and device | |
| CN111666898A (en) | Method and device for identifying class to which vehicle belongs | |
| US10606886B2 (en) | Method and system for remote management of virtual message for a moving object | |
| CN112181564A (en) | Wallpaper generation method, mobile terminal and storage medium | |
| CN106027801A (en) | Method and device for processing communication message and mobile device | |
| CN107895108B (en) | Operation management method and mobile terminal | |
| CN106331281A (en) | Mobile terminal and information processing method | |
| CN109981624A (en) | Intrusion detection method, device and storage medium | |
| CN113139029A (en) | Processing method, mobile terminal and storage medium | |
| CN113032627A (en) | Video classification method and device, storage medium and terminal equipment | |
| CN109670105B (en) | Searching method and mobile terminal | |
| CN110213062B (en) | Method and device for processing message | |
| CN112000266A (en) | Page display method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |