WO2022062775A1 - 一种基于车辆终端系统的监控处理方法、系统及相关设备 - Google Patents

一种基于车辆终端系统的监控处理方法、系统及相关设备 Download PDF

Info

Publication number
WO2022062775A1
WO2022062775A1 PCT/CN2021/113284 CN2021113284W WO2022062775A1 WO 2022062775 A1 WO2022062775 A1 WO 2022062775A1 CN 2021113284 W CN2021113284 W CN 2021113284W WO 2022062775 A1 WO2022062775 A1 WO 2022062775A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
abnormal
terminal system
abnormal condition
alarm
Prior art date
Application number
PCT/CN2021/113284
Other languages
English (en)
French (fr)
Inventor
黄洪光
Original Assignee
恒大新能源汽车投资控股集团有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 恒大新能源汽车投资控股集团有限公司 filed Critical 恒大新能源汽车投资控股集团有限公司
Publication of WO2022062775A1 publication Critical patent/WO2022062775A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18Status alarms
    • G08B21/24Reminder alarms, e.g. anti-loss alarms
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/30Services specially adapted for particular environments, situations or purposes
    • H04W4/38Services specially adapted for particular environments, situations or purposes for collecting sensor information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/30Services specially adapted for particular environments, situations or purposes
    • H04W4/40Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]

Definitions

  • This document relates to the technical field of networking, in particular to a monitoring and processing method, system and related equipment based on a vehicle terminal system.
  • the embodiments of this specification provide a monitoring and processing method, system and related equipment based on a vehicle terminal system, which enable the vehicle terminal system to actively identify abnormal conditions through remote monitoring and give an alarm in time.
  • a monitoring and processing method based on a vehicle terminal system including:
  • the vehicle terminal system obtains the monitoring data collected by the monitoring device set at the target location based on the Internet of Vehicles;
  • the vehicle terminal system extracts the characteristic data from the monitoring data according to the characteristic data representation method required by the preset abnormal condition identification model, and analyzes the target based on the abnormal condition identification model in combination with the characteristic data in the monitoring data.
  • the abnormal situation is identified at the location to obtain an abnormal situation identification result, wherein the abnormal situation identification model is obtained by training according to the characteristic data extracted from the abnormal situation sample and the corresponding abnormal situation classification label;
  • the vehicle terminal system detects the vehicle state of the vehicle when the abnormal state identification result indicates that an abnormal state occurs at the target location, and determines an on-board alarm mode that conforms to the vehicle state;
  • the vehicle terminal system initiates an alarm operation for the abnormal condition identification result according to the determined vehicle alarm mode.
  • a vehicle terminal system including:
  • the data acquisition module based on the Internet of Vehicles, acquires the monitoring data collected by the monitoring device set at the target location;
  • the abnormality identification module extracts characteristic data from the monitoring data according to the characteristic data representation mode required by the pre-set abnormal condition identification model, and analyzes the characteristic data in the monitoring data based on the abnormal condition identification model in combination with the characteristic data in the monitoring data. Identifying the abnormal situation at the target location to obtain an abnormal situation identification result, wherein the abnormal situation identification model is obtained by training according to the characteristic data extracted from the abnormal situation sample and the corresponding abnormal situation classification label;
  • an alarm determination module when the abnormal condition identification result indicates that an abnormal condition occurs at the target location, detects the vehicle state of the vehicle, and determines an on-board alarm mode that conforms to the vehicle state;
  • the alarm execution module initiates an alarm operation for the abnormal condition identification result according to the determined vehicle-mounted alarm mode.
  • an electronic device comprising: a memory, a processor, and a computer program stored on the memory and executable on the processor, the computer program being executed by the processor:
  • the vehicle state of the vehicle is detected, and an on-board alarm mode that conforms to the vehicle state is determined;
  • an alarm operation for the abnormal condition identification result is initiated.
  • a computer-readable storage medium is provided, a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the following steps are implemented:
  • the vehicle state of the vehicle is detected, and an on-board alarm mode that conforms to the vehicle state is determined;
  • an alarm operation for the abnormal condition identification result is initiated.
  • the vehicle terminal system can remotely obtain the monitoring data collected by the monitoring device of the target location through the Internet of Vehicles, and use the abnormal condition recognition model to perform abnormal analysis on the monitoring data, and mechanically determine the target location. Abnormal conditions, so as to carry out the alarm operation for abnormal conditions according to the alarm mode that conforms to the current vehicle state.
  • the vehicle terminal system plays a role in reminding the vehicle personnel in time, which can assist the vehicle personnel to take measures to reduce losses as soon as possible.
  • FIG. 1 is a first schematic flowchart of a monitoring and processing method for a vehicle terminal system provided by an embodiment of the present specification.
  • FIG. 2 is a schematic flowchart of constructing an abnormal situation identification model according to an embodiment of the present specification.
  • FIG. 3 is a second schematic flowchart of a monitoring and processing method for a vehicle terminal system according to an embodiment of the present specification.
  • FIG. 4 is a schematic structural diagram of a vehicle terminal system according to an embodiment of the present specification.
  • FIG. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present specification.
  • the present application aims to propose a technical solution based on a vehicle-mounted product that can actively identify abnormal conditions through remote monitoring and give an alarm in time.
  • FIG. 1 is a flowchart of a monitoring processing method based on a vehicle terminal system according to an embodiment of the present specification. The method shown in FIG. 1 can be executed by the corresponding vehicle terminal system below, including the following steps:
  • the vehicle terminal system acquires the monitoring data collected by the monitoring device disposed at the target location based on the Internet of Vehicles.
  • the vehicle terminal system may, but is not limited to, refer to the central control system of the vehicle.
  • the central control system has the function of human-computer interaction.
  • the monitoring device may include a camera set at the target location, and the monitoring data collected by the camera corresponds to the monitoring image of the target location.
  • the vehicle terminal system can directly establish communication with the monitoring device through the Internet of Vehicles, and obtain the monitoring data transmitted by the monitoring device.
  • the monitoring device uploads the collected monitoring data associated with the vehicle network account to the vehicle network system.
  • the vehicle terminal system responds to the monitoring data call event (the event can be triggered by user operation or periodically), and logs into the vehicle network account based on the vehicle network login to the vehicle network system to download the monitoring data of the target location to the vehicle network system.
  • the vehicle terminal system can detect the current network quality parameters of the vehicle networking of the vehicle, and provide the network quality parameters to the vehicle network system.
  • the vehicle network system compresses the monitoring data of the target location based on the data compression parameters matching the network quality parameters, and then sends the compressed monitoring data to the vehicle terminal system, thereby improving the transmission time of the monitoring data.
  • the vehicle terminal system extracts the characteristic data from the monitoring data according to the characteristic data representation mode required by the preset abnormal condition identification model, and identifies the abnormal condition of the target location based on the abnormal condition identification model and the characteristic data in the monitoring data, An abnormal situation identification result is obtained, wherein the abnormal situation identification model is obtained by training according to the characteristic data extracted from the abnormal situation samples and the corresponding abnormal situation classification labels.
  • some samples of abnormal conditions may be collected in advance, and these samples may be classified and marked with abnormal conditions, so as to construct training data of the abnormal condition recognition model.
  • the feature data extracted from the sample can be used as the input of the abnormal situation recognition model, and the abnormal situation classification label obtained by the sample annotation can be used as the output of the abnormal situation recognition model, so as to carry out supervised training of the abnormal situation recognition model.
  • the training result given by the abnormal situation identification model can be obtained.
  • This training result is the abnormal classification result predicted by the abnormal situation identification model for the sample, and the abnormal classification result may be different from the true value indicated by the previously marked abnormal situation classification label.
  • the embodiment of this specification can calculate the error value between the predicted abnormal classification result and the true value result based on the loss function derived from the maximum likelihood estimation, and for the purpose of reducing the error value, identify the parameters in the abnormal condition model Make adjustments (such as the weight value of the underlying vector) to achieve the training effect.
  • the monitoring data collected by the monitoring device at the target location can be characterized according to the characteristic data representation method required by the abnormal situation recognition model and input into the abnormal situation recognition model, and the obtained data is represented by Abnormal situation identification model The abnormal situation identification result provided by the machine.
  • the feature data representation manner depends on the feature data type used in training the abnormal condition identification model, which is not specifically limited herein.
  • the characteristic data of the two-dimensional image is input during the training of the abnormal condition recognition model, after the vehicle terminal system obtains the monitoring screen through the monitoring device at the target location, the monitoring screen needs to be converted into The two-dimensional image is then input to the abnormal condition recognition model.
  • the monitoring device may also directly provide monitoring data in a characteristic data representation manner that meets the requirements of the abnormal condition identification model. That is to say, in this step, the vehicle terminal system can directly use the monitoring data as the input data of the abnormal condition identification model.
  • the vehicle terminal system detects the vehicle state of the vehicle, and determines an on-board alarm mode that conforms to the vehicle state.
  • the vehicle-mounted alarm mode is the head-up display alarm, or the combination of the head-up display alarm and the buzzer alarm; if the vehicle terminal system detects the vehicle's If the vehicle state is a static state or a flameout state, it is determined that the vehicle-mounted alarm mode includes a central control display alarm, or a combination of a central control display alarm and a buzzer alarm. It can be seen that the vehicle-mounted alarm mode that conforms to the vehicle state should reduce the disturbance to the driver as soon as possible.
  • the vehicle terminal system initiates an alarm operation for the abnormal condition identification result according to the determined vehicle-mounted alarm mode.
  • the abnormal state classification label may be marked with multiple abnormal levels.
  • the vehicle terminal system sets a matching alarm operation according to the abnormality level marked by the abnormality classification label, and executes an alarming operation matching the abnormality level of the abnormality identification result in this step.
  • abnormal conditions can be classified into three abnormal levels: no abnormality, common abnormality, and serious abnormality
  • the abnormal condition identification model is trained by using the characteristic data of the sample abnormal conditions corresponding to the three abnormal conditions, so that the abnormal condition identification model can be It has the ability to classify the degree of abnormality.
  • the vehicle terminal system sets different alarm operations for the three abnormal levels of no abnormality, normal abnormality and serious abnormality, and selects and executes the corresponding alarm operation according to the abnormality level indicated by the abnormal situation identification result.
  • the vehicle terminal system can remind the people in the car through the central control display; when the abnormal condition recognition result indicates a serious abnormality, the vehicle terminal system will display a reminder on the central control display.
  • the buzzer is further used for alarming, and the vehicle terminal system can also enable the communication module to make emergency contact calls and/or rescue calls.
  • the vehicle terminal system can remotely obtain the monitoring data collected by the monitoring device of the target location through the Internet of Vehicles, and use the abnormal condition recognition model to perform abnormal analysis on the monitoring data. , to mechanically determine the abnormal condition of the target location, so as to carry out the alarm operation for the abnormal condition according to the alarm mode conforming to the current vehicle state.
  • the vehicle terminal system plays a role in reminding the vehicle personnel in time, which can assist the vehicle personnel to take measures to reduce losses as soon as possible.
  • the vehicle terminal system establishes communication with the camera installed in the user's home through the Internet of Vehicles, and identifies whether an abnormal situation occurs from the monitoring picture of the home captured by the camera.
  • Figure 2 is the process of constructing an abnormal condition recognition model in this application scenario 1, which mainly includes the following steps:
  • S201 collect images of abnormal situations of the sample such as the person fainting/falling and the fire.
  • S202 characterize the collected images of the abnormal conditions of the samples, and obtain image characteristic data of the abnormal conditions of the samples.
  • S203 preprocessing the image feature data of the abnormal situation of the sample, including:
  • A. Clean the image feature data of the abnormal situation of the sample. Cleaning methods include:
  • Missing value cleaning such as: remove unnecessary fields and fill in the missing content reasonably;
  • Format content cleaning such as: correcting or deleting the content that does not conform to the format remaining after the characteristic data is characterized
  • the image feature data of the abnormal condition of the sample can be marked with black samples and white samples. If the abnormal situation identification model needs to be able to identify abnormal levels of different degrees of abnormality, each abnormal level can be marked on the image feature data of the abnormal situation of the sample.
  • the accuracy of the test result may be determined according to the comparison between the test result and the abnormal classification label of the corresponding image feature data. If the accuracy of the test results does not meet the requirements, the abnormal condition recognition model is trained and tested again until the test accuracy of the abnormal condition recognition model reaches the full requirements.
  • Figure 3 shows the process of abnormal identification and alarm in the vehicle terminal system using the abnormal condition recognition model in this application scenario, which mainly includes the following steps:
  • the camera will provide the vehicle terminal system with the monitoring picture captured by the abnormal situation in the home through the Internet of Vehicles.
  • the vehicle terminal system characterizes the monitoring screen of the abnormal situation according to the preset characteristic data representation method, and then inputs the characteristic to the abnormal situation identification model to obtain the abnormal situation identification result.
  • the vehicle terminal system performs an alarm operation according to the abnormal condition identification result. Specifically include:
  • the vehicle terminal system controls its own buzzer to emit an alarm sound, and controls its own central control screen to display the alarm prompt information and the real-time monitoring picture at home;
  • the vehicle terminal system controls and controls the buzzer to issue an alarm sound, and controls its own head-up display to display the alarm prompt information and the real-time monitoring picture at home on the front windshield of the vehicle (which can avoid interfering with driving. the driver observes the driving environment ahead).
  • the vehicle terminal system may preset alarm operations corresponding to each abnormal condition category (such as fire, person falling to the ground) when the vehicle is in a running state and when the vehicle is in a stationary state.
  • each abnormal condition category such as fire, person falling to the ground
  • the vehicle terminal system automatically activates the communication module to call an emergency contact number and/or a rescue number to call for help.
  • the vehicle terminal system establishes communication with the gas sensor installed in the user's home through the Internet of Vehicles, and identifies whether there is a crisis of gas leakage in the home from the gas measurement parameters in the home collected by the gas sensor.
  • the abnormal condition recognition model is trained and tested by using the characteristic data corresponding to the gas exceeding the safety index. After the test accuracy of the abnormal condition recognition model reaches a certain standard, it will be deployed in the vehicle terminal system for application.
  • the gas sensor When there is an abnormal situation of gas leakage in the user's home, the gas sensor will supply the collected gas measurement parameters at home to the vehicle terminal system through the Internet of Vehicles (the gas measurement parameters can be provided periodically, or when the gas exceeds the safety index) .
  • the vehicle terminal system characterizes the gas measurement parameters provided by the gas sensor according to the representation method of the characteristic data used for training the abnormal condition identification model, and then inputs it into the abnormal condition identification model to obtain the abnormal identification result of gas leakage.
  • the vehicle terminal system can control its own buzzer to emit an alarm sound, and control its own central control screen to display the alarm prompt information of gas leakage and the gas measurement parameters at home.
  • the vehicle terminal system controls and controls the buzzer to issue an alarm sound, and controls its own head-up display to display the alarm prompt information of gas leakage and the gas measurement parameters at home on the front windshield of the vehicle.
  • the vehicle terminal system can further automatically activate the communication module to call an emergency Contact number and/or rescue number to call for help.
  • FIG. 4 is a schematic structural diagram of a vehicle terminal system 400 according to an embodiment of the present specification, including:
  • the data acquisition module 410 acquires the monitoring data collected by the monitoring device arranged at the target location based on the Internet of Vehicles.
  • the abnormality identification module 420 extracts characteristic data from the monitoring data according to the characteristic data representation mode required by the pre-set abnormal condition identification model, and analyzes all the data based on the abnormal condition identification model in combination with the characteristic data in the monitoring data.
  • the abnormal situation identification is performed at the target location to obtain an abnormal situation identification result, wherein the abnormal situation identification model is obtained by training according to the characteristic data extracted from the abnormal situation samples and the corresponding abnormal situation classification labels.
  • the alarm determination module 430 detects the vehicle state of the vehicle when the abnormal state identification result indicates that an abnormal state occurs at the target location, and determines an on-board alarm mode that conforms to the vehicle state.
  • the alarm execution module 440 initiates an alarm operation for the abnormal condition identification result according to the determined vehicle-mounted alarm mode.
  • the vehicle terminal system of the embodiment of this specification can remotely obtain the monitoring data collected by the monitoring device of the target location through the Internet of Vehicles, and use the abnormal condition identification model to perform abnormal analysis on the monitoring data, and mechanically determine the abnormal condition of the target location.
  • an alarm operation for abnormal conditions is performed according to an alarm mode conforming to the current vehicle state.
  • the vehicle terminal system plays a role in reminding the vehicle personnel in time, which can assist the vehicle personnel to take measures to reduce losses as soon as possible.
  • the alarm determination module 430 is specifically configured to: if the vehicle terminal system of the vehicle detects that the vehicle state of the vehicle is a driving state, then determine that the vehicle-mounted alarm mode is a heads-up display alarm, or a combination of a heads-up display alarm and a buzzer alarm; The terminal system detects that the vehicle state of the vehicle is a stationary state or a flameout state, and determines that the vehicle alarm mode includes a central control display alarm, or a combination of a central control display alarm and a buzzer alarm.
  • the data acquisition module 410 may, in response to the monitoring data invocation event, log in to the vehicle network account registered in the vehicle network system based on the vehicle network, and download the monitoring data of the target location stored in association with the vehicle network account by the vehicle network system. , wherein the monitoring data is collected by a monitoring device set at the target location and uploaded to the vehicle network system in association with the vehicle network account.
  • the vehicle terminal system is provided with matching alarm measures according to the abnormality level marked by the abnormality classification label; the vehicle-mounted alarming method determined by the alarm execution module 440 initiates an abnormality level corresponding to the abnormality recognition result. matching alarm action.
  • the alarm execution module 440 may also enable the communication module to make an emergency contact call and/or a rescue call.
  • the in-vehicle terminal system 400 shown in FIG. 4 in the embodiment of this specification can implement the steps and functions of the monitoring processing method shown in FIG. 1 above. Since the principle is the same, this article will not repeat them.
  • FIG. 5 is a schematic structural diagram of an electronic device provided by an embodiment of the present specification.
  • the electronic device includes a processor, and optionally an internal bus, a network interface, and a memory.
  • the memory may include memory, such as high-speed random-access memory (Random-Access Memory, RAM), or may also include non-volatile memory (non-volatile memory), such as at least one disk memory.
  • RAM Random-Access Memory
  • non-volatile memory such as at least one disk memory.
  • the electronic equipment may also include hardware required for other services.
  • the processor, network interface and memory can be connected to each other through an internal bus, which can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect, peripheral component interconnect standard) bus or an EISA (Extended Component Interconnect) bus. Industry Standard Architecture, extended industry standard structure) bus, etc.
  • the bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one bidirectional arrow is shown in FIG. 5, but it does not mean that there is only one bus or one type of bus.
  • the program may include program code, and the program code includes computer operation instructions.
  • the memory may include memory and non-volatile memory and provide instructions and data to the processor.
  • the processor reads the corresponding computer program from the non-volatile memory into the memory and runs it, forming a monitoring and processing device at the logical level, and the monitoring and processing device may refer to the above-mentioned vehicle terminal system, or refer to the above-mentioned vehicle terminal system. Components in the system .
  • the processor executes the program stored in the memory, and is specifically used to perform the following operations:
  • the monitoring data collected by the monitoring device set at the target location is obtained.
  • the vehicle state of the vehicle is detected, and an on-board alarm mode that conforms to the vehicle state is determined;
  • an alarm operation for the abnormal condition identification result is initiated.
  • the electronic device of the embodiment of this specification can enable the vehicle terminal system to remotely obtain the monitoring data collected by the monitoring device of the target location through the Internet of Vehicles, and use the abnormal condition recognition model to perform abnormal analysis on the monitoring data, and mechanically determine the target location. Therefore, the alarm operation for the abnormal situation is carried out according to the alarm mode that conforms to the current vehicle state.
  • the vehicle terminal system plays a role in reminding the vehicle personnel in time, which can assist the vehicle personnel to take measures to reduce losses as soon as possible.
  • each step of the above-mentioned method can be completed by a hardware integrated logic circuit in a processor or an instruction in the form of software.
  • the above-mentioned processor can be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; it can also be a digital signal processor (Digital Signal Processor, DSP), dedicated integrated Circuit (Application Specific Integrated Circuit, ASIC), Field Programmable Gate Array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
  • DSP Digital Signal Processor
  • ASIC Application Specific Integrated Circuit
  • FPGA Field Programmable Gate Array
  • a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
  • the steps of the method disclosed in conjunction with one or more embodiments of this specification may be directly embodied as executed by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor.
  • the software modules may be located in random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers and other storage media mature in the art.
  • the storage medium is located in the memory, and the processor reads the information in the memory, and completes the steps of the above method in combination with its hardware.
  • the electronic devices in this specification do not exclude other implementations, such as logic devices or the combination of software and hardware, etc. That is to say, the execution subjects of the following processing procedures are not limited to each logic unit. It can also be a hardware or logic device.
  • the embodiments of this specification also provide a computer-readable storage medium, where the computer-readable storage medium stores one or more programs, and the one or more programs include instructions, and the instructions, when stored in a portable computer including multiple application programs
  • the portable electronic device can be made to execute the method of the embodiment shown in FIG. 1 to FIG. 3 , and is specifically configured to execute the following operations:
  • the monitoring data collected by the monitoring device set at the target location is obtained.
  • the vehicle state of the vehicle is detected, and an on-board alarm mode that conforms to the vehicle state is determined;
  • an alarm operation for the abnormal condition identification result is initiated.
  • a typical implementation device is a computer.
  • the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or A combination of any of these devices.
  • Computer-readable media includes both persistent and non-permanent, removable and non-removable media, and storage of information may be implemented by any method or technology.
  • Information may be computer readable instructions, data structures, modules of programs, or other data.
  • Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), Flash Memory or other memory technology, Compact Disc Read Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device.
  • computer-readable media does not include transitory computer-readable media, such as modulated data signals and carrier waves.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Alarm Systems (AREA)

Abstract

本说明书公开一种基于车辆终端系统的监控处理方法、系统及相关设备。方法应用车载终端系统,包括:基于车联网获取设置于目标地点的监控装置采集到的监控数据。按照预先设置的异常状况识别模型的特征数据表征方式,从监控数据中提取特征数据,并基于异常状况识别模型结合该特征数据对目标地点进行异常状况识别,模型是根据从异常状况的样本中提取出的特征数据和对应的异常状况分类标签训练得到的。在异常状况识别结果指示目标地点出现异常状况时,检测车辆的车辆状态,确定符合车辆状态的车载报警方式。按照该车载报警方式发起针对异常状况识别结果的报警操作。

Description

一种基于车辆终端系统的监控处理方法、系统及相关设备
本申请要求2020年09月28日提交在中国专利局、申请号为202011044125.6、发明名称为“一种基于车辆终端系统的监控处理方法、系统及相关设备”的中国专利申请的优先权,该申请的全部内容通过引用结合在本申请中。
技术领域
本文件涉及网联化技术领域,尤其涉及一种基于车辆终端系统的监控处理方法、系统及相关设备。
背景技术
目前市面上还没有远程监控居家情况的车载产品。用户在驾车或乘车过程中,如果家里发生了意外状况,则没有能力进行感知,从而无法及时采取措施解决问题。
为此,有必要提出一种基于车载产品的可通过远程监控主动识别异常状况并及时报警的技术方案。
发明内容
本说明书实施例提供了一种基于车辆终端系统的监控处理方法、系统及相关设备,能够使车辆终端系统主动通过远程监控识别异常状况并及时进行报警。
为解决上述技术问题,本说明书实施例是这样实现的:
第一方面,提供一种基于车辆终端系统的监控处理方法,包括:
车辆终端系统基于车联网获取设置于目标地点的监控装置采集到的监控数据;
车辆终端系统按照预先设置的异常状况识别模型所要求的特征数据表征方式,从所述监控数据中提取特征数据,并基于所述异常状况识别模型结合所述监控数据中的特征数据对所述目标地点进行异常状况识别,得到异常状况识别结果,其中,所述异常状况识别模型是根据从异常状况的样本中提取出的特征数据和对应的异常状况分类标签训练得到的;
所述车辆终端系统在所述异常状况识别结果指示所述目标地点出现异常状况时,检测车辆的车辆状态,确定符合所述车辆状态的车载报警方式;
所述车辆终端系统按照确定到的车载报警方式,发起针对所述异常状况识别结果的报警操作。
第二方面,提供一种车辆终端系统,包括:
数据获取模块,基于车联网获取设置于目标地点的监控装置采集到的监控数据;
异常识别模块,按照预先设置的异常状况识别模型所要求的特征数据表征方式,从所述监控数据中提取特征数据,并基于所述异常状况识别模型结合所述监控数据中的特征数 据对所述目标地点进行异常状况识别,得到异常状况识别结果,其中,所述异常状况识别模型是根据从异常状况的样本中提取出的特征数据和对应的异常状况分类标签训练得到的;
报警确定模块,在所述异常状况识别结果指示所述目标地点出现异常状况时,检测车辆的车辆状态,确定符合所述车辆状态的车载报警方式;
报警执行模块,按照确定到的车载报警方式,发起针对所述异常状况识别结果的报警操作。
第三方面,提供一种电子设备包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述计算机程序被所述处理器执行:
基于车联网获取设置于目标地点的监控装置采集到的监控数据;
按照预先设置的异常状况识别模型所要求的特征数据表征方式,从所述监控数据中提取特征数据,并基于所述异常状况识别模型结合所述监控数据中的特征数据对所述目标地点进行异常状况识别,得到异常状况识别结果,其中,所述异常状况识别模型是根据从异常状况的样本中提取出的特征数据和对应的异常状况分类标签训练得到的;
在所述异常状况识别结果指示所述目标地点出现异常状况时,检测车辆的车辆状态,确定符合所述车辆状态的车载报警方式;
按照确定到的车载报警方式,发起针对所述异常状况识别结果的报警操作。
第三方面,提供一种计算机可读存储介质,所述计算机可读存储介质上存储有计算机程序,,所述计算机程序被处理器执行时实现如下步骤:
基于车联网获取设置于目标地点的监控装置采集到的监控数据;
按照预先设置的异常状况识别模型所要求的特征数据表征方式,从所述监控数据中提取特征数据,并基于所述异常状况识别模型结合所述监控数据中的特征数据对所述目标地点进行异常状况识别,得到异常状况识别结果,其中,所述异常状况识别模型是根据从异常状况的样本中提取出的特征数据和对应的异常状况分类标签训练得到的;
在所述异常状况识别结果指示所述目标地点出现异常状况时,检测车辆的车辆状态,确定符合所述车辆状态的车载报警方式;
按照确定到的车载报警方式,发起针对所述异常状况识别结果的报警操作。
基于本申请实施例的方案,车辆终端系统可通过车联网远程获取目标地点的监控装置所采集到的监控数据,并利用异常状况识别模型对监控数据进行异常分析,以机械方式确定出目标地点的异常状况,从而按照符合当前车辆状态的报警方式进行针对异常状况的报 警操作。在目标地点突发异常情况时,车辆终端系统起到了及时提醒车辆人员注意的作用,可辅助车辆人员尽快采取措施降低损失。
附图说明
此处所说明的附图用来提供对本说明书的进一步理解,构成本说明书的一部分,本说明书的示意性实施例及其说明用于解释本说明书,并不构成对本说明书的不当限定。在附图中:
图1为本说明书实施例提供的车辆终端系统的监控处理方法的第一种流程示意图。
图2为本说明书实施例提供的构建异常状况识别模型的流程示意图。
图3为本说明书实施例提供的车辆终端系统的监控处理方法的第二种流程示意图。
图4为本说明书实施例提供的车辆终端系统的结构示意图。
图5为本说明书实施例提供的电子设备的结构示意图。
具体实施方式
为使本文件的目的、技术方案和优点更加清楚,下面将结合本说明书具体实施例及相应的附图对本说明书技术方案进行清楚、完整地描述。显然,所描述的实施例仅是本文件一部分实施例,而不是全部的实施例。基于本说明书中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本文件保护的范围。
如前所述,目前市面上还没有远程监控居家情况的车载产品。用户在驾车或乘车过程中,如果家里发生了意外状况(特别是家里没人或者只有小孩、老人待在家中),则没有能力进行感知,从而无法及时采取措施解决问题。为此,本申请旨在提出一种基于车载产品的可通过远程监控主动识别异常状况并及时报警的技术方案。
以下结合附图,详细说明本说明书各实施例提供的技术方案。
图1是本说明书实施例基于车辆终端系统的监控处理方法的流程图。图1所示的方法可以由下文相对应的车辆终端系统执行,包括如下步骤:
S102,车辆终端系统基于车联网获取设置于目标地点的监控装置采集到的监控数据。
应理解,本说明书实施例中,车辆终端系统可以但不限于是指车辆的中控系统。中控系统具有人机交互功能。
需要说明的是,本申请不对监控装置以及采集到的监控数据的类型作具体限定。作为示例性介绍:监控装置可以包括设置于目标地点的摄像头,摄像头采集到的监控数据则对应为目标地点的监控画面。
在实际应用中,车辆终端系统可以通过车联网直接与监控装置建立通信,获取监控装 置传输的监控数据。
或者,监控装置将采集到的监控数据关联车辆网账户上传至车辆网系统。车辆终端系统响应于监控数据调用事件(事件可以由用户操作触发或者周期性触发),基于车联网登录在车辆网系统登录该车辆网账户,以向车辆网系统下载目标地点的监控数据。这里,考虑到突发的异常状况能够得到及时感知,车辆终端系统可以检测车辆当前的车联网的网络质量参数,并向车辆网系统提供该网络质量参数。车辆网系统基于网质量参数相匹配的数据压缩参数对目标地点的监控数据进行压缩,之后,将压缩的监控数据发送给车辆终端系统,从而提高监控数据的传输时间。
S104,车辆终端系统按照预先设置的异常状况识别模型所要求的特征数据表征方式,从监控数据中提取特征数据,并基于异常状况识别模型结合监控数据中的特征数据对目标地点进行异常状况识别,得到异常状况识别结果,其中,异常状况识别模型是根据从异常状况的样本中提取出的特征数据和对应的异常状况分类标签训练得到的。
具体地,本说明书实施例可以预先收集一些异常状况的样本,并对这些样本进行异常状况的分类标注,从而构建异常状况识别模型的训练数据。在训练过程中,可以将样本中提取出的特征数据作为异常状况识别模型的输入,将样本标注得到的异常状况分类标签作为异常状况识别模型的输出,以对异常状况识别模型进行有监督训练。
应理解,在将样本的特征数据输入至异常状况识别模型后,即可得到异常状况识别模型给出的训练结果。这个训练结果是异常状况识别模型针对样本预测的异常分类结果,异常分类结果可能与之前标注的异常状况分类标签所指示的真值结果存在差异。本说明书实施例可以基于最大似然估计所推导出的损失函数,计算出预测的异常分类结果与真值结果之间的误差值,并以降低误差值为目的,对异常状况识别模型中的参数进行调整(例如底层向量的权重值),从而达到训练效果。
本步骤在异常状况识别模型训练完成后,可以获得的监控装置在目标地点采集到的监控数据按照异常状况识别模型所要求的特征数据表征方式,进行特征表征并输入至异常状况识别模型,得到由异常状况识别模型机械提供的异常状况识别结果。
应理解,特征数据表征方式取决于在对异常状况识别模型进行训练时所使用的特征数据类型,这里本文不作具体限定。作为示例性介绍:假设在对异常状况识别模型进行训练时,输入的是二维图像的特征数据,则车辆终端系统通过目标地点的监控装置获取到监控画面后,需要将监控画面也同样转换为二维图像后再输入至异常状况识别模型。
当然,本说明书实施例中,监控装置也可以直接提供符合异常状况识别模型要求的特 征数据表征方式的监控数据。也就是说,本步骤中,车辆终端系统可以将监控数据直接作为异常状况识别模型的输入数据。
S106,车辆终端系统在异常状况识别结果指示目标地点出现异常状况时,检测车辆的车辆状态,确定符合车辆状态的车载报警方式。
具体地,本步骤中,若车辆终端系统检测车辆的车辆状态为行驶状态,则确定车载报警方式为抬头显示报警,或者,抬头显示报警与蜂鸣器报警的组合;若车辆终端系统检测车辆的车辆状态为静止状态或熄火状态,则确定车载报警方式包括中控显示报警,或者,中控显示报警与蜂鸣器报警的组合。可以看出,符合车辆状态的车载报警方式应即可能地减少对驾驶员的干扰。
S108,车辆终端系统按照确定到的车载报警方式,发起针对异常状况识别结果的报警操作。
应理解,报警操作的具体表现形式并不唯一,这里本文不作具体限定。
此外本说明实施例中,异常状况分类标签可以标注多个异常级别。车辆终端系统根据异常状况分类标签标注的异常级别,设置有相匹配的报警操作,并在本步骤中执行与异常状况识别结果的异常级别相匹配的报警操作。
作为示例性介绍:
本说明实施例可以将异常状况分类为:无异常、普通异常、严重异常三种异常级别,并使用样本异常状况对应这三种异常级别的特征数据训练异常状况识别模型,从而使异常状况识别模型具有分类异常程度能力。同时,车辆终端系统针对无异常、普通异常、严重异常三种异常级别分别设置不同的报警操作,并根据异常状况识别结果所指示的异常级别,来选择执行对应的报警操作。
比如,异常状况识别结果指示为普通异常且车辆处于静止状态,则车辆终端系统可以通过中控显示提醒车中的人员;当异常状况识别结果指示为严重异常,则车辆终端系统在中控显示提醒的基础之上,进一步使用蜂鸣器进行报警,同时车辆终端系统还可以启用通信模块进行紧急联系人呼叫和/或救援呼叫。
通过图1所示的可以知道:本申请实施例的方案中,车辆终端系统可通过车联网远程获取目标地点的监控装置所采集到的监控数据,并利用异常状况识别模型对监控数据进行异常分析,以机械方式确定出目标地点的异常状况,从而按照符合当前车辆状态的报警方式进行针对异常状况的报警操作。在目标地点突发异常情况时,车辆终端系统起到了及时提醒车辆人员注意的作用,可辅助车辆人员尽快采取措施降低损失。
下面结合实际的应用场景,对本说明书实施例的车辆终端系统的监控处理方法进行详细介绍。
本应用场景一
本应用场景一中,车辆终端系统通过车联网与用户家中安装的摄像头建立通信,从根据摄像头捕捉到的家中的监控画面,来识别是否发生异常情况。
图2是本应用场景一构建异常状况识别模型的流程,主要包括如下步骤:
S201,收集人员晕倒/摔倒以及火灾等样本异常情况的图像。
S202,按照预先设定的特征数据表征方式,对收集到的样本异常情况的图像进行特征表征,得到这些样本异常情况的图像特征数据。
S203,对样本异常情况的图像特征数据进行预处理,包括:
A.对样本异常情况的图像特征数据进行清洗。清洗方式包括:
(1)缺失值清洗,比如:去掉不需要的字段,合理填充缺失的内容;
(2)格式内容清洗,比如:对特征数据表征后残留的不符合格式的内容进行纠正或删除处理;
(3)逻辑错误清洗,比如:数据去重、删除不合理值以及修正矛盾内容;
(4)非需求数据清洗。
B.根据分类需求,对样本异常情况的图像特征数据进行人为标注,确定各图像特征数据所对应的异常分类标签。
比如,本应用场景中,如果只需要异常状况识别模型能够识别出是否发生异常,则可以对样本异常情况的图像特征数据进行黑样本和白样本的标注。如果需要异常状况识别模型能够识别出不同异常程度的异常级别,则可以对样本异常情况的图像特征数据进行各异常级别的标注。
S204,将样本异常情况的图像特征数据分类为训练样本集和测试样本集。
S205,使用训练样本集中的图像特征数据和对应异常分类标签,对异常状况识别模型进行训练。
S206,使用测试样本集中的图像特征数据对异常状况识别模型进行测试。
本步骤中,具体可以根据测试结果与对应图像特征数据的异常分类标签进行比对,确定测试结果的准确率。如果测试结果的准确率未达到要求,则再次对异常状况识别模训练、测试,直至异常状况识别模型的测试准确率达到满要求。
S207,将通过测试的异常状况识别模型部署在车辆终端系统以进行应用。
图3是本应用场景中车辆终端系统使用异常状况识别模型进行异常识别、报警的流程,主要包括如下步骤:
S301,用户家中发生异常情况。
S302,摄像头将通过车联网将捕获到家中的异常情况的监控画面供给车辆终端系统。
S303,车辆终端系统按照预先设定的特征数据表征方式,对异常情况的监控画面进行特征表征后输入至异常状况识别模型,得到异常状况识别结果。
S304,车辆终端系统根据异常状况识别结果,执行报警操作。具体包括:
S3041,在车辆处于静止状态时,车辆终端系统控制自身蜂鸣器发出报警声音,以及控制自身中控屏幕显示报警提示信息和家中的实时监控画面;
S3042,在车辆处于行驶状态,车辆终端系统控制控制自蜂鸣器发出报警声音,以及控制自身的抬头显示器将报警提示信息和家中的实时监控画面显示在车辆前挡风玻璃处(可避免干扰驾驶员观察前方行驶环境)。
应理解,本说明书实施例中,车辆终端系统可以预先设置各个异常状况类别(如火灾、人员倒地)在车辆处于行驶状态时以及车辆处于静止状态时所对应的报警操作。
S305,若异常状况识别结果指示异常级别为严重异常时,车辆终端系统自动启用通信模块呼叫紧急联系人电话和/或救援电话,以进行呼救。
本应用场景二
本应用场景二中,车辆终端系统通过车联网与用户家中安装的煤气传感器建立通信,从根据煤气传感器采集到的家中的煤气测量参数,来识别家中是否出现煤气泄漏的危机情况。
同样地,首先使用煤气超出安全指标对应的特征数据对异常状况识别模型进行训练、测试。在异常状况识别模型的测试准确率达到一定标准后,将异其部署在车辆终端系统以进行应用。
当用户家中发生煤气泄漏的异常情况时,煤气传感器通过车联网将采集到的家中的煤气测量参数供给车辆终端系统(可以是周期性提供煤气测量参数,也可以是在煤气超出安全指标时提供)。
之后,车辆终端系统按照训练异常状况识别模型所使用的特征数据的表征方式,对煤气传感器提供的煤气测量参数进行特征表征后,输入至异常状况识别模型,得到煤气泄漏的异常识别结果。
如果车辆当前处于静止状态时,则车辆终端系统可以控制自身蜂鸣器发出报警声音, 以及控制自身中控屏幕显示煤气泄漏的报警提示信息和家中的煤气测量参数。
如果车辆当前处于形式状态时,则车辆终端系统控制控制自蜂鸣器发出报警声音,以及控制自身的抬头显示器将煤气泄漏的报警提示信息和家中的煤气测量参数显示在车辆前挡风玻璃处。
此外,上述基础之上,如果异常状况识别模型具有识别煤气泄漏严重程度的能力,则在异常状况识别结果指示煤气泄漏的异常级别为严重异常时,车辆终端系统还可以进一步自动启用通信模块呼叫紧急联系人电话和/或救援电话,以进行呼救。
以上应用场景是对本说明书实施例方法的示例性介绍。应理解,在不脱离本文上述原理基础之上,还可以进行适当的变化,这些变化也应视为本说明书实施例的保护范围。
此外,与上述图1所示的监控处理方法相对应地,本说明书实施例还提供一种车辆终端系统。图4是本说明书实施例车辆终端系统400的结构示意图,包括:
数据获取模块410,基于车联网获取设置于目标地点的监控装置采集到的监控数据。
异常识别模块420,按照预先设置的异常状况识别模型所要求的特征数据表征方式,从所述监控数据中提取特征数据,并基于所述异常状况识别模型结合所述监控数据中的特征数据对所述目标地点进行异常状况识别,得到异常状况识别结果,其中,所述异常状况识别模型是根据从异常状况的样本中提取出的特征数据和对应的异常状况分类标签训练得到的。
报警确定模块430,在所述异常状况识别结果指示所述目标地点出现异常状况时,检测车辆的车辆状态,确定符合所述车辆状态的车载报警方式。
报警执行模块440,按照确定到的车载报警方式,发起针对所述异常状况识别结果的报警操作。
本说明书实施例的车辆终端系统可通过车联网远程获取目标地点的监控装置所采集到的监控数据,并利用异常状况识别模型对监控数据进行异常分析,以机械方式确定出目标地点的异常状况,从而按照符合当前车辆状态的报警方式进行针对异常状况的报警操作。在目标地点突发异常情况时,车辆终端系统起到了及时提醒车辆人员注意的作用,可辅助车辆人员尽快采取措施降低损失。
可选地,报警确定模块430具体用于:若车辆终端系统检测车辆的车辆状态为行驶状态,则确定车载报警方式为抬头显示报警,或者,抬头显示报警与蜂鸣器报警的组合;若车辆终端系统检测车辆的车辆状态为静止状态或熄火状态,则确定车载报警方式包括中控显示报警,或者,中控显示报警与蜂鸣器报警的组合。
可选地,数据获取模块410可以响应于监控数据调用事件,基于车联网登录在车辆网系统注册的车辆网账户,下载所述车辆网系统针对所述车辆网账户关联存储的目标地点的监控数据,其中,所述监控数据是设置于所述目标地点的监控装置采集并关联所述车辆网账户上传至所述车辆网系统的。
可选地,所述车辆终端系统根据异常状况分类标签标注的异常级别,设置有相匹配的报警措施;报警执行模块440确定到的车载报警方式,发起针对所述异常状况识别结果的异常级别相匹配的报警操作。
可选地,若所述异常状况识别结果达到预设目标异常级别,则所报警执行模块440还可以启用通信模块进行紧急联系人呼叫和/或救援呼叫。
显然,本说明书实施例图4所示的车载终端系统400可以实现上述图1所示的监控处理方法的步骤和功能。由于原理相同,本文不再赘述。
图5是本说明书的一个实施例提供的电子设备的结构示意图。请参考图5,在硬件层面,该电子设备包括处理器,可选地还包括内部总线、网络接口、存储器。其中,存储器可能包含内存,例如高速随机存取存储器(Random-Access Memory,RAM),也可能还包括非易失性存储器(non-volatile memory),例如至少1个磁盘存储器等。当然,该电子设备还可能包括其他业务所需要的硬件。
处理器、网络接口和存储器可以通过内部总线相互连接,该内部总线可以是ISA(Industry Standard Architecture,工业标准体系结构)总线、PCI(Peripheral Component Interconnect,外设部件互连标准)总线或EISA(Extended Industry Standard Architecture,扩展工业标准结构)总线等。所述总线可以分为地址总线、数据总线、控制总线等。为便于表示,图5中仅用一个双向箭头表示,但并不表示仅有一根总线或一种类型的总线。
存储器,用于存放程序。具体地,程序可以包括程序代码,所述程序代码包括计算机操作指令。存储器可以包括内存和非易失性存储器,并向处理器提供指令和数据。
处理器从非易失性存储器中读取对应的计算机程序到内存中然后运行,在逻辑层面上形成监控处理装置,该监控处理装置可以指上述车辆终端系统,或者指上述车辆终端系统中的部件。处理器,执行存储器所存放的程序,并具体用于执行以下操作:
基于车联网获取设置于目标地点的监控装置采集到的监控数据。
按照预先设置的异常状况识别模型所要求的特征数据表征方式,从所述监控数据中提 取特征数据,并基于所述异常状况识别模型结合所述监控数据中的特征数据对所述目标地点进行异常状况识别,得到异常状况识别结果,其中,所述异常状况识别模型是根据从异常状况的样本中提取出的特征数据和对应的异常状况分类标签训练得到的。
在所述异常状况识别结果指示所述目标地点出现异常状况时,检测车辆的车辆状态,确定符合所述车辆状态的车载报警方式;
按照确定到的车载报警方式,发起针对所述异常状况识别结果的报警操作。
本说明书实施例的电子设备可以使车辆终端系统可通过车联网远程获取目标地点的监控装置所采集到的监控数据,并利用异常状况识别模型对监控数据进行异常分析,以机械方式确定出目标地点的异常状况,从而按照符合当前车辆状态的报警方式进行针对异常状况的报警操作。在目标地点突发异常情况时,车辆终端系统起到了及时提醒车辆人员注意的作用,可辅助车辆人员尽快采取措施降低损失。
上述如本说明书图1至图3所示实施例揭示的监控处理方法可以应用于处理器中,或者由处理器实现。处理器可能是一种集成电路芯片,具有信号的处理能力。在实现过程中,上述方法的各步骤可以通过处理器中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器可以是通用处理器,包括中央处理器(Central Processing Unit,CPU)、网络处理器(Network Processor,NP)等;还可以是数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本说明书一个或多个实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本说明书一个或多个实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成,或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器,闪存、只读存储器,可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器,处理器读取存储器中的信息,结合其硬件完成上述方法的步骤。
当然,除了软件实现方式之外,本说明书的电子设备并不排除其他实现方式,比如逻辑器件抑或软硬件结合的方式等等,也就是说以下处理流程的执行主体并不限定于各个逻辑单元,也可以是硬件或逻辑器件。
此外,本说明书实施例还提出了一种计算机可读存储介质,该计算机可读存储介质存储一个或多个程序,该一个或多个程序包括指令,该指令当被包括多个应用程序的便携式 电子设备执行时,能够使该便携式电子设备执行图1至图3所示实施例的方法,并具体用于执行以下操作:
基于车联网获取设置于目标地点的监控装置采集到的监控数据。
按照预先设置的异常状况识别模型所要求的特征数据表征方式,从所述监控数据中提取特征数据,并基于所述异常状况识别模型结合所述监控数据中的特征数据对所述目标地点进行异常状况识别,得到异常状况识别结果,其中,所述异常状况识别模型是根据从异常状况的样本中提取出的特征数据和对应的异常状况分类标签训练得到的。
在所述异常状况识别结果指示所述目标地点出现异常状况时,检测车辆的车辆状态,确定符合所述车辆状态的车载报警方式;
按照确定到的车载报警方式,发起针对所述异常状况识别结果的报警操作。
应理解,上述指令当被包括多个应用程序的便携式电子设备执行时,能够使上文所述的车辆终端系统实现图1至图3所示实施例的功能。由于原理相同,本文不再赘述。
上述实施例阐明的系统、装置、模块或单元,具体可以由计算机芯片或实体实现,或者由具有某种功能的产品来实现。一种典型的实现设备为计算机。具体的,计算机例如可以为个人计算机、膝上型计算机、蜂窝电话、相机电话、智能电话、个人数字助理、媒体播放器、导航设备、电子邮件设备、游戏控制台、平板计算机、可穿戴设备或者这些设备中的任何设备的组合。
计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括,但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带,磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。按照本文中的界定,计算机可读介质不包括暂存电脑可读媒体(transitory media),如调制的数据信号和载波。
还需要说明的是,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所 述要素的过程、方法、商品或者设备中还存在另外的相同要素。
本说明书中的各个实施例均采用递进的方式描述,各个实施例之间相同相似的部分互相参见即可,每个实施例重点说明的都是与其他实施例的不同之处。尤其,对于系统实施例而言,由于其基本相似于方法实施例,所以描述的比较简单,相关之处参见方法实施例的部分说明即可。

Claims (16)

  1. 一种基于车辆终端系统的监控处理方法,其中,包括:
    车辆终端系统基于车联网获取设置于目标地点的监控装置采集到的监控数据;
    车辆终端系统按照预先设置的异常状况识别模型所要求的特征数据表征方式,从所述监控数据中提取特征数据,并基于所述异常状况识别模型结合所述监控数据中的特征数据对所述目标地点进行异常状况识别,得到异常状况识别结果,其中,所述异常状况识别模型是根据从异常状况的样本中提取出的特征数据和对应的异常状况分类标签训练得到的;
    所述车辆终端系统在所述异常状况识别结果指示所述目标地点出现异常状况时,检测车辆的车辆状态,确定符合所述车辆状态的车载报警方式;
    所述车辆终端系统按照确定到的车载报警方式,发起针对所述异常状况识别结果的报警操作。
  2. 如权利要求1所述的方法,其中,
    所述车辆终端系统检测车辆的车辆状态,确定与车辆状态匹配的车载报警方式,包括:
    若车辆终端系统检测车辆的车辆状态为行驶状态,则确定车载报警方式为抬头显示报警,或者,抬头显示报警与蜂鸣器报警的组合;
    若车辆终端系统检测车辆的车辆状态为静止状态或熄火状态,则确定车载报警方式包括中控显示报警,或者,中控显示报警与蜂鸣器报警的组合。
  3. 如权利要求1所述的方法,其中,还包括:
    车辆终端系统基于车联网获取设置于目标地点的监控装置采集到的监控数据,包括:
    车辆终端系统响应于监控数据调用事件,基于车联网登录在车辆网系统注册的车辆网账户,下载所述车辆网系统针对所述车辆网账户关联存储的目标地点的监控数据,其中,所述监控数据是设置于所述目标地点的监控装置采集并关联所述车辆网账户上传至所述车辆网系统的。
  4. 如权利要求3所述的方法,其中,
    下载所述车辆网系统保存的目标地点的监控数据,包括:
    所述车辆终端系统检测车辆当前的车联网的网络质量参数;
    所述车辆终端系统向所述车辆网系统发送当前车联网的网络质量参数,使得所述车辆网系统基于当前车联网的网络质量参数相匹配的数据压缩参数对目标地点的监控数据进行压缩;
    所述车辆终端系统向所述车辆网系统下载所述车辆网系统压缩后的所述目标地点的监控数据。
  5. 如权利要求1所述的方法,其中,
    所述车辆终端系统根据异常状况分类标签标注的异常级别,设置有相匹配的报警措施;
    所述车辆终端系统按照确定到的车载报警方式,发起针对所述异常状况识别结果的报警操作,报警操作包括:
    所述车辆终端系统按照确定到的车载报警方式,发起针对所述异常状况识别结果的异常级别相匹配的报警操作。
  6. 如权利要求5所述的方法,其中,还包括:
    若所述异常状况识别结果达到预设目标异常级别,则所述车辆终端系统启用通信模块进行紧急联系人呼叫和/或救援呼叫。
  7. 如权利要求1-6中任一项所述的方法,其中,
    所述监控数据包括监控画面,训练所述异常状况识别模型所使用的样本异常状况的特征数据包括:人员倒地的图像特征数据和/或火灾的图像特征数据,所述车辆终端系统按照所述异常状况识别模型对人员倒地和/或火灾的图像特征表征方式对所述监控数据进行特征表征;
    或者,
    所述监控数据包括煤气测量参数,训练所述异常状况识别模型所使用的样本包括:煤气超出安全指标对应的特征数据,所述车辆终端系统按照所述异常状况识别模型对煤气超出安全指标的特征表征方式对所述煤气测量参数进行特征表征。
  8. 一种车辆终端系统,其中,包括:
    数据获取模块,基于车联网获取设置于目标地点的监控装置采集到的监控数据;
    异常识别模块,按照预先设置的异常状况识别模型所要求的特征数据表征方式,从所述监控数据中提取特征数据,并基于所述异常状况识别模型结合所述监控数据中的特征数据对所述目标地点进行异常状况识别,得到异常状况识别结果,其中,所述异常状况识别模型是根据从异常状况的样本中提取出的特征数据和对应的异常状况分类标签训练得到的;
    报警确定模块,在所述异常状况识别结果指示所述目标地点出现异常状况时,检测车辆的车辆状态,确定符合所述车辆状态的车载报警方式;
    报警执行模块,按照确定到的车载报警方式,发起针对所述异常状况识别结果的报警 操作。
  9. 如权利要求8所述的车辆终端系统,其中,
    所述报警确定模块,具体用于:
    若车辆终端系统检测车辆的车辆状态为行驶状态,则确定车载报警方式为抬头显示报警,或者,抬头显示报警与蜂鸣器报警的组合;
    若车辆终端系统检测车辆的车辆状态为静止状态或熄火状态,则确定车载报警方式包括中控显示报警,或者,中控显示报警与蜂鸣器报警的组合。
  10. 如权利要求8所述的车辆终端系统,其中,所述数据获取模块,具体用于:
    响应于监控数据调用事件,基于车联网登录在车辆网系统注册的车辆网账户,下载所述车辆网系统针对所述车辆网账户关联存储的目标地点的监控数据,其中,所述监控数据是设置于所述目标地点的监控装置采集并关联所述车辆网账户上传至所述车辆网系统的。
  11. 如权利要求10所述的车辆终端系统,其中,所述数据获取模块,具体用于:
    所述车辆终端系统检测车辆当前的车联网的网络质量参数;
    所述车辆终端系统向所述车辆网系统发送当前车联网的网络质量参数,使得所述车辆网系统基于当前车联网的网络质量参数相匹配的数据压缩参数对目标地点的监控数据进行压缩;
    所述车辆终端系统向所述车辆网系统下载所述车辆网系统压缩后的所述目标地点的监控数据。
  12. 如权利要求8所述的车辆终端系统,其中,
    所述车辆终端系统根据异常状况分类标签标注的异常级别,设置有相匹配的报警措施;
    所述报警执行模块,具体用于:
    所述车辆终端系统按照确定到的车载报警方式,发起针对所述异常状况识别结果的异常级别相匹配的报警操作。
  13. 如权利要求12所述的车辆终端系统,其中,还包括:
    若所述异常状况识别结果达到预设目标异常级别,则所述车辆终端系统启用通信模块进行紧急联系人呼叫和/或救援呼叫。
  14. 如权利要求8-13中任一项所述的车辆终端系统,其中,
    所述监控数据包括监控画面,训练所述异常状况识别模型所使用的样本异常状况的特征数据包括:人员倒地的图像特征数据和/或火灾的图像特征数据,所述车辆终端系统按照所述异常状况识别模型对人员倒地和/或火灾的图像特征表征方式对所述监控数据进行特 征表征;
    或者,
    所述监控数据包括煤气测量参数,训练所述异常状况识别模型所使用的样本包括:煤气超出安全指标对应的特征数据,所述车辆终端系统按照所述异常状况识别模型对煤气超出安全指标的特征表征方式对所述煤气测量参数进行特征表征。
  15. 一种电子设备包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,其中,所述计算机程序被所述处理器执行:
    基于车联网获取设置于目标地点的监控装置采集到的监控数据;
    按照预先设置的异常状况识别模型所要求的特征数据表征方式,从所述监控数据中提取特征数据,并基于所述异常状况识别模型结合所述监控数据中的特征数据对所述目标地点进行异常状况识别,得到异常状况识别结果,其中,所述异常状况识别模型是根据从异常状况的样本中提取出的特征数据和对应的异常状况分类标签训练得到的;
    在所述异常状况识别结果指示所述目标地点出现异常状况时,检测车辆的车辆状态,确定符合所述车辆状态的车载报警方式;
    按照确定到的车载报警方式,发起针对所述异常状况识别结果的报警操作。
  16. 一种计算机可读存储介质,所述计算机可读存储介质上存储有计算机程序,其中,所述计算机程序被处理器执行时实现如下步骤:
    基于车联网获取设置于目标地点的监控装置采集到的监控数据;
    按照预先设置的异常状况识别模型所要求的特征数据表征方式,从所述监控数据中提取特征数据,并基于所述异常状况识别模型结合所述监控数据中的特征数据对所述目标地点进行异常状况识别,得到异常状况识别结果,其中,所述异常状况识别模型是根据从异常状况的样本中提取出的特征数据和对应的异常状况分类标签训练得到的;
    在所述异常状况识别结果指示所述目标地点出现异常状况时,检测车辆的车辆状态,确定符合所述车辆状态的车载报警方式;
    按照确定到的车载报警方式,发起针对所述异常状况识别结果的报警操作。
PCT/CN2021/113284 2020-09-28 2021-08-18 一种基于车辆终端系统的监控处理方法、系统及相关设备 WO2022062775A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011044125.6A CN111935319B (zh) 2020-09-28 2020-09-28 一种基于车辆终端系统的监控处理方法、系统及相关设备
CN202011044125.6 2020-09-28

Publications (1)

Publication Number Publication Date
WO2022062775A1 true WO2022062775A1 (zh) 2022-03-31

Family

ID=73334337

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/113284 WO2022062775A1 (zh) 2020-09-28 2021-08-18 一种基于车辆终端系统的监控处理方法、系统及相关设备

Country Status (2)

Country Link
CN (1) CN111935319B (zh)
WO (1) WO2022062775A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115131187A (zh) * 2022-07-07 2022-09-30 北京拙河科技有限公司 机场多点定位监测数据的生成方法及系统
CN116215295A (zh) * 2023-03-31 2023-06-06 广东健怡投资有限公司 充电桩监控预警方法、装置、设备及存储介质

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111935319B (zh) * 2020-09-28 2021-01-01 恒大新能源汽车投资控股集团有限公司 一种基于车辆终端系统的监控处理方法、系统及相关设备
CN112887984B (zh) * 2020-12-25 2022-05-17 广州中海电信有限公司 一种用于无线通讯的数据监控系统及其监控方法
CN115085951B (zh) * 2021-03-10 2024-05-28 中国移动通信集团山东有限公司 车联网安全预警方法和电子设备
CN117217651A (zh) * 2023-11-09 2023-12-12 青岛盈智科技有限公司 一种货车运输过程的监控平台

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101958819A (zh) * 2010-10-22 2011-01-26 南京大学 一种基于因特网的智能车载家居监控系统及其工作方法
CN109413124A (zh) * 2017-08-17 2019-03-01 上海擎感智能科技有限公司 基于汽车的物联网控制方法及装置、存储介质、终端
CN110708516A (zh) * 2019-10-30 2020-01-17 一汽轿车股份有限公司 一种车家视频互联系统及车家视频互联方法
CN210038467U (zh) * 2019-05-17 2020-02-07 奇瑞汽车股份有限公司 一种车载智能家居监控设备
WO2020121947A1 (ja) * 2018-12-10 2020-06-18 泰昌 安 遠隔監視ソフトウェアプログラム
CN211557383U (zh) * 2019-10-30 2020-09-22 一汽奔腾轿车有限公司 一种车家视频互联系统
CN111935319A (zh) * 2020-09-28 2020-11-13 恒大新能源汽车投资控股集团有限公司 一种基于车辆终端系统的监控处理方法、系统及相关设备

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103676883B (zh) * 2013-12-17 2016-04-13 中国计量学院 一种基于物联网的餐厨监控装置
CN106809116B (zh) * 2017-01-18 2020-05-19 安徽江淮汽车集团股份有限公司 安全开门控制方法及系统
CN207115049U (zh) * 2017-07-03 2018-03-16 广州城市职业学院 一种物联网智能家居报警控制系统
US10498829B1 (en) * 2019-01-30 2019-12-03 Capital One Services, Llc Smart-device communication in response to event
CN110807896A (zh) * 2019-10-18 2020-02-18 英华达(南京)科技有限公司 安全监护方法、装置及系统
CN110853311B (zh) * 2019-11-08 2023-02-03 北京三快在线科技有限公司 一种车辆的报警方法及装置
CN110942632B (zh) * 2019-12-05 2022-02-15 苏州智加科技有限公司 一种自动驾驶的数据处理方法、装置及设备
CN111612997A (zh) * 2020-05-14 2020-09-01 中电工业互联网有限公司 一种混凝土泵车实时分级报警系统及方法

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101958819A (zh) * 2010-10-22 2011-01-26 南京大学 一种基于因特网的智能车载家居监控系统及其工作方法
CN109413124A (zh) * 2017-08-17 2019-03-01 上海擎感智能科技有限公司 基于汽车的物联网控制方法及装置、存储介质、终端
WO2020121947A1 (ja) * 2018-12-10 2020-06-18 泰昌 安 遠隔監視ソフトウェアプログラム
CN210038467U (zh) * 2019-05-17 2020-02-07 奇瑞汽车股份有限公司 一种车载智能家居监控设备
CN110708516A (zh) * 2019-10-30 2020-01-17 一汽轿车股份有限公司 一种车家视频互联系统及车家视频互联方法
CN211557383U (zh) * 2019-10-30 2020-09-22 一汽奔腾轿车有限公司 一种车家视频互联系统
CN111935319A (zh) * 2020-09-28 2020-11-13 恒大新能源汽车投资控股集团有限公司 一种基于车辆终端系统的监控处理方法、系统及相关设备

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115131187A (zh) * 2022-07-07 2022-09-30 北京拙河科技有限公司 机场多点定位监测数据的生成方法及系统
CN115131187B (zh) * 2022-07-07 2023-09-19 北京拙河科技有限公司 机场多点定位监测数据的生成方法及系统
CN116215295A (zh) * 2023-03-31 2023-06-06 广东健怡投资有限公司 充电桩监控预警方法、装置、设备及存储介质
CN116215295B (zh) * 2023-03-31 2023-09-19 广东健怡投资有限公司 充电桩监控预警方法、装置、设备及存储介质

Also Published As

Publication number Publication date
CN111935319A (zh) 2020-11-13
CN111935319B (zh) 2021-01-01

Similar Documents

Publication Publication Date Title
WO2022062775A1 (zh) 一种基于车辆终端系统的监控处理方法、系统及相关设备
US20120295595A1 (en) Integrated Alcohol Detection And Mobile Communication Apparatus And Method
CN113839904B (zh) 基于智能网联汽车的安全态势感知方法和系统
CN107730841B (zh) 报警处理方法及相关产品
WO2020181840A1 (zh) 分心驾驶监测方法、系统及电子设备
WO2019148684A1 (zh) 一种车内监控方法及设备
CN108298393A (zh) 基于深度网络过滤电梯困人误报的方法
CN110830771A (zh) 智能监控方法、装置、设备及计算机可读存储介质
WO2024055698A1 (zh) 一种包裹检测方法、系统及电子设备
CN110650243B (zh) 一种报警方法、装置、存储介质以及终端
US10847006B1 (en) Physiological-based detection and feedback systems and methods
CN113911872B (zh) 故障处理方法、系统及预警救援系统
CN110928305A (zh) 用于铁路客运车站巡更机器人的巡更方法及系统
CN112052774A (zh) 行为检测方法及装置
CN115904883A (zh) 一种rpa流程执行可视化异常监控方法、装置及介质
CN110579440A (zh) 氢气安全控制方法、控制装置、存储设备及氢能汽车
CN110852253A (zh) 梯控场景检测方法、装置及电子设备
WO2019227374A1 (zh) 报警方法、装置、系统及电子设备
US11810149B2 (en) Method and device for monitoring a passenger of a vehicle
US11763561B2 (en) Information processing apparatus, information processing method, and program
CN211979500U (zh) 一种车载信息汇总处理系统
US20230162755A1 (en) Object left-behind detection method, object left-behind detection apparatus, and program
CN215268530U (zh) 一种监控系统
WO2021095153A1 (ja) ドライバー異常対応システム、ドライバー異常対応方法、及びプログラム
KR101464974B1 (ko) 보험사 연계용 외장형 통신모듈이 구비된 블랙박스장치를 이용한 교통사고 처리 시스템

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21871148

Country of ref document: EP

Kind code of ref document: A1