RU2795025C2 - Multifunctional media complex for transport with network management and video analytics - Google Patents

Abstract

FIELD: computer technology; specifically video analytics systems.

SUBSTANCE: media complex additionally contains a thermostat with a temperature sensor connected to it, infrared heaters, an uninterruptible power supply, a battery, an operation analysis unit, a cooling fan connected to the monitoring and control unit, a video signal splitter, additional monitors and a unit generating a monitor control signal, a video analytics module consisting of a capture unit with a set of digital video cameras, and a software unit.

EFFECT: increase of reliability and expansion of functionality of the system.

5 cl, 1 dwg

Description

The present invention relates to means for presenting audiovisual information, including advertising, and can be used in vehicles of any type (buses, trolleybuses, trams, metro taxis and other vehicles), including a video analytics module with the ability to receive data from cameras, processing and transfer to an external service.

Known information and advertising system of a passenger vehicle (RF patent 59503, B60R 13/00, G09F 27/00, publ. power supply, a video camera installed with the ability to shoot inside and outside the cabin and connected to the information exchange unit, which is made in the form of a hard disk connected to the uninterruptible power supply unit and interconnected, a network board and a computer based on the motherboard associated with the receiver, video camera, monitor and with a network board on which the antenna is installed, the computer based on the motherboard includes an integrated video card with memory and an integrated sound card, and the receiver is connected to the uninterruptible power supply unit through the ignition circuit and the relay unit of the vehicle. The system provides the ability to control and manage vehicles on the routes and helps to improve traffic safety and increase the volume and thematic diversity of information received by passengers, the driver and the dispatch center.

An automotive information media complex is known (RF patent 44848, G06F 5/00, published on March 27, 2005), containing a control unit, a means for reproducing information from a media capable of reproducing audiovisual information, a display means and an audio playback means, a display means and the sound reproduction means are located in the cabin of the bus, minibus or fixed-route taxi, the first input of the display means and the first input of the sound reproduction means are connected to the corresponding outputs of the means for reproducing information from the media, additionally contains one sensor, a control unit designed to process information from the sensor and issue control signals , containing a processor and a power management device, the input of which is connected to the first output of the processor, one input of which is connected to the output of the sensor, the second output of the processor is connected to the second input of the means for reproducing information from the media, the third output of the processor is connected to the second input of the display means, the first output of the power management device is connected to the corresponding input of the audio playback means, the second output of the power management device is connected to the corresponding input of the display means, the third output of the power management device is connected to the first input of the media playback means.

An information and advertising system is known (RF patent 53480, G09F 9/00, G09F 5/00, published on 06/10/2005), containing one information terminal connected to the transmission medium, a storage module and a central station connected to the transmission medium to form information and advertising materials from persons interested in its distribution and a storage module. The interface module and the peripheral module, connected by means of an interface device, are part of an information terminal capable of informationally functioning autonomously, having a unique address that uniquely identifies it in the information and advertising system, and located in a mobile public transport object moving in the territorial zone of the system. The interface module consists of a visualization panel connected to the interface device, displaying graphical dynamic information, a sound reproducing device, an information consumer console, an operational control panel, a visualization panel, a sound reproducing device and an information consumer console, located in the passenger compartment of a mobile public transport facility in the place where they can be viewed by passengers. The peripheral module consists of an adapter connected to the transmission medium and an interface device, and an input module for information and promotional materials connected to the interface device. The information terminal is powered by a converter from a power source, and the central station is connected to the transmission medium by means of an adapter block.

A common disadvantage of the above technical solutions is the lack of the ability to account for and control the amount of displayed information material, monitor the operation of equipment in real time, quickly replace audio and video materials, automatically play a playlist depending on the geographic location of the vehicle, broadcast a running line and information blocks on monitor in real time, the ability to schedule airtime depending on the current time, time of day and day of the week and the ability to broadcast effective and relevant content - weather forecast, current time, news, vehicle speed, as well as the lack of fixation and video surveillance designed to for processing and saving data from cameras inside the vehicle and further transfer to an external service.

Closest to the claimed invention is an advertising and information device (RF patent 77086, G09F 21/04, G09F 27/00, G07C 1/00, publ. 10.10.2008), installed on a vehicle, containing interconnected by known means monitoring and control devices, a power supply unit connected to the vehicle battery, an interconnected monitor, an information storage device, a wireless access modem for communicating with virtual networks, an RS-232 serial port and a USB input-output port, a receiver combined with a satellite navigation antenna , as well as a module for wireless data transmission and transmission for transmitting information to the user. The power supply unit is combined and connected to the batteries of autonomous power supply. The storage device is made removable.

The disadvantage of the well-known advertising and information device, taken as a prototype, is the lack of the ability to control the performance of each media complex in real time, receive reports on the actual presentation of advertising and information materials, start broadcasting a ticker and information blocks on advertising monitors, prompt replacement of advertising video materials, lack of the ability to broadcast effective and up-to-date content of the weather forecast, current time, news, as well as the low reliability of the device.

The main objective of the proposed invention is to create an efficient multifunctional media complex for transport with network control with increased reliability, expand the arsenal of information and advertising capabilities, as well as provide video analytics functions with subsequent data transmission for recognition.

The technical result, which provides a solution to the problem, is to increase the reliability and expand the functionality of the system.

The advantages of the claimed invention are:

- maintaining the optimal temperature regime of functional blocks;

- ensuring uninterrupted power supply of all functional units;

- management of the entire network of media complexes from the control server;

- monitoring the performance of each media complex in real time;

- tracking the route of the vehicle on which a specific media complex is installed with the ability to save information;

- automatic playback of information material depending on the geographical location of the vehicle;

- receiving reports on the actual number of submissions of each advertising material and the actual number of operating media complexes;

- providing the advertiser with remote access to monitor and manage the progress of the advertising campaign;

- start broadcasting the ticker and information blocks on the monitor in real time;

- recording video and audio information inside and outside the vehicle and prompt transmission to the server.

- automatic updating of information materials when in the coverage area of wireless networks;

- automatic detection of the faces of vehicle passengers;

- detection and normalization of the face image.

The technical result is achieved by the fact that in a well-known advertising and information device containing a control and management unit, a power supply unit, a monitor, an information storage device, a wireless access device, a block of ports, a satellite navigation receiver combined with an antenna, and a wireless data transceiver module, a thermostat with a temperature sensor connected to it, the first and second infrared heaters, an uninterruptible power supply, a storage battery, an operation analysis unit, a cooling fan connected to the monitoring and control unit, a video signal splitter, additional monitors and a monitor control signal generation unit, the thermostat outputs are connected to the inputs of the power supply unit, one of the inputs of the uninterruptible power supply and the input of the analysis unit, one input of the thermostat is connected to the vehicle battery, the uninterruptible power supply is connected to the power supply unit and the battery, the outputs of the power supply unit are connected to the inputs of the monitoring and control unit, the unit analysis, information accumulator, monitor control signal generation unit, monitoring and control unit is connected to the information accumulator and analysis unit, one of the outputs of the control and control unit is connected to the input of the monitor control signal generation unit, one of the outputs of the control and control unit is connected to one of monitor inputs and with a video signal splitter, other outputs of the monitoring and control unit are connected to the inputs of the port unit, satellite navigation receiver, wireless data transceiver module and wireless access device, while the monitor is connected to the outputs of the power supply unit, the monitor control signal generation unit and the splitter video signal, which is connected to additional monitors, a video analytics module, consisting of a capture unit with a set of digital video cameras 25, the number of which varies depending on the number of landing sites of the vehicle (from 3 to 6), and a program unit 26.

The claimed technical result is achieved by ensuring the optimal temperature regime of functional units, which is achieved by a thermostat equipped with a temperature sensor, two infrared heaters and a cooling fan, and adding a video analytics module.

Uninterrupted power supply of all functional units is provided by an uninterruptible power supply and a rechargeable battery.

Management of the entire network of advertising monitors from the control computer is provided by a wireless access device and/or a wireless data transceiver module using a GPRG/WiMAX/3G network via a closed VPN channel.

Control of the operation of each advertising monitor in real time is carried out thanks to a wireless connection and a monitoring program at the dispatcher.

The determination of the coordinates of the vehicle on which a particular media complex is installed is provided by a satellite navigation receiver and the transmission of the vehicle coordinates via a wireless connection to the control server, where the obtained coordinates are superimposed on the terrain map.

Automatic playback on the monitor of information and advertising materials, depending on the geographical location of the vehicle, is carried out using the control and management unit due to the coordinates of the vehicle received from the satellite navigation receiver.

Obtaining reports on the actual number of presentation of each advertising material and the actual number of working monitors is achieved by maintaining statistics of file playback (start time, end time, coordinates, file name, etc.) and transfer to the control server, where information received from all media complexes is combined , processed and on the basis of it reporting is formed.

Providing the advertiser with remote access to monitor and manage the progress of the advertising campaign is provided through access to the server.

The launch of the broadcast of the ticker and information blocks on the advertising monitor in real time occurs by overlaying the ticker on the main image of the received data from the server.

Information materials are automatically updated when you are in the wireless access zone using a wireless access device.

Detection and fixation of persons in public transport using cameras located opposite the entrance doors is carried out during the entrance of passengers. A picture is taken, normalization and formation of face feature vectors are performed.

The image is normalized and identified using special algorithms and the determination of face element vectors.

The claimed invention is illustrated in the drawings, where in Fig. 1 shows a block diagram of a multifunctional media complex for transport with network management and video analytics.

A multifunctional advertising media complex for transport with network management and video analytics, contains a control and management unit 1, a power supply unit 2, a vehicle battery 3, a monitor 4, an information storage device 5, a wireless access device 6, a block of ports 7, a satellite navigation receiver 8, a wireless module data transceiver 9, thermostat 10, key 11, temperature sensor 12, first infrared heater 13, second infrared heater 14, uninterruptible power supply 15, battery 16, operation analysis unit 17, cooling fan 18, video signal splitter 19, additional monitors 20, monitor control signal generation unit 21, LED information board 22, temperature and voltage sensor unit 23, video camera and microphone 24, image capture unit from video analytics cameras 25, software unit 26.

The control and management unit 1, using a software package (not shown in Fig.), monitors the state of the system, receives data on the location of the vehicle from the satellite navigation receiver 8 (GPS / GLONASS), through the wireless data transceiver module 9 (GPRS, EDGE , UMTS, CDMA2000, Wi-Fi, WiMAX, Bluetooth) communicates through the control center server (not shown in the figure), with the dispatcher, the Internet, clients, displays visual information on monitor 4 (additional monitors 20), outputs sound information to the vehicle warning system. The monitoring and control unit 1 additionally monitors the temperature inside the case and the elements of the monitoring and control unit 1 by means of a temperature and voltage sensor unit 23 (system, processor, chipsets, etc.), an information storage device 5, and using the built-in controller - the supply voltage ratings on the unit control and management 1, and if their values go beyond the allowable limits, the information is transmitted via GPRS to the dispatcher, and at the end of the transmission, the device is turned off until the cause is clarified and corrected.

The power supply unit 2 provides power to the functional units of the system and peripheral equipment with stabilized voltages when the voltage of the vehicle battery 3 varies from 11 V to 30 V, which allows it to be used for vehicles of various types with different voltages of the on-board network.

Monitor 4 supports D-SUB, HDMI (for FULL HD content), LVDS, DVI on LCD panel with high resolution (1920×1080) and LED backlight, which reduces power consumption by more than two times.

The information storage 5 is based on an SSD with high capacity, high speed performance and high vibration resistance, or based on a flash drive.

The module for wireless data transmission and reception is made on the basis of a GPRS terminal with the possibility of a hardware reset of the terminal in case of its inoperability.

Port block 7 for peripheral equipment includes SATA (Additional storage connection), COM/LPTYUSB2.0 (Connection of additional control and data modules), Full-Mini PCI Express (Connection of additional storage or high-speed wireless access device), Ethernet RG45 (Connection of a router and third-party systems), 6 audio channels (Connection of warning systems and sound accompaniment) and allows you to further expand the functionality of the system if necessary.

The satellite navigation receiver 8 can be made in a protected design with a built-in magnetic antenna and a magnetic mount with the ability to connect an external antenna.

The video camera and microphone 24 are made in a protected design with the ability to record a color video image at any time of the day.

The wireless access device 6 is designed to transmit information and advertising materials to the control and management unit 1 and can be made in the form of a PCI card (including with a narrow form factor), an external antenna and support for operating modes: Client, Access Point, Access point + client for the possibility of providing clients with both Internet access through the media complex and additional services via Wi-Fi.

To ensure a stable temperature of the blocks of the media complex, a thermostat 10 is installed inside the case with a temperature sensor 12 connected to it, the first infrared heater 13 and the second infrared heater 14, located in close proximity to the information storage device 5. The thermostat 10 is powered from the vehicle battery 3 through the key 11 The thermostat 10 consists of several modules: temperature control in the housing, control key for the first and second infrared heaters, and power supply start enable key. At a temperature below 0°C, or another pre-set temperature, the thermostat 10 connects the first infrared heater 13 and the second infrared heater 14 to the battery 3 of the vehicle with a control key to heat the system blocks. When the set temperature is reached, the thermostat 10 sends a signal to enable the power supply 2. The thermostat 10 has a temperature hysteresis.

The uninterruptible power supply 15 includes a charger for the battery 16, a module for protecting the battery 16 from full discharge / overcharging and provides charging of the battery 16 in the presence of external power supply of the media complex from the battery 3 of the vehicle, and in case of power failure maintains the media complex operability by switching the power supply of the media complex units to the battery 16.

Block analysis work 17 is made as a separate module. The software complex of the monitoring and control unit 1 constantly transmits data on its status and the status of the wireless data transceiver module 9 to the operation analysis unit 17, which analyzes the incoming information and, in case of inconsistency with its specified parameters or a delay in the receipt of data for analysis, the operation analysis unit 17 gives a signal to restart the software complex of the monitoring and control unit 1, the wireless data transceiver module 9.

The work analysis unit 17 receives signals about the state of operation from the thermostat 10 and the power supply 2, and in case of an error in operation, the corresponding information is transmitted via the GPRS channel to the dispatcher and additionally, if the power supply 2 fails, after the information is transmitted to the dispatcher, the command to turn off the media complex is given. Additionally, the analysis unit 17 displays information about the state of the thermostat 10 and the power supply to the LED information board 22 for troubleshooting.

The cooling fan 18 is designed to maintain the temperature of the system blocks in the operating range and is turned on by the monitoring and control unit 1 when the upper limit of the temperature range is reached.

The video splitter 19 provides the ability to connect additional monitors 20 installed in the passenger compartment and/or outside the vehicle.

The monitor control signal generation unit 21 allows generating and transmitting the signal to turn on and off the monitor 4 and the video signal splitter 19 for additional monitors 20.

The image capture unit works with the video stream received through the video analytics cameras 25 connected to the uninterruptible power supply, and is intended for video recording of the faces of incoming passengers and the formation of a set of vectors with subsequent transmission to the identification (recognition) server.

The video stream received from the capture unit 25 is transmitted to the program block 26. The video stream goes through the process of detection, normalization and vectorization, and then, using the transceiver 9, transmits the generated set of face images to an external identification server.

The multifunctional media complex for transport with network control and video analytics works as follows: when voltage is applied from the battery 3 of the vehicle, the thermostat 10 outputs voltage to the power supply unit 2, uninterruptible power supply 15, controls the temperature inside the case, and if it is higher or equal to the set value, it supplies permission signal to turn on the power supply unit 2. If the temperature inside the case is below the set value, the thermostat 10 supplies power to the first infrared heater 13, which heats the blocks in the case and the second infrared heater 14, which locally heats the information storage device 5. When the temperature inside is reached body of the specified range, the thermostat 10 issues a signal to enable the power supply unit 2 and continues heating, controlling the temperature and maintaining it automatically in the specified range. The thermostat 10 generates and transmits information to the monitoring and control unit 1 about power failures of the vehicle. The power supply unit 2 generates and supplies power supply voltage for the monitoring and control unit 2 (simultaneously giving the start permission signal), the monitor and at the same time generating a signal to turn on the monitor by applying a signal to the monitor control signal generation unit and other peripheral equipment. A feature of the power supply unit 2 of the media complex is the stabilization of the supply voltage when the vehicle battery voltage 3 changes in the range from 11 V to 30 V, which allows it to be used in different types of vehicles. The control and management unit 1 in the absence of visual advertising information can turn off the monitor through the control signal generation unit of the monitor 21.

The software installed on the control computer sets the content of each playlist and the geographic area (coordinates) of its operation. This information is updated and written to the information storage device 5 using the control and management unit 1 through the wireless data transceiver module 9.

When the vehicle moves from one geographical area to another, the control and management unit 1 receives coordinates from the satellite navigation receiver 8, tracks the location of the vehicle and automatically switches on the broadcast of the corresponding playlist of information through the monitor 4 (video signal splitter 19 and additional monitors 20).

While the vehicle is on the route line, information (date, current time, weather, weather forecast, news, announcements, etc.) is transmitted to the media complex via the GPRS channel, received by the wireless data transceiver module 9 and displayed on monitor 4 ( additional monitors 20) in the form of a running line or an information block. Real-time control, monitoring the status of the multifunctional media complex for transport, as well as downloading and launching the ticker is carried out by transmitting data via GPRS channels or other channels.

IP video cameras located opposite the landing sites transmit the video stream to the image capture unit. Next, the video stream is redirected to a software block that performs detection and normalization, allowing you to analyze video images and identify the faces of passengers. After that, a set of face images is transferred to an external identification server.

The proposed multifunctional media complex for transport with network management and video analytics is highly reliable due to maintaining optimal temperature conditions and ensuring uninterrupted power supply to functional units and has advanced functionality consisting in:

- maintaining the optimal temperature regime of functional blocks;

- ensuring uninterrupted power supply of all functional units;

- management of the entire network of media complexes from the control server;

- monitoring the performance of each media complex in real time;

- tracking the route of the vehicle on which a specific media complex is installed with the ability to save information;

- automatic playback of information material depending on the geographical location of the vehicle;

- receiving reports on the actual number of submissions of each advertising material and the actual number of operating media complexes;

- providing the advertiser with remote access to monitor and manage the progress of the advertising campaign;

- start broadcasting the ticker and information blocks on the monitor in real time;

- recording video and audio information inside and outside the vehicle and prompt transmission to the server;

- automatic updating of information materials when in the coverage area of wireless networks;

- automatic detection of the faces of vehicle passengers;

- detection and normalization of the face image.

Claims (5)

1. A multifunctional media complex for transport with network management and video analytics, containing a control and management unit, a power supply unit, a monitor, an information storage device, a wireless access device, a port block, a satellite navigation receiver combined with an antenna, and a wireless data transceiver module that differs the fact that it additionally contains a thermostat with a temperature sensor connected to it, the first and second infrared heaters, an uninterruptible power supply, a battery, an operation analysis unit, a cooling fan connected to the monitoring and control unit, a video signal splitter, additional monitors and a control signal generation unit monitors, a video analytics module consisting of a capture unit with a set of digital video cameras, the number of which varies depending on the number of landing sites of the vehicle and the software unit. 2. The multifunctional media complex according to claim 1, characterized in that the inputs of the power supply unit, one of the inputs of the uninterruptible power supply and the input of the analysis unit are connected to the thermostat outputs, one input of the thermostat is connected to the vehicle battery. 3. The multifunctional media complex according to claim 1, characterized in that the uninterruptible power supply is connected to the power supply unit and the battery, the outputs of the power supply unit are connected to the inputs of the monitoring and control unit, the analysis unit, the information storage unit, the monitor control signal generation unit. 4. The multifunctional media complex according to claim 1, characterized in that the monitoring and control unit is connected to the information storage unit and the analysis unit, one of the outputs of the monitoring and control unit is connected to the input of the monitor control signal generation unit, one of the outputs of the monitoring and control unit is connected to one of the monitor inputs and with a video signal splitter, the other outputs of the monitoring and control unit are connected to the inputs of the port unit, satellite navigation receiver, wireless data transceiver module and wireless access device. 5. The multifunctional media complex according to claim 1, characterized in that the monitor is connected to the outputs of the power supply unit, the monitor control signal generation unit and the video signal splitter, which is connected to additional monitors.

Images