RU47546U1 - DEVICE OF AUTOMATED CONTROL OF THE ENVIRONMENT IN THE AUDIENCE HALLS - Google Patents

Abstract

The system of automated access control and the situation in the auditorium comprising at least one video camera installed in the auditorium, adapted to receive images of the auditorium, and at least one computing device with memory, connected via a local area network, and according to this utility model in the memory of the computing device, a database is formed storing data reflecting the filling of the auditorium, according to the tickets sold, and computing the system is able to process the video signal received from the video camera to obtain data on the filling of the auditorium with the possibility of storing these data in memory for subsequent analysis, as well as the ability to compare the data with data stored in the database and with the ability to generate a violation signal of the established mode in case of non-compliance compared data by more than a predetermined threshold value. The method underlying this system allows you to effectively control the station in multiplex cinemas.

Description

Technical field

This utility model relates to the field of technical security systems and automated monitoring, and more specifically relates to automated monitoring devices in auditoriums.

State of the art

The prior art automated (hardware-software) systems and methods for ensuring security and monitoring of various objects. Most often, such systems are used to ensure the safety and monitoring of a protected premises or territory, in particular, to monitor the movement and location of mobile objects in this room, in particular people and cars. Known systems use video cameras combined with video recording means. General control over the situation in the room is usually carried out by the operator, or in an automated mode the video signal received by the camera using hardware and software is compared with predefined “alarm” video images with the ability to generate an alarm if they coincide.

Also known from the prior art are automated access control systems and the number of people in a room. Such systems are based on the automated reading of passes (tickets or tokens) when people pass into the controlled area. Reading is carried out using a computer

systems with an appropriate electronic reader, examples of such systems are automated access systems installed at enterprises (for example, Siemens) and automated systems for filling parking spaces, taking into account the number of cars that have entered and left and automatically prevent overfilling of the parking lot.

For example, from the patent of the Russian Federation 2231123, a video control and room monitoring system is known containing a TV-camera connected in series, an automatic signaling circuit about the presence of a moving object in the field of view of the TV-camera, and a video control device (VKU). The automatic alarm circuit includes a strobe pulse generator, which is moved by the operator on the VKU screen to the zone of increased interest. The video signals of two consecutive frames allocated using a strobe pulse are fed into the corresponding memory devices (memory) and compared by a comparator. When the difference exceeds the threshold, the alarm indicator and VCR are turned on to record the television signal. A TV camera is a tool of the same purpose as a television signal sensor, an automatic signaling circuit is equivalent to a set of blocks, which includes a clock selector, a frame signal conditioner and a motion detector; VKU is equivalent to a video control unit. This system does not allow to effectively control a room with a sufficiently large number of objects to be controlled. There is no possibility of collecting statistical data on the controlled object and the mobile objects located in it.

Known from the patent of the Russian Federation 2137203 a system for monitoring the movement of vehicles, which includes a mobile checkpoint, many stationary control zones, each of which represents

conditional rectangle covering a specific local section of the road, switching devices installed near the road at a given distance from the specified rectangle. In each control zone, video cameras, lamps, a separator of lanes and directions of movement are installed. The system also contains a hardware-software complex installed at a mobile checkpoint. The complex includes vehicle identification computers with which video cameras are connected through switching devices for a certain time, a server for controlling and searching vehicles in the database, a local area network, a video surveillance system connected to the video camera through a switching device, a telephone communication system, and a telecommunication system . This system allows with a certain error to identify individual mobile search objects in controlled areas and register them. The limitations of this system are the limited control zones (cameras are fixed and have a limited viewing angle), and the cameras are static. In addition, this system does not provide for the possibility of high-precision automated recognition of the situation in the control zone. There is no duplication of the work of individual elements of the system, so the recognition accuracy is limited. There is no way to save high-definition images in the system memory for subsequent analysis. There is no possibility of collecting statistical data on the controlled object and the mobile objects located in it.

The system for signaling and controlling a fleet of vehicles, monitoring the status of moving objects and their movement in real time, protecting stationary and mobile objects, and also monitoring the environment is known from RF patent 2196358. The system contains

communication center dispatch center and consumer equipment containing an on-board computer, interface, processor, analog-to-digital video signal converter, memory device, digital-to-analog audio signal converter, video signal converter, a group of security sensors, a keyboard, a modem, a video monitoring camera, an audio system, a television monitor, an autonomous power supply unit . The control room includes a computer for differential correction of the coordinates of the observed objects, a server for monitoring protected objects, communication equipment computers, a computer network, modems, transceivers with antennas, a power supply unit, oscillators, an audio signaling device, an executive door unit, and marker lamps. This system allows you to control the protected area by receiving and processing a signal from sensors and video cameras. It is possible to duplicate the operation of sensors and video cameras to increase recognition accuracy. The preservation and analysis of images of protected objects of high accuracy is not provided. There is no possibility of collecting statistical data on the controlled object and the mobile objects located in it.

Known from the prior art, video monitoring systems allow you to control a specific area and the mobile objects located in it with a certain accuracy. Known systems for access control to the premises allow you to control and take into account the access of mobile objects to the premises, but do not allow you to effectively control and quickly respond to the actions of mobile objects inside the premises. At the same time, in some cases it is necessary to carry out both effective control and statistical accounting of people's access to the room and monitor their presence inside the room. This problem is especially acute in large multiplex cinemas,

otherwise called movieplexes or multiplexes. This is due to the fact that in such complexes the number of service personnel, including those providing security, is relatively small compared to the number of spectators, which increases the risk of emergency situations and makes it difficult to quickly eliminate them. It was also established that the damage from unauthorized visits to cinemas (without a ticket) can be a significant amount.

Utility Model Essence

The present utility model is based on the technical task of creating such a device for automated control of the situation in the auditoriums, which would provide effective control and statistical accounting of spectators' access to the auditorium and would allow monitoring the situation in the auditorium with the ability to quickly and reliably respond to emerging non-staff situation.

The specified technical problem is solved due to the fact that the proposed device for automated control of the situation in the auditorium containing at least one video camera installed in the auditorium, adapted to receive images of the auditorium, and at least one computing device with memory through a local area network, and according to this utility model, a database is stored in the memory of the computing device storing data that reflects the filling Hall, according to the tickets sold, and the computing device is adapted to process the video signal received from the video camera to obtain data on the filling of the auditorium with the possibility of storing this data in memory for subsequent analysis, as well as the ability to compare the data with data stored in the database and the ability to generate a signal

violations of the established regime in the event of a mismatch of the compared data by more than a predetermined threshold value.

Preferably, the device further comprises at least one video camera to provide effective coverage of the entire space of the hall with the possibility of duplication of the video signal. Preferably, the local area network is adapted to transmit a video signal from a video camera to a computing device without causing interference to the electronic equipment of the room.

Preferably, data describing emergency situations, including smoke, fire, congestion, are recorded in the memory of the computing device, and the computing device is adapted to process the signal received from the video camera to generate data about the situation in the auditorium and compare these data with data characterizing emergency situations with the ability to issue alarm in case of coincidence of the compared data.

Preferably, the device comprises at least one movable video camera configured to aim at the target and obtain a target image suitable for further analysis by the operator. The movable video camera is configured to rotate in the vertical and horizontal plane and / or change the focal length and / or change the aperture and / or focus setting to provide guidance to the target.

Advantageously, the device comprises a hardware-software interface for providing communication with an operator.

Preferably, a personal computer or server is used as a computing device with memory, the server being adapted to process up to 4 video streams. If the device according to the present utility model includes more than 4 cameras, it further includes at least

one additional computing device connected to a local area network and interfaced with the aforementioned computing device. The device, according to the present utility model also includes, implemented on hardware and software, a device for storing data on tickets sold, adapted to transmit the accumulated data to a database formed in the memory of a computing device. The device according to the present utility model also includes a device for controlling the entrance of spectators, which is a means of automated reading of a ticket, adapted to allow a spectator to enter the auditorium in case of presentation of an appropriate ticket and fixing in memory the number of spectators who have passed in accordance with the tickets presented by them. The device for controlling the entrance of the audience is preferably implemented on a computer with a barcode reader, which is applied at the ticket office to the ticket.

Detailed description of utility model

The present utility model will be understood by a person skilled in the art from the following more detailed description of a specific non-limiting example of a device implementation according to a utility model with reference to the figure of the drawings, in which:

- figure 1 depicts a General diagram of a specific example implementation of the device according to the present utility model;

The device according to this utility model is implemented, in particular, in a specific hall control system (hereinafter - VHC), the device and the operation of which are described below in an amount sufficient for its implementation by a specialist in this field.

VHC is a hardware-software complex designed to control the attendance of viewers, as well as to support public services

order and safety in large cinemas, otherwise called cinema complexes or multiplexes.

Shown schematically in figure 1 of the drawings, a non-limiting example of the implementation of the device according to the present utility model is intended for use in a cinema with two auditoriums. The situation in the auditoriums 1 and 2 of the cinema is monitored by a device including four highly sensitive video cameras 3, 4, 5 and 6, respectively placed two in each room and installed with the ability to effectively cover the entire auditorium with duplication. The video cameras are electrically connected via the interface to the server 7, intended for processing video streams coming from these cameras. The server 7 is connected electrically with a computer 8 that implements an interface with the operator. The server 7 is also electrically connected to the cinema box office computer 9, in which a database of sold tickets is generated. Server 7, computer 8 and cash register computer 9 are connected via a local network to which video cameras 3, 4, 5 and 6 are also connected via an interface. Video capture cards are installed on the cameras (not shown in FIG. 1).

The device operates as follows. Data on the number of tickets sold for specific sessions, generated in the database, is transmitted over the local network from computer 9 to the box office of the cinema (most modern cinema halls are equipped with a computer system for selling tickets) to server 7. Data is transmitted in the form of a database reflecting the filling of specific places in each from the halls adapted to work together with the processing algorithm. Conventionally, such a mapping can be represented by a matrix-table, in which the rows represent the rows of the cinema hall, and each position in the table is a visual place. Place on

which the ticket is sold, is conventionally represented as 1, the place for which the ticket is not sold at the box office is represented as - 0.

Counting the audience and monitoring the situation in the auditorium in real time during the session is carried out by analyzing the video image from the highly sensitive cameras 3, 4, 5 and 6 installed in the cinemas, providing clarity of playback and with a limited level of illumination existing in halls 1 and 2 at film demonstrations. As a result of image analysis using processing programs on the server 7, data is generated on which of the places is full. Carry out a "calculation" and assess the filling of the cinema hall. As a result of this calculation, a model of the actual filling of the auditorium is formed in the memory of the server 7 of the system (for example, in the form of a matrix table, where the rows correspond to the rows of the cinema hall, and each element is a place, with 1 - a place filled, 0 - a place free). By comparing the obtained real model and the model formed according to the data obtained from the computer 9 of the cinema box office (for example, performed programmatically in the form of arithmetic operations with matrices), data are obtained on the discrepancy between the real filling and the data on tickets sold.

As high-sensitivity cameras required for use in low light conditions during a session, you can use: color video cameras (for example, WAT-220, presented on the Russian market by Watec), black and white video cameras (for example, WAT-902H, Watec ), infrared cameras (for example, TVC200ML, f. Central Research Institute "Electron"), thermal imaging cameras (for example, TV-04 Ket, f. NTPP NIIITsTP).

In halls 1 and 2, in the general case, not four can be installed, but a different number and combination of the above cameras, depending on the specific

the needs of device users, as well as operating conditions. Cameras can be installed to ensure duplication of each other's work and mutual overlap of control zones to ensure increased reliability of the device. The cameras are electrically connected through an interface (for example, a composite video signal or Ethernet) with a computing device implemented on the server. The server is connected to a personal computer that provides an interface with the operator.

In general, a computing device can be implemented as a specialized computing device (for example, an industrial computer based on modules of the PC-104 standard using the Multicor processor) or on the basis of a universal personal computer (for example, with an Intel Pentium processor) equipped with software that allows you to receive and digitize information from video cameras and store the information received in the database.

More complex systems covered by this application are characterized by the use of additional cameras for a more detailed analysis of the situation in the room. If a mobile video camera is used in the system (for example, WV-CS854 from Panasonic or more sensitive analogues on the market), to obtain an enlarged image of an object, the computing device is electrically connected via an interface (for example, RS-485) to the mobile video camera moreover, the computing device is adapted to control a mobile video camera over a serial communication channel, due to the use of, for example, standard software. Mobile video camera designed to obtain a detailed enlarged image of targets used for additional recognition of target parameters or detailed

tracking a target at the request of a system operator connected to it through a hardware-software interface (for example, implemented on a personal computer with a monitor). The operator has the ability to receive data, as well as control the operation of a mobile video camera through a keyboard or other specialized interface such as a human computer (for example, a joystick).

It is also possible automated analysis of the situation in the cinema due to a special algorithm embedded in the system. In particular, this is achieved by implementing the following algorithm: obtaining one large video image of the auditorium from the first camera, analyzing it in a computer for detection and recognition of alarm situations in the hall (by comparing it with models of alarm situations stored in the computer's memory) and determining coordinates of the place where the alarm situation takes place and pointing the moving video camera (second camera) with a variable focal length to this place to obtain an enlarged image of the alarm situation tion for its further analysis (for example, by an operator or software) and storing in the system memory.

If the system is designed to operate in a cinema with more than one hall, several video cameras are installed in each cinema. The upper limit of the number of cameras to be installed and their technical characteristics (resolution, sensitivity, etc.) are limited by the required cost of the system (the price of cameras), and the lower limit for choosing this part of the hardware is determined by the following conditions: the cinema hall must be full, possible camera fixing points are located on the walls on the side or on the ceiling and are agreed in advance in accordance with the layout of the visual places in the hall, when processing the image, one chair occupied by the viewer falsely

have at least 30 pixels wide in a resolution frame of 720 × 576. The same restrictions apply when choosing the focal length of camera lenses.

To transmit a signal from video cameras to computing platforms, any communication channel known to the person skilled in the art is used that is not subject to external interference of the cinema and does not interfere with the equipment for cinema display. In this case, the power and frequency characteristics of the electronic film project and sound equipment should be taken into account to eliminate crosstalk and interference, which is easily achieved both by choosing a communication channel and by installing lines at a sufficient distance from the corresponding cinema equipment.

Video capture and its conversion is carried out by capture cards (for example, bt-878 standard capture cards available on the market). Almost any video capture device available on the market is suitable for the operation of this system with different efficiencies.

Typical computing platforms (servers) intended for working with video applications of this kind are used as a computing device. Typical servers currently on the market can process up to 4 video streams simultaneously, so if more than 4 cameras are installed in the cinema, then more than one server controls the situation in it. At the same time, the server is coordinated by methods known to the specialist, in order to ensure parallel processing of video streams. In addition to a computer providing an interface with an operator, servers can be connected to servers on a local network (for example, those implemented on personal computers), on which application programs can be launched to output data received and processed by the system (data on the actual quantity

viewers present and their location in the auditorium, video images (general plan and enlarged plan of individual places, archival records from the system’s memory).

Processing of images received by cameras (video signal) is carried out in a computing device (on computing platforms) that meet certain requirements for the speed of operations. In particular, the processing speed should provide the ability to compare data in a mode close to real time. Other indicators of computing platforms are selected based on the required applications that the user (for example, according to the types of presentation of information to users and data storage, graphical and statistical application programs).

As a computing device with memory, a personal computer or server was used, the server being adapted to process up to 4 video streams. If the device according to the present utility model includes more than 4 video cameras, it further includes at least one additional computing device connected to the local area network and interfaced with the aforementioned computing device. Due to the use of data processing algorithms, it is possible to implement a server with the ability to process up to 6 video streams (due to this, it is possible to save the number of servers), but the processing mode for up to 4 video streams is preferable for modern hardware.

Counting the number of spectators in cinemas in accordance with the sessions, forming an array of the received data, storing the received data in a format convenient for statistical analysis and comparing it with the data on tickets sold can be carried out in various ways.

For example, a series of videos and measurements of the number of viewers is performed at each session. Each measurement of the number of viewers occurs for a certain time at certain points in time, relative to the beginning of each session, in accordance with the configured configuration. Such an approach allows obtaining statistically reliable data and minimizing statistical error. Before the start of the working day, the SKZ system, upon its automatic request through the information system of the cinema (multiplex), receives a schedule of sessions for each hall, in accordance with which the beginning of the measuring cycles and their end will be determined. During the working day, the VHC system periodically sends requests for confirmation of the correctness of the schedule in order to insure against a situation of canceling or transferring the session. The ticket sales program and the SKZ system work synchronously, the time difference between the servers on which these systems are running should not exceed 5 seconds to ensure operation in a mode close to real time.

When measuring the number of spectators, a photograph is also taken of the entire auditorium at the time of measurement, with the date, time, name of the cinema, hall number, and the estimated number of spectators displayed on it. Recognition of the fact of filling a place occurs by methods known in the art. The aforementioned lower limits of the requirements for video cameras eliminate the reading error. By converting the video signal data of each of the cameras, as well as comparing the data from cameras installed with duplication, the system receives data on the filling of the cinema hall at the moment. In fact, the system compares the fact of filling each place, forms according to these data and stores in memory a table reflecting the filling, similar to the table of data on sold tickets described above (1-

filled space, 0-free). This approach makes it easy to compare the data on tickets sold and actual data on the filling of seats. In this case, one should take into account the possibility of transplanting viewers from place to place and temporary absence from places (leaving the hall for a while). Comparison of data should take into account such facts in the form of permissible systematic measurement error. The set level, the excess of which is the basis for the inclusion of the signal "violation of the mode" should take into account the systematic error. It is impractical to set the response threshold too low.

The obtained quantitative data and photographs are stored in a database in the cinema, for example, for 6 months (this value is adjustable) if there is sufficient disk space. Perhaps longer storage on special additional memory devices (tape memory, etc.).

The system provides an interface for viewing quantitative data and photographs of occupied places with the ability to view from remote computers.

Data on the maximum number of viewers present at each session is exported to the ticketing system to create an archive and generate reports.

Video recording in auditoriums, saving video recordings of halls in files, the ability to view images from each camera in real time and in recording (glued). Video recording is made in the VHC proprietary format and is available for viewing on any computer where the VHC client application is installed.

Since the video recording of each auditorium is carried out by several cameras in sections, the “bonding” of individual images and the video of the observation area are reproduced in full. The guaranteed frame rate for such a recording should be at least 1 frame in 5 seconds. In one frame gluing is shown:

Hall number, date, time, counted number of spectators (number). The archive of video data is built on a ring basis and stores data for 3-4 weeks if there is sufficient disk space.

Raising the "alarm" in case of emergency. The list of emergency situations:

- The number of spectators in the hall exceeds the number of tickets sold by more than a predetermined value of N.

- Situations related to disturbance of public order and fire

safety in the halls (brawl, smoking, uplift, presence of strangers

items after the end of the session, etc.).

The system is configured to respond to these alarming situations through the use of appropriate software on computing platforms. At the same time, a specific alarming situation is presented in the form of a specialized subprogram that stores pre-recorded data, which is accessed when comparing the received video signal. For example, the uplift is represented as a change in the brightness indicators in a zone of a certain area on the information model of the hall. The fight is presented in the form of intensive movement of mobile objects (defined as the number of movement units for the control time) in a certain area of the hall’s information model.

In the particular case of the implementation of this utility model for the simplest system consisting of one hall and a minimum number of cameras covering the given hall with its image, the computing platform can be implemented on a universal personal computer with the Intel Pentium processor, 32 MB RAM and memory and hard drive

20 MB in size. This personal computer has a database and a terminal for monitoring results analysis and system management. The computer, in accordance with the software based on the Windows operating system, converts the composite analog video signal received from the cameras into digital form and performs image processing, namely, it performs the following actions: analyzes the background, detects targets, and recognizes goals and situations, determines the parameters of targets, their coordinates, remembers the motion paths, transfers the recognition results to the database, attaching events to time, records the video signal in compression whether or unprocessed form in the computer memory in the form of files, whose address is in the database, so the video is associated with events, details of which are located in the database and compares the signal with a pre-recorded data, reflecting the alarming situation.

The developed system (software) is scalable and provides the ability to control in multiplexes having an arbitrary number of cinema halls with an arbitrary number of seats in each.

In the General case, the device according to the present utility model during operation carries out the following steps (when coming from outside the system video signal, control commands and information about the audience) -

- Receiving a video signal from video cameras to capture cards (YUV2) of a video signal installed on a personal computer,

- Image stream processing (counting viewers and other functions),

- Postprocessing recognition data,

- Interaction with the cinema complex information system and work with its database,

- Recording to the archive,

- Work with the client interface (work with the archive, showing the current video, setting parameters)

- Deleting an archive by cycle and redundancy (when managing archiving parameters and the control algorithm).

The software used in the system and the video processing algorithms underlying it are resistant to sharp changes in the illumination in the cinema.

Industrial applicability

A real utility model to effectively monitor the situation in the auditorium. At the same time, the problem of counting and controlling the real number of spectators and their location, the prevention and timely response to disturbing situations in the hall are important, but not the only goals of the solution. In the framework of the set of essential features of this utility model, other practical problems of automating the operation of multi-screen cinema halls that are relevant at the present time are also being solved.

Claims (11)

1. A device for automated access control and the situation in the auditorium, comprising at least one video camera installed in the auditorium, adapted to receive images of the auditorium, and at least one computing device with memory, connected via a local area network, moreover, according to the present utility model, a database is formed in the memory of the computing device storing data reflecting the filling of the auditorium, according to the tickets sold, and the calculator The device is capable of processing the video signal received from the video camera to obtain data on the filling of the auditorium with the possibility of storing these data in memory for subsequent analysis, as well as the ability to compare the data obtained with the data stored in the database and with the ability to generate a violation signal of the established mode in the case of inconsistencies of the compared data by more than a predetermined threshold value. 2. The device according to claim 1, characterized in that it further comprises at least one video camera to ensure effective coverage of the entire space of the hall with the possibility of duplication of the video signal. 3. The device according to claim 1, characterized in that the local area network is adapted to transmit a video signal from a video camera to a computing device without inducing interference to the electronic equipment of the room. 4. The device according to claim 1, characterized in that data describing emergency situations, including smoke, fire, congestion of people, are recorded in the memory of the computing device, and the computing device is adapted to process the signal received from the video camera to generate data about the situation in the auditorium and compare this data with data characterizing emergency situations with the ability to give an alarm in case of coincidence of the compared data. 5. The device according to claim 1, characterized in that it contains at least one movable video camera configured to aim at a target and obtain an image of a target suitable for further analysis by the operator, the mobile video camera configured to rotate in vertical and horizontal planes, and / or changes in focal length, and / or changes in aperture, and / or focus settings to provide aiming at the target. 6. The device according to claim 1, characterized in that it contains a hardware-software interface for communication with the operator. 7. The device according to claim 1, characterized in that a personal computer is used as a computing device with memory. 8. The device according to claim 1, characterized in that a server is used as a computing device with memory, the server being adapted to process up to 4 video streams. 9. The device according to claim 1, characterized in that it further includes a data storage device for tickets sold, adapted to transmit the accumulated data to a database formed in the memory of the computing device. 10. The device according to claim 1, characterized in that it further comprises a device for controlling the entrance of the audience, which is an automated ticket reading device, adapted to allow the viewer to enter the auditorium in case of presentation of the proper ticket and fixing in memory the number of spectators who have passed in accordance with the tickets presented . 11. The device according to claim 1, characterized in that it further comprises a device for controlling the entrance of the audience, implemented on a computer with a system for reading the bar code applied to the ticket office in the ticket office computer.