Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
  • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
  • H04N19/115—Selection of the code volume for a coding unit prior to coding
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
  • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
  • H04N21/2385—Channel allocation; Bandwidth allocation
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
  • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
  • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
  • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
  • H04N21/4621—Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
  • H04N7/188—Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position
• • G—PHYSICS
  • G08—SIGNALLING
  • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
  • G08B13/00—Burglar, theft or intruder alarms
  • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
  • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
  • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
  • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
  • G08B13/19654—Details concerning communication with a camera
  • G08B13/19656—Network used to communicate with a camera, e.g. WAN, LAN, Internet
• • G—PHYSICS
  • G08—SIGNALLING
  • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
  • G08B13/00—Burglar, theft or intruder alarms
  • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
  • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
  • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
  • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
  • G08B13/19663—Surveillance related processing done local to the camera
• • G—PHYSICS
  • G08—SIGNALLING
  • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
  • G08B13/00—Burglar, theft or intruder alarms
  • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
  • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
  • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
  • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
  • G08B13/19665—Details related to the storage of video surveillance data
  • G08B13/19667—Details realated to data compression, encryption or encoding, e.g. resolution modes for reducing data volume to lower transmission bandwidth or memory requirements
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
  • H04N19/164—Feedback from the receiver or from the transmission channel
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/21—Server components or server architectures
  • H04N21/218—Source of audio or video content, e.g. local disk arrays
  • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
  • H04N21/2365—Multiplexing of several video streams
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
  • H04N21/4347—Demultiplexing of several video streams
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
  • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors

Definitions

• the invention relates to a video surveillance system based on a network provided with at least one intelligent camera and capable of dynamically reconfiguring itself.
• intelligent camera designates a camera comprising means for compressing the captured video sequence. It can also be an analog or digital camera coupled to a compression box. In both cases, this "intelligent camera” is also capable of performing an analysis of said sequence in the compressed domain.
• the intelligent camera is further capable of transmitting the compressed video sequence and the result of the analysis in the compressed domain to a server through a telecommunications network.
• background is used to designate the mobile object (s) of a video sequence.
• background refers to the environment as well as to fixed or near-fixed objects in the sequence. This includes, for example, soil, trees or other immobile or not perfectly immobile objects.
• video sequence or "video stream” denote the same object.
• CCTV systems have evolved considerably in recent years. The digitization of the contents and the increase of computer computing capabilities make it possible to process video sequences in real time in order to interpret them. New systems have emerged in recent years and are usually referred to as intelligent video surveillance systems. These systems rely on image processing techniques and / or video for example to compare images, to detect a movement, to detect a face or to recognize an object.
• a typical video surveillance system usually includes the following elements: at least one analog or digital camera for capturing a video sequence;
• At least one remote server capable of processing the video sequences transmitted by the camera (s) of the system; at least one terminal for viewing and / or storing the video sequences;
• At least one memory zone for storing the video sequences.
• the video camera (s) had the main task of capturing and compressing the digital video stream before transmission to the remote server via a telecommunications network.
• the desire to use more and more efficiently the bandwidth of the transmission media on which these sequences pass and the objectives of reducing the cost of storage have raised the question of video compression very early on.
• Conventional compression algorithms reduce the spatial redundancy and time-specific redundancy of a video sequence. These compression techniques make it possible to reduce the bit rate necessary for the transmission of a video stream through, for example, a telecommunications network. In existing video encoding systems, it is necessary to select a compression ratio adapted to the application and therefore to the service in question.
• the remote server Its role is usually to analyze the video stream after decompression. These analyzes, for example the identification of moving objects of a video stream, are traditionally performed at the remote server and not cameras because they require algorithmic tools capable of analyzing an uncompressed video stream. Indeed, the video stream is analyzed at the pixel level of the images, which requires resources in terms of calculations and important memory. It is for this reason that the analysis of the video streams was until recently not conducted by the cameras but remotely on a server with sufficient resources to decompress the streams and analyze them.
• This method has the advantage of using part of the work done by the video encoder and thus exploiting information available in the compressed domain such as, for example, the coefficients calculated by applying the discrete cosine transform (known under the English name "Discrete Cosine Transform” (DCT) and motion estimation vectors.
• DCT discrete Cosine Transform
• This information must then be analyzed.
• the motion estimation vectors do not necessarily correspond to a real movement of an object in the video sequence but can be similar to noise.
• this method it is then possible, for example, to identify the areas of the image with moving objects. The computing load becomes reasonable, the video cameras can take care of the analysis of the video streams.
• Motion Estimation Generator determines vectors for all the blocks encoded by the encoder in "Intra" mode (within Intra or predicted images);
• Low-Res Object Segmentation LROS
• Motion Based Object Based Filtering uses MEG output vectors to determine moving areas from motion estimation;
• a cooperative decision CD - Cooperative Decision is established from these two segmentations, taking into account the specificities of each module according to the type of image analyzed (Intra or predicted).
• analysis times are now 10 to 20 times the real time (250 to 500 images processed per second) for images 720x576 4: 2: 0 .
• a conventional CCTV network architecture relies on an initial network dimensioning that either passes the streams coming from all the sensors or video cameras simultaneously, or takes into account a periodic switchover from one stream to the other. It is then at the monitoring room that the operator or powerful computing and analysis servers can request the visualization of a precise flow according to the importance granted.
• the object of the present invention relates to an intelligent video surveillance system including the ability to automatically reconfigure itself in order to, for example, optimize the use of resources of said system.
• This system relies on the use of smart cameras with the ability to compress and analyze in the compressed domain the video sequences they capture and to detect specific events. Signaling data is then transmitted over a telecommunications network by the smart cameras to a remote server. This server is able to analyze this signaling data to determine commands for reconfiguring system elements dynamically.
• the subject of the invention is a dynamically reconfigurable video surveillance system composed of at least one video camera, a remote server, at least one viewing terminal, means for recording the video sequences captured by the or the camera (s), said system being characterized in that: the video camera (s) and the remote server comprise means for communicating with each other through a telecommunications network; the video camera (s) comprise means for compressing the captured video sequences, the compression ratio being adapted dynamically taking into account the control messages from the remote server; the video camera (s) comprise means for analyzing said video sequences in the compressed domain, for characterizing the activity detected in their field of vision and for transmitting the result of this characterization to the remote server; the remote server comprises means for calculating, for each of the compressed video streams from the video camera (s), a command, allowing parameterizing each of them taking into account the signaling data received.
• a variant of this video surveillance system is characterized in that a priority level is associated by the server with each of the video streams received from the camera (s) of the system, said priority level being determined according to the signaling information representative of the activity detected and reported by the video camera (s).
• a variant of this video surveillance system is characterized in that the remote server controls the transmission of the signaling data sent by the video camera (s) of the system by sending requests to adapt the frequency, the type and the content of the signaling messages.
• a variant of this video surveillance system is characterized in that the compression of the video sequences captured by the cameras is parameterized by a flow rate instruction specific to each camera, said flow rate setpoint being calculated by the remote server as a function of the associated priority level to each of the video streams and is then transmitted by the server to each of the cameras in the system.
• a variant of this video surveillance system is characterized in that a priority level associated with the video streams is calculated by each camera, said priority order being determined according to the activity detected by each of the cameras.
• a variant of this video surveillance system is characterized in that the priority level associated with the video streams is transmitted to the server by each of the cameras of the system and that said server uses this signaling information in order to calculate a rate command transmitted to the cameras in order to that these adapt their compression parameters in order to satisfy this target flow constraint.
• a variant of this video surveillance system is characterized in that the priority level of the video stream is used by each camera to calculate a flow setpoint, said flow setpoint being used to adapt the compression parameters of the video stream.
• a variant of this video surveillance system is characterized in that the automatic switching of the display on the terminal or terminals display is of a duration determined by the order of priority, said duration being all the longer as the corresponding order of priority is important.
• a variant of this video surveillance system is characterized in that the display on the viewing terminal (s) of a priority video stream is accompanied by an augmented reality mechanism making it possible to highlight the portion (s) of the image containing the unusual activity identified by the smart camera.
• a variant of this video surveillance system is characterized in that the augmented reality mechanism is controlled by the remote server and that said server accordingly transmits a request to the corresponding intelligent camera in order to acquire the necessary signaling data.
• a variant of this video surveillance system is characterized in that the portion (s) of the image containing the unusual activity are highlighted by one or more rectangle (s) flashing (s) or fixed (s).
• a variant of this video surveillance system is characterized in that the portion (s) of the image containing the unusual activity are highlighted by a color highlighting.
• a variant of this video surveillance system is characterized in that the highlighting of the portion of the image containing the unusual activity identified by the smart camera is accompanied by a message appearing on the screen of at least a display terminal.
• a variant of this video surveillance system is characterized in that highlighting the portion of the image containing the unusual activity identified by the smart camera is accompanied by an alarm indicator.
• a variant of this video surveillance system is characterized in that the compressed video streams are recorded in a memory area of the system and that the control data, such as the priority level of the streams and the metadata from the targeted cameras, are also recorded.
• a variant of this video surveillance system is characterized in that a supervised mode of the system allows an operator to select a particular video stream that is not necessarily a priority and that the server reacts accordingly by decreasing the overall bit rate and ordering the chosen camera a maximum bit rate.
• FIG. 1 shows the modules used for the analysis in the compressed domain as previously described
• FIG. 2 illustrates a possible result of the analysis in the compressed domain, namely the identification of zones containing moving objects
• FIG. 3 shows another example of the result of the analysis in the compressed domain, namely a motion map established from the motion estimation vectors
• FIG. 4 shows another example of the result of the analysis in the compressed domain, namely a low resolution confidence map corresponding to the contours of the image
• FIG. 5 illustrates a variant of the architecture of the video surveillance system according to the invention
• FIG. 6 illustrates an example of sequencing of the operations carried out by an intelligent camera of the video surveillance system according to the invention
• FIG. 7 illustrates an example of sequencing of the operations carried out by the remote server of the video surveillance system according to the invention
• the video surveillance system is based on an architecture, an example of which is given in FIG. 5.
• the areas to be monitored are covered by means of at least one video camera 1 called the intelligent camera (s) ( s).
• These smart cameras are capable of at least: capturing a video sequence of the area they cover; compressing the video sequence (using, for example, the compression techniques described in the MPEG-2 and MPEG-4 standards); to analyze the video sequences in the compressed domain; - to characterize the activity detected in the area covered by the camera.
• Analysis in the compressed domain allows these smart cameras to characterize activities relevant to the service rendered by the system.
• the advantage of performing these operations in the compressed domain is to reduce the computation time and the memory resources necessary for the analysis and thus make possible the implementation of these on-board analysis tools within the cameras. It can be realized at low cost, for example, a segmentation of moving objects and a tracking of these objects on video streams. It is then possible to integrate modeling and activity characterization tools into each camera by using, for example, Gaussian Mixture Modeling (GMM) techniques that take into account data from objects. followed (entry and exit points of the field of view, trajectory, speed, acceleration, size, etc.).
• GMM Gaussian Mixture Modeling
• an unsupervised learning phase is necessary for each camera, to which can be added one or more supervised step (s) to specify the type of abnormal behavior to be traced back to the remote server in priority. (identification of a portion of sequence by an operator, reconstruction by recorded scenes, etc.).
• Relevant activities that can be detected by smart cameras are, for example: a car traveling in the opposite direction (as part of a traffic monitoring service); a crowd movement, which may be the consequence of a critical event such as a fire; an individual with a suspicious behavior in a parking lot; a star departure from a point that can be triggered by any event said to be unusual in relation to a given operation;
• These cameras communicate to a remote server 3 the video streams and the signaling data representative of the eventual activity detected and this through a first telecommunications network 2.
• This signaling data can be, for example: - the number of detected moving objects; the surface covered by moving objects; the speed of movement of moving objects; the location of moving objects; etc.
• This telecommunications network can be, for example, a fiber optic network or a wireless network using the Internet protocol (known as the Anglo-Saxon "Internet protocol" - IP).
• the role of the remote server 3 is to route the video streams it receives from the smart cameras to one or more storage servers 5, one or more control terminals 6 enabling one or more operators to monitor the areas concerned, and this through a second telecommunications network 4.
• the remote server 3 is further capable of triggering alarm signals 7 remotely.
• the server can also process the signaling data reported by smart cameras. It can, for example, categorize the video streams received in order of priority and use information to dynamically reconfigure the video surveillance system.
• the remote server 3 can also manage several tasks related to the (x) station (s) monitoring 6: - The automatic switching from one video stream to another on the monitor with a display of a determined duration according to the priority order. If multiple streams are considered high priority (for example, by thresholding on priority), the server will be able to display a mosaic of these streams by continuing to fail over to the other streams in one of the windows.
• the display of a priority stream may be accompanied by an augmented reality aspect by highlighting the portion of the image containing the unusual activity identified by the camera.
• the type of technique used may be example: the use of flashing rectangle, color highlighting, etc. This can be accompanied by a message on the screen and / or an alarm light. Everything is done via a request from the server 3 to obtain the corresponding signaling data of the camera concerned.
• the recording of the streams in a memory zone 5 of the network with their priority levels possibly accompanied by signaling data from the targeted cameras, for example in the case of high priorities.
• the operator can select a particular stream not necessarily priority according to the camera.
• the server then decreases the overall rate (higher total priority P) and orders the chosen camera a maximum rate.
• a variant that makes it possible to reduce the transmission rate of the signaling information flowing from the cameras to the server is to trace a single priority indicator per camera. Indeed, all the signaling data available at the output of one of the cameras 1 can (if the number of signaling data is high) represent a significant volume of information and it is not always necessary to transmit them. permanently on the network.
• the video cameras 1 transmit to the remote server 3 a set of signaling information (also called metadata). In this case, it is the responsibility of the server to associate a priority to each of the streams based on this information and then determine the commands for dynamically reconfiguring the system.
• the remote server may send an external request to control the transmission of all or part of the signaling data.
• FIG. 5 gives an example of the operations that can be performed by one of the intelligent cameras of the system.
• the video stream 10 captured by the camera 1 (FIG. 5) is compressed and analyzed in the compressed domain
• Compression is carried out following a target rate instruction 15.
• the step of encoding, analyzing and characterizing the activity results in: a compressed video stream 12; a set of signaling data (or metadata) 13 resulting for example from the application of the tools for characterizing the compressed stream.
• the compression step is further parameterized by a rate setpoint from the remote server 3 and optimized by the analysis in the compressed domain. Indeed, the analysis in the compressed domain can make it possible to segment the images into different areas of relevance. For each of these different zones, different rates can then be allocated to adapt the flow rate of the video stream to the target value.
• the process may lead to the allocation of a significant bitrate for this part at the expense of the irrelevant part of the stream, in this case the background, which will be allocated a lower flow.
• Figure 7 gives an example of the operations that can be performed by the remote server.
• the example given considers a system where three smart cameras each transmit to the remote server a set of data 21, 24 and 27. These data sets consist, for example, of video streams 22, 25, 28 and associated signaling data. 23, 26, 29 for each of the cameras. This data is then processed by the server to perform priority arbitration between the streams.
• the server associates a priority level 31, 32, 33 with each video stream according to the information carried by the signaling data.
• the server uses these different priority levels as well as topology and system-specific information to determine the reconfiguration commands 36, 37, 38 for each of the cameras in the system.
• These commands are, for example, flow instructions that will be used to adapt the compression parameters of the video stream by each camera.
• the orders thus calculated must then be transmitted 39, 40, 41 through the telecommunications network to the cameras concerned.
• the cameras can then calculate their target rate according to the previous formula and adapt the compression of the video stream to this value.

Applications Claiming Priority (2)

Publications (1)

Family

ID=40428275

Family Applications (1)

Country Status (6)

Families Citing this family (1)

Citations (2)

Family Cites Families (8)

• 2008
  • 2008-06-03 FR FR0803052A patent/FR2932054B1/fr not_active Expired - Fee Related
• 2009
  • 2009-05-29 WO PCT/EP2009/056684 patent/WO2009147116A1/fr active Application Filing
  • 2009-05-29 EP EP09757497A patent/EP2300997A1/de not_active Ceased
  • 2009-05-29 MX MX2010013320A patent/MX2010013320A/es not_active Application Discontinuation
  • 2009-05-29 BR BRPI0913386-0A patent/BRPI0913386B1/pt not_active IP Right Cessation
• 2010
  • 2010-12-03 MA MA33396A patent/MA32380B1/fr unknown

Patent Citations (2)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events