WO2014189406A1 - Procédé et système pour recherche de données vidéo au moyen d'un identifiant de dispositif personnel - Google Patents

Procédé et système pour recherche de données vidéo au moyen d'un identifiant de dispositif personnel Download PDF

Info

Publication number
WO2014189406A1
WO2014189406A1 PCT/RU2013/001194 RU2013001194W WO2014189406A1 WO 2014189406 A1 WO2014189406 A1 WO 2014189406A1 RU 2013001194 W RU2013001194 W RU 2013001194W WO 2014189406 A1 WO2014189406 A1 WO 2014189406A1
Authority
WO
WIPO (PCT)
Prior art keywords
personal device
video data
personal
identifier
data
Prior art date
Application number
PCT/RU2013/001194
Other languages
English (en)
Inventor
Nikolai Vadimovich PTITSYN
Original Assignee
Obshestvo S Ogranichennoy Otvetstvennostyu "Sinezis"
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Obshestvo S Ogranichennoy Otvetstvennostyu "Sinezis" filed Critical Obshestvo S Ogranichennoy Otvetstvennostyu "Sinezis"
Publication of WO2014189406A1 publication Critical patent/WO2014189406A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42201—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223—Cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/188—Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H04W4/025—Services making use of location information using location based information parameters
    • H04W4/027—Services making use of location information using location based information parameters using movement velocity, acceleration information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H04W4/029—Location-based management or tracking services

Definitions

  • the invention relates to processing, marking and video data search in systems of video recording and storage III, 111.
  • the invention allows marking of video data, using data on personal devices and implementation of quick object search (a person or a vehicle) in the video archive by personal device identifier of this object.
  • the invention can be used for such tasks as marking (indexing) of video archive, detection of alarms, static data collection, uploading videos containing document information on a person or a group of persons from the video archive.
  • the invention may operate in local and global networks, on dedicated or cloud servers, and may be imbedded directly into the camera, video server, video recorder and personal device in the form of hardware and/or software.
  • the invention can be used to provide various services in the Internet via browser and/or personal devices, including security services, search of individuals, personalized video, market research, targeted advertising, improving the quality of customer service.
  • the invention can be used in such spheres as safety and security, communication services, transport and retail networks, industrial production, sports, entertainment, housing and municipal services and social infrastructure.
  • the invention can be used in video-surveillance systems based on standards and/or regulations adopted by the Open Network Video Interface Forum (ONVIF, www.onvif.org), (Physical Security Interoperability Alliance (PSIA, www.psiaalliance.org) or the Common Alerting Protocol (CAP, http://docs.oasis- open.org/emergency/cap/).
  • Video storage video archiving system, video recorder
  • l ⁇ l p. 227-294
  • I I with search tools are an integral part of almost any video-surveillance system.
  • Modern video data storages allow quick search and playback of recorded video fragments on user demand. This random (direct) access to the video data is implemented by video data marking or index.
  • the index is a lookup table, creating interdependence with addresses of corresponding video data.
  • the index significantly reduces the access time to video data recorded in the storage for further processing by the user or the computer, for example, 151, 161.
  • Temporal index relates the temporal scale to video data, that is, allows the storage quick search of video data on the specified date and time.
  • Event index comprises a table of events and allows the storage quick search of video data on the specified events such as motion detector or other sensors connected to the video-surveillance system.
  • Video analytics i.e. video analysis tools, based on vision algorithms can be a source of events to construct the index.
  • video analytics allows defining such events as the motion of a person in the given direction, appearance or disappearance of the object 111.
  • the index can contain additional information about the object, recognized by video analytics for further search of video data.
  • the index can contain a vehicle registration mark, person's height, the color of clothing, facial features.
  • the codes are built in real time on an on-going basis of video data entry in the storage from the surveillance cameras. Then the indexes are used in the processing of user requests searching for information in the video data storage.
  • Biometric surveillance systems allow identification of people by black or white lists, as well record of facial features in the index for further search (for example, /8/).
  • biometric surveillance systems have a number of shortcomings: a) lack of accuracy of biometric algorithms when comparing individuals, b) specific requirements for placement of cameras, lighting and organizing of people's motion in front of the camera, and c) high cost of hardware, including cameras and video processing servers.
  • Some existing systems 191 use personal devices for detection and tracking of people, who are the owners and/or carriers of these devices.
  • Such systems have significant limitations: devices identifiers are not used for indexing of video data that are not recorded in the index of storage with reference to the respective cameras for subsequent retrieval of video data. This limitation does not allow organizing a quick search by personal device identifier.
  • Video-surveillance system is selected as a prototype, for example, Intellect product of ITV /10/.
  • Fig. 1 One of the schemes of the joint method and system for searching video data by personal device identifier.
  • the owner of the device is aware and intentionally participates in the system.
  • Special software installed by the owner on the device, transmits the device identifier to the server over the wireless data network.
  • Fig. 2 One of the schemes of the hidden method and system for searching video data by personal device identifier.
  • the owner of the device may not be aware of the system.
  • the sensor reads the device identifier and transmits it to the server without using special software on the device.
  • This invention is designed to eliminate the above shortcomings of the known methods and systems. It increases the efficiency of search, especially in crowded places.
  • the claimed invention uses this feature to search video data for a given set of identifiers associated with the personal device.
  • the index of video data from the camera is supplemented by personal device 90 identifier, possibly located next to the camera or in the field of view of the camera.
  • Technical result of the invention is faster and more accurate search of video data containing image of a person or a number of people based on personal devices identifiers of these people.
  • first embodiment of a method of recording video data and their marking, using data on personal devices involves the following steps.
  • the service area is characterized by its geolocation and the field of view area. Recording and storage of video data from one or more video sources (cameras) in the memory of video storage device. Detecting location and identifier of at least one personal device. Identifying one or more source of video data in the service area of which is the
  • Personal device identifier can be set, for example, by the device manufacturer,
  • the derived from the personal device identifier can be used.
  • its cryptographic transformation obtained, for example, by encryption or hash function is stored.
  • Location of the personal device may be detected by one or more transceivers.
  • Location of the personal device may be detected by means of triangulation on the transceivers. Location of the personal device may be detected based on data obtained from one or a combination of the following devices: picocells, WI-FI station, Bluetooth station, NFC station, if the personal device is within their 120 coverage area.
  • Video is usually recorded from the moment of personal device detection. In some cases, video recording is carried out in continuous mode.
  • Entering search parameters and selection of results, including video data and/or personal devices identifiers is carried out in accordance with a complete or partial 125 list of search parameters.
  • the computer system may supplementary display the recorded video data and associated personal device identifiers on the display of the device.
  • Reference, relating the recorded video data from the video source to the data obtained from the personal device, is kept on the storage device. Usually it is an 130 external device located in the "cloud" space.
  • the video data are analyzed and images of people are derived therefrom. This function can be performed automatically It is possible to perform biometric identification of individuals on the features of face or body, manner of walking or body language.
  • a system containing a computer system, video data source, personal device, device for detection the location of personal devices, wherein the computer system includes one or more processors, data storage device, one or more programs, wherein one or more 140 programs are stored on the device and are executed on one or more processors, wherein one or more programs include instructions, is suggested. Instructions are designed to control the computer system that implements the claimed method.
  • the set of instructions is the following.
  • Detecting the location and the identifier of at least one personal device Identifying one or more video data source in the service area of which is the personal device by comparing the received location of the personal device with the 150 data on the service area of at least one video data source.
  • the personal device shall contain one or more modules of the 155 wireless communication.
  • the above reference to the video data shall contain one or a combination of options from the following list: unique alpha- numeric sequence, Uniform Resource Identifier (URI), video data source identifier, identifier of the service of the video data source, temporal mark, location of the personal device, personal 160 device identifier, identifier of the owner of the personal device.
  • URI Uniform Resource Identifier
  • Location of the personal device can be detected by means of triangulation on the transceivers.
  • Location of the personal device is detected based on data received from one or a combination of the following devices: picocells, nanocells, WI-FI station, 165 Bluetooth station.
  • Video data source and device for detection of the personal devices may be combined into one device.
  • the source of video data can be a pan-tilt-zoom camera PTZ), and the service area of the camera is specified, including automatically, after each change of PTZ 170 position.
  • PTZ pan-tilt-zoom camera
  • Personal device identifier may involve one or a combination of parameters: bluetooth- address of the device, phone number of the device, IP-address of the device in the Internet, MAC-address of the network interface of the device, the identifier used in cellular communication systems, the address used in cellular 175 communication systems, RFID identifier used in radio frequency identification means, RFID address used in radio frequency identification means, the device identifier specified by the manufacturer. References relating the recorded video data to the personal device identifier can be stored on a secondary computer system.
  • the video data source can be any of the following devices: camera, video recorder, video server, video encoder.
  • Multi-camera tracking can perform simultaneous personal device tracking by its identifier (multi-camera tracking).
  • Personal device may comprise one or more modules of the wireless 185 communication.
  • the identifier can be any character sequence associated with a personal device, including the serial number of the device, Unique Device Identifier (UDID), IP- address of the device in the Internet, phone number of the device, serial number of the device software, user name or e-mail of the device owner.
  • UDID Unique Device Identifier
  • MAC-address of the network interface of the device can act as the identifier.
  • MAC Media Access Control
  • Wi-Fi Wireless Fidelity, Wi-Fi
  • Bluetooth- address of the device can act as the identifier.
  • Radio-Frequency Identification RFID
  • NFC Near field communication technology
  • Identifiers and addresses used in cellular communication systems including GSM (Global System for Mobile Communications), CDMA (Code division multiple access), UMTS (Universal Mobile Telecommunications System), LTE (Long Term Evolution) can act as the identifier.
  • GSM Global System for Mobile Communications
  • CDMA Code division multiple access
  • UMTS Universal Mobile Telecommunications System
  • LTE Long Term Evolution
  • IMSI identifiers 200 International Mobile Subscriber Identity
  • SIM cards Subscriber Identity Module
  • the identifier may be both a unique and non-unique.
  • MAC-address of the network interface of the device can be used, as the non-unique identifier - a code or sign of cellular operator to which the device 205 is connected.
  • the derived from the personal device identifier can be used.
  • cryptographic transformation of the original identifier is kept (obtained, for example, by encryption or hash function).
  • identifiers or addresses may be used as the device identifier.
  • Detection of possible location of personal devices in the field of view of the camera or nearby can be performed with the help of wireless readers of identifiers
  • Detection of possible location of personal devices in the field of view of the camera can be performed using the transmission equipment of the cellular operator or wireless Internet connection.
  • Detection of possible location of personal devices in the field of view of the camera or nearby can be performed using such data as cellular base station or Wi- Fi access point identifier, including SSID identifier (Service Set Identifier), signal level and delay at data exchange with the device and local transmitter (sensor) located nearby to the camera, IP-address of the device, available connection types
  • SSID identifier Service Set Identifier
  • sensor located nearby to the camera
  • IP-address of the device IP-address of the device
  • Detection of possible location of personal devices in the field of view of the camera can be performed by such positioning systems as GPS (Global Positioning System), A-GPS (Assisted GPS), GLONASS (Global Navigation Satellite System) and WPS (Wi-Fi- based Positioning System).
  • GPS Global Positioning System
  • A-GPS Assisted GPS
  • GLONASS Global Navigation Satellite System
  • WPS Wi-Fi- based Positioning System
  • special software for personal device, which records the time-space coordinates of the device, compares them with the coordinates of the service areas of cameras and transmits the data needed to build an index to the video data storage or specialty server, can be used.
  • Second embodiment of a method of recording video data and its, marking, using information on the personal devices on a computer system involves the following steps. Entering initial data on the service area, characterized by geolocation and the field of view of at least one source of video data;
  • Location of the personal device can be detected by means of triangulation on the transceivers.
  • Location of the personal device can be detected based on the data obtained from one or a combination of the following devices: picocells, nanoscells, WI-FI and Bluetooth stations.
  • the user can detect the location of the personal device manually, selecting from the list and/or on the map.
  • Location of the personal device can be detected by one or more means of global positioning.
  • Personal device identifier can be set * for example, by the device manufacturer, service provider or user.
  • Data sent by the personal device may supplementary contain time-space 265 trajectory and/or motion parameters.
  • Video recording starts at the detection of the personal device or is carried out in continuous mode. Entering search parameters and selection of results, including video data and/or personal device identifiers may be implemented fully or partially corresponding to 270 the search parameters.
  • the computer system may supplementary display the recorded video data and associated personal device identifiers on the display of the device (e.g., displays).
  • Reference, relating the recorded video data from the video source to the data obtained from the personal device, is stored on a storage device, such as the 275 database.
  • the storage device may be external and remote. It can be designed using "cloud" technologies.
  • the video data can be subject to direct primary analysis and (including, automatic) allocation of people's images on them.
  • Identification of individuals can be performed by any known method, for 280 example, biometric identification on the features of the face, body, manner of walking, etc.
  • the computer system involves one or more processors No. 1, data storage device No. 1, one or more programs No. 1, wherein one or more programs No. 1 are stored on the data storage device No. 1 and are executed on one or more processors No. 1.
  • the specified one or more programs include instructions for introducing initial 290 data on the service area of at least one video data source, recording on the computer system of video data received from at least one video source, transmitting data on the service area of at least one video source from the computer system to at least one personal device, receiving on the computer system of video data received from at least one personal device, creating on the computer system of 295 at least one reference, relating the recorded video data from the video source in the service area of which is at least one personal device to the data received from the personal device.
  • the service area of video source is characterized by its geolocation and the dimensions of the field of view area.
  • the personal device shall involve one or more processors No. 2, data storage device No. 2, one or more wireless communications modules, one or more programs No. 2, wherein one or more programs No. 2 are stored on the data storage device No. 2 and are executed on one or more processors No. 2.
  • the specified program includes instructions for detection the
  • Location of the personal device may be detected by means of triangulation on transceivers.
  • Reference to video data may involve one or a combination of parameters: unique alphanumeric sequence, Uniform Resource Identifier (URI), video source identifier, service area identifier of the video data source, temporal mark, location 315 of the personal device, personal device identifier, identifier of the owner of the personal device.
  • URI Uniform Resource Identifier
  • the service area is usually characterized by its geolocation and the field of view area.
  • Personal device identifier may involve one or a combination of the following parameters: bluetooth- address of the device, phone number of the
  • IP-address of the device in the Internet IP-address of the device in the Internet
  • MAC-address of the network interface of the device the identifier used in cellular communication systems, the address used in cellular systems, identifier used in Radio Frequency Identification (RFID), address used in Radio Frequency Identification (RFID), device identifier specified by the manufacturer.
  • RFID Radio Frequency Identification
  • RFID Radio Frequency Identification
  • the source of video data can be a pan-tilt-zoom camera (PTZ).
  • PTZ pan-tilt-zoom camera
  • Tracking of the personal device by its identifier can be performed in multiple cameras mode.
  • Video data source and device for detection of personal device location may be 330 combined into one device.
  • References, relating the recorded video data and the personal device identifier, can be stored on the personal device.
  • Location of the personal device can be detected based on the data obtained from one or a combination of the following devices: picocells, nanocells, WI-FI 335 and Bluetooth stations.
  • a method of video data recording and its marking, using data from personal devices on the computer system involves the following steps.
  • Personal device location can be detected by means of triangulation on the transceivers.
  • Detection of the personal device location is based on data received from one or 355 a combination of the following devices: picocells, nanocells, WI-FI and Bluetooth stations. Personal device location is selected by the user manually from the list and/or on the map.
  • Personal device location can be detected using one or more global positioning 360 means.
  • Personal device identifier can be set, for example, by the device manufacturer, service provider or user.
  • the derived from that personal device identifier can be used.
  • its cryptographic transformation obtained, for example, by encryption or hash function
  • any of the following devices can act as the video source: camera, video recorder, video encoder.
  • Data sent by the personal device may supplementary involve time-space 370 raj ectory and/or motion parameters.
  • the video data can be subject to direct primary analysis and automatic allocation of people's images on them. It is also possible to turn on the function of biometric identification of people by the features of face and/or body, manner of walking, and so on.
  • Video recording can be activated (started) at the detection of the personal device.
  • Video recording is in continuous mode.
  • Entering search parameters and selection of results that include video data and/or personal device identifiers is carried on a full or partial list of parameters.
  • the computer system may supplementary display the recorded video data and 380 associated personal device identifiers on the display of the device.
  • Reference, relating the recorded video data from the video source to the data obtained from the personal device, is stored on the storage device, including remote.
  • the storage device including remote.
  • a remote (including, "cloud) device for example, in the database located on a remote (including, "cloud") device.
  • the computer system includesone or more processors Al; data storage device Al; one or more programs Al, wherein one or more programs Al are stored at the
  • one or more first program includes instructions for: entering the initial data on the service area, characterized by geolocation and parameters of the field of view of at least one video data source; recording on the computer system of video data received from at least one video data source; receiving data on the
  • 395 computer system from at least one personal device determining the relation between the data on the location of the personal device and the service area of at least one video source; creating on the computer system of at least one reference relating the recorded video data from the video source, in the service area of which is at least one personal device to the data received from the personal device.
  • the specified personal device includes one or more processors B 1 ; data storage device Bl; one or more wireless communications modules, one or more programs B 1; wherein one or more programs Bl are stored on the data storage device B 1 and are executed on one or more processors Bl .
  • one or more programs include instructions to: determine the location
  • Reference to the video data may comprise one or a combination of the following parameters: unique alphanumeric sequence, Uniform Resource Identifier
  • URI URI
  • video source identifier identifier
  • service area identifier identifier
  • timestamp identifier of the owner of the personal device.
  • Location of the personal device can be detected by means of triangulation on transceivers.
  • Video data source and device for detection of the location of the personal 415 devices may be combined into one.
  • a pan-tilt-zoom camera may act as the video data source, in this case the parameters of the service area of the camera are specified after each change of PTZ position.
  • Tracking of the personal device by its identifier can be performed in multiple 420 cameras mode.
  • References, relating the recorded video data to the personal device identifier, may be stored on the personal device.
  • Personal device identifier may comprise one or a combination of the following parameters: bluetooth-address of the device, phone number of the device, IP- 425 address of the device in the Internet, MAC-address of the network interface of the device, identifier used in cellular communication systems, address used in cellular systems, identifier used in radio frequency identification (RFID), address used in radio frequency identification (RFID), device identifier specified by the manufacturer.
  • bluetooth-address of the device may comprise one or a combination of the following parameters: bluetooth-address of the device, phone number of the device, IP- 425 address of the device in the Internet, MAC-address of the network interface of the device, identifier used in cellular communication systems, address used in cellular systems, identifier used in radio frequency identification (RFID), address used in radio frequency identification (RFID), device identifier specified by the manufacturer.
  • RFID radio frequency identification
  • RFID radio frequency identification
  • the derived from the personal device identifier can be used.
  • its cryptographic transformation obtained, for example, by encryption or hash function
  • Location of the personal device can be detected based on data obtained from
  • one-dimensional or two-dimensional barcodes for example, QR- codes
  • the barcode containing 440 camera identifier
  • the barcode is placed within the field of view of this camera.
  • Personal device user reads the barcode using the built-in camera of the personal device.
  • the personal device then decodes the barcode, determines the identifier for the camera, and sends identifiers of the device and the camera to the server for indexing the video data.
  • the index of video data can be stored not only in the video data storage, but also on personal devices and in other supporting servers.
  • Such an external index can relate the device identifier, timing mark, video data storage, camera (camera's service area). External index allows finding the reference to the video data on the device identifier and request these video data from the server.
  • Software for personal device can have the functions of video data viewing.
  • the index stored on the server, secondary server and/or on this personal device can be used.
  • the personal device may request video data from the server, using the index and display video data to the user on the screen of the personal device.
  • Personal device and/or the user can be notified on their location in service area of the camera.
  • This function can be useful for setting up personalized video recording in crowded places, such as amusement parks, ski resorts and attractions.
  • the invention allows visitors of these places to find and view personal video recordings 460 among many videos of other visitors.
  • the server can be virtualized, i.e. not constrained to embodiment, physical configuration or geographical location of hardware.
  • the cameras can be fixed (stationary) or mobile In the case of mobile cameras, their service area shall be determined dynamically as the camera moves for the inclusion or exclusion of device identifiers in the index.
  • the server may record the video data in the event-driven mode by the signal from the sensor of the personal device or from the personal device itself.
  • the server can use motion detection and/or video analytics for more accurate indexing and video data search. This motion detector and/or video analytics can be imbedded into the camera, or can run on the server.
  • the server may use the face detector to detect faces from the video data. For each detected face, an entry in the index for further comparison of the found faces and identifiers of personal devices.
  • the index can comprise extended information about the personal device and its owner, including the location, the space-time trajectory, the motion nature and a 480 method of detecting the personal device.
  • the video data source may be such device as camera, video recorder, video server, video encoder, etc.
  • the video data source and/or sensor for detecting the personal device may be combined into one device.
  • Search results of video data by identifier may be provided to the user as a list of images obtained from the video data based on the index.
  • the user may not know the identifier of the desired video data, but may set the general search criteria of the identifier and 490 video data in the index.
  • the video data search can be performed in real time for rapid detection of people and vehicles by means of cameras and personal devices.
  • the present invention can be used, for example, in trade, transportation and banking networks for the collection of statistical data about customers, namely for counting the people, determination the queue length, estimation the number of returns, determination of conversion and performance.
  • the present invention can be used for multi-tracking, for determination the 510 trajectory of motion of the person or vehicle as it moves from one camera to another.
  • Fig. 1 shows one of the schemes of the joint method and system for video data search by personal device identifier.
  • the peculiarity of this embodiment is that the 515 owner of the device installs special software on the device and deliberately uses the system.
  • Camera 25 transmits video data 19 to the server 14, where storage 18 and indexing of video data are executed.
  • object of surveillance 26 such as a person or a vehicle.
  • Personal device 12 520 moves together with the object or becomes part of the object.
  • the software on the device 12 transmits the device identifiers and cameras 25 to the server via wireless communication channels.
  • the transfer can be made in different modes: continuous and/or event-driven (at the time the device appears next to the camera), and/or by user request 13.
  • the fact that the device appeared next to the camera 25 or in the service area of the camera can be set by specific software of the device comparing the location of the device 12 detected by the device and the known location of cameras (service areas of the cameras).
  • the fact that the device appeared 530 next to the camera or in the service area of the camera can be set by special server software 14, comparing the location of the device 12, sent from the device, and the known locations of cameras 25 (cameras service areas).
  • the amount of data transmitted to the server from the device will be significantly larger than in the case of detection locally on the device, as described above.
  • the server performs indexing of video data from the camera and identifiers of personal devices received from these devices.
  • System user 13 may be the object 26 or its device 12. In other words, a person can use the system to search for the video data containing this person.
  • Fig. 2 shows one of the schemes of the hidden method and system for video data search by personal device identifier.
  • the peculiarity of this embodiment is that the owner of the device may not be aware of the system and does not use it 550 intentionally.
  • Camera 25 transmits the video data 19 to the server 14, where storage 18 and indexing of video data are implemented.
  • surveillance object 26 such as a person or a vehicle.
  • Personal device 12 moves together with the object or is part of the object.
  • the device 12 emits radio signals that are received by sensor 1 11.
  • the transmitters GSM, LTE, Wi-Fi, Bluetooth and other installed on the device can emit such signals.
  • Sensor 1 1 1 detects the device identifier via radio signal and transmits it 1 1 to the server 14.
  • 560 Server performs indexing of video data from the camera 25 and personal devices identifiers received from these devices.
  • the claimed technical result in the described embodiment is achieved as follows.
  • the user 13 sends to the server 14 a request for the video data 10 with the specified search criteria of video data, which may include the known device 565 identifier or indirect identifiers for search.
  • Server 14 processes a search query 10 and returns the user 13 the found video data 17.
  • the invention is industrially applicable, since it uses industrially manufactured and industrially applicable resources.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Analytical Chemistry (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Library & Information Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

L'invention concerne des procédés pour enregistrer des données vidéo et leur marquage au moyen de données sur des dispositifs personnels. Les procédés comprennent les étapes consistant à entrer des données initiales dans la zone de service de la caméra vidéo; à enregistrer et à stocker des données vidéo à partir d'une ou de plusieurs source(s) vidéo (caméras); à détecter l'emplacement et l'identifiant d'au moins un dispositif personnel; à identifier une ou plusieurs source(s) de données vidéo dans la zone de service à laquelle le dispositif personnel appartient par comparaison de l'emplacement reçu du dispositif personnel avec les données de la zone de service d'au moins une source de données vidéo; et à créer au moins une référence relative aux données vidéo enregistrées à partir de la source de données vidéo dans la zone de service à laquelle au moins un dispositif personnel relatif à l'identifiant de dispositif appartient. L'invention concerne également des systèmes pour mettre en œuvre les procédés précités.
PCT/RU2013/001194 2013-05-23 2013-12-30 Procédé et système pour recherche de données vidéo au moyen d'un identifiant de dispositif personnel WO2014189406A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EA201301010A EA201301010A1 (ru) 2013-05-23 2013-05-23 Способ и система поиска видеоданных по идентификатору персонального мобильного устройства
EA201301010 2013-05-23

Publications (1)

Publication Number Publication Date
WO2014189406A1 true WO2014189406A1 (fr) 2014-11-27

Family

ID=51933844

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/RU2013/001194 WO2014189406A1 (fr) 2013-05-23 2013-12-30 Procédé et système pour recherche de données vidéo au moyen d'un identifiant de dispositif personnel

Country Status (2)

Country Link
EA (1) EA201301010A1 (fr)
WO (1) WO2014189406A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3297276A4 (fr) * 2015-05-12 2018-11-21 Hangzhou Hikvision Digital Technology Co., Ltd. Procédé, système et serveur de traitement pour déterminer des informations de suivi d'une personne cible

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080186162A1 (en) * 2007-02-06 2008-08-07 Qualcomm Incorporated Apparatus and Methods for Locating, Tracking and/or Recovering a Wireless Communication Device
US20110018995A1 (en) * 2009-07-26 2011-01-27 Verint Systems Ltd. Systems and methods for video- and position-based identification
US20110285845A1 (en) * 2010-05-21 2011-11-24 Honeywell International Inc. Distant face recognition system
US20120064921A1 (en) * 2009-03-06 2012-03-15 Hernoud Melani S Systems and methods for mobile tracking, communications and alerting

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080186162A1 (en) * 2007-02-06 2008-08-07 Qualcomm Incorporated Apparatus and Methods for Locating, Tracking and/or Recovering a Wireless Communication Device
US20120064921A1 (en) * 2009-03-06 2012-03-15 Hernoud Melani S Systems and methods for mobile tracking, communications and alerting
US20110018995A1 (en) * 2009-07-26 2011-01-27 Verint Systems Ltd. Systems and methods for video- and position-based identification
US20110285845A1 (en) * 2010-05-21 2011-11-24 Honeywell International Inc. Distant face recognition system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3297276A4 (fr) * 2015-05-12 2018-11-21 Hangzhou Hikvision Digital Technology Co., Ltd. Procédé, système et serveur de traitement pour déterminer des informations de suivi d'une personne cible
US10185023B2 (en) 2015-05-12 2019-01-22 Hangzhou Hikvision Digital Technology Co., Ltd. Method, system, and processing server for determining track information of target person

Also Published As

Publication number Publication date
EA201301010A1 (ru) 2014-11-28

Similar Documents

Publication Publication Date Title
US9342974B2 (en) Autonomous aggregated search platform and methods using the same
US20150085111A1 (en) Identification using video analytics together with inertial sensor data
US9288619B2 (en) Real-time location information system using multiple positioning technologies
US8315673B2 (en) Using a display to select a target object for communication
US10584968B2 (en) Visual mapping of geo-located tagged objects
US9084103B2 (en) Analytic and tracking systems and methods using over-the-air identifiers of mobile devices
US11113937B2 (en) Theft prediction and tracking system
US9704132B2 (en) Method, system and apparatus for adapting the functionalities of a connected object associated with a user ID
US9769625B2 (en) Mobile device detection and tracking
US20150054620A1 (en) Method for setting up a beacon network inside a retail environment
US20170150321A1 (en) Location and activity aware media content delivery system
EP2280382B1 (fr) Procédé pour l'identification basée sur la vidéo et la position
USRE49713E1 (en) Devices, methods and systems for close proximity identification of unmanned aerial systems
US20170055118A1 (en) Location and activity aware content delivery system
US11417202B2 (en) Theft prediction and tracking system
KR101738443B1 (ko) 증강 현실 콘텐츠를 스크리닝하는 방법, 장치, 및 시스템
JP6804501B6 (ja) 移動している物体に関連付けられた通信デバイスへメッセージを送るための方法およびプラットフォーム
WO2014189406A1 (fr) Procédé et système pour recherche de données vidéo au moyen d'un identifiant de dispositif personnel
KR20130006387A (ko) 스마트폰을 이용한 미아찾기 방법 및 시스템, 그리고, 기록매체
US9877145B2 (en) Wireless communication apparatus and method for a user wirelessly receiving information regarding belongings of a nearby person
EP3806053A1 (fr) Référence croisée vers des applications associées
US20240086657A1 (en) Video management system, video management method, reading apparatus, and information processing apparatus
US11615663B1 (en) User authentication system
CN117596546A (zh) 场景确定方法及装置、终端设备、存储介质
US20120287158A1 (en) Display apparatus, control method for display apparatus, and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13885045

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13885045

Country of ref document: EP

Kind code of ref document: A1