WO2021131050A1 - 表示システム、表示処理装置、表示処理方法、およびプログラム - Google Patents

表示システム、表示処理装置、表示処理方法、およびプログラム Download PDF

Info

Publication number
WO2021131050A1
WO2021131050A1 PCT/JP2019/051545 JP2019051545W WO2021131050A1 WO 2021131050 A1 WO2021131050 A1 WO 2021131050A1 JP 2019051545 W JP2019051545 W JP 2019051545W WO 2021131050 A1 WO2021131050 A1 WO 2021131050A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
road
image
camera
display processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2019/051545
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
大輝 山崎
龍司 若草
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEC Corp
Original Assignee
NEC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEC Corp filed Critical NEC Corp
Priority to PCT/JP2019/051545 priority Critical patent/WO2021131050A1/ja
Priority to JP2021566750A priority patent/JP7392738B2/ja
Priority to US17/788,837 priority patent/US12198436B2/en
Publication of WO2021131050A1 publication Critical patent/WO2021131050A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/60—Extraction of image or video features relating to illumination properties, e.g. using a reflectance or lighting model
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30242—Counting objects in image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07—Target detection

Definitions

  • the present invention relates to a display system, a display processing device, a display processing method, and a program.
  • Patent Document 1 describes an evacuation guidance support device that effectively utilizes image processing technology to monitor the entry of a person into a dangerous area and determine an evacuation route.
  • Patent Document 2 describes a technique for displaying disaster prevention information on a large display installed in a city or the like when disaster prevention information is broadcast by one-segment broadcasting.
  • the above document describes a technique for monitoring the entry into a dangerous area in a state where a disaster has already occurred, and displaying a captured image of the place where the disaster has occurred on a large display. This makes it possible to keep away from dangerous places where disasters have occurred, and to avoid dangerous places to evacuate.
  • the present invention has been made in view of the above circumstances, and an object of the present invention is to provide a technique for monitoring the back alleys with few traffic and suppressing the occurrence of crime.
  • the first aspect relates to the display system.
  • the display system related to the first aspect is The display means installed on the first road and It has an imaging means for imaging a second road narrower than the first road.
  • the display means acquires and displays an image generated by the image pickup means or display data using the image.
  • the second aspect relates to a display processing device.
  • the display processing device is It has a display control means for acquiring an image generated by an imaging means for imaging a second road narrower than the first road on which a display is installed or display data using the image and displaying the image on the display.
  • the third aspect relates to a display processing method performed by at least one computer.
  • the display processing method according to the third aspect is The display processing device An image generated by an imaging means that images a second road narrower than the first road on which the display is installed, or display data using the image is acquired. Includes displaying on the display.
  • this invention may be a program that causes at least one computer to execute the method of the third aspect, or a recording medium that can be read by a computer that records such a program. You may.
  • This recording medium includes a non-temporary tangible medium.
  • This computer program includes computer program code that causes the computer to perform its display processing method on the display processing device when executed by the computer.
  • the various components of the present invention do not necessarily have to be independent of each other, and a plurality of components are formed as one member, and one component is formed of a plurality of members. It may be that a certain component is a part of another component, a part of a certain component overlaps with a part of another component, and the like.
  • the order of description does not limit the order in which the plurality of procedures are executed. Therefore, when implementing the method and computer program of the present invention, the order of the plurality of procedures can be changed within a range that does not hinder the contents.
  • the method of the present invention and the plurality of procedures of the computer program are not limited to being executed at different timings. Therefore, another procedure may occur during the execution of a certain procedure, a part or all of the execution timing of the certain procedure and the execution timing of the other procedure may overlap, and the like.
  • FIG. 1 It is a figure which shows typically the outline of the display system which concerns on embodiment. It is a figure which shows another example of the 2nd road. It is a functional block diagram which shows the logical configuration example of a display system. It is a block diagram which illustrates the hardware configuration of the computer which realizes the image pickup part and the display part of the display system shown in FIG. 1, respectively. It is a flowchart which shows the operation example of the display system of this embodiment. It is a figure which shows typically the configuration example of the display system. It is a functional block diagram which shows the logical configuration example of the display processing apparatus of this embodiment. It is a flowchart which shows the operation example of a display system. It is a functional block diagram which shows the logical configuration example of the display processing apparatus of this embodiment.
  • acquisition means that the own device retrieves data or information stored in another device or storage medium (active acquisition), and is output to the own device from the other device. Includes at least one of entering data or information (passive acquisition).
  • active acquisition include making a request or inquiry to another device and receiving the reply, and accessing and reading another device or storage medium.
  • passive acquisition may be receiving information to be delivered (or transmitted, push notification, etc.).
  • acquisition may be to select and acquire the received data or information, or to select and receive the delivered data or information.
  • FIG. 1 is a diagram schematically showing an outline of a display system 1 according to an embodiment.
  • roads are indicated by broken lines.
  • the second road R2 is imaged by the surveillance camera C1 at a place where there is a main street (first road R1) and an alley narrower than the first road R1 (second road R2), and the first It is displayed on the display D1 installed on the road R1.
  • the display system 1 displays a captured image of a low-traffic, that is, low-traffic, back alley on the display D1 installed on a high-traffic, that is, high-traffic boulevard, so that people passing through the boulevard can see the back alley. Can be monitored naturally.
  • FIG. 2 is a diagram showing another example of the second road R2.
  • the second road R2 intersects the first road R1.
  • there is only one camera C1 but in another example, a camera may be installed on the second road R2 on the opposite side of the intersection with the first road R1.
  • the second road R2 is connected to the first road R1 via yet another third road R3.
  • the imaging unit 102 images the second road R2 that intersects the first road R1.
  • the imaging unit 102 images the second road R2 connected to the first road R1 via the third road R3.
  • the second road R2 on which the camera C1 is installed can be considered in various forms, and is not limited to these examples.
  • FIG. 3 is a functional block diagram showing a logical configuration example of the display system 1.
  • the display system 1 includes an imaging unit 102 and a display unit 104.
  • the imaging unit 102 images the second road R2, which is narrower than the first road R1.
  • the display unit 104 is installed on the first road R1 and acquires and displays an image generated by the image pickup unit 102 or display data using the image.
  • the imaging unit 102 is, for example, a surveillance camera C1.
  • the camera C1 may be specialized for the display system 1, or for example, a surveillance camera previously installed on the second road R2 may be diverted.
  • the camera C1 includes an image sensor such as a lens and a CCD (Charge Coupled Device) image sensor.
  • CCD Charge Coupled Device
  • the camera C1 may be provided with a mechanism that controls the orientation of the camera body and the lens, zooms, focuses, etc. by following the movement of a person entering the angle of view.
  • the camera C1 is installed with the lens facing at least in the direction of photographing the second road R2 from the entrance.
  • the image generated by the camera C1 is preferably taken in real time and transmitted to the display D1.
  • the image transmitted to the display D1 does not have to be directly transmitted from the camera C1, and may be an image delayed by a predetermined time.
  • the image captured by the camera C1 may be temporarily stored in another storage device, and the display D1 may read out from the storage device sequentially or at predetermined intervals.
  • the image transmitted to the display D1 is preferably a moving image, but may be a frame image at predetermined intervals or a still image.
  • the display unit 104 is, for example, a display D1 such as a liquid crystal display or an organic EL display. Alternatively, it may be a building or structure standing along the second road R2 using projection mapping technology, or a projection device that displays an image in space.
  • the display D1 may be specialized for the display system 1, or may be diverted from a display for displaying contents such as advertisements and notification information previously installed on the second road R2. Good.
  • the installation location of the display D1 is not particularly limited as long as a person passing through the first road R1 can be seen.
  • the display D1 may be installed on a support provided in a median strip of the first road R1 or a median strip between the sidewalk and the first road R1.
  • the display D1 may be mounted on the sidewalk-side outer wall of the structure built along the first road R1 or in the show window of the store.
  • the screen of the display D1 is arranged so that the screen is substantially parallel to the traffic direction of the first road R1 and the screen faces the sidewalk side, that is, the screen of the display D1 is displayed from a person walking along the first road R1. It is preferably installed so that it can be seen. Although one camera C1 and one display D1 are shown in FIG. 1, a plurality of cameras and a plurality of displays may be provided.
  • the camera C1 and the display D1 are directly connected.
  • the image captured by the camera C1 is directly displayed on the display D1.
  • the camera C1 and the display D1 may be connected via a repeater (not shown).
  • the connection may be made via the management device of the center via the network.
  • the connection method between the camera C1 and the display D1 may be wireless or wired. In the case of wireless connection, it is assumed that the camera C1 and the display D1 each have a wireless communication function.
  • the camera C1 may be a network camera such as an IP (Internet Protocol) camera.
  • the image displayed on the display D1 may be display data using the image generated by the camera C1.
  • the display data is, for example, character information, a symbol, an image, an animation indicating the situation shown in the captured image, or character information, a symbol, an image, an animation, etc. indicating a necessary measure from the situation estimated from the captured image. There may be.
  • the situations shown in the captured image are, for example, the situation where a crime is occurring, the occurrence of pickpocketing and snatching, the occurrence of assault and fighting, the occurrence of terrorism, the escape direction of the criminal, or the key person, wanted person, etc. There are missing persons, lost children, wanderers, wanderers, etc.
  • the display processing device 100 which will be described later, can use the image processing device 120 to analyze the image generated by the image pickup unit 102 (camera C1) and estimate the situation. Necessary measures from the situation estimated from the captured image include reporting to the police and guards, requesting the dispatch of ambulances and fire engines, and evacuation guidance.
  • the image processing device 120 may be included in the display processing device 100 of the embodiment described later, or may be a device separate from the display processing device 100.
  • the camera C1 may have a microphone (not shown) for inputting sound together with an image.
  • the display D1 may have a speaker (not shown) that outputs sound.
  • the sound input by the microphone of the camera C1 may be output from the speaker of the display D1.
  • the speaker of the display D1 may output voice information and a warning sound indicating the situation reflected in the captured image, or voice information and a warning sound indicating necessary measures from the situation estimated from the captured image. ..
  • FIG. 4 is a block diagram illustrating a hardware configuration of a computer 1000 that realizes the imaging unit 102 and the display unit 104 of the display system 1 shown in FIG. 1, respectively. Further, the display processing device 100 described later is also realized by the computer 1000.
  • the computer 1000 has a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060.
  • the bus 1010 is a data transmission path for the processor 1020, the memory 1030, the storage device 1040, the input / output interface 1050, and the network interface 1060 to transmit and receive data to and from each other.
  • the method of connecting the processors 1020 and the like to each other is not limited to the bus connection.
  • the processor 1020 is a processor realized by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.
  • the memory 1030 is a main storage device realized by a RAM (Random Access Memory) or the like.
  • the storage device 1040 is an auxiliary storage device realized by an HDD (Hard Disk Drive), an SSD (Solid State Drive), a memory card, a ROM (Read Only Memory), or the like.
  • the storage device 1040 is a program that realizes each function of the display system 1 (for example, an imaging unit 102, a display unit 104, a display control unit 106 of a display processing device 100 described later, a specific unit 108, an estimation unit 112, a determination unit 114, etc.).
  • the processor 1020 reads each of these program modules into the memory 1030 and executes them, each function corresponding to the program module is realized.
  • the storage device 1040 also functions as a storage unit for storing various information used by the display processing device 100.
  • the program module may be recorded on a recording medium.
  • the recording medium on which the program module is recorded includes a medium that can be used by the non-temporary tangible computer 1000, and the program code that can be read by the computer 1000 (processor 1020) may be embedded in the medium.
  • the input / output interface 1050 is an interface for connecting the computer 1000 and various input / output devices.
  • the network interface 1060 is an interface for connecting the computer 1000 to the communication network.
  • This communication network is, for example, LAN (Local Area Network) or WAN (Wide Area Network).
  • the method of connecting the network interface 1060 to the communication network may be a wireless connection or a wired connection. However, the network interface 1060 may not be used.
  • the computer 1000 is connected to necessary devices (for example, camera C1, display D1, speaker, microphone, recording device, image processing device 120, etc.) via the input / output interface 1050 or the network interface 1060.
  • necessary devices for example, camera C1, display D1, speaker, microphone, recording device, image processing device 120, etc.
  • FIG. 5 is a flowchart showing an operation example of the display system 1 of the present embodiment.
  • the imaging unit 102 uses the camera C1 to image the second road R2, which is narrower than the first road R1, and generates an image (step S101).
  • the display unit 104 acquires and displays an image or display data using the image (step S103).
  • the imaging unit 102 images the second road R2 narrower than the first road R1 to generate an image
  • the display unit 104 acquires and displays the image or display data using the image.
  • the situation of the second road R2 can be shown to the person on the first road R1.
  • the image of the back alley can be shown to the people on the main street, so the people on the main street can monitor the back alley. You can get it.
  • the image of the back alley By displaying the image of the back alley on the main street, it will be effective in deterring crimes in the back alley. In addition, when a crime occurs, it can be detected immediately and it becomes possible to deal with it promptly and appropriately. Furthermore, if the image can be recorded, it can be used later as a clue or evidence for confirming or verifying the situation of a crime or identifying the criminal.
  • the display system 1 of the present embodiment is the same as that of the above embodiment except that it has a configuration for controlling the timing of displaying the captured image on the display D1.
  • FIG. 6 is a diagram schematically showing a configuration example of the display system 1.
  • the display system 1 includes a display processing device 100.
  • FIG. 7 is a functional block diagram showing a logical configuration example of the display processing device 100 of the present embodiment. As described above, the display processing device 100 is realized by the computer 1000.
  • the imaging unit 102 includes a first camera C11 installed at the entrance of the second road R2 and a second camera C12 installed in the middle of the second road R2. Then, the display control unit 106 processes the image of the first camera C11, and when it detects the entry of a person on the second road R2, causes the display unit 104 to display the image of the second camera C12.
  • the imaging unit 102 is the camera C1 and the display unit 104 is the display D1. Therefore, the image of the imaging unit 102 (camera C1) is directly displayed on the display unit 104 (display D1). That is, the imaging unit 102 (camera C1) and the display unit 104 (display D1) actively image the second road R2, send and receive the captured image, and display the image.
  • the imaging unit 102 may have a function of causing at least one camera C1 to capture an image of the second road R2 and a function of acquiring an captured image from the camera C1.
  • the display control unit 106 acquires an image captured by the camera C1 from the image pickup unit 102 and displays it on the display unit 104 (display D1).
  • the camera C1 may be controlled by the imaging unit 102
  • the display D1 may be controlled by the display control unit 106 to operate passively.
  • the second camera C12 is installed in the middle of the second road R2 and images the second road R2.
  • the first camera C11 is constantly photographing the entrance of the second road R2.
  • the image of the first camera C11 does not have to be displayed on the display D1.
  • the image of the first camera C11 is used to detect at least the entry of a person into the second road R2.
  • the second camera C12 may stop shooting or may be shooting the second road R2.
  • the first camera C11 has an imaging range at the entrance of the second road R2.
  • the image captured by the first camera C11 is transmitted to, for example, the image processing device 120 of FIG.
  • the image processing device 120 detects a person existing in the image, identifies the moving direction of the detected person with respect to the second road R2, and detects the entry of the person into the second road R2.
  • the image of the second camera C12 is not displayed on the display D1 until the presence of a person is detected on the second road R2.
  • the display D1 may display other images, for example, contents such as advertisements and notification information.
  • the display control unit 106 starts shooting if the second camera C12 has stopped shooting when it is detected that a person has entered the second road R2. Then, the display control unit 106 causes the display D1 to display the image of the second camera C12.
  • FIG. 8 is a flowchart showing an operation example of the display system 1.
  • This figure includes the same steps S101 and S103 as the flowchart of FIG. 5, and further includes steps S111 to S117 before step S101.
  • the display unit 104 (display D1 installed on the first road R1) mainly displays the image.
  • the display control unit 106 displays an image on the display D1 installed on the first road R1.
  • the imaging unit 102 causes the first camera C11 to image the second road R2 and generates an image (step S111).
  • the image of the second road R2 by the first camera C11 may be constantly performed, or may be performed at least for a predetermined time.
  • the display control unit 106 causes the display D1 to display a predetermined image (step S113).
  • the predetermined image is not particularly limited, but may include an image other than the captured image of the second road R2, and may be various contents such as an advertisement video and notification information. However, the screen of the display D1 may be turned off without displaying the predetermined image on the display D1.
  • the display control unit 106 acquires the image of the first camera C11 and causes the image processing device 120 of FIG. 18 to process it, and determines the entry of a person into the second road R2 using the processing result (step S115). .. Then, when the display control unit 106 detects the entry of a person into the second road R2 (YES in step S117), the display control unit 106 proceeds to step S101.
  • the image pickup unit 102 causes the second camera C12 to take an image of the second road R2 and generates an image (step S101).
  • the display control unit 106 acquires the image of the second camera C12 and displays the image or the display data using the image on the display D1 (step S103).
  • the process returns to step S111, the first camera C11 takes a picture of the second road R2, and the predetermined image on the display D1 in step S113 is taken. The display continues.
  • the timing of stopping the display of the image of the second road R2 on the display D1 by the second camera C12 is not particularly limited, but is exemplified below.
  • a plurality of the following conditions (a1) to (a4) may be combined.
  • (A1) When the exit of a person who has already entered from the second road R2 is detected by processing the image captured by the first camera C11 (a2)
  • the image captured by the second camera C12 is processed in the second road R2.
  • the presence of a person is no longer detected
  • a3 After a predetermined time has elapsed from the start of shooting of the second camera C12 (a4)
  • a predetermined or shooting stop time has passed
  • the display control unit 106 stops the display of the image of the second road R2 on the display D1 by the second camera C12, and then displays a predetermined image on the display D1. However, the screen of the display D1 may be turned off without displaying the predetermined image on the display D1.
  • the entry of a person into the second road R2 is detected by processing the image of the first camera C11 provided at the entrance of the second road R2, and the person has entered the second road R2.
  • the captured image of the second camera C12 can be displayed on the display D1.
  • the captured image of the second road R2 is displayed on the display D1, and at other times, other images, for example, contents such as advertisements and notification information are displayed on the display D1. It can be displayed. Therefore, the captured image of the second road R2 can be displayed on the display D1 installed in the city where the contents such as advertisements are displayed only when monitoring is required.
  • FIG. 9 is a functional block diagram showing a logical configuration example of the display processing device 100 of the present embodiment.
  • the display system 1 of the present embodiment is the same as the above-described embodiment except that the conditions for displaying the image of the second camera C12 on the display D1 are different from the above-described embodiment.
  • the display processing device 100 further includes a specific unit 108 in addition to the configuration of the display processing device 100 shown in FIG.
  • the identification unit 108 processes the image of the first camera C11 and identifies the attributes of a person. Then, the display control unit 106 causes the display D1 to display the image of the second camera C12 when the attribute satisfies the reference.
  • the attributes of the person specified by the specific unit 108 are, for example, gender, age group, and the like. Criteria are, for example, female for gender and children for total age (eg, under 10 years old).
  • the feature amount of the specific person may be registered in advance, and the specific person may be detected from the captured image by using the image processing device 120 of FIG.
  • the particular person may include, for example, any person on the run, pursuing, and wanted, and a person to be guarded, such as a VIP.
  • FIG. 10 is a flowchart showing an operation example of the display system 1. This figure includes the same step S101 as the flowchart of FIG. 5, the same steps S103, S111, and S113 as the flowchart of FIG. 8, and further includes steps S121 and S123 between steps S113 and S101.
  • the imaging unit 102 causes the first camera C11 to image the second road R2 and generates an image (step S111).
  • the display control unit 106 causes the display D1 to display a predetermined image (step S113).
  • the identification unit 108 acquires the image of the first camera C11 and causes the image processing device 120 of FIG. 18 to process it, and identifies the attribute of the person in the image using the processing result (step S121).
  • the display control unit 106 determines whether or not the attribute satisfies a predetermined criterion, for example, whether or not it is a woman or a child (step S123). If the criteria are met (YES in step S123), the process proceeds to step S101.
  • the image pickup unit 102 causes the second camera C12 to take an image of the second road R2 and generates an image (step S101).
  • the display control unit 106 acquires the image of the second camera C12 and displays the image or the display data using the image on the display D1 (step S103).
  • the process returns to step S111, the first camera C11 takes a picture of the second road R2, and the predetermined image on the display D1 in step S113 is taken. The display continues.
  • the timing of stopping the display of the image of the second road R2 on the display D1 by the second camera C12 is the same as that of the above embodiment.
  • the display control unit 106 After stopping the display of the image of the second road R2 on the display D1 by the second camera C12, the display control unit 106 causes the display D1 to display a predetermined image. However, the screen of the display D1 may be turned off without displaying the predetermined image on the display D1.
  • the image of the camera when the attributes of the person who has entered the second road R2 satisfy the criteria, the image of the camera can be displayed on the display, so that the image of the place corresponding to the situation where the crime rate is high is high. Can be displayed on the main street, and people on the main street can be watched. It can be expected that the degree of attention to the image will be increased by displaying it in a specific case as compared with the case where it is always displayed.
  • FIG. 11 is a functional block diagram showing a logical configuration example of the display processing device 100 of the present embodiment.
  • FIG. 12 is a diagram schematically showing an arrangement example of the display D1 and the camera C1 installed on the second road R2 to be monitored by the display system 1.
  • the display processing device 100 of the present embodiment is the same as the display processing device 100 of the above-described embodiment of FIG. 7 except that the captured images of the plurality of second roads R2 are displayed on one display D1.
  • the display processing device 100 of the present embodiment has the same configuration as the display processing device 100 of the above-described embodiment of FIG. 7, and further includes an estimation unit 112 and a determination unit 114.
  • the estimation unit 112 and the determination unit 114 of the present embodiment can be combined within a range consistent with the configuration of the display processing device 100 of the embodiment other than the embodiment of FIG.
  • a plurality of second roads in this example, the second road R21 and the second road R22, are linked to one display unit 104 (display D1).
  • the imaging unit 102 is a plurality of cameras installed at the entrance and exit of the second road R2, respectively, in this example, the cameras C31 and C32 associated with the second road R21, and the cameras associated with the second road R22. Includes C41 and camera C42.
  • a first camera for detecting the entry of a person and a second camera for capturing the second road are installed at each entrance / exit. And. These two cameras are shown as a set with one reference numeral in FIG.
  • the camera C31 includes a first camera C11 and a second camera C12.
  • the estimation unit 112 estimates the number of people staying on each second road by processing images from a plurality of cameras.
  • the determination unit 114 uses the estimated number of people to determine which road image is to be displayed on the display D1.
  • Display D1 displays images from at least one camera.
  • the screen of the display D1 may be divided to display images from a plurality of cameras.
  • the display D1 may sequentially display images from a plurality of cameras by switching them at predetermined time intervals.
  • the image used by the estimation unit 112 for estimating the number of people is the image captured by the first camera C11 installed at each position.
  • the captured image of the second camera C12 installed at each position is used.
  • FIG. 13 is a flowchart showing an operation example of the display system 1. This figure includes the same step S103 as the flowchart of FIG. 8, and further includes steps S131 to S135 before step S103.
  • the imaging unit 102 acquires images from the cameras C31, C32, C41, and C42 at the entrances and exits of the plurality of second roads R21 and R22 in association with each road (step S131).
  • the captured image of the first camera C11 installed at each position is acquired.
  • FIG. 14 is a diagram showing an example of a day structure of camera information and image information.
  • FIG. 14A shows camera information 130
  • FIG. 14B shows image information 132. This information is stored in the storage device 1040 of the computer 1000.
  • Identification information is predetermined for each of the plurality of second roads.
  • the road identification information of the second road is associated with the identification information of the camera installed on the second road and the information of the installation position thereof.
  • the installation position information may simply be information indicating whether the second road is the entrance or the exit, or may be information indicating an absolute position such as longitude and latitude. Alternatively, it may be information indicating an address, or may be the name of an installation position, for example, a building name, a facility name, an intersection name, etc., and when installed on a utility pole, identification information assigned to the utility pole. It may be.
  • the image data captured by each camera is associated with the imaging date and time and the camera identification information.
  • the identification information that identifies each camera may be, for example, an IP (Internet Protocol) address assigned to each camera.
  • the image information 132 may hold a file name including a path indicating a location where the image data file is temporarily or non-temporarily stored, or at least a file name as image data.
  • the substance of the image data file may be stored in a predetermined storage location. Further, the date and time information may not be provided if the image data itself holds it.
  • the estimation unit 112 acquires images of the first cameras C11 installed at a plurality of positions, causes the image processing device 120 of FIG. 18 to process them, and stays on each second road using the processing results.
  • the number of people doing this is estimated (step S133).
  • the image processing device 120 causes the image processing device 120 to recognize a person passing through the entrance / exit of the second road.
  • the simplest method is to detect the entry / exit of a person at each entrance / exit, increment the counter for the number of people when an intruder is detected, and decrement the counter for the number of people when an exit is detected.
  • the number of visitors and the number of exits may be counted for each entrance / exit of the second road, and the difference may be obtained to obtain the number of people staying on the second road.
  • a person who has entered the second road is image-recognized by the image processing device 120, and the feature amount of the person is registered in the visitor list as a visitor.
  • the counter of the number of people may be incremented.
  • the image processing device 120 is made to image-recognize the person who has left the second road, it is determined whether or not the feature amount is registered as a visitor, and if it is registered, the feature amount of the person is listed in the visitor list. Remove from.
  • the counter of the number of people may be decremented.
  • the number of people may be obtained by counting the number of people registered in the attendee list.
  • the exit person is not included in the attendee list, do nothing.
  • the feature amount, the date and time of leaving, the identification information of the imaging camera, and the like may be recorded.
  • the determination unit 114 determines which road image is to be displayed on the display D1 using the number of people estimated in step S133 (step S135). Then, the display control unit 106 causes the limited image to be displayed on the display D1 (step S103).
  • the screen of the display D1 is divided into a plurality of screens, and images or display data captured by the plurality of cameras are displayed in each area.
  • the captured images or display data of the plurality of cameras are sequentially displayed on the entire screen of the display D1, each area divided into screens, and at least a part of the screen of the display D1 for a predetermined time.
  • B3 When a specific condition is satisfied, an captured image or display data satisfying the condition is displayed as a pop-up screen in at least a part of the screen of the display D1.
  • the one-time display time of each image or display data is changed constantly or according to conditions.
  • the image displayed on each screen or area is displayed by selecting and switching between the captured image or display data of the camera and other images, for example, contents such as advertisements and notification information according to conditions.
  • B6 When a specific condition is satisfied, the captured image or display data of the specific camera is emphasized and displayed.
  • Priority is given to the cameras, and the cameras are displayed in descending order of priority, or the display time is lengthened.
  • B8 Images captured by a plurality of cameras are randomly displayed.
  • C1 If the number of people staying on the second road is larger than the specified number, the priority is lowered.
  • C2) If the number of people staying on the second road is one, lower the priority.
  • C3) If the number of people staying on the second road is within the standard range (for example, 2 to 3 people), the priority is raised.
  • the priority may be indicated by, for example, a ratio of 0 to 1.
  • the priority indicates the priority for displaying the captured image of the camera on the display D1.
  • the image captured by the camera includes a situation in which the incidence of crime is increasing.
  • the higher the priority value the higher the priority, that is, the higher the crime rate.
  • the priority may be 0 to 100, or may be indicated by a predetermined level such as low, medium and high, or 1 to 5.
  • the images captured by a camera having a priority equal to or higher than the threshold value may be displayed preferentially and displayed in descending order of priority, or the display time may be lengthened as the priority is higher. It is not necessary to display the captured image of the camera having the priority below the threshold value.
  • FIG. 15 is a diagram showing an example of a display screen of the display D1.
  • FIG. 15A shows an example in which the screen 150 is divided into four and the images captured by the four cameras are displayed in each area. In each area, information 152 indicating the shooting location of the image may be displayed together with the captured image.
  • FIG. 15B shows an image of a camera whose priority exceeds the threshold value in a part area 160 of the screen 150 of the display D1, and an advertisement or the like in the other area 154 other than the image captured by the camera. Shows an example in which the content image of is displayed. In the area 160, character information indicating a message calling attention, an image 162, or the like may be further displayed. Alternatively, the frame of the area 160 may be emphasized or blinked, or the animation may be superimposed and displayed to call for more attention.
  • images captured by a plurality of cameras can be selected according to the priority of the cameras and displayed on the display D1, so that the cameras installed in a place where the crime rate is high.
  • the captured image of the above can be displayed with priority given to the display D1. Therefore, more effective crime control can be expected.
  • the conditions for displaying the image generated by the imaging unit 102 on the display D1 may be a specific time, the ambient brightness is equal to or less than the reference value, or the like.
  • the display control unit 106 displays the image captured by the image pickup unit 102 on the display D1.
  • the display processing device 100 may further include a time acquisition unit (not shown) for acquiring the current time.
  • the time acquisition unit may acquire the current time from a clock (not shown) included in the computer 1000, or may acquire the current time from an NTP (Network Time Protocol) server via a communication network.
  • NTP Network Time Protocol
  • the display time may be set in advance. Further, the display time may be changed by the operation of the administrator. For example, the time from evening to dawn may be set. It is possible to specify a time zone in which the number of people on the second road R2 is low, a time zone in which the number of people on the second road R2 is high, and a time period in which security is poor. Further, the display on the display D1 may be stopped during the time when the number of people on the first road R1 is low. That is, the display unit 104 displays the image in a time zone other than the time zone when the number of people on the first road R1 is low.
  • the ambient brightness can be estimated by processing the image generated by the imaging unit 102.
  • the estimated ambient brightness is dark, that is, when it is equal to or less than the reference value, the image of the imaging unit 102 is displayed on the display D1.
  • the ambient brightness may be acquired from the information measured by the camera C1 at the time of shooting.
  • FIG. 16 is a flowchart showing an operation example of the display system 1.
  • the flowchart of FIG. 16 includes steps S111, S113, and S103 of the flowchart of FIG. 8, and further includes steps S141 to S145.
  • the imaging unit 102 causes the first camera C11 to image the second road R2 and generates an image (step S111).
  • the display control unit 106 causes the display D1 to display a predetermined image (step S113).
  • the display control unit 106 determines whether or not the display timing is set for each camera (step S141). This judgment condition is, for example, when the attribute of the person who entered the second road R2 meets the standard (female or child, etc.), at a specific time, or when the ambient brightness falls below the standard. At least one of.
  • Step S141 when the display timing is set (YES in step S141) and there are a plurality of cameras at the display timing (YES in step S143), the display control unit 106 selects a camera having a high priority. (Step S145), the display is displayed on the display D1 (step S103).
  • step S141 If it is not at the display timing (NO in step S141), the process returns to step S111. If there is only one camera at the display timing (NO in step S143), step S145 is bypassed and the display control unit 106 displays the captured image of the camera on the display D1 (step S103).
  • FIG. 17 is a diagram showing a configuration example of the display system 1 of another embodiment.
  • the display system 1 includes a plurality of cameras C1, a display D1, and a management device 200.
  • the management device 200 is connected to the plurality of cameras C1 and the display D1 via a communication network 3 such as the Internet.
  • the display processing device 100 described in the above embodiment may be included in the management device 200.
  • FIG. 18 is a diagram showing a configuration example of a display system 1 including an image processing device 120.
  • the display system 1 includes a display D1, at least one camera C1, a display processing device 100, and an image processing device 120.
  • the devices are connected to each other via the communication network 3.
  • the image captured by the camera C1 is image-processed by the image processing device 120 to detect the entry of a person into the second road R2, identify the attribute of the person who has entered, and the person. It is possible to acquire the feature amount.
  • the display system 1 has described the configuration including one display D1, but the present invention is not limited to this, and a plurality of displays may be provided.
  • the moving direction of the person to be tracked is specified, and the image of the camera capturing the person is displayed on the display in the moving direction.
  • the method of detecting the occurrence of a crime can be detected by image processing by the image processing device 120.
  • it may be linked with a predetermined warning system to acquire information on the location of the crime, and the camera and display may be specified from the location information.
  • the display control unit 106 displays the image captured by the camera that captures the place where the crime occurs and the place where the person to be tracked exists on the display.
  • the display means installed on the first road and An imaging means for imaging a second road narrower than the first road is provided.
  • the display means is a display system that acquires and displays an image generated by the image pickup means or display data using the image.
  • 2. 1. 1. In the display system described in The imaging means is a display system that images the second road intersecting the first road. 3. 3. 1. 1. Or 2. In the display system described in The imaging means is a display system that images the second road connected to the first road via a third road. 4. 1. 1. From 3.
  • a display system further comprising a display control means for processing an image of the first camera and displaying an image of the second camera on the display means when an intrusion of a person is detected on the second road. 5. 4. In the display system described in Further provided with specific means for processing the image of the first camera and identifying the attributes of a person, The display control means is a display system that causes the display means to display an image of the second camera when the attributes satisfy the criteria. 6. 1. 1. From 5. In the display system described in any one of The display control means is a display system that causes the display means to display the image at a specific time. 7. 1. 1. From 6.
  • the display control means is a display system that causes the display means to display the image when the ambient brightness is equal to or less than a reference value.
  • the imaging means includes a plurality of cameras installed at the entrance and exit of the second road, respectively.
  • An estimation means for estimating the number of people staying on each of the second roads by processing images from the plurality of cameras, and an estimation means.
  • a display system comprising a determination means for determining which road image is to be displayed on the display means using the estimated number of people.
  • a display process including an image generated by an imaging means that images a second road narrower than the first road on which a display is installed, or a display control means that acquires display data using the image and displays it on the display. apparatus. 10. 9. In the display processing apparatus described in The image pickup means is a display processing device that images the second road intersecting with the first road. 11. 9. Or 10. In the display processing apparatus described in The imaging means is a display processing device that images the second road connected to the first road via a third road. 12. 9. From 11.
  • the display control means A display processing device that processes an image of the first camera and causes the display means to further display an image of the second camera when an intrusion of a person is detected on the second road. 13. 12. In the display processing apparatus described in Further provided with specific means for processing the image of the first camera and identifying the attributes of a person, The display control means is a display processing device that causes the display means to display an image of the second camera when the attributes satisfy the criteria. 14. 9. To 13. In the display processing apparatus described in any one of The display control means is a display processing device that causes the display means to display the image at a specific time. 15. 9. From 14.
  • the display control means is a display processing device that causes the display means to display the image when the ambient brightness is equal to or less than a reference value. 16. 9. To 15.
  • the imaging means includes a plurality of cameras installed at the entrance and exit of the second road, respectively.
  • An estimation means for estimating the number of people staying on each of the second roads by processing images from the plurality of cameras, and an estimation means.
  • a display processing device including a determination means for determining which road image is to be displayed on the display means using the estimated number of people.
  • the display processing device An image generated by an imaging means that images a second road narrower than the first road on which the display is installed, or display data using the image is acquired.
  • the image pickup means is a display processing method for imaging the second road intersecting with the first road. 19. 17.
  • In the display processing method described in The image pickup means is a display processing method for imaging the second road connected to the first road via a third road. 20. 17. From 19.
  • the image of the first camera is processed to identify the attributes of a person, A display processing method for displaying an image of the second camera on the display means when the attribute satisfies the criteria. 22. 17. From 21.
  • the imaging means includes a plurality of cameras installed at the entrance and exit of the second road, respectively.
  • the display processing device By processing the images of the plurality of cameras, the number of people staying on each of the second roads is estimated.
  • any one of The imaging means The first camera installed at the entrance of the second road and Including a second camera installed in the middle of the second road, A program for causing a computer to perform a procedure of processing an image of the first camera and further displaying an image of the second camera on the display means when an intrusion of a person is detected on the second road. 29. 28.
  • a plurality of the second roads are linked to the one display means.
  • the imaging means includes a plurality of cameras installed at the entrance and exit of the second road, respectively. A procedure for estimating the number of people staying on each of the second roads by processing images from the plurality of cameras.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Alarm Systems (AREA)
  • Closed-Circuit Television Systems (AREA)
PCT/JP2019/051545 2019-12-27 2019-12-27 表示システム、表示処理装置、表示処理方法、およびプログラム Ceased WO2021131050A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
PCT/JP2019/051545 WO2021131050A1 (ja) 2019-12-27 2019-12-27 表示システム、表示処理装置、表示処理方法、およびプログラム
JP2021566750A JP7392738B2 (ja) 2019-12-27 2019-12-27 表示システム、表示処理装置、表示処理方法、およびプログラム
US17/788,837 US12198436B2 (en) 2019-12-27 2019-12-27 Display system, display processing method, and nontransitory computer-readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2019/051545 WO2021131050A1 (ja) 2019-12-27 2019-12-27 表示システム、表示処理装置、表示処理方法、およびプログラム

Publications (1)

Publication Number Publication Date
WO2021131050A1 true WO2021131050A1 (ja) 2021-07-01

Family

ID=76574194

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/051545 Ceased WO2021131050A1 (ja) 2019-12-27 2019-12-27 表示システム、表示処理装置、表示処理方法、およびプログラム

Country Status (3)

Country Link
US (1) US12198436B2 (https=)
JP (1) JP7392738B2 (https=)
WO (1) WO2021131050A1 (https=)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20230152104A1 (en) * 2021-11-18 2023-05-18 Johnson Controls Tyco IP Holdings LLP Methods and apparatuses for implementing integrated image sensors
US12100320B1 (en) * 2024-01-19 2024-09-24 Scott Krantz Billboard advertising structure

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003063746A (ja) * 2001-08-23 2003-03-05 Mitsubishi Electric Building Techno Service Co Ltd エレベータのかご内監視装置
JP2003317168A (ja) * 2002-04-22 2003-11-07 Ikeno Tsuken Kk 違法行為、不法行為等の情報収集方法
JP2004272507A (ja) * 2003-03-07 2004-09-30 Hitachi Kokusai Electric Inc 交差点監視システム
JP2004310208A (ja) * 2003-04-02 2004-11-04 Fb Automation Co Ltd 音声検知防犯警報システム、映像公開型防犯カメラシステム、及び複合型防犯警報システム
JP2007261722A (ja) * 2006-03-28 2007-10-11 Megachips System Solutions Inc エレベータかご内の表示装置およびエレベータかご内の表示方法
JP2017138678A (ja) * 2016-02-01 2017-08-10 株式会社日本マシンサービス 防犯装置

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07296068A (ja) 1994-04-25 1995-11-10 Toshiba Corp 避難誘導支援装置
JP2009134488A (ja) 2007-11-30 2009-06-18 Toshiba Corp プラント監視システム
DE102007061754A1 (de) * 2007-12-20 2009-06-25 Elektro Grundler Ges.M.B.H. & Co. Kg Evakuierungsvorrichtung und Fluchtweganzeige hierfür
JP2011029754A (ja) 2009-07-22 2011-02-10 Toshiba Corp 防災情報処理装置および防災情報表示システム
US9092963B2 (en) 2010-03-29 2015-07-28 Qualcomm Incorporated Wireless tracking device
JP6041515B2 (ja) 2012-04-11 2016-12-07 キヤノン株式会社 画像処理装置および画像処理方法
KR101274549B1 (ko) * 2012-10-05 2013-06-13 주식회사 미르메이트 곡선도로의 영상제공 장치.
JP2015041820A (ja) * 2013-08-20 2015-03-02 キヤノン株式会社 撮像装置及びその制御方法、撮像システム、プログラム
JP6413310B2 (ja) 2014-04-10 2018-10-31 富士通株式会社 見守り装置、表示方法及びプログラム
US20170061258A1 (en) 2015-08-25 2017-03-02 Nokia Technologies Oy Method, apparatus, and computer program product for precluding image capture of an image presented on a display
JP6177408B1 (ja) 2016-10-18 2017-08-09 オカムラ印刷株式会社 見守りシステム、見守り方法、情報取得装置、情報処理装置およびそれらの方法とプログラム
JP6346357B2 (ja) 2017-07-11 2018-06-20 オカムラ印刷株式会社 見守りシステム、見守り方法、情報取得装置、情報処理装置およびそれらの方法とプログラム
WO2019021853A1 (ja) * 2017-07-28 2019-01-31 ソニーセミコンダクタソリューションズ株式会社 画像処理装置および方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003063746A (ja) * 2001-08-23 2003-03-05 Mitsubishi Electric Building Techno Service Co Ltd エレベータのかご内監視装置
JP2003317168A (ja) * 2002-04-22 2003-11-07 Ikeno Tsuken Kk 違法行為、不法行為等の情報収集方法
JP2004272507A (ja) * 2003-03-07 2004-09-30 Hitachi Kokusai Electric Inc 交差点監視システム
JP2004310208A (ja) * 2003-04-02 2004-11-04 Fb Automation Co Ltd 音声検知防犯警報システム、映像公開型防犯カメラシステム、及び複合型防犯警報システム
JP2007261722A (ja) * 2006-03-28 2007-10-11 Megachips System Solutions Inc エレベータかご内の表示装置およびエレベータかご内の表示方法
JP2017138678A (ja) * 2016-02-01 2017-08-10 株式会社日本マシンサービス 防犯装置

Also Published As

Publication number Publication date
JP7392738B2 (ja) 2023-12-06
US20230025590A1 (en) 2023-01-26
US12198436B2 (en) 2025-01-14
JPWO2021131050A1 (https=) 2021-07-01

Similar Documents

Publication Publication Date Title
US11157778B2 (en) Image analysis system, image analysis method, and storage medium
US10424175B2 (en) Motion detection system based on user feedback
US20120257061A1 (en) Neighborhood Camera Linking System
US20190108404A1 (en) Consumer Camera System Design for Globally Optimized Recognition
US20190108735A1 (en) Globally optimized recognition system and service design, from sensing to recognition
US20130329047A1 (en) Escort security surveillance system
KR101990803B1 (ko) IoT를 이용한 취약계층 보호관리 시스템
US20190108405A1 (en) Globally optimized recognition system and service design, from sensing to recognition
JP2008167429A (ja) カメラ・タンパリング検出
CN110120113A (zh) 数据处理方法及装置、门禁设备和门禁控制系统
JP6977328B2 (ja) 顔認証装置、人物追跡システム、人物追跡方法、および、人物追跡プログラム
US20180082413A1 (en) Image surveillance apparatus and image surveillance method
KR20140122779A (ko) 위치기반 통합관제시스템
JP7392738B2 (ja) 表示システム、表示処理装置、表示処理方法、およびプログラム
JP6663703B2 (ja) 見守りシステム
Basthikodi et al. AI based automated framework for crime detection and crowd management
JP6483414B2 (ja) 画像確認システムおよびセンタ装置
JP2015088816A (ja) 画像監視システム
JP7652229B2 (ja) 監視装置、監視方法、およびプログラム
JP2015056697A (ja) 監視システムおよびその制御方法
JP2013005336A (ja) 監視装置、警備システム及び監視装置用プログラム
JP2005135188A (ja) 監視方法、監視システム、およびコンピュータプログラム
JP2008112402A (ja) 地域監視システム
JP7682386B1 (ja) 監視装置、監視方法、監視プログラム及び監視システム
JP7212257B2 (ja) 監視システム、画像利用許諾方法、および画像利用許諾プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19957993

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021566750

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19957993

Country of ref document: EP

Kind code of ref document: A1