KR102183285B1 - Social distance meter - Google Patents

Abstract

Disclosed is a social distance meter for maintaining a social distance between users. According to one embodiment, the social distance meter comprises: a user recognition unit recognizing a plurality of users using image information acquired by using a camera installed in an electronic device wherein content is outputted; a distance measurement unit measuring distance information between users for the recognized plurality of users; and an alarm generation unit generating an alarm through the electronic device wherein the content is outputted in accordance with an alert generation condition determined based on the measured distance information between users.

Description

Social Distance Meter {SOCIAL DISTANCE METER}

The following description relates to a technique for measuring distance information between objects from image information.

Since the first outbreak in Wuhan, China, a new type of coronavirus (SARS-CoV-2), which has spread throughout China and around the world, has caused respiratory infections. Coronavirus infection 19 is transmitted when droplets (saliva) of an infected person penetrate the respiratory tract or mucous membranes of the eyes/nose/mouth. When infected, after an incubation period of about 2 to 14 days (estimated), fever (37.5 degrees), respiratory symptoms such as cough or shortness of breath, and pneumonia are the main symptoms.

With the rapid spread of the coronavirus infection 19, social distancing in the community is being implemented. Social distancing refers to infection control measures or campaigns that maintain distances between people to slow the spread of community infections. For example, to minimize contact with people, such as refraining from participating in events/meetings, and to prevent infection of Corona 19　 even when meeting people inevitably, social distancing prevention rules such as keeping a distance of more than 2m　 and shaking hands with elbows were implemented Has become.

Nevertheless, with the prolonged coronavirus infection 19, the perception of social distancing has become weakened, and people are flocking to crowded places. Thus, until a vaccine against coronavirus infection 19 is developed, there is a need for a technology that can maintain actions such as refraining from unnecessary conversations with a distance of 2m or more between people indoors and outdoors.

It is possible to provide a social distance measuring device and method for maintaining social distance between users.

The social distance measurer includes: a user recognition unit for recognizing a plurality of users using image information acquired using a camera installed in an electronic device for outputting content; A distance measuring unit measuring distance information between users for the recognized plurality of users; And an alarm generator that generates an alarm through an electronic device to which the content is output according to an alert generation condition determined based on the measured distance information between users.

The camera installed in the electronic device is a 3D depth camera, the user recognition unit includes acquiring image information photographed using the 3D depth camera, and the distance measurement unit recognizes the acquired image information Each box area including a plurality of users is generated, and distance information between each box area including a plurality of users recognized in the acquired image information is automatically calculated, and the alarm generator comprises: It is determined whether the automatically calculated distance information between each box area exists within the preset distance standard based on the total average value of the box areas recognized within the acquired image information, and between the automatically calculated box areas When distance information exists within the preset distance reference, it may be set as a condition for generating a warning.

The distance measuring unit generates each box area including a plurality of users recognized in the acquired image information, and compares relative distance information between each box area including a plurality of users recognized in the acquired image information Including, the alarm generation unit, based on the total average value of the box area recognized in the obtained image information, determine whether the distance information between the compared respective box areas exists within the preset distance reference, When the compared distance information between the respective box areas exists within the preset distance criterion, a warning generation condition may be set.

The distance measuring unit may obtain a total average value obtained by calculating height information for each box area recognized within the obtained image information.

The electronic device is a digital signage that outputs advertisement content, and while outputting the advertisement content through the digital signage, the electronic device includes real-time photographing of users waiting at a store counter using a camera installed on the digital signage, , The alarm generator may stop advertisement content output from the electronic device, output image information related to users existing within the preset distance criterion, and generate an alarm at the same time.

The electronic device is a digital signage that outputs advertisement content, and outputs the advertisement content through the digital signage, and includes photographing users moving outdoors in real time using a camera installed on the digital signage, The alarm generator uses image information related to users existing within the preset distance criterion as interactive content, and a user existing within a preset distance criterion before the next advertisement content is output after the advertisement content is output It is possible to generate an alarm while outputting video information related to the field.

The user recognition unit includes recognizing a plurality of users based on image information obtained from location information in which the social distance finder is installed, and the alarm generator includes location information on which the social distance finder is installed and the social distance finder A congestion map may be constructed by using congestion information of a plurality of users recognized based on image information acquired from the installed location information, and the constructed congestion map may be serviced through the electronic device.

The social distance meter according to an embodiment can maintain social distance by measuring distance information between users recognized in the captured image information using digital signage in which advertisement content is output and generating an alarm when it is closer than a certain distance. , It can prevent the spread of infectious diseases.

1 is a diagram for explaining a general operation of a social distance meter according to an embodiment.
2 is a block diagram illustrating a configuration of a social distance meter according to an exemplary embodiment.
3 is a flowchart illustrating a method of measuring a social distance in a social distance meter according to an embodiment.
4 is a diagram for describing a method of measuring distance information between users in a social distance meter according to an exemplary embodiment.
5 is an example for explaining generating an alarm through distance information measured between users existing in a purchase waiting line in a social distance meter according to an exemplary embodiment.
6 is an example for explaining generating an alarm through distance information measured between users walking on a street in a social distance meter according to an embodiment
7 is an example for explaining providing a congestion level map through distance information measured between users in a social distance meter according to an embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings.

1 is a diagram for explaining a general operation of a social distance meter according to an embodiment.

The social distance measurer 100 recognizes users (for example, pedestrians) in the image information captured using an electronic device, and measures the distance between the recognized users, and an alarm to give attention when it is closer than a certain distance. Can occur.

The social distance meter 100 may be operated in an electronic device or in combination with an electronic device. The electronic device may be a fixed terminal implemented as a computer system or a mobile terminal. Examples of electronic devices include smart phones, mobile phones, navigation systems, computers, notebook computers, digital broadcasting terminals, PDAs (Personal Digital Assistants), PMPs (Portable Multimedia Players), tablet PCs, game consoles, There are wearable devices, internet of things (IoT) devices, virtual reality (VR) devices, augmented reality (AR) devices, and digital signage. In addition, at least one camera 130 may be embedded or attached to the electronic device. In the embodiment, description will be made on the assumption that the electronic device is a digital signage 140 that outputs advertisement content.

The digital signage 140 is an advertisement using a digital information display (DID), and means an advertisement board capable of controlling advertisement contents through a communication network in a control center. It is common in subway stations, bus stops, apartment elevators, banks, and other places with a large floating population. For example, there are types of digital signage such as outdoor digital signage installed on the exterior wall of a building or an electronic signage, and small indoor digital signage installed on the inner wall of a large shopping mall or made in the form of a signboard.

The social distance meter 100 may capture image information using the camera 130 present in the digital signage 140. The social distance meter 100 may capture image information using a camera when there are multiple users. For example, the social distance meter 100 may be photographing image information in real time, and may measure social distance when two or more users (pedestrians) are detected. Alternatively, the social distance meter 100 may capture image information only when two or more users are detected.

The social distance meter 100 may set a composition photographed by the camera 130 present in the digital signage 140. The social distance meter 100 may set a composition such as a direction and an angle of the camera. For example, the social distance measurer 100 may install the camera view composition at an angle so that the user (for example, a pedestrian) does not overlap each other in case that recognition is difficult due to the overlapping of the users within the image information. You can change the composition.

The social distance measurer 100 may photograph all users viewing the digital signage 140 on which content is output. The social distance measurer 100 recognizes (120) a plurality of users using image information 110 acquired using a camera installed in a digital signage 140 in which content is output, and distance information between users in the image information If it is closer than a certain distance by measuring, it can give attention to the user.

The social distance meter 100 measures distance information between users for a plurality of recognized users, and generates an alarm through an electronic device that outputs content according to an alert occurrence condition determined based on the measured distance information between users. It can be alarmed.

For example, the social distance finder 100 may include a 3D depth camera. For example, at least one or more 3D depth cameras may be installed in the digital signage 140, or a 3D depth camera in the form of a module may be built into the digital signage 140. In addition, in addition to a camera for capturing an image, various sensors for measuring distance information may be built-in or attached. The social distance finder 100 may acquire image information photographed using a 3D depth camera. The social distance meter 100 may generate each box area including users recognized in the acquired image information. Distance information between each box area including users recognized in the acquired image information may be automatically calculated. In this case, when a 3D depth camera is used, a distance between objects (users) within the image information may be automatically calculated. The social distance measurer 100 determines whether distance information between each box area, which is automatically calculated based on the total average value of the box area recognized within the acquired image information, exists within a preset distance standard, and is automatically calculated. When distance information between each box area exists within a preset distance standard, a warning generation condition can be set.

As another example, the social distance finder 100 may include a 2D camera. At this time, at least one 2D camera may be installed in the digital signage 140, or a module-type 2D camera may be built into the digital signage 140. In addition, in addition to a camera for capturing an image, various sensors for measuring distance information may be built-in or attached. The social distance measurer 100 may acquire image information photographed using a 2D camera. Referring to FIG. 4, it is an example for explaining a method of measuring distance information between users. For example, it is generally recommended to maintain a social distance of 1.5-2M. At this time, since the user's movement in the image information continuously changes, the social distance meter 100 may measure the social distance by using the relative distances of users recognized in the image information. Since the height of an average person is between 1.6 and 1.8M, it may be relatively similar to the user's vertical length (height) and social distance (1.5-2M) recognized in the image information. In an embodiment, social distance may be measured using the vertical length of the user. The social distance measurer 100 generates each box area 210 and 220 including users recognized in the image information 110, and each box area 210 including users recognized in the acquired image information. 220) distance information can be compared. In this case, the social distance meter 100 may generate a box area based on the size of the user recognized in the image information. The social distance measurer 100 may acquire image information in real time. For example, assuming that one image information is photographed per second, the height of users recognized in the image information acquired through photographing every second You can calculate the average. The social distance measurer 100 may obtain an overall average value obtained by calculating height information for each box area recognized within the acquired image information. Accordingly, when a user included in the image information changes every second, the calculated average key value may vary. In addition, when there are two or more users recognized in the image information, the social distance measurer 100 may compare distance information by the number of cases between box regions in the recognized image information. For example, assuming that there are 3 users (A, B, C) recognized in the image information, the distance information between A and B, the distance information between B and C, and the distance information between C and A are each A , B, C can be compared with the overall average value. The social distance measurer 100 may compare the average value calculated by calculating the average height of users recognized through the image information acquired every second and relative distance information between the recognized users in the image information acquired every second. In this case, the social distance measurer 100 may compare the average value corresponding to the image information having the same time information and the relative distance information.

The social distance meter may generate an alarm through digital signage in which content is output according to an alert generation condition determined based on the measured distance information between users. The social distance measurer 100 may determine whether distance information between the compared box regions exists within a preset distance criterion based on the overall average value of the box regions recognized in the acquired image information. The social distance measurer 100 may set a warning generation condition when the distance information between the compared box areas is within a preset distance reference (eg, an average value, a specific value, etc.). When the relative distance information between specific users existing in the image information 110 is less than the average value, the social distance measurer 100 may regard it as a social distancing failure, and the relative distance information between specific users existing in the image information 100 If is above the average value, it can be regarded as a success in social distancing. The social distance meter 110 may generate an alarm to maintain a wide distance between users when it is determined that social distancing has failed.

In addition, the social distance measurer may generate a warning regardless of distance measurement when the user is recognized in the image information more than a preset reference (eg, 10 or more). The social distance meter can use digital signage to continuously remind users to maintain social distance by alerting all users who are maintaining or not maintaining social distance.

FIG. 2 is a block diagram illustrating a configuration of a social distance measurer according to an exemplary embodiment, and FIG. 3 is a flowchart illustrating a method of measuring a social distance in a social distance measurer according to an exemplary embodiment.

The social distance meter 100 may include a user recognition unit 210, a distance measurement unit 220, and an alarm generator 230. Components of the social distance finder 100 may be expressions of different functions performed by a processor according to an instruction provided by a program code stored in the social distance finder 100. Components of the social distance finder 100 and the social distance finder 100 may control the social distance finder to perform steps 310 to 330 included in the social distance measurement method of FIG. 3. In this case, the elements of the social distance finder 100 and the social distance finder 100 may be implemented to execute an instruction according to the code of the operating system included in the memory and the code of at least one program.

The processor may load the program code stored in the program file for the social distance measurement method into the memory. For example, when a program is executed in the social distance finder, the processor may control the social distance finder to load the program code from the program file into the memory under control of the operating system. At this time, each of the user recognition unit 210, the distance measurement unit 220 and the alarm generator 230 included in the social distance meter 100 and the social distance meter 100 is a corresponding part of the program code loaded into the memory. It may be different functional expressions of the social distance meter 100 for executing the subsequent steps 310 to 330 by executing the command of.

In step 310, the user recognition unit 210 may recognize a plurality of users using image information acquired using a camera installed in an electronic device to which content is output. The user recognition unit 210 may acquire image information photographed using a 3D depth camera. The user recognition unit 210 may recognize a plurality of users based on image information obtained from location information in which a social distance meter is installed.

In step 320, the distance measurement unit 220 may measure distance information between users for a plurality of recognized users. The distance measuring unit 220 generates each box area including a plurality of users recognized in the acquired image information, and automatically calculates distance information between each box area including a plurality of users recognized in the acquired image information. Can be calculated. The distance measurement unit 220 generates each box area including a plurality of users recognized in the acquired image information, and compares relative distance information between each box area including a plurality of users recognized in the acquired image information. I can. The distance measurement unit 220 may obtain an overall average value obtained by calculating height information for each box area recognized within the acquired image information.

In step 330, the alarm generator 230 may generate an alarm through an electronic device that outputs content according to an alert generation condition determined based on the measured distance information between users. The alarm generator 230 determines whether the distance information between each box area, which is automatically calculated based on the total average value of the box area recognized within the acquired image information, exists within a preset distance standard, and is automatically calculated. When distance information between each box area exists within a preset distance standard, a warning generation condition can be set. The alarm generator 230 determines whether the distance information between the compared boxes exists within a preset distance standard based on the total average value of the box area recognized within the acquired image information, and If the distance information exists within a preset distance criterion, it can be set as a warning generating condition. The alarm generator 230 may stop the advertisement content output from the electronic device, output image information related to users existing within a preset distance criterion, and generate an alarm at the same time. The alarm generator 230 utilizes video information related to users within a preset distance reference as interactive content, and a user existing within a preset distance reference before the next advertisement content is output after the advertisement content is output. It is possible to generate an alarm while outputting video information related to the field. The alarm generator 230 constructs a congestion map by using congestion information of a plurality of users recognized based on the location information where the social distance finder is installed and the image information obtained from the location information where the social distance finder is installed. Maps can also be serviced even through congestion.

5 to 7 will be described an example to which the social distance meter according to an embodiment can be applied. FIG. 5 is an example for explaining generating an alarm through distance information measured between users existing in a purchase waiting line in a social distance meter according to an embodiment. Users can wait in a purchase waiting line to purchase products at an outdoor or indoor store. The digital signage 140 may be installed inside or outside the store. In this case, the digital signage 140 may be displaying advertisement content. While the social distance meter outputs advertisement content through the digital signage 140, the camera 130 installed in the digital signage 140 can shoot users waiting at the store counter in real time. For example, in digital signage, information on sales products (eg, menus) sold in stores may be alternately output along with advertisement contents. The social distance measurer may recognize users through image information obtained by photographing users waiting at a store counter in real time. The social distance finder can create each box area containing the recognized user. The social distance meter may compare distance information of each of the generated box areas. The social distance measurer can generate a warning when the distance information between the box areas is less than the total average value when comparing each distance information, or the distance information between the box areas is the distance information between the box areas based on the total average value. If it is determined that it is within the preset criteria, an alarm (warning) can be generated.

The social distance measurer may stop advertising content output from the digital signage 140 and output image information related to users existing within a preset distance criterion, generate an alarm, and guide to maintain social distance. . The social distance measurer may detect a user with a close social distance, for example, a user who wants to cut-out while outputting advertisement content. The social distance measurer can generate an alarm in the middle of outputting advertisement content (interrupt type).

6 is an example for explaining generating an alarm through distance information measured between users walking on a street in a social distance meter according to an exemplary embodiment. The social distance meter can be used as a camera interactive content to increase the attention between advertisements and advertisements in large outdoor digital signage (display board).

A digital signage 140 for outputting advertisement content may be installed in an outdoor building. The social distance measurer can shoot users moving outdoors in real time using the camera 130 installed in the digital signage 140 while outputting advertisement content through the digital signage 140. The social distance meter can output messages such as "Real-time shooting", "Social distance measuring", and "The video being filmed is not saved" through the digital signage 140. Users waiting in the purchase waiting line can recognize that the waiting line is being photographed.

The social distance finder may recognize users through image information acquired as the social distance finder photographs users walking on the street in real time at a location where digital signage exists. The social distance finder can create each box area containing the recognized user. The social distance meter may compare distance information of each of the generated box areas. The social distance measurer can generate a warning when the distance information between the box areas is less than the total average value when comparing each distance information, or the distance information between the box areas is the distance information between the box areas based on the total average value. If it is determined that it is within the preset criteria, a warning can be generated.

The social distance measurer utilizes video information related to users within a preset distance standard as interactive content, and users existing within a preset distance standard after the advertisement contents are output and before the next advertisement contents are output. At the same time as outputting the video information related to the alarm, it is possible to guide the maintenance of social distance (scheduled).

Referring to FIG. 7, it is an example for explaining providing a congestion degree map through information on a distance measured between users. The social distance finder can construct and service a congestion map using the location information and congestion information on which the social distance finder is installed, like a navigation congestion travel time (CTT). For example, image information may be photographed using a camera installed in a digital signage existing indoors (for example, a shopping mall).

The social distance finder may recognize a plurality of users based on image information obtained from location information in which the social distance finder is installed. The social distance finder may construct a congestion map by using congestion information of a plurality of users recognized based on location information in which the social distance finder is installed and image information obtained from the location information in which the social distance finder is installed. For example, the social distance finder may generate a congestion map by mapping image information obtained from location information where the social distance finder is installed and indoor map information. In this case, the social distance meter may classify the degree of congestion based on a preset reference range. The social distance meter can be classified into low congestion, medium congestion, and high congestion. The social distance finder may generate a congestion map with congestion information displayed. The social distance measurer may service a congestion map built through digital signage or a user's electronic device (eg, a mobile phone). The social distance meter can guide a route to a destination based on the degree of congestion (distribution) provided on the congestion map. At this time, a route through which the route can be moved around a place where people are not crowded may be guided.

The apparatus described above may be implemented as a hardware component, a software component, and/or a combination of a hardware component and a software component. For example, the devices and components described in the embodiments are, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA). , A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions, such as one or more general purpose computers or special purpose computers. The processing device may execute an operating system (OS) and one or more software applications executed on the operating system. In addition, the processing device may access, store, manipulate, process, and generate data in response to the execution of software. For the convenience of understanding, although it is sometimes described that one processing device is used, one of ordinary skill in the art, the processing device is a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of these, configuring the processing unit to behave as desired or processed independently or collectively. You can command the device. Software and/or data may be interpreted by a processing device or to provide instructions or data to a processing device, of any type of machine, component, physical device, virtual equipment, computer storage medium or device. Can be embodyed. The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of the program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

As described above, although the embodiments have been described by the limited embodiments and drawings, various modifications and variations are possible from the above description by those of ordinary skill in the art. For example, the described techniques are performed in a different order from the described method, and/or components such as a system, structure, device, circuit, etc. described are combined or combined in a form different from the described method, or other components Alternatively, even if substituted or substituted by an equivalent, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and claims and equivalents fall within the scope of the claims to be described later.

Claims (7)

A user recognition unit for recognizing a plurality of users using image information acquired using a camera installed in an electronic device outputting content;
A distance measuring unit measuring distance information between users for the recognized plurality of users; And
An alarm generator that generates an alarm through an electronic device to which the content is output according to an alert generation condition determined based on the measured distance information between users
Including,
The electronic device is a digital signage, and while outputting content through the digital signage, the electronic device includes in real time photographing users moving or waiting outdoors or indoors using a camera installed on the digital signage,
The camera installed in the electronic device includes a 3D depth camera or a 2D camera,
The user recognition unit,
Acquiring image information using the 3D depth camera or acquiring image information using the 2D camera,
The distance measuring unit,
Each box area including a plurality of users recognized in the image information acquired using the 3D depth camera is generated, and distance information between each box area including a plurality of users recognized in the acquired image information is Each box that is automatically calculated and includes a plurality of users recognized in image information acquired using the 2D camera, and each box including a plurality of users recognized in the acquired image information Including comparing relative distance information between regions,
The alarm generating unit,
It is determined whether the automatically calculated distance information between each box area exists within a preset distance criterion based on the total average value of the box areas recognized within the acquired image information, and between each automatically calculated box area When distance information exists within the preset distance reference, a warning generation condition is set, and when the compared distance information between each box area exists within the preset distance reference, a warning generation condition is set,
If the distance information between users existing in the acquired image information is less than the overall average value, it is regarded as a social distancing failure, and if the distance information between users existing in the acquired image information is more than the overall average value, it is considered as social distancing success. And, when it is determined that social distancing has failed, an alarm is generated while outputting image information related to users existing within the preset distance criterion, and a user above a preset criterion is recognized in the acquired image information. In case, it raises an alert regardless of distance measurement
Social distance meter. delete delete The method of claim 1,
The distance measuring unit,
Obtaining an overall average value of calculating height information for each box area recognized in the acquired image information
Social distance meter, characterized in that. The method of claim 1,
The electronic device is a digital signage that outputs advertisement content, and while outputting the advertisement content through the digital signage, the electronic device includes real-time photographing of users waiting at a store counter using a camera installed on the digital signage, ,
The alarm generating unit,
Stops advertisement content output from the electronic device, outputs image information related to users existing within the preset distance criterion, and generates an alarm at the same time.
Social distance meter, characterized in that. The method of claim 1,
The electronic device is a digital signage that outputs advertisement content, and outputs the advertisement content through the digital signage, and includes photographing users moving outdoors in real time using a camera installed on the digital signage,
The alarm generating unit,
Image information related to users existing within the preset distance criterion is used as interactive content, and image information related to users existing within a preset distance criterion before the next advertisement content is output after the advertisement content is output Outputting and generating an alarm
Social distance meter, characterized in that. The method of claim 1,
The user recognition unit,
Recognizing a plurality of users based on image information obtained from location information where the social distance meter is installed,
The alarm generating unit,
Construct a congestion map using the congestion information of a plurality of users recognized based on the location information in which the social distance finder is installed and the image information obtained from the location information in which the social distance finder is installed, and the constructed Service congestion map
Social distance meter, characterized in that.

Images