KR20160036416A - Information display position determining method according to the characteristic information of the user and the system - Google Patents

Abstract

The present invention relates to a method and a system for determining an information display position in accordance with user characteristics, allowing the center of information to be displayed in accordance with a user′s eye level reference so that the user is provided with a comfortable screen viewing environment. The system determining an information display position in accordance with user characteristics according to the present invention includes: a display unit for information expression; an image processing unit for processing an image obtained by a camera; a frame information acquisition unit acquiring human body frame information regarding a user from the image; a height analysis unit analyzing a size of the user′s height by using result data of the image processing unit; a screen expression control unit managing and controlling a manner of on-screen information expression in accordance with the size of the user′s height; a media delivery unit sending information to be exposed on the display unit screen; a media storage unit storing a source of the information to be exposed on the screen; and a central processing unit performing the image processing, data processing, data analysis, and functional procedure control.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information display position determining method and system,

The present invention relates to a method and system for determining an information display position according to the characteristics of an information user. More particularly, the present invention relates to a method and system for determining an information display position according to characteristics of an information user, To a method and system for determining an information display position according to characteristics.

The information display method using digital signage usually displays the center of the information to be displayed at the center of the physical screen of the digital signage.

This type of information display gives the user inconvenience due to differences in height. That is, in the case of adults, when comparing the case of a woman with a height of 158 cm and the case of a woman with a height of 190 cm which is somewhat taller, when the center of the information display is adjusted to 190 cm, I feel the inconvenience of having to lift a lot. As another example, for adults and children, children would feel much more uncomfortable if they adjusted the information display center of the adult eye level to eye level. In the case of a disabled person with a wheelchair, the difference from the normal adult is very large.

On the other hand, a conventional technique for displaying information on a digital signage is disclosed in Patent Document 1, Korean Patent Laid-Open Publication No. 10-2014-0059996 (published on April 19, 2014).

The prior art disclosed in Patent Document 1 provides a user-specific advertisement exposure system that selects a terminal device to which a user is notified of a plurality of terminal devices and exposes an advertisement to the selected terminal device.

Another prior art is disclosed in Patent Document 2: Korean Published Patent Application No. 10-2009-0102108 (published on September 30, 2009).

The prior art disclosed in Patent Document 2 relates to screen division on a touch screen screen, and displays different screens according to key input.

Korean Patent Publication No. 10-2014-0059996 (published on May 19, 2014) Korean Patent Publication No. 10-2009-0102108 (disclosed on September 30, 2009)

However, the above-described related art has a disadvantage in that it is impossible to adjust the information display position on the signage according to the characteristics of the information users.

An object of the present invention is to provide a method and apparatus for displaying a center of information to be displayed in accordance with the eye level of a user in order to provide a comfortable screen viewing environment to a user, And a method and system for determining an information display position according to the characteristics of a user.

It is another object of the present invention to provide a method and system for determining an information display position according to the characteristics of an information user that can divide and output information in one terminal device.

It is still another object of the present invention to provide a method and system for determining information display position according to characteristics of an information user, in which the center position of information display is automatically changed according to the size of a kidney.

According to an aspect of the present invention, there is provided a system for determining an information display position according to characteristics of an information user, comprising: a display unit for displaying information; An image processing unit for processing an image acquired from a camera; A skeleton information acquisition unit for acquiring the human skeleton information of the user from the image; An extension analyzer for analyzing a size of a user's extension using result data of the image processor; A screen display control unit for managing and controlling the information display mode on the screen according to the size of the user's height; A media transmission unit for transmitting information to be exposed on a screen; A media storage unit for storing a source of information to be displayed on a screen; A central processing unit for performing data processing, data analysis, and functional procedure control; A system control unit for controlling the entire system of the digital signage; And a memory for storing image data, calculation data, and analysis program codes.

In this case, the screen display control unit expresses the human body as joint information, determines the height position of the user using the size information of the user's height and the face area joint information calculated based on the joint information, And the center position of the information to be displayed on the screen is designated as the eye-level position of the user so as to control the information to be displayed.

(X, y, z) using the distance (depth information) (z) from the camera to the plane coordinates (x, y) of the joint in the camera image and, by the size of the height calculated for the y coordinate and the hip joint of the distance difference (d ₁₎ and the distance difference of the y coordinate and the ankle joint y coordinate of the hip joint in the y-axis coordinates (d ₂₎ of a face joint respectively And the elongation is calculated by summing the two distance differences d ₁ and d ₂ .

The screen display control unit calculates the difference between the y-axis coordinate value y _k of the knee joint and the y-axis coordinate value y _h of the hip joint in order to judge whether the user is sitting or not, And if it is smaller than the threshold value range in which the relationship is not formed, it is judged as a sitting posture.

According to another aspect of the present invention, there is provided a method of determining an information display position according to a characteristic of an information user, the method comprising the steps of: (a) Detecting a human body region in an image; (b) acquiring skeleton information of a human body in a human body region; (c)

Acquiring joint information of a human body; (d) acquiring face region information of a human body; (e) calculating the size of the kidney; (f) determining an information display center position according to the calculated elongation size.

According to the present invention, in providing information in the same signage, information is provided according to the eye level of the user such as an adult, a child, or a disabled person using a wheelchair, And the use of signage is improved.

In addition, according to the present invention, when applied to a digital outdoor advertisement using digital signage, it is possible to increase the attention of the user in accordance with the eye level, thereby improving the advertisement effect.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a configuration diagram of an information display position determination system according to a characteristic of an information user according to a preferred embodiment of the present invention;
2 is a flowchart illustrating a method of determining an information display position according to a characteristic of an information user according to a preferred embodiment of the present invention.
FIG. 3 is a diagram illustrating the eye-gaze visual line relationship according to the size of the kidney,
Fig. 4 is an exemplary view of information display position setting according to the size of the elongation,
5A to 5D are illustrations of joint information,
FIG. 6 is an illustration of the face joint information of the standing posture and sitting posture. FIG.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a method and system for determining an information display position according to a characteristic of an information user according to a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a configuration diagram of an information display position determination system according to a characteristic of an information user according to a preferred embodiment of the present invention.

An information display position determination system according to a characteristic of an information user according to a preferred embodiment of the present invention includes a display unit 101, a display interface unit 111, an image processing unit 102, a skeleton information obtaining unit 103, A display control unit 105, a media transmission unit 106, a media storage unit 107, a central processing unit 108, a system control unit 109, a memory 110, a camera 112, (113).

The display unit 101 serves to display information. The display unit 101 may be a digital signage or an information display unit of a digital signage.

The image processing unit 102 processes an image acquired from the camera 112 and the skeleton information acquisition unit 103 acquires the human skeleton information of the user from the acquired image.

The stretch analyzing unit 104 analyzes the size of the user's stretch using the result data of the image processing unit 102. The screen display control unit 105 controls the stretch analyzing unit 104 based on the size of the user's stretch, It manages and controls the information presentation method.

In addition, the media transmission unit 106 transmits information to be displayed on the screen, and the media storage unit 107 stores a source of information to be displayed on the screen.

In addition, the central processing unit 108 performs data processing, data analysis, and functional procedure control. The system control unit 109 controls the entire system of the digital signage. The memory 110 stores image data , Operation data, and analysis program code.

2 is a flowchart illustrating a method of determining an information display position according to characteristics of an information user according to the present invention, comprising the steps of: (a) detecting a human body region in an image acquired through a camera (S10 to S30); (b) acquiring skeleton information of a human body in the human body region (S40); (c) acquiring joint information of the human body (S50); (d) acquiring face region information of the human body (S60); (e) calculating the size of the kidney (S70); (f) determining an information display center position according to the calculated elongation size (S80).

The operation of the information display position determination method and the system according to the characteristics of the information user according to the preferred embodiment of the present invention will be described in detail as follows.

First, the display unit 101 is an image display device attached to a digital signage for digital outdoor advertisement. Thereby displaying an image to be displayed to the user.

The image processing unit 102 processes the image acquired from the camera 112 installed in the digital signage (S10, S20). For example, image processing such as noise cancellation (pre-processing) and human body region detection processing are processed.

Here, human body area detection is a process of detecting only the human body area of the user in the image photographed by the camera 112 attached to the digital signage (FIG. 5A), and detects the human body area of each user in order to grasp individual characteristics for each user (S30).

When the detection of the human body region is completed, the skeleton information obtaining unit 103 obtains joint information for connecting the skeleton information of the human body with the skeleton from the human body region image (S40, S50) The process of extracting the face region using the joint information is performed step by step (S60). These joint information can be generated using image processing techniques, and spatial coordinates of each joint can be obtained by using a camera such as Kinect. The spatial coordinates of the joint can be expressed as (x, y, z), where (x, y) represents the plane coordinates of each joint in the image and z represents the distance from the camera (depth information).

5D, since the face region information can be estimated using the joint information of the face region, the y-axis coordinate of the face joint information can be regarded as the position of the eye in the human body, and the user's height Size. However, if the user is sitting on a wheelchair, the y-axis coordinate of the facial joint information can not be estimated as the size of the user's elongation (see FIG. 6).

Y-axis coordinate of the joint face information is determined by comparing the y-axis coordinate value y _h of the knee joint y-axis coordinate value y _k and the hip joint in order to determine if similar to the size of the kidney. The y-axis distance d = y _k -y _h between the two joints maintains a constant ratio compared to the size of the kidney, so the difference in the value of d is very small when sitting. For example, the value of the y-axis distance d between the two joints is compared with the size of the elongation, and if the difference is smaller than a threshold range in which a proportional relation is not formed, it is judged as a sitting posture.

Next, the elongation analysis unit 104 analyzes the size of the user's elongation using the image processing result data of the image processing unit 102, and calculates elongation using the joint information of the human body (user) (S70) . The size of the user's height h = | y-axis coordinates of the facial joints - y-axis coordinates of the hip joints | + | Y axis coordinate of the hip joint - y axis coordinate of the ankle joint |

Using the thus calculated kidney size and facial joint information, an eye-level display position corresponding to the size of the user's height is determined on the physical screen of the digital signage and the center position of the information to be displayed is designated (S80). As shown in FIG. 3, the center position of the digital signage changes depending on the size of the human body. Therefore, as shown in Fig. 4, the eye level position is determined according to the size of the user's stretch, and the display position is displayed on the screen as the center position of the information to be displayed. As a result, the user always adjusts the center of the screen to the eye height regardless of the size of the kidney.

For example, the screen display control unit 105 sets the relative center position of the signage screen in accordance with the size of the user's height, and manages and regulates the method of reconstructing the information to be displayed based on the set relative center position. In other words, the screen display control unit 105 expresses the human body as joint information, determines the height position of the user using the size information of the user's height and the face area joint information calculated based on the joint information, The center position of the information to be displayed on the physical screen of the device is designated as the eye-level position of the user so as to control the information to be displayed.

In addition, the media transmission unit 106 transmits information (news, advertisement, publicity, etc.) to be exposed on the digital signage screen based on the relative center position determined by the screen display control unit 105.

The media storage unit 107 stores a source of information (moving pictures, photographs, news, publicity materials, etc.) to be exposed on the digital signage screen.

Meanwhile, the central processing unit 108 performs data processing, data analysis, and functional procedure control, and programs necessary for the data processing are initially stored in the memory 110, and are transferred to the central processing unit 108 and executed.

The system control unit 109 controls the entire system of the digital signage according to the processing procedure and the functional procedure control of the central processing unit 108.

Here, the memory 110 temporarily stores the image data acquired from the camera 112, stores the processed result data after the image data is processed by the analysis program, or stores the analysis program code and the like do.

The display interface unit 111 supports interlocking with the display unit 101 and performs functions of collecting data from the display unit 101 and controlling transmission of data to the display unit 101. [

Finally, the camera interface unit 113 supports interlocking with the camera 112 attached to the digital signage apparatus, and acquires an image from the camera 112 or controls the functions of the camera 112 (power function, zoom function, Tilt function). In particular, a plurality of cameras can be interlocked at the same time, and at the same time, different types of interlocking cameras can be interlocked even if their characteristics are different. For example, different types of cameras such as a monochrome camera, a color camera, and a depth camera can be linked together at the same time. The camera interface unit 113 supports interlocking with the system control unit 109 using a wired system and a wireless system (Wi-Fi, Bluetooth, beacon, etc.).

Although the present invention has been described in detail with reference to the above embodiments, it is needless to say that the present invention is not limited to the above-described embodiments, and various modifications may be made without departing from the spirit of the present invention.

The present invention is applied to a technique for displaying information in accordance with an eye-level reference using a digital signage.

101:
102:
103: Skeleton information acquisition unit
104:
105: Screen display control unit
106: Media transmission unit
107: Media storage unit
108:
109:
110: Memory
112: camera

Claims (5)

A display unit for displaying information;
An image processing unit for processing an image acquired from a camera;
A skeleton information acquisition unit for acquiring the human skeleton information of the user from the image;
An extension analyzer for analyzing a size of a user's extension using result data of the image processor;
A screen display control unit for managing and controlling the information display mode on the screen according to the size of the user's height;
A media transmission unit for transmitting information to be exposed on the display unit screen;
A media storage unit for storing a source of information to be exposed on the screen;
And a central processing unit for performing the image processing, the data processing, the data analysis, and the functional procedure control based on the characteristics of the information user.
The method according to claim 1, wherein the screen display control unit expresses the human body as joint information, determines the height position of the user using the size information of the user and the face area joint information calculated based on the joint information, Wherein the control unit controls the display of the information by designating the center position of information to be displayed on the physical screen of the device as the eye-level position of the user.
(X, y) of the joint in the camera image and the distance (depth information) (z) from the camera to the joint in the camera image, distance difference z) representation, and in the size of the kidneys face joint y coordinates and hip joints y distance difference (d ₁₎ and the hip joint of the axial coordinate of a y-axis coordinate and the ankle joint y coordinate (d ₂₎ the two distance difference between d ₁ and d ₂ characterized in that the sum information display position determining system according to the characteristics of the user as to calculate the height of the calculated respectively.
The screen display control unit according to claim 1, wherein the screen display control unit calculates a difference between a y-axis coordinate value y _k of the knee joint and a y-axis coordinate value y _h of the hip joint to determine whether the user is seated, When the size of the information display position is smaller than a threshold value range in which a predetermined proportional relationship with the size is not formed, a sitting position is determined.
A method for determining an information display position on a display screen according to characteristics of a user using digital signage,
(a) detecting a human body region in an image acquired through a camera;
(b) acquiring skeleton information of a human body in a human body region;
(c) obtaining joint information of the human body in the human body region;
(d) obtaining face region information of the human body in the human body region;
(e) calculating the size of the kidney; And
(f) determining an information display center position in accordance with the calculated elongation size.

Images