KR101796578B1 - Device for displaying realistic experience - Google Patents

Abstract

The present invention relates to a sensation experience apparatus, comprising: a display; A collecting unit for collecting information received from the display; A classifying unit for classifying the collected information according to characteristics or environment of information; A judging unit for judging the form and timing of the classified information; And a determination unit for determining the display range and the display mode based on the display style and the timing.

Description

Device for displaying realistic experience "

The present invention relates to a sensation experience information display apparatus which can be easily understood and recognized by a user based on a mirror type display characteristic.

In recent years, digital signage machines, which provide various contents and messages through digital displays instead of conventional hardware media such as posters, guide signs, and signboards displayed on roads, shops, or public facilities, Advertising media are being developed in a direction that enables two - way communication instead of the conventional unidirectional advertising medium.

In the past, most digital signage-based contents were merely showing information, but as IT technology developed, they developed intelligent information supporting the situation of the user, that is, interactive service, and through interactive service They engage directly with users, create new experiences through participation, accumulate quantified data on user responses, and incorporate them into other technologies.

The information providing devices using the digital display are used in various places, and they are installed so that they can be exposed to places where people, such as a station, a subway, a restaurant entrance or an airport, gather and pass a lot.

In recent years, however, viewers are increasingly watching actual advertisements that naturally come into contact with digital displays in a place where they spend their time staying outside the customers who are exposed to advertisements.

For example, a recent beauty salon has a small display at the customer's site to provide information about the designer's history, recent hair style trends, event promotions and customer's procedures, and advertisements for new product launches.

However, in the future, it will not be necessary to install such a small display separately, and in the case of a beauty salon or a fitness club, a mirror for observing the user's own image will be provided with a display function, not a simple mirror.

Techniques are already being developed to provide information to mirrored displays, such as virtual clothing fitting tests, by combining multiple brands with Kinect technology, including BOE mirror displays, Vital Signs collaborated with Harvard and MIT, and New York Times R & D There are several prototypes, including the Magic mirror of the lab.

Unlike a conventional display providing various information such as contents and advertisements, the mirror-type display has a form in which a user's appearance is visible and other information is arranged around the user's appearance.

Mirror displays are primarily intended for primary viewing, and secondly, to provide enhanced information about the user, information that is useful to the user, information that is needed, or information that is likely to be of interest.

Therefore, in order to better meet the secondary purpose within a range that does not infringe on the primary purpose of the mirror-type display, information presentation which improves the user's perception, visibility and attention according to the characteristics and the information of the mirror- A device is needed.

Therefore, embodiments of the present invention can display information in a range that does not disturb the user by naturally matching the appearance of the user in the mirror-type display, and it is easy for the user to recognize the displayed information, further, The purpose of this paper is to induce the expansion of

To this end, the sensory experience information display apparatus according to one aspect of the present invention includes: a display; A collecting unit for collecting information received from the display; A classifying unit for classifying the collected information according to characteristics or environment of information; A judging unit for judging the form and timing of the classified information; And a determination unit for determining the display range and the display mode based on the display style and the timing.

According to the present invention, it is possible to easily and comfortably provide information provided by a user under various conditions in which the user can receive the sensation experience information based on various information provided by the mirror type display, the place where the mirror type display is installed, There is an appreciable advantage.

FIG. 1 is a view showing a sensation experience information displaying apparatus according to an embodiment of the present invention.
2 is a view showing a classifying unit according to an embodiment of the present invention.
3 is a diagram showing an example of the operation of the classifying unit according to an embodiment of the present invention.
4 is a diagram illustrating a determination unit according to an embodiment of the present invention.
5A and 5B are views showing an example of the operation of the determination unit according to an embodiment of the present invention.

While the present invention has been described in connection with certain exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and similarities. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

In addition, the singular phrases used in the present specification and claims should be interpreted generally to mean " one or more " unless otherwise stated.

The present invention differs from the existing invention in which the display method and apparatus considering the characteristics of mirrors (reflectivity, left-right symmetrical expression, etc.) are taken into account, and based on the results of studies on ergonomic and cognitive engineering, The present invention relates to a mirror-type display-based real-life experience information display device for classifying information that can be provided by type, determining the type and size of information according to the type, and determining frequency and timing of providing.

Hereinafter, the present invention will be described in detail with reference to the drawings.

1 is a view showing a sensation experience apparatus according to an embodiment of the present invention.

Referring to FIG. 1, a sensory experience information display apparatus 100 includes a collecting unit 110, a classifying unit 120, a determining unit 130, a determining unit 140, and a display 150.

The collection unit 110 collects advertisement information and user information appearing on the display 150. The advertisement information refers to general information displayed on the display and all information for inducing interest, and the user information refers to information of a person using the display. The user information may be collected through a vision sensor such as Kinect and Webcam mounted on the display 150 and installed information input software. Specifically, when the user's information is input based on the vision sensor mounted on the display, the user information can be collected using the existing user estimation algorithm such as the face estimation algorithm and the key prediction algorithm and the user classification DB.

At this time, the user can directly input the user information to the display 150. [

The classifying unit 120 classifies the information collected from the collecting unit 110 according to the general characteristics of the information, and classifies the information in consideration of design and environmental aspects. Hereinafter, it will be described in detail in FIG.

The determination unit 130 may receive the classified information from the classification unit 120 and determine the presentation type and timing according to the information depth, distance to the mirror, or information importance. This will be described in detail with reference to FIG.

The determination unit 140 determines the display range and the display format based on the type and timing provided by the determination unit 130. The determining unit 140 can determine information by dividing the form and timing of the information determined in consideration of the type of information and the characteristics of the mirror display from the classifying unit 120 and the determining unit 130 according to the surrounding environment of the display have.

For example, the color of the provided information is determined according to the brightness of the light, and the display range and the amount of information to be provided are determined according to the use purpose (whether one-on-one or one-to-many) of the display. Since the usage purpose is one-to-one, the decision unit 140 can be displayed as it is according to the form and timing determined by the judgment unit 130.

The display 150 can output mirror-based display-based feeling experience information. Information determined in accordance with the type, timing, and presentation method of information determined according to the mirror type display characteristic, information type, etc. from the determination unit 140 is graphically processed and output to the user. The display 150 of the present invention is mainly used in a mirror-type display but can be applied to a display surface that can reflect the user's appearance.

2 is a view showing a classifying unit according to an embodiment of the present invention.

Referring to FIG. 2, the classification unit 200 includes an information property-based information classification module 210 and an environment-based information classification module 220.

The information property-based information classification module 210 may classify the information collected through the collection unit into three pieces of information, that is, the user characteristic information 211, the user-customized information 212, and the general information 213. This is to provide the user with customized information to increase the visibility.

The information classified into the user characteristic information 211 may be information such as the age, sex, or body size of the user. Such user characteristic information 211 can be collected by inducing the display to input information directly to the user through the user input software installed in the display.

The information classified into the user-customized information 212 may be information such as a style or an area of interest. The user-customized information 212 is information processed by processing the collected primary user characteristic information 211 and adapted to the user.

The user customized information 212 may be collected by inputting user information directly through the user input software installed on the display, or may be collected through an estimation using an intelligent algorithm and sensors mounted on the display.

For example, in the case of a user using a mirror-type display mounted on a gym, if there is information on the age, sex, and body size of the collected user characteristic information 211, Style of sportswear.

As another example, in the case of a user using a mirror-type display installed in a clothes shop, if there is age, gender, and body size information, which are user characteristic information 211 collected first, the latest fashion style information This is the recommendation coordination information that may be suitable for me.

The information classified as the general information 213 includes specific advertisements or interest inducing information. In other words, this is information that attracts the attention of general users who use mirror displays, or provides them for commercial purposes.

For example, in the case of a gym, general information 213 is information on sports drink advertisements during sports, sports clothing advertisements, or video advertisements that do not get bored while exercising.

As another example, in the case of a clothes store, a photograph of a celebrity wearing the brand, information on introducing a new product of the brand, and the like may be general information 213.

The environment-based information classification module 220 receives the LTA type information 221, the LTM type information 222, the STA type information 223, and the STM type information 224 ), And the like. This is because if the information is classified according to the frequency of exposure and awareness, the user can quickly recognize / understand the information provided.

First, ST (short term) type information is information with low exposure frequency, LT (long term) type information is high frequency information, M (Manipulative) type information is high information, attractive type information is information that emphasizes cultural and social characteristics, although it is relatively low in cognition.

Therefore, while type-M information should provide information to enhance functional readability, type-A information should express information that implies cultural specificity that emphasizes aesthetic features.

Among the pieces of information classified based on the information property described above, the general information 213 corresponds to the STM type information 224. [

For example, in a mirror-type display installed in a gym, information on sports drink advertisements, sports clothing advertisements, or video advertisements that do not bore while exercising, This is information that is temporarily provided, so it is highly readable and highly recognizable information that has a low frequency of exposure and needs to be advertised in a short time.

As another example, the case of the user-customized information 212 corresponds to the LTA type information 221 or the LTM type information 222. [

For example, when providing mirrored displays in a gym, provide exercise information that is tailored to your age, gender, and body size, you must continue to provide information in a multistep or multi-expression manner until you can recognize it. do. In addition, if it is the information that should emphasize the aesthetic sense of the presentation method according to the provided information, it corresponds to the LTA type information 221, and if the provided information is the information that the user directly has to face, it is classified into the LTM type information 222.

For example, the exercise information corresponding to the age, sex, and body size corresponds to the LTM type information 222, and information on the appearance of the user based on the body size, (221).

Accordingly, the information collected through the collecting unit is classified into three kinds of information by the information property-based information classification module 210, and classified by the environment-based information classification module 220 into one of the four pieces of information do.

3 is a diagram showing an example of the operation of the classifying unit according to an embodiment of the present invention.

Referring to Figure 3, a mirrored display includes a vision sensor capable of capturing or estimating motion of the entire body of a user. The mirror-type display can extract the facial characteristics of the user, and can collect / estimate the age and body size of the user through avatar generation. Based on this, the user characteristic information can be collected and classified, and as a result of mapping with the classified DB, the result that the user characteristic information is classified into the LTM type information can be known.

4 is a diagram illustrating a determination unit according to an embodiment of the present invention.

Referring to FIG. 4, the determination unit 400 includes an information depth determination module 410, a distance based determination module 420 and a information importance based determination module 430.

Since STM type information has cognitive engineering properties such as timeliness, errorlessness, and conciseness, it should be expressed in the form of a simple figure that can be immediately recognized by the user. It should be displayed as close as possible to the viewing angle, and should be displayed in a direction that does not discriminate the user's view due to the characteristics of the mirror display.

In addition, the shape, size, and display location are in accordance with a defined standard display format such as resolution, size, and user's cognitive ability (analogy with user information such as age) of the mirror type display.

LTM type information is a type of information that should be able to be manipulated and expressed at an influential level beyond the cognitive level, and has a visualization attribute called completeness and image interpretability. Therefore, And it should be expressed by the depth of the step and various expression methods according to the user's perception.

That is, the information depth-based determination module 410 determines the form and timing of information provision differently according to the type of information and the visualization attribute.

For example, in a mirror-type display installed in a gymnasium, when it is intended to provide information on the exercise method suitable for the user based on the user's age, sex and body size information, since the LTM type information is used, (Eg, upper body, forearm, abdomen, etc.) or exercise type (eg diet, body correction, etc.). Next, the information depth-based determination module 410 orders the classified information step by step and judges the timing and type of providing information according to the feedback of the user.

More specifically, if 'abdominal dieting exercise' is selected according to the user information, the information depth based decision module 410 determines that information should be provided in order of the exercise sequence from the stretching exercise, Provide additional information (for example, more detailed information) to make it easier to recognize, or to provide the same information continuously (for example, repeatedly) (Eg, blinking, highlighting, voice complexity, etc.).

The distance based decision module 420 determines the type and timing of information provision according to the distance between the user and the mirror. Judgment based on the distance determines the shape and timing based on the results of ergonomic research considering the characteristics of the mirror type display.

Since the size of the image reflected on the mirror and the range of the image that the user can see vary depending on the distance between the mirror and the user, in the case of a normal mirror, depending on whether the user focuses on his / In the case of a mirror-type digital display in which information and a user's view are displayed together, the distance between the user and the display may vary according to the position, size, and necessity of the user's preferred information.

The distance-based decision module 420 with the mirror manipulates the information window in a range that does not discriminate the user behavior pattern and the user's appearance when the distance between the mirror type digital display and the user is divided into near and far distances, Based on the study results of the desired user psychological pattern, the size of information and the direction of providing information are determined. The size of the information basically increases as the distance between the user and the mirror increases, and decreases as the distance between the user and the mirror increases.

The distance-based decision module 420 with the mirror determines that the user and the information are approaching each other in the opposite direction according to the lateral movement of the user, and when the user moves again after meeting at the center, .

Further, the distance-based determination module 420 determines the amount and subdivision of the provided information according to a change in the distance between the user and the display.

For example, the distance-based decision module 420 with the mirror identifies the distance between the user and the display and when the user approaches the mirror, the user recognizes who the user is and adds interest information (e.g., hobbies, related images, etc.) And when it comes closer, it decides to show more information related to the existing information by considering it as interested in information.

The information importance based determination module 430 determines the information providing time differently according to the importance of the provided information.

For example, a mirror-type display installed in a fitness center according to the present invention can provide information on a user-information-based customized exercise method. In this case, when the user wants to see the effect according to the information according to the provided information, the information corresponding to the general information among the information provided in the display is low in importance, and information for inducing the user to exercise, The information about it is very important. Therefore, the information importance-based determination module 430 may determine the importance of the information based on the importance, and provide the information with high importance more frequently and preferentially.

In another example, a mirror-type display installed in a public place such as a subway or a large mart can provide general information in addition to the function of the actual mirror to an unspecified number of users passing by. Therefore, if issue news, subway line information, and advertisement are provided recently, information such as train arrival time or next stop provided according to the actual subway movement should be provided first because it is the most important and is temporal information tendency , And the time to provide it. On the other hand, information on subway lines, recent issue news, and advertisements are low in importance, so they are provided only after information is provided or when priority information is not generated.

The information importance based determination module 430 determines the provision information and the timing according to the importance.

5A and 5B are views showing an example of the operation of the determination unit according to an embodiment of the present invention.

Referring to FIG. 5A, a user's position and silhouette information are measured and extracted based on an intelligent vision sensor mounted on a mirror-type display, and the user can see the area on the mirror-type display.

Referring to FIG. 5B, the provided information is determined in depth according to the classification, and is expressed as a different shape and position according to the characteristic from information 1 to information 5, respectively.

At this time, as the user moves from A to B in FIG. 5A, the amount of information, the form of expression, the position and size of expression, and the like provided to the display, as well as the user's appearance, are changed in the mirror type display as shown in FIG. 5B. More specifically, in FIG. 5A, when the user's distance is long (position A), the amount of information provided is greater than B. When the user's distance is near (B position), information with low importance can be eliminated or expressed in a simplified manner according to the importance and depth of information.

FIG. 5B shows that information 2, which is low importance information, can be omitted, and information 5 can be simplified. In addition, the information (e.g., information 1) determined to be important can be expressed by modifying the frequency or size.

However, considering the mirror type display characteristics, the same information can be provided at a similar position as possible, thereby minimizing the user's gaze movement.

The apparatus and method according to embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer readable medium may include program instructions, data files, data structures, and the like, alone or in combination.

Program instructions to be recorded on a computer-readable medium may be those specially designed and constructed for the present invention or may be available to those skilled in the computer software arts. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Includes hardware devices specifically configured to store and execute program instructions such as magneto-optical media and ROM, RAM, flash memory, and the like. The above-mentioned medium may also be a transmission medium such as a light or metal wire, wave guide, etc., including a carrier wave for transmitting a signal designating a program command, a data structure and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like.

The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

The embodiments of the present invention have been described above. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

Claims (4)

A collection unit for collecting information;
A classifier for classifying the collected information on the basis of characteristics or environments;
A judging unit for judging the form and timing of the classified information;
A determining unit for determining the display range and the display mode based on the display mode and the timing; And
A display for displaying the feeling experience information according to the display range and the display form;
Lt; / RTI >
Wherein,
An information depth based determination module for determining at least one of the presentation type and the time of the information according to the type of the information and the visualization attribute;
A distance based decision module with a mirror for determining at least one of the expression type of the information, the information providing direction and the amount of the information to be represented according to the distance between the user and the display; And
An information importance based determination module that determines at least one of a providing frequency, a providing order, and the time of the information according to the importance of the information;
/ RTI >
Wherein,
An information property based information classification module for classifying the collected information into user characteristic information, user customized information, or general information; And
An environment-based information classification module for classifying the collected information into LTA type information, LTM type information, STA type information, or STM type information;
And displaying the sensed-experience-experience information.
delete The method according to claim 1,
Wherein the display collects the information by capturing a face of the user through a vision sensor or by estimating motion to extract facial features, and estimating an age and a body size of the user.
delete

Images