KR102367853B1 - A method of building custom studio - Google Patents

Abstract

The present invention may provide a method for building a custom studio for various purposes. A displaying method of a display performed by a server according to an embodiment may comprise the steps of: acquiring a spatial image including a user and at least one display through a camera; acquiring location information of the user and behavior information of the user based on the spatial image; and adjusting the brightness of the at least one display from a reference intensity to a first intensity based on the location information and the behavior information. The step of adjusting the brightness of the display based on the location information and the behavior information to the first intensity may include a step of setting the brightness of the display spaced apart by a predetermined distance or more from the user to the first intensity based on the location information.

Description

{A method of building custom studio}

The present invention relates to a method of building a custom studio.

With the recent opening of the era of internationalization, various conferences are being held, and a customized space is required to perform various tasks according to the purpose and use. In particular, in arranging a display, a space that can be used for various purposes rather than a uniform arrangement is required. In particular, research on this is urgently needed in the modern society, where meetings are conducted in various ways, such as presentations, academic research, or meetings between company executives in the modern society where meetings are held in various fields.

In particular, in disposing the display, when a lecture is conducted, it may be necessary to adjust the display according to the intention of the lecturer. This can reduce unnecessary power, and can clearly inform the user's intentions, so there is a need for research on this.
Reference Patent Documents: Laid-Open Patent Publication No. 10-2006-0015706 (February 20, 2006), Patent Publication No. 10-2021-0053096 (May 11, 2021) and Japanese Patent Application Laid-Open No. 2016-192151 (November 10, 2016)

The present invention may provide a method for building a custom studio for various purposes.

In a display display method performed by a server according to an embodiment, the method comprising: acquiring a spatial image including a user and at least one display through a camera; acquiring the location information of the user and the behavior information of the user based on the spatial image; and adjusting the brightness of at least one display from a reference intensity to a first intensity based on the location information and the behavior information, wherein the brightness of at least one display is adjusted based on the location information and the behavior information The adjusting to the first intensity may include adjusting the brightness of the display separated by a predetermined distance or more from the user to the first intensity based on the location information.

The adjusting of the brightness of the at least one display based on the location information and the behavior information may include: deriving the user's hand gesture information based on the behavior information; and adjusting the brightness of a portion of a predetermined area of the display including the pointer pointed by the user to a second intensity based on the hand gesture information.

In the display display method according to an embodiment, deriving the user's hand gesture information based on the behavior information includes: obtaining the user's hand shape information; and deriving the pointer pointed to by the user when the user's hand shape is maintained in a predetermined pattern shape for more than a predetermined time based on the hand shape information.

A method of displaying a display according to an embodiment, the method comprising: obtaining voice information of the user; The method may further include adjusting the display brightness of the screen corresponding to the corresponding voice to a third intensity based on the voice information.

In the display display method according to an embodiment, adjusting the display brightness of a screen corresponding to the corresponding voice based on the voice information includes: deriving word information included in the voice information; adjusting the display brightness of the screen corresponding to the word to the third intensity based on the word information.

The present invention can provide a feeling of satisfaction to the user by creating a multi-purpose studio space.

The present invention can improve the user's satisfaction by providing a customized studio space.

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are included as part of the detailed description to aid understanding of the various embodiments, provide various embodiments and, together with the detailed description, explain technical features of the various embodiments.
1 is a diagram illustrating an operation of a processor according to an embodiment.
2 is a diagram illustrating an operation of acquiring a spatial image of a studio according to an embodiment.
3 is a diagram illustrating an operation of adjusting brightness of at least one display according to an embodiment.
4 is a diagram illustrating an operation of adjusting the brightness of a display based on hand gesture information according to an embodiment.
5 is a diagram illustrating an operation of adjusting the brightness of a display based on voice information according to an embodiment.
6 is a diagram illustrating an operation of adjusting the brightness of a display based on distance information between a user and the display according to an exemplary embodiment.

Since the present invention can have various changes and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and it should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention. In describing each figure, like reference numerals have been used for like elements.

Terms such as first, second, A, and B may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component. The term “and/or” includes any combination of a plurality of related listed items or any of a plurality of related listed items.

When an element is referred to as being “connected” or “connected” to another element, it is understood that it may be directly connected or connected to the other element, but other elements may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the accompanying drawings. In explaining the present invention, in order to facilitate the overall understanding, the same reference numerals are used for the same components in the drawings, and duplicate descriptions of the same components are omitted.

1 is a diagram illustrating an operation of a processor belonging to a server 1 according to an embodiment. Referring specifically to FIG. 1 , the at least one processor 110 may be a central processing unit (CPU), a graphics processing unit (GPU), or a dedicated unit in which methods according to embodiments of the present invention are performed. may mean a processor of Each of the memory 120 and the storage device 160 may be configured of at least one of a volatile storage medium and a non-volatile storage medium. For example, the memory 120 may be one of a read only memory (ROM) and a random access memory (RAM), and the storage device 160 is a flash-memory. , a hard disk drive (HDD), a solid state drive (SSD), or various memory cards (eg, micro SD card).

In addition, the server 1 may be included in the server, and may include a transceiver 130 for performing communication through a wireless network. In addition, the server 1 may further include an input interface device 140 , an output interface device 150 , a storage device 160 , and the like. Each of the components included in the server 1 may be connected by a bus 170 to communicate with each other.

2 is a diagram illustrating an operation of acquiring a spatial image of a studio according to an embodiment.

3 is a diagram illustrating an operation of adjusting the brightness of at least one display according to an exemplary embodiment.

2 and 3 , the server may acquire a spatial image including a user and at least one display through a camera. In this case, the spatial image may mean an image including at least one display and a user, and this may mean an image inside the studio if the place is a studio. The server may acquire the location information of the user and the behavior information of the user based on the spatial image. The user's behavior information may include user's hand gesture information and hand shape information, as will be described later. In addition, the server may adjust the brightness of at least one display based on the location information and the behavior information. In addition, the server may adjust the brightness of the display separated from the user by a predetermined distance or more from the reference intensity to the first intensity based on the location information. In this case, the first intensity may mean an intensity that is less bright than the reference intensity.

In an embodiment, when there are a plurality of displays and the plurality of displays are turned on, the user may proceed with a conversation related to the display. In this case, a display that is farther away from the user by a certain distance or more may have low importance. Therefore, after obtaining the location information of the user through the camera, obtaining the location information of the display, obtaining the distance corresponding to each of the user and the displays, a signal to weakly adjust the brightness of the screen of the display separated by a predetermined distance or more can be printed out.

The server may acquire (301) the spatial image, acquire (302) the user's location information and the user's behavior information, and adjust (303) the display brightness from the reference intensity to the first intensity.

4 is a diagram illustrating an operation of adjusting the brightness of a display based on hand gesture information according to an embodiment. 4 , it is possible to derive the user's hand gesture information based on the behavior information. The hand gesture information may mean acquiring an image of a user's hand shape. The server may adjust the brightness of a portion of a predetermined area of the display including the pointer pointed by the user from the reference intensity to the second intensity based on the hand gesture information. The pointer may mean a point through which a line connecting from the starting point of the fingertip passes through the display in the pointing direction based on the user's hand shape information. It may mean that the direction in which there is is connected. In this case, the predetermined area may mean the entire area of the display including the pointer, or may mean a predetermined area inside the display.

In one embodiment, the server recognizes as a specific hand shape if the user's hand shape is in a state where only one or two fingers are open based on the hand shape image acquired through the camera and the direction of the open finger is toward the display The brightness of the display including the specific area of the display facing the direction can be adjusted to be bright.

In one embodiment, if the user is holding a specific object, after recognizing the end of the specific object, if the direction of the end is facing the display, it is recognized as a specific hand shape and a specific area of the display in which the direction of the corresponding finger is facing is recognized. You can adjust the brightness of the current display.

The server may also obtain the user's hand shape information, and based on the hand shape information, if the user's hand shape is maintained in a predetermined pattern shape for a predetermined time or longer, a pointer pointed to by the user may be derived. .

According to an embodiment, if the pointer is derived based on the hand shape information, a predetermined area including the pointer may be brightened by an area of a predetermined size at first, and if the time the pointer moves within the predetermined movement range increases, , you can set the pointer to become wider in proportion to time. In this case, the area in which the pointer is widened may also have a limit area determined.

5 is a diagram illustrating an operation of adjusting the brightness of a display based on voice information according to an embodiment.

Referring specifically to FIG. 5 , the server may acquire voice information, and may adjust the display brightness of a screen corresponding to the voice based on the voice information. The voice information may mean information about a voice spoken by the user, and the screen corresponding to the voice may mean a screen related to the user's voice by recognizing the user's voice.

In this case, the server may derive word information included in the voice information, and may adjust the display brightness of the screen corresponding to the word based on the word information.

As an embodiment, when the user mentions a specific word, the user may recognize it and set the brightness of the specific display screen to be adjusted when the specific word appears. In this case, to adjust the brightness of a specific display screen, the brightness of the display may be strongly or weakly adjusted for a predetermined second time period, and then it may be set to return to its original state again.

In this case, the speech recognition may use machine learning, which may be performed by a universal method.

Also, according to an embodiment, the display brightness may be adjusted based on the pointer and voice information. In this case, an emphasis score may be derived based on the pointer and voice information, and the brightness of the display may be adjusted based on the emphasis score. In this case, the brightness of the display may be adjusted to increase in proportion to the emphasis score.

A method of deriving an emphasis score may be based on Equation 1 below.

[Equation 1]

K may mean an emphasis score. b may mean the number of highlight factor variables including the time the pointer stays on the display and the number of words among the words included in the display of the screen and the words mentioned by the user for a specific time.

Sa may mean the weight of the a-th corresponding variable. Ta may mean a pre-tabled numerical value corresponding to the a-th variable.

In an embodiment, if a hand shape is pointing to the display while maintaining a predetermined time period of 3 seconds or more in a predetermined pointing pattern shape based on the user's hand shape information, a pointer may be derived and the pointer may be derived and pointed for 5 seconds or more The number 5 may be substituted for T, and a weight S corresponding to the hand shape variable may be substituted. Also, if the specific time is set to 3 seconds, if the word corresponding to the specific display and the word spoken by the user during the specific time of 3 seconds have the same word as 'flower' and 'flowerpot', the number 2 will be substituted for T. and a weight S corresponding to the word factor may be substituted. In this case, the specific time point may start after the first common word appears, and after a specific time (3 seconds in the above embodiment), the specific time point will start again when the next common word comes out. can

After deriving the emphasis score, the emphasis score may be classified into a predetermined number of categories. In this case, the basis for classifying the categories may be the amount of power.

According to an embodiment, after dividing the display power into three categories according to the amount of display power, the display brightness may be adjusted by classifying them into three categories according to the emphasis score and the power intensity corresponding to the corresponding category.

Also, according to an embodiment, the size of a certain area of the display may be changed in proportion to the emphasis score. As an embodiment, if the emphasis score is high, the bright area may be set to be wider in proportion to the emphasis score with the corresponding pointer as the center.

The server may derive ( 701 ) the word information included in the voice information, and may adjust the display brightness of the screen corresponding to the word to the third intensity ( 702 ) based on the word information.

6 is a diagram illustrating an operation of adjusting the brightness of a display based on distance information between a user and the display according to an exemplary embodiment. Referring specifically to FIG. 6 , if there is an area of the display where the distance between the user and the display is more than a predetermined distance S10 as described above, the area or the entire screen of the display including the area may be adjusted to the first intensity. there is.

A user terminal is a communicable desktop computer, a laptop computer, a notebook, a smart phone, a tablet PC, a mobile phone, and a smart watch. ), smart glass, e-book reader, PMP (portable multimedia player), portable game console, navigation device, digital camera, DMB (digital multimedia broadcasting) player, digital voice recorder (digital) audio recorder), a digital audio player, a digital video recorder, a digital video player, and a personal digital assistant (PDA).

When using machine learning tasks, deep learning models can be used, and it can be performed using machine learning models. In this case, the learning data set may include various information acquired from various external servers as the learning data set, and a supervised learning method may be used. In this case, the deep learning model module may use a deep neural network (DNN) algorithm. Without being limited to the description, convolutional neural network (CNN), recurrent neural network (RNN), Restricted Boltzmann Machine (RBM), 　Deep Belief Network (DBN) algorithms are may be used, and since each algorithm is a well-known technique, a description thereof will be omitted.

The methods according to the present invention may be implemented in the form of program instructions that can be executed by various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the computer-readable medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the art of computer software.

Examples of computer-readable media may include hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions may include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as at least one software module to perform the operations of the present invention, and vice versa.

In addition, the above-described method or apparatus may be implemented by combining all or part of its configuration or function, or may be implemented separately.

Although the above has been described with reference to preferred embodiments of the present invention, those skilled in the art can variously modify and change the present invention within the scope without departing from the spirit and scope of the present invention as set forth in the claims below. You will understand that it can be done.

The methods according to the present invention may be implemented in the form of program instructions that can be executed by various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the computer-readable medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the art of computer software.

Examples of computer-readable media may include hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions may include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as at least one software module to perform the operations of the present invention, and vice versa.

In addition, the above-described method or apparatus may be implemented by combining all or part of its configuration or function, or may be implemented separately.

Although the above has been described with reference to preferred embodiments of the present invention, those skilled in the art can variously modify and change the present invention within the scope without departing from the spirit and scope of the present invention as set forth in the claims below. You will understand that it can be done.

S10: predetermined distance

Claims (5)

In the display display method performed by the server,
acquiring a spatial image including a user and at least one display through a camera;
acquiring the location information of the user and the behavior information of the user based on the spatial image; and
adjusting the brightness of the at least one display from a reference intensity to a first intensity based on the location information and the behavior information;
adjusting the brightness of the at least one display from the reference intensity to a first intensity based on the location information and the behavior information,
acquiring location information of the at least one display through the camera;
obtaining distance information between the user and the at least one display based on the location information of the user and the location information of the at least one display; and
Including; adjusting the brightness of the display separated by a predetermined distance or more from the user from the reference intensity to the first intensity based on the distance information;
deriving hand gesture information of the user based on the behavior information;
deriving a pointer pointed to by the user based on the hand gesture information;
obtaining voice information of the user;
deriving word information included in the voice information;
deriving an emphasis score based on the word information and the pointer;
adjusting the brightness of a portion of a certain area of the display including the pointer pointed by the user from the reference intensity to a second intensity based on the hand gesture information;
A portion of a certain area of the display is widened in proportion to the emphasis score,
The method of deriving the emphasis score may be based on the following Equation 1,
[Equation 1]

,
where K denotes an emphasis score, b denotes the number of highlight factor variables including the number of words included in the display and the number of words mentioned by the user that match during the time the pointer stays on the display, , wherein Sa represents a weight of the a-th variable, and Ta represents a pre-tabled numerical value corresponding to the a-th variable. The method of claim 1,
The step of deriving the pointer pointed to by the user based on the hand gesture information comprises:
obtaining the user's hand shape information;
and deriving the pointer pointed to by the user when the user's hand shape is maintained in a predetermined pattern shape for a predetermined time or longer based on the hand shape information.
. delete delete delete

Images