KR20190006791A - Projector system with panarama screen conversion function - Google Patents

Abstract

The present invention relates to a projector system with a panorama screen conversion function which can give mental security by reflecting domestic and foreign natural sceneries in real time and interacting with a user while displaying a panorama image including a natural scenery together with a sound on an indoor wall. To this end, the projector system comprises a plurality of high-resolution projectors.

Description

[0001] PROJECTOR SYSTEM WITH PANARAMA SCREEN CONVERSION FUNCTION [0002]

The present invention relates to a projector system, and more particularly, to a projector system which includes a plurality of high-resolution projectors to display a panoramic image containing natural scenery on the wall of the room together with sound, To a projector system having a panorama image conversion function capable of giving a panorama image.

People who live in complex modern society, such as workers, students, and housewives, are exposed to various stresses, and various measures are being sought to relieve stress and find psychological stability.

As a representative method for this, there are professional psychotherapy and various leisure activities. However, since it takes a substantial amount of time and economic cost, most people do not have much time.

In the IT digital field, which is experiencing rapid development in recent years, attempts have been made to develop contents that can relieve mental fatigue and stress, and it is anticipated that a lot of time, space and economic constraints will be improved have.

However, the aspect of the content that has been developed so far is either a screen saver format in which only the video material is superimposed without sound, a simple and simple static video object, an audio format in which only audio is provided without video, And the effect obtained by the video-based video objects combined for the purpose of content development was insignificant.

Especially, these contents have been pointed out that the main demand is not a home, but there are no time, space, and economic constraints. Therefore, it has been pointed out that the effect is reduced due to a decrease in the size of output from a monitor connected to a digital TV or a computer.

As an alternative to enlarging the size of the display, a panoramic display method in which a plurality of display devices are connected by connecting several TVs or display devices is considered as a single display device. However, the content is limited and the above- In fact.

Published Japanese Patent Application No. 10-1998-0023191 (July 1998)

SUMMARY OF THE INVENTION The present invention has been made in order to solve the above-mentioned problems, and an object of the present invention is to provide a projector having a plurality of high resolution projectors for displaying panoramic images together with sounds on the wall of a room, A projector system having a panorama screen conversion function that provides multimedia contents by applying interaction and temporal change with a user.

In accordance with another aspect of the present invention, there is provided a projector system for outputting a panoramic image along a wall surface of a room, the projector system comprising: a first projector and a second projector installed on a ceiling of a room for outputting images to a wall; And outputting the panoramic image through the first projector and the second projector in a panoramic manner; An acoustic output unit having a plurality of loudspeakers and outputting an input acoustic signal through each loudspeaker; An auxiliary camera for photographing a room including a wall surface on which an image is output through a fisheye lens; and an analyzer for extracting a person from the image photographed through the auxiliary camera and deriving behavior characteristics of the extracted person; A timer for generating a current time and a content playback time; a timer for generating a current time and a content playback time of the background content, the time content including a wide video signal and a time signal; A control unit having a playback unit for applying a wide video signal and an audio signal reflecting time information to the video output unit and the audio output unit respectively and a conversion unit for giving a video effect of background content to be played back corresponding to the behavioral characteristics; .

The control unit may include a first communication unit capable of communicating with a remote server, and a request unit requesting a content to the support server, the second communication unit communicating with the first communication unit, a collection unit collecting the panoramic background contents, A database in which background contents including a wide video signal and an audio signal are classified and stored according to genres, and a management unit for managing copyright and royalty charges and distribution for each content stored in the database; .

A third communication unit capable of communicating with the second communication unit; a panoramic camera unit that captures the surroundings and generates a wide image; a microphone that collects ambient sounds; a combination of the generated wide- A real time support unit installed in a selected outdoors and having a content generation unit for transmitting to the support server through the third communication unit in real time; The control unit may further include a real-time relay unit for requesting real-time content through the request unit and receiving the content generated by the real-time support unit via a support server in a streaming manner.

The control unit may further include an image mixing unit for mixing the selected object contents with the wide image signal, and the converting unit may be configured to select one of a plurality of objects, It is preferable to move the object contents according to a behavior characteristic according to a touch.

According to the present invention, a plurality of projectors having a high resolution can be provided in a customized manner with images of natural scenery as content, and a panoramic image can be displayed on the wall of the room together with sounds to enhance the psychological stability effect. Especially, it can be applied to home, hospital, and accommodation facilities to save time, space, and cost, so that it can feel as if it is located in famous holiday resort in Korea and abroad. By applying interaction and temporal change, .

1 is a conceptual diagram of the present invention,
2 is a block diagram illustrating a configuration and a connection relationship according to a preferred embodiment of the present invention.
3 is a block diagram illustrating a configuration and a connection relationship according to another embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the configuration of a projector system having a panoramic screen conversion function according to the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a conceptual diagram of the present invention. The present invention basically comprises two or more projectors 111 and 112 for outputting a panoramic image along a wall surface of a room. Wide video signal along with the sound along the wall of the room so that the user can feel as if he or she is at the resort spot.

At this time, it is possible to maximize the real feeling by giving various changes to the images according to the behavior characteristics of the user or the time change, and it is possible not only to receive various background contents according to the user's taste from the remote support server 150 using the Internet, It is possible to provide a virtual travel environment for a desired location by relaying real-time scenery and sound from various domestic and overseas resort sites in real time.

2 is a block diagram illustrating a configuration and a connection relationship according to a preferred embodiment of the present invention. In the preferred embodiment of the present invention for implementing the above-described technology, the video output unit 110 and the audio output unit 120 A user sensing unit 130, and a control unit 140. [0033]

The image output unit 110 is configured to output an image containing natural scenery of a user's mind and body for stabilization to wall surfaces of various indoor rooms where the user is located. The image output unit 110 includes a first projector 111 and a second projector 112 and an image divider 113 for splitting an inputted wide video signal so as to be outputted as a panoramic image through the first projector 111 and the second projector 112.

However, since the first projector 111 and the second projector 112 having high resolution specifications are installed side by side, wide images are output in a panoramic manner throughout the entire wall surface, And a larger number of projectors such as a third projector and a fourth projector may be provided depending on an installation environment.

At this time, although the same effect can be obtained without installing the projectors 111 and 112 on the ceiling portion of the projector, the degree of immersion is lowered due to shadowing or inconvenience caused by blocking light output during movement of the user The installation is performed so as to minimize the hindrance and influence to the movement of the user.

In addition, the video divider 113 divides a wide video signal inputted in correspondence with the number of the installed projectors in the horizontal direction, so that the video outputted through the first projector 111 and the second projector 112 is continuously disconnected So that it is outputted along the wall surface.

The sound output unit 120 includes a plurality of speakers 121 for outputting sounds included in the background content together with the images, and outputs the input sound signals through the respective speakers 121.

Of course, there is no problem in outputting sound through a single speaker, but as mentioned above, a wide image is output over the entire wall surface, and various natural sounds included in the image may vary depending on the position of the image, It is preferable to provide the indoor units 121 at appropriate intervals so as to control the intensity and the characteristic of the sound to be different from each other.

Such a configuration can greatly benefit mind and body stability by outputting various natural scenes to the wall of the room. However, by interacting with the user, some or all of the background contents can be changed to maximize the reality .

The user sensing unit 130 for sensing the movement of the user located in the room may sense movement of the user in various ways. In a preferred embodiment of the present invention, And an analysis unit 132 for extracting a person from the images photographed through the auxiliary camera 131 and deriving behavior characteristics of the extracted person.

That is, as described above, the auxiliary camera 131 having a fisheye lens is used as a means for sensing the movement of the user in the indoor space through the single camera without inconveniencing the movement of the user.

The fisheye lens is an ultra-wide angle lens having an angle of more than 180 degrees. Unlike a conventional camera, the fisheye lens can be mounted independently on the ceiling portion like the first projector 111 and the second projector 112, It is possible to shoot people in all areas.

Such a fisheye lens has a feature that the photographed image is rounded because the range of view is basically wide by 180 °. Of course, due to the distortion of the image, the accuracy of the user's accurate position or behavior may be lowered. However, it is possible to capture a wider range than a general wide-angle lens, It is sufficient to grasp an approximate trend and can be a configuration suitable for the present invention.

However, if necessary, an operation of correcting the distorted image due to the fisheye lens may be performed in order to grasp the position and behavior of the correct user. Such a correction is made by a mathematical model and a numerical analysis of the lens distortion. The correction is carried out by using the lens of the sub camera 131, the distance between the lens and the image sensor, the angle between the lens and the image sensor, Calibration can be done in such a way that parameter values are received and applied in reverse.

Then, the analysis unit 132 calculates the position and the change of the user through the image analysis taken through the assistant camera 131 to generate behavioral characteristics. Specifically, the user can distinguish the action from the current position toward the wall where the background content is reproduced, the motion away from the wall surface, and the movement in the lateral direction along the wall surface. If necessary, It can also be created as a behavioral characteristic, including the action of scrubbing hands.

The control unit 140 is configured to control overall functions for outputting video and audio of background contents and includes an interface unit 142, a storage unit 143, a timer 144, a playback unit 145, And a conversion unit 146, and may be configured as a control console or a separate terminal, and may be implemented through a computer, a smart phone, or various terminals providing equivalent functions.

As the input / output means, the interface unit 142 provides functions such as overall control including power on / off and search and selection of a background content desired by a user from among a plurality of background contents stored or setting a time, The detailed description of the solution is omitted in order to prevent the gist of the present invention from being blurred.

The storage unit 143 is a storage unit for storing background contents in which a wide video signal and a sound signal are generated together with time information. As mentioned above, in the present invention, the background content to be played on the wall is a wide-angle image composed of natural scenery such as mountains, valleys, sea, night sky, etc., and a wide range of natural images such as a sound of birds, water, waves, , And has a relatively long play time such that the background contents can be reproduced for a sufficient time.

Of course, it is possible to reproduce short images repeatedly due to low dynamics of images due to the natural scenery. However, for a more realistic presentation reflecting the time changes such as morning, lunch, evening, and night, It is preferable to have a play time.

The timer 144 is configured to generate a current time and a background content playback time. As described above, the timer 144 reflects changes in time such as morning, lunch, evening, and night and checks the current time and the play time .

The playback unit 145 may output a wide video signal and an audio signal reflecting the time information corresponding to the current time to the background content selected by the user through the interface unit 142 among the background contents stored in the storage unit 143 To the video output unit 110 and the audio output unit 120, respectively. In other words, it can basically reflect the current time in the scenery of nature. The morning, the lunch, the evening, and the night scenery are outputted corresponding to the current time so that the mind and body stabilization effect can be maximized in accordance with the user's biorhythm.

The converting unit 146 is configured to give a video effect of the background content to be reproduced corresponding to the behavior characteristics analyzed by the user detecting unit. A variety of visual effects can be given. Typically, the scale is changed according to the position of the user on the basis of the wall surface on which the background content is output. That is, the user changes the scale to which the perspective is applied based on the user's approach to the wall with respect to the natural landscape at the farthest position from the wall surface, and can give a sense of reality as if it is in the actual landscape.

In addition, dynamic changes of the image, which may not be easily perceived when the user is close to the wall, can be displayed when the user is away from the wall. For example, in the background content based on polar regions, aurora , And a scene in which the shooting star falls from the background content reflecting the night time zone.

FIG. 3 is a block diagram illustrating a configuration and a connection relationship according to another embodiment of the present invention. The background content used in the present invention is basically a high-quality wide image, and its capacity is significantly increased. Accordingly, It is necessary to remotely support a variety of contents reflecting the psychological state and taste of the user, as well as the burden of the storage capacity.

For this, the control unit 140 may include a first communication unit 141 that can perform communication using a communication network such as the Internet with a remote server, and a request unit 147 that requests content to the support server And a support server for supporting contents through a communication network. That is, the user can reproduce the content through the request unit 147 by selecting and transmitting the desired background content among the various contents connected to the remote support server, that is, by downloading and storing it in the storage unit 143 .

The support server 150 includes a second communication unit 151 capable of communicating with the first communication unit 141 and a detailed configuration of a collecting unit 152, a database 153 and a management unit 154.

The collection unit 152 collects panoramic background contents. Basically, the collection unit 152 collects background contents generated by other users on a support server. In addition, You can also upload a panoramic natural scenery video and sound source to suit your needs and collect it by paying for the copyright.

In the database 153, background contents including the collected wide video signals and sound signals are classified and stored by genre. As mentioned, the images are classified into mountains, valleys, sea, and night sky. Sounds are classified according to criteria such as birds, water sounds, waves, worms, and animal sounds so that users can easily search for and choose Preferably, the specialist can classify the user as a psychological state diagnosis and prescription standard so that the user can select a content suitable for his or her psychological state.

The management unit 154 manages the copyright and royalty charges and distribution for each content stored in the database. The management unit 154 allows the user to sell the downloaded content according to his or her preference, Which will facilitate the acquisition and purchase of various high-quality background contents.

In addition, according to another embodiment of the present invention, a real-time scenery of famous domestic and foreign resorts can be provided as background contents, which can not easily be accessed due to time and economic problems, and a real-time support unit 160 is provided.

The real-time support unit 160 is installed outside the famous domestic and overseas resort areas and relays the scenery in real time, thereby providing a function for the user to feel the presence feeling anywhere in the world. The second communication unit 151, The detailed configuration of the panorama camera section 162, the microphone 163, and the content generation section 164, as well as the third communication section 161 capable of communication.

The panoramic camera unit 162 is a panoramic camera that captures the surrounding scenery of the installed place and generates a wide image. The panoramic camera unit 162 photographs a landscape reflecting the natural change of the outdoor environment in high image quality, avoiding direct sunlight or the like.

The microphone 163 is configured to acquire ambient sound at the same time as the image acquisition by the panoramic camera unit 162. The microphone 163 receives sounds of waves, . Of course, it may include a noise level that does not hinder the stability of mind and body, such as the sound of children playing around, but it is preferable to exclude the noise level that does not help mind and body stability.

The content generating unit 164 may combine the wide image generated through the panoramic camera unit 162 and the sound collected through the microphone 163 to form a background content, and at the request of the support server 150, And transmitted via the communication unit 161 in real time.

In response, the control unit 140 allows the user to request real-time contents through the request unit 147. [ That is, the user provides simple information about a plurality of currently supported real-time support units 160, and the user requests real-time contents by searching and selecting the real-time contents. The real-time contents generated by the real- And a real time relay unit 148 for receiving the video signal through the video output unit 110 and the audio output unit 120 through a streaming method.

Of course, in the present invention, real-time broadcasting is basically performed, but the received real-time contents are stored in the storage unit 143 in order to compensate for the situation of the communication network. It is possible to relay substantially the same effect as real time.

In addition, according to another embodiment of the present invention, the image mixing unit 149 is configured to combine various objects in the background content to be reproduced and to maximize the sense of reality and immersion as well as a more dynamic image in response to the interaction with the user .

To this end, the storage unit 143 stores object contents composed of images including movements of animals and plants. This is a variety of animals and plants that can help in mental and physical well-being while mixing well with the background content. It can be made of images of mild wild animals including birds and various flowers and plants.

The image mixing unit 149 is configured to mix and output the selected object contents in the wide image signal selected and output, and the converting unit may be configured to move the object contents according to a behavior of a person .

For example, when the user accesses the wall, the effect of moving the animal, which is outputted as the object content, from the person is realized, or the effect of the shake of the content of the object output by the flower or grass is implemented.

It is to be understood that the invention is not limited to the disclosed embodiment, but is capable of many modifications and variations within the scope of the appended claims. It is self-evident.

110: video output unit 111: first projector
112: second projector 113: image divider
120: Acoustic output unit 121: Speaker
130: user detection unit 131: auxiliary camera
132: analysis unit 140:
141: first communication unit 142: interface unit
143: storage unit 144: timer
145: reproducing section 146: converting section
147: requesting unit 148: relaying unit
149: image mixing unit 150: support server
151: second communication unit 152:
153: Database 154:
160: Real time support section 161: Third communication section
162: panoramic camera unit 163: microphone
164:

Claims (4)

A projector system for outputting a panoramic image along a wall surface of a room,
A first projector 111 and a second projector 112 installed on the ceiling of the room for outputting an image to the wall and a second projector 112 for outputting an input wide image signal to the panoramic image through the first projector 111 and the second projector 112, A video output unit 110 having a video dividing unit 113 dividing the video signal into a plurality of video signals;
An audio output unit 120 having a plurality of speakers 121 and outputting an inputted audio signal through each speaker 121;
An auxiliary camera 131 for photographing the room including the wall surface through which the image is outputted through the fisheye lens, an analysis unit 130 for extracting a person from the image photographed through the auxiliary camera 131, A user sensing unit 130 having a plurality of sensors 132;
A timer 144 for generating a current time and a content playback time, and a timer 144 for selecting a content selected from the background content stored in the storage 143 A playback unit 145 for applying a wide video signal and an audio signal reflecting the time information corresponding to the current time to the background content, to the video output unit 110 and the audio output unit 120, A control unit (140) having a conversion unit (146) for giving a visual effect of a background content to be reproduced; And a panorama image conversion function.
The method according to claim 1,
The control unit 140 may further include a first communication unit 141 capable of communicating with a remote server and a request unit 147 requesting a content from the support server 150,
A second communication unit 151 capable of communicating with the first communication unit 141, a collecting unit 152 collecting panoramic background contents, a background content including a wide video signal and a sound signal, 153), a support server (150) having a management unit (154) for managing copyright and royalties charges and distribution for each content stored in the database (153); The projector system of claim 1, further comprising:
3. The method of claim 2,
A third communication unit 161 capable of communicating with the second communication unit 151, a panoramic camera unit 162 for photographing the surroundings and generating a wide image, a microphone for collecting ambient sound, A real-time support unit 160 installed in the outdoors and having a content generation unit 164 for transmitting real-time background contents to the support server through the third communication unit 161; Further comprising:
The control unit 140 may further include a real-time relay unit 148 for requesting real-time content through the request unit 147 and receiving the content generated by the real-time support unit via the support server 150 in a streaming manner And a panorama image conversion function.
The method according to claim 1,
The storage unit 143 stores object contents including images of movements of animals and plants,
The control unit 140 further includes an image mixing unit 149 for mixing the selected object content with the wide video signal,
Wherein the conversion unit (146) moves the object content according to a behavior and a behavior according to a human's approach and touch.

Images