KR20210144465A - Method of providing educational virtual reality contents in vehicle such as a bus and a system thereof - Google Patents

Abstract

The present invention relates to a method and a system for providing educational virtual reality content in a vehicle like a bus, comprising: a content transmission device providing content or an effect control signal; an HMD device displaying the content and arranged for each vehicle seat; a mobile device connected to the HMD device through wired or wireless networks and receiving the content from the content transmission device; and a simulator generating an effect synchronized with the content in accordance with the effect control signal, wherein the content transmission device can protect the eyesight of a user by controlling brightness of a screen of the mobile device in accordance with the brightness of the surrounding environment so as to prevent a glare phenomenon and allow the power to last longer by reducing the power consumption of the mobile device.

Description

METHOD OF PROVIDING EDUCATIONAL VIRTUAL REALITY CONTENTS IN VEHICLE SUCH AS A BUS AND A SYSTEM THEREOF

The present invention relates to a method and system for providing virtual reality content, and more particularly, to a method and system for providing virtual reality content for education in a vehicle such as a bus.

On the other hand, the present invention relates to a method and system for providing educational virtual reality content in a vehicle such as a bus capable of preventing power loss, and more particularly, it occurs in the process of converting rotational motion into linear motion when driving a simulation chair. It relates to a method and system for providing virtual reality content that can prevent vibration or noise by a component to reduce power loss.

As the low birth rate and aging population in our society intensify, the local population is concentrated in the metropolitan area and large cities. In particular, rural areas are in danger of collapsing in fertility, childcare, childcare, education, and economic foundations as tax revenues decrease and competitiveness decreases due to population decline. In terms of education, there has been a demand for a method of providing educational contents to elementary, middle, high school and out-of-school youths in so-called underprivileged areas such as rural and fishing villages and old towns, where opportunities for educational experience are relatively lacking compared to urban areas.

Accordingly, as a social contribution project to bridge the educational experience gap, career experience buses are being operated for elementary, middle, high school and out-of-school youths in underprivileged areas, but there are limitations in content to provide a variety of experiences.

Therefore, there is a need for a method and system for providing various contents even in marginalized areas such as rural areas by combining it with a vehicle.

Accordingly, in order to provide various contents in an underprivileged area, interest in a method of providing educational contents using virtual reality technology is growing.

Virtual reality refers to an artificial world or such technology in which a virtual world or an object or background of the real world is artificially implemented using a computer. It can be divided into providing to users, and in the former case, the user is immersed in a virtual space or environment created by a computer, and in the latter case, real information is delivered to the user through the virtual reality system device, Augmented reality or mixed reality belongs to this category.

When such a virtual reality image is used, the viewpoint changes according to the movement of the user, so that images from various viewpoints can be provided. Attempts to apply these characteristics to various fields such as games, education, medical care, video, broadcasting, advertising, and manufacturing are actively underway.

In addition, since virtual reality can artificially implement the virtual world or the real world, users can be provided with various contents without restrictions within the virtual reality. can be

On the other hand, according to the method of providing a conventional virtual reality technology, as the HMD (Head Mounted Display) device becomes popular, the HMD device can provide a user with a virtual reality image that can feel as if it is interacting with the real surrounding environment. have. However, as display screens become brighter, more colorful, and higher-end, the number of pixels per inch (PPI) increases and letters become smaller, a technology for protecting the user's eyesight is required. In particular, when the HMD device is used for a long period of time, the distance between the bright and colorful display and the user's eyes is close, which increases eye fatigue and deteriorates eyesight.

In addition, unlike general audiovisual output devices, virtual reality output devices are configured to allow visual recognition of a user only by an image appearing on an output screen in a state in which the user's view is completely covered, so that the user's physical movement and output If there is a difference in the movement of the image displayed on the screen, motion sickness may be felt. This motion sickness symptom is also called cyber sickness (or virtual motion sickness), but when cyber sickness is accumulated, there is a problem in that the convenience of using the output device itself may be significantly reduced.

Accordingly, the screen luminance value of the mobile device is dazzling according to the luminance of the surrounding environment in order to provide a virtual reality device to provide various educational contents to students in underprivileged areas, while reducing eye fatigue and improving the problem of causing cybersickness symptoms. There is a need for a method of providing virtual reality content that limits the length of the content so as not to exceed the threshold luminance value causing the phenomenon and not to use the HMD device for a long time.

On the other hand, 6-DOF motion is a yaw that rotates around the z-axis, a roll that rotates left and right about the y-axis about the x-axis, a pitch where the z-axis rotates up and down about the y-axis, It refers to six virtual motions: a heave that reciprocates linearly on the z-axis, a surge that reciprocates linearly on the y-axis, and a sway that reciprocates linearly on the x-axis. A driving device that implements a degree of freedom motion by driving an actuator has been used in various ways, such as training devices and construction equipment, but recently, it is used for entertainment purposes such as game simulators and amusement parks.

In order to drive the degree of freedom suitable for the content provided to the user in the device providing the virtual reality content, the driving device installed in the simulator chair implements this.

In the simulation chair, all actuators are installed parallel to the horizontal center line of the lower plate, and a moment is generated around the spline by the component force in the process of converting rotational motion into linear motion when the actuator is driven. Friction is generated according to the moment, and irregular noise or vibration is generated during operation of the simulation chair, which interferes with immersion in virtual reality contents, and power loss caused by friction is a problem.

On the other hand, display screens are getting brighter, more colorful, and high-end, and the number of pixels per inch (PPI) increases. Therefore, in order to reproduce high-definition images in HMD devices, the power consumption of the panel and chipset is too high, so a heavy battery or power supply is required. had to connect Moreover, in the case of a vehicle in which it is difficult to connect a power source, there is a limit to operating multiple HMD devices that consume a lot of power as described above.

Korean Patent No. 10-1814883

The problem to be solved by the present invention is an invention devised to solve the above problems, and an object of the present invention is a method of providing virtual reality contents that can provide various educational contents to students in an underprivileged area by introducing virtual reality technology and to provide a system.

In addition, while humans have a characteristic of vision in which eye fatigue is more felt when looking at a bright thing in a dark place, a mobile device that provides content must provide bright content to provide clear picture quality, In other words, viewing high-definition content is very tiresome for the user's eyes. The present invention relates to an HMD device, and since the HMD device blocks external light, it is a virtual reality content including a content transmission device that adjusts the brightness of the contents by reflecting the external brightness, that is, the luminance, before wearing in a dark state after wearing. A method and system are provided.

In addition, the advantage of providing bright content causes a problem of causing unpleasant glare to the user, and light is the main cause of the onset of macular degeneration, which damages the retina and leads to loss of vision. Accordingly, the present invention provides a content transmission device and a mobile device capable of controlling the screen luminance according to the luminance of the surrounding environment in consideration of human visual characteristics in order to reduce the user's eye fatigue caused by glare and reduce the intensity of light to prevent vision loss. A method and system for providing virtual reality content including a device are provided.

In addition, the present invention provides a method for providing virtual reality content that can protect the eyesight of the user by displaying the screen of the user's mobile device in the eyesight protection mode according to the user input, the content providing time, the user's eye fatigue state, etc. and systems.

In addition, since the present invention is characterized in that it is made in a vehicle, there is a limitation in its limited power. Accordingly, the present invention provides a method and system for providing virtual reality content including a content transmission device capable of saving power consumption by controlling screen luminance to prevent glare from occurring according to ambient luminance.

In addition, according to the present invention, more than 80% of users who have experienced 3D virtual reality for 20 minutes or more experience cyber-sickness caused by incongruity of vision and movement, and pilots trained professionally using virtual reality However, considering that drivers are prohibited from actually flying or driving within 12 to 24 hours after training, the cybersickness that students receiving virtual reality content can experience when they wear virtual reality (VR) devices for a long time A method and system for providing virtual reality content are provided in 20 minutes or less, in which more than 80% of users experience cybersickness in order to alleviate this problem.

In addition, the present invention uses an HMD device, and the HMD maintains high brightness because it provides high-definition content. Therefore, when students' eyes are exposed to such high-definition bright light, the eyesight of growing students is easily adversely affected. Therefore, we provide a method and system for providing virtual reality content that limits the time of using the HMD device for students.

In addition, in the present invention, since humans feel cybersick from the dissonance of vision and movement, the present invention provides a screen on the HMD device, Provided are a method and system for providing virtual reality content in which movement occurs simultaneously.

In addition, in the present invention, the user cannot be immersed in the content due to vibration or noise caused by friction that is inevitably generated according to the component force generated in the process of converting rotational motion into linear motion in the motion process of the actuator, and there is a problem of losing interest There is a problem of power loss due to the friction generated. Accordingly, the present invention provides a method and system for providing virtual reality content for improving the problems caused by the friction.

In addition, the present invention is for stable driving by changing the position of the actuator according to the user's weight, and the actuators constituting the axes under the simulator according to the user's weight have different loads. The load on the actuator is greater.

In addition, when the actuator is driven on the central axis of the simulator, a large movement of the simulator can be led even with a small vertical movement. For example, as the distance from the center increases, the motion of the simulator decreases even when the actuator is driven. Therefore, if the actuators of the simulator are dispersed and provided, the desired driving range cannot be reached.

Therefore, the present invention allows the simulator to move in a wide driving range for a user with a small weight according to the user's weight, while changing the position of the actuator so that the axes of the lower surface of the simulator are widely distributed for users with a lot of weight. It provides a method and system for providing virtual reality content that enables stable operation of the device and prevents power loss due to a small load on the actuator.

In addition, the present invention provides a method and system for providing virtual reality content including a simulation chair capable of various movements in various positions compared to a simulation chair including a fixed actuator because the angle of the actuator of the simulation chair can be changed.

In addition, the present invention provides a virtual reality content providing method and system for improving the unnecessary power loss that occurs because the mobile device and the simulator are running even when the user is not seated on the simulation chair.

Another object of the present invention is to provide a vehicle for providing a method and system for providing virtual reality content in order to secure accessibility to students in an underprivileged area.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

According to the present invention, a method for providing virtual reality content for education using a content transmission apparatus in a vehicle such as a bus includes the steps of: (a) connecting the content transmission apparatus to a mobile device through wireless or wired communication; (b) connecting the content transmission device to a head-mounted display (HMD) device arranged for each vehicle seat through a connection with the mobile device through wireless or wired communication; (c) transmitting, by the content transmission apparatus, the content to the mobile device; (d) causing the content transmission apparatus to measure the ambient environment luminance of the mobile device in the mobile device and transmit the measured environment luminance to the content transmission apparatus; (e) the content transmission apparatus calculates a threshold screen luminance at which glare starts to occur in the mobile device using the measured environmental luminance and a preset glare index value, and the content corresponding to the calculated threshold screen luminance deriving an average luminance level threshold; (f) the content transmission device calculates the average luminance level of the content by using the luminance of each pixel constituting the frame of the content input, and the calculated average luminance level of the content is the average luminance level threshold of the content adjusting the luminance of the light emitting module of the mobile device so that the screen luminance of the mobile device does not exceed the threshold screen luminance when it exceeds; (g) transmitting, by the content transmission apparatus, the content reproduction start signal to the mobile device; (h) transmitting, by the content transmission apparatus, the content to the HMD apparatus through the mobile device, so that the HMD apparatus displays the content; (i) receiving, by the content transmission apparatus, time information according to the content reproduction transmitted by the HMD apparatus under the control of the mobile device; (j) the contents transmission device synchronizes the contents transmission device and the simulator using the time information, and transmits an effect control signal to be generated at a corresponding time to the simulator, so that the effect of the simulator according to the effect control signal and the contents synchronizing; including, wherein the content transmission device transmits a command for simultaneous playback to the mobile device, so that a screen is displayed on the HMD device and the simulator is moved at the same time, and the length of the content is a characteristic of the content Alternatively, it may be determined according to the characteristics of the user, the length of the content may be controlled by cutting off power provided to the HMD device, and the simulator may be a simulation chair that fluctuates according to the effect control signal transmitted by the content transmission device (chair).

In the method for providing educational virtual reality content in a vehicle such as a bus according to the present invention, the content transmission device may be selected from a group including a desktop, a lap top, a mobile terminal, and a smart phone. can

The method for providing educational virtual reality content in a vehicle such as a bus according to the present invention may further include stopping the simulator by applying a stop signal to a control device included in the simulator.

In the method of providing educational virtual reality content in a vehicle such as a bus according to the present invention, the content may be educational content.

The method for providing educational virtual reality content in a vehicle such as a bus according to the present invention includes measuring a distance between the mobile device and a user, and determining whether to transmit the content to the HMD device according to the measured distance may further include.

A system for providing educational virtual reality content using a content transmission device in a vehicle such as a bus according to the present invention, the content transmission device comprising: a communication unit for connecting to a mobile device or an HMD device through wireless or wired communication; a content service unit transmitting the content to the mobile device or the HMD device; a terminal control unit configured to measure the ambient environment luminance by the environmental luminance measuring unit of the mobile device and transmit the measured environmental luminance to the content transmission apparatus; The threshold screen luminance of the mobile device at which glare begins to occur is calculated using a preset glare index value and the environmental luminance measured by the environmental luminance measurement unit, and the average luminance level threshold value of content corresponding to the calculated threshold screen luminance Threshold determining unit for deriving; an average luminance level calculator for calculating an average luminance level of the content by using the luminance of each pixel constituting the input frame of the content; A light emitting module to prevent the screen luminance of the mobile device from exceeding the threshold screen luminance when the average luminance level of the content calculated by the average luminance level calculator exceeds the average luminance level of the content derived by the threshold determiner a luminance control unit for adjusting the luminance of light emission; a start signal transmitter for transmitting the content reproduction start signal to the mobile device; a mobile device control unit that transmits the content to the HMD apparatus through the mobile device and causes the HMD apparatus to display the content; a time information receiving unit for receiving time information according to the content reproduction; and an effect control unit that synchronizes the content transmission device and the simulator using the time information, transmits an effect control signal to be generated at a corresponding time to the simulator, and synchronizes the effect of the simulator according to the effect control signal and the content ; including, wherein the content transmission device transmits a command for simultaneous playback to the mobile device, so that a screen is displayed on the HMD device and the simulator is moved at the same time, and the length of the content is a characteristic of the content Alternatively, it may be determined according to the characteristics of the user, the length of the content may be controlled by cutting off power provided to the HMD device, and the simulator may be a simulation chair that swings according to the effect control signal.

The system for providing educational virtual reality contents in a vehicle such as a bus according to the present invention may further include a control device for stopping the simulator by applying a stop signal.

In the system for providing educational virtual reality content in a vehicle such as a bus according to the present invention, the content may be educational content.

A system for providing educational virtual reality content in a vehicle such as a bus according to the present invention, the mobile device includes: a proximity sensor unit for measuring a distance between the mobile device and a user; and a processor that determines whether to transmit the content to the HMD device according to the measured distance.

A vehicle such as a bus according to the present invention may include a system for providing virtual reality content for education.

A method of providing educational virtual reality content in a vehicle such as a bus capable of preventing power loss according to the present invention, comprising: (a) connecting the content transmission device to a mobile device through wireless or wired communication; (b) connecting the content transmission device to a head-mounted display (HMD) device arranged for each vehicle seat through a connection with the mobile device through wireless or wired communication; (c) transmitting, by the content transmission apparatus, the content to the mobile device; (d) transmitting, by the content transmission apparatus, the content reproduction start signal to the mobile device; (e) transmitting, by the content transmission apparatus, the content to the HMD apparatus through the mobile device, so that the HMD apparatus displays the content; (f) receiving, by the content transmission apparatus, time information according to the content reproduction transmitted by the HMD apparatus under the control of the mobile device; (g) the contents transmission device synchronizes the contents transmission device and the simulator using the time information, and transmits an effect control signal to be generated at a corresponding time to the simulator, and the effect of the simulator according to the effect control signal and the contents synchronizing; (h) allowing the content transmission device to measure the pressure applied to the simulator by a sensor unit; (i) receiving, by the content transmission device, the pressure information measured by the sensor unit from the simulator; (j) allowing the content transmission device to identify the location of the actuator included in the simulator, and receiving the location information; (k) the content delivery device according to the pressure information of the actuator included in the simulator calculating the angle; and (l) adjusting, by the content transmission device, the angle of the actuator by changing the position of the actuator according to the calculated angle; including, wherein the content transmission device transmits a command for simultaneous playback to the mobile device, so that a screen is displayed on the HMD device and the simulator is moved at the same time, and the length of the content is a characteristic of the content Alternatively, it may be determined according to the characteristics of the user, the length of the content may be controlled by cutting off power provided to the HMD device, and the simulator may be a simulation chair that fluctuates according to the effect control signal transmitted by the content transmission device (chair).

A method of providing virtual reality content for education according to the present invention, the content transmission device comprising: determining, by the sensor unit, whether a pressure of a predetermined value or more is applied in the simulator; receiving, by the content transmission device, a control signal from the simulator when it is determined that a pressure of a predetermined value or more is applied by the sensor unit; and controlling, by the content transmission apparatus, operations of the mobile device and the simulator according to the received control signal. may include.

In the method of providing virtual reality content for education according to the present invention, the content transmission device transmits a control signal only when a weight of a certain value or more is measured within the range of 0.1 to 20 kilograms [kg] in the sensor unit installed in the simulator. may be configured to receive.

The method of providing virtual reality content for education according to the present invention may further include stopping the simulator by applying a stop signal to a control device included in the simulator.

The method of providing virtual reality content for education according to the present invention may further include measuring a distance between the mobile device and the user, and determining whether to transmit the content to the HMD device according to the measured distance. have.

In the method of providing virtual reality content for education according to the present invention, the simulator may be capable of driving a roll, a pitch, and a heave.

In the system for providing virtual reality content for education including a content transmission device in a vehicle such as a bus capable of preventing power loss according to the present invention, the content transmission device may perform wireless or wired communication with a mobile device or HMD device. A communication unit for connecting; A content service unit for transmitting the content to the mobile device or the HMD device; a start signal transmitter configured to transmit the content reproduction start signal to the mobile device; a mobile device controller configured to transmit the content to the HMD apparatus through the mobile device and display the content by the HMD apparatus; a time information receiving unit for receiving time information according to the content reproduction; and an effect control unit that synchronizes the content transmission device and the simulator using the time information, transmits an effect control signal to be generated at a corresponding time to the simulator, and synchronizes the effect of the simulator according to the effect control signal and the content ; a sensor control unit for measuring the pressure applied to the simulator by the sensor unit; a pressure information receiving unit for receiving the pressure information measured by the sensor unit from the simulator; a location information receiver to identify a location of an actuator included in the simulator and receive the location information; an angle calculator for calculating an angle of the actuator included in the simulator according to the pressure information; and an angle control unit configured to adjust the angle of the actuator by changing the position of the actuator according to the calculated angle. including, wherein the content transmission device transmits a command for simultaneous playback to the mobile device, so that a screen is displayed on the HMD device and the simulator is moved at the same time, and the length of the content is a characteristic of the content Alternatively, it may be determined according to the characteristics of the user, the length of the content may be controlled by cutting off power provided to the HMD device, and the simulator may be a simulation chair that swings according to the effect control signal.

A system for providing virtual reality content for education according to the present invention, the content transmission device includes: a sensor controller configured to determine whether a pressure greater than or equal to a predetermined value is applied in the simulator; a control signal receiver configured to receive a control signal from the simulator when it is determined that a pressure greater than or equal to a predetermined value is applied by the sensor unit; and a terminal controller for controlling operations of the mobile device and the simulator according to the received control signal.

In the system for providing virtual reality content for education according to the present invention, the content transmission device transmits a control signal only when the weight of a certain value or more is measured within the range of 0.1 to 20 kilograms [kg] in the sensor unit installed in the simulator. may be configured to receive.

A vehicle such as a bus according to the present invention may include a system for providing virtual reality content for education.

Other specific details of the invention are included in the detailed description and drawings.

The method and system for providing educational virtual reality content in a vehicle such as a bus according to the present invention have the following effects.

The present invention can artificially implement a virtual world or a real world by using virtual reality technology, so that a user can be provided with various contents without limitation in the virtual reality regardless of the user's environment. Accordingly, the present invention can provide content so that students can experience experiences that they could not experience because they were not provided in an underprivileged area.

In addition, according to the content transmission apparatus 100 of the present invention, the screen luminance of the mobile device 200 is glare by adjusting the luminance of the light emitting module 270 using the luminance and glare index of the surrounding environment of the mobile device 200 . It is possible to maintain an appropriate luminance that does not occur. Accordingly, eye fatigue of a user using the mobile device may be reduced.

In addition, according to the present invention, the light emitting module 270 automatically adjusts the luminance according to the luminance of the surrounding environment by using the luminance of the surrounding environment and the glare index of the mobile device 200 , so that power consumption can be saved.

In addition, the present invention provides a sense of reality and immersion in virtual reality to the user because the screen appears on the HMD device and the simulator moves at the same time, while reducing cybersickness caused by the difference from the real world under these realistic contents. can

In addition, since content is provided within 20 minutes or less when more than 80% of users experience cybersickness, cybersickness that can occur when wearing a virtual reality device for a long time can be alleviated.

In addition, since the students expected to be users of the present invention have their eyesight sensitively changed to the surrounding environment, the content is provided by limiting the length of the content, so it is possible to reduce visual acuity that may occur when wearing the virtual reality device for a long time.

In addition, the present invention provides immersive virtual reality contents by preventing vibration or noise caused by friction that is finally generated according to the component force generated in the process of converting rotational motion into linear motion, while reducing power loss caused by friction. An object of the present invention is to provide a method and system for providing virtual reality content for education.

In addition, the present invention is provided with a sensor unit in the simulator when the user is seated in the simulator, and when the pressure applied to the sensor unit by the user, that is, the weight is greater than a certain value, it may be difficult to stably drive the actuator of the simulator, so the position of the actuator is adjusted. This is to provide a method and system for providing educational virtual reality content that provides stable driving and provides greater motion on the central axis of the simulator by adjusting the position of the actuator of the simulator when the weight is below a certain value.

In addition, the present invention is provided with a sensor unit in the simulator so that the mobile device and the simulator are driven when the user is seated in the simulator, so that the mobile device and the simulator are driven only when the user is seated in the seat, so that the power of the mobile device and the simulator An object of the present invention is to provide a method and system for providing virtual reality content for education that prevents loss.

In addition, the present invention is to provide educational content using a vehicle such as a bus, and the bus according to the present invention can move to a place where there are students who are difficult to experience various experiences by living in an underprivileged area, and it is difficult to easily access virtual reality. have.

Effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a diagram illustrating a system for providing virtual reality content according to an embodiment of the present invention.
2 is a diagram illustrating a method for providing virtual reality content according to an embodiment of the present invention.
3 is a diagram illustrating a method for providing virtual reality content according to another embodiment of the present invention.
4 is a block diagram schematically showing the configuration of the content transmission apparatus 100 according to an embodiment of the present invention.
5 is a block diagram schematically illustrating a configuration of a mobile device 200 according to an embodiment of the present invention.
6 is a block diagram schematically showing the configuration of the HMD device 300 according to an embodiment of the present invention.
7 is a block diagram showing the configuration of the content transmission apparatus 100 and the mobile device 200 involved in brightness control according to an embodiment of the present invention.
8 is a diagram for explaining the content transmission apparatus 100 involved in luminance control according to an embodiment of the present invention.
9 is a flowchart illustrating a luminance control method according to an embodiment of the present invention.
10 is a flowchart illustrating a method of providing content when a distance between a mobile device and a user is less than or equal to a threshold value according to an embodiment of the present invention.
11 is a flowchart illustrating a method of providing an eyesight protection mode of the content transmission apparatus 100 according to an embodiment of the present invention.
12 is a flowchart illustrating a method in which a stop signal is applied to a control device according to an embodiment of the present invention.
13 is a flowchart illustrating a method in which an angle adjustment signal is applied to the simulator 400 according to an embodiment of the present invention.
14 is a block diagram illustrating a system in which an angle adjustment signal is applied to the simulator 400 according to an embodiment of the present invention.
15 is a flowchart illustrating a method of controlling the mobile device 200 and the simulator 400 using a sensor according to an embodiment of the present invention.
16 is a block diagram illustrating a system for controlling the mobile device 200 and the simulator 400 using a sensor according to an embodiment of the present invention.

Advantages and features of the present invention and methods of achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but will be implemented in various different forms, and only these embodiments allow the disclosure of the present invention to be complete, and to completely inform those skilled in the art of the scope of the invention It is provided for purposes of illustration, and the present invention is defined only by the scope of the claims.

When one element is referred to as “connected to” or “coupled to” with another element, it means that it is directly connected or coupled to another element, or when another element is intervening. Includes all cases where elements are interposed. On the other hand, when one component is referred to as “directly connected to” or “directly coupled to” with another component, it indicates that another component is not interposed therebetween.

Like reference numerals refer to like elements throughout.

As used herein, “and/or” includes each and every combination of one or more of the recited items.

Although first, second, etc. are used to describe various components, modules, and/or sections, it should be understood that the components, modules, and/or sections are not limited by these terms. These terms are merely used to distinguish one component, module, or sections from another component, module, or sections. Accordingly, it goes without saying that the first component, the first module, or the first section mentioned below may be the second component, the second module, or the second section within the spirit of the present invention.

As used herein, the singular also includes the plural, unless the phrase specifically states otherwise.

As used herein, “comprises” and/or “comprising” refers to the presence or addition of one or more other components, modules and/or sections in addition to the stated components, modules and/or sections. do not exclude

Unless otherwise defined, all terms (including technical and scientific terms) used herein will have the meanings commonly understood by those of ordinary skill in the art. In addition, terms defined in the dictionary are not to be interpreted ideally or excessively unless specifically defined explicitly.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a system for providing virtual reality content according to an embodiment of the present invention.

Referring to FIG. 1 , the content transmission apparatus 100 , the mobile device 200 , the HMD apparatus 300 , and the simulator 400 are connected to each other through a network. The content transmission apparatus 100 , the mobile device 200 , the HMD apparatus 300 , and the simulator 400 may transmit/receive data and/or information to and from each other through a network.

The network may be configured as a network of various sizes, such as a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), and the like. The network may be configured as a wired or wireless network.

The content transmission apparatus 100 is installed inside a vehicle and provides content or an effect control signal according to the content to the mobile device 200 . Through this, it means a terminal that transmits content to the mobile device 200 . The effect control signal may be a signal that causes the simulator to vibrate, that is, to shake and move. The simulator oscillating according to the effect control signal has a characteristic of performing motion including driving of roll, pitch, and heave.

The content transmission device 100 is managed by a subject operating a vehicle providing virtual reality content, and generates an effect control signal for controlling the fluctuation of the simulator 400 according to the content, and uses the generated effect control signal to the simulator. Send to 400. That is, the content transmission device 100 receives time information according to the content reproduction from the HMD device 300 in real time, and performs synchronization through communication with the simulator 400 using the time information to generate an occurrence at the corresponding time. Sends an effect control signal to the simulator.

As described above, the contents transmitted by the content transmission device 100 to the mobile device 200 are, for example, educational games, educational travel contents, educational movies/dramas, educational music videos, educational animations, new experiences, vocational education programs, and technology. It may include educational programs or programs related to subjects such as mathematics and science.

In addition, while providing the content, the user may be aware of the user's personal characteristics such as age, gender, weight, height, and eye fatigue, or the characteristics of the content such as the type of content, the resolution of the content, and the saturation of the content. Depending on the type, you may experience eye strain or cybersickness differently. For example, younger users feel eye fatigue faster than adult users, and when the luminance of content is high, eye fatigue is increased and cybersickness is amplified.

On the other hand, if the brightness of the content is lowered, the resolution is lowered, which prevents the user from immersing in the virtual reality content. Therefore, it is necessary to reduce the resolution of the content to reduce eye fatigue and avoid cybersickness, while maintaining a certain resolution so that you can immerse yourself in the content.

To this end, the present invention provides content at a lower resolution, while providing content below a certain level of resolution for an immersive feeling. Therefore, the length of the content is limited according to the characteristics of the user and the content as described above. In the present invention, considering that more than 80% of users who have experienced virtual reality for more than 20 minutes feel cybersick and that educational content is provided to students, it is recommended to limit the length of the content from 5 minutes to 10 minutes. desirable.

Also, the length of the content may be controlled by cutting off the power provided to the HMD device 300 . That is, when content is provided beyond a limited time in consideration of the characteristics of the user wearing the HMD device 300 and the characteristics of the content, the content may be terminated by cutting off the power provided to the HMD device 300 .

Meanwhile, in this specification, the description that the content transmission apparatus 100 transmits or provides content to the mobile device 200 means that the content transmission apparatus 100 transmits the above content to the mobile device 200, This should also be understood as the same meaning as providing the corresponding content to the user of the mobile device 200 disposed on the seat in the vehicle.

Similarly, in the present specification, an action of the content transmission apparatus 100 may be understood as an action performed by a user's manipulation of the content transmission apparatus 100 .

The content transmission device 100 may be, for example, a personal computer (PC) such as a desktop, a laptop, a mobile terminal, and a smart phone. The content transmission device 100 may be another computing device not illustrated.

The HMD apparatus 300 is connected to the mobile device 200 , and receives and displays the content transmitted by the content transmission apparatus 100 to the mobile device 200 from the mobile device 200 . The HMD device 300 provides a virtual reality effect when displaying content. For example, assuming that the content is a roller coaster, the HMD device 300 provides a feeling of riding a real roller coaster to users wearing the HMD device 300 .

The HMD device 300 transmits time information according to content reproduction to the content transmission device 100 in real time. Then, the content transmission device 100 performs synchronization with the simulator 400 using the time information.

The HMD device 300 is arranged for each seat or person in the vehicle, and when wearing of the HMD device is notified, users wear the HMD device 300 on their head.

The HMD device 300 has, for example, a communication function and a data processing function, and may be in a form that can be worn on the user's head, and the HMD device 300 worn by the user is a screen Display the content on the screen. In this case, the HMD device 300 may display content in a preset size at a preset location. Also, the HMD device 300 may have the form of glasses. The HMD device 300 may be temporarily fixed to the user's head by a frame or the like.

There are two types of the HMD device 300 , a first type having a CPU and a display, and a second type, which can be used by mounting the mobile device 200 in the HMD device 300 . In the case of the second type, the mobile device 200 controls the HMD apparatus 300 to display content.

The first type has the same structure as (a), and the HMD device 300 receives and displays the content from the content transmission device 100 .

The second type has the same structure as (b), and the HMD apparatus 300 is connected to the mobile device 200 through wired or wireless communication. The mobile device 200 receives content from the content transmission apparatus 100 , and the HMD apparatus 300 receives and displays the content from the mobile device 200 .

In the second type, the HMD apparatus 300 may be communicatively connected to the mobile device 200 , and the HMD apparatus 300 is designed to output content transmitted from the mobile device 200 . In this case, the HMD apparatus 300 receives the content from the mobile device 200 through a mirrorcast technology or the like, and displays the received content on the display.

The mobile device 200 connected to the HMD device 300 includes a smart phone, a tablet PC, a PC, a smart TV, a mobile phone, a personal digital assistant (PDA), a laptop, a media player, a micro server, a global positioning system (GPS) device, and an electronic device. It may be a book terminal, a digital broadcasting terminal, a navigation device, a kiosk, an MP3 player, a digital camera, and other mobile computing devices, but is not limited thereto. Also, the mobile device 200 may be a watch or a band having a communication function and a data processing function, but is not limited thereto.

As such, the mobile device 200 and the HMD apparatus 300 are connected to each other through wired or wireless communication. For data pairing between the HMD device 300 and the mobile device 200 , a mirrorcast technology or a wifi-direct technology may be applied.

The simulator 400 is connected to the content transmission device 100 and generates an effect synchronized with the content according to an effect control signal transmitted from the content transmission device 100 .

The simulator 400 may include a simulation chair 410 on which a user sits when viewing content or a simulation effect device 420 installed in a vehicle to provide various effects to the audience in conjunction with the content. When the content starts, the simulation chair 410 provides motion and vibration according to the content, and the simulation effect device 420 matches the content in real time with snow, rain, wind, dew, fog, heavy rain, lightning, fragrance, light. effects such as

In addition, the simulation effect device 420 may include an effect device capable of spraying air or water to the ankle, face, neck, etc. of the audience. That is, an effect device such as a leg tickle, a face shot, a neck shot, a water spray shot, a vibration, etc. is provided on one side of the chair, and accordingly, the user can receive stimulation not only visually and auditory but also the tactile sense. You will be able to watch while being more immersed in it.

The simulator 400 may include a function unit for driving devices that internally implement actual special effects, that is, a plurality of effect devices, and this function unit includes a program necessary to control the effect devices, that is, firmware. ) is installed. The firmware is usually recorded in a storage space within the functional unit, specifically, a ROM, and includes control commands for effect devices constituting the simulator 400 . The functional unit in which the above firmware is installed receives the effect control signal from the content transmission device 100 and then controls the effect devices through the firmware.

The simulator 400 is provided with a separate control device in order to stop the simulator 400 by operating the user. When the user operates the control device, the simulator stops. The control device is not limited to a switch, a lever, or the like.

The simulator 400 may be provided with seat belt attachment brackets on both sides and in the center, so that the user can wear the seat belt mounted there, so that the user can watch the image with confidence, and The problem of safety accidents can be completely eliminated.

The simulator 400 synchronizes time codes in order to communicate with the content transmission apparatus 100 in real time during content presentation. That is, the content transmission device 100 and the simulator 400 perform time code synchronization to match the cross-referenced time information when the content is started to be screened. 400), even if an unexpected variable occurs, such as when a sudden error occurs and initialization is attempted, an appropriate action can be taken at an appropriate time by referring to the time code shared with the simulator 400.

When explaining the actuator constituting the simulation chair 410 of the present invention, the actuator refers to a mechanical device used to move or control an object, and electric (Electricity), hydraulic (Oil Pressure), pneumatic (Air Pressure), etc. use the

In the present invention, an electric actuator is used, and the electric type is usually referred to as a motor type, and the type of the motor is usually a servo motor or a brushless direct current motor (BLDC). It is difficult to make the actuator that makes the movement of the chair small and light, but the speed and position control for the movement are excellent. The movement of each chair is almost identical, it can create various motions, and it can operate only with electricity.

Simulation chair 410 according to the present invention, roll (Roll), pitch (Pitch) and heave (Heave) driving is possible. Various movements can be given by using a large number of actuators, but in this case, power consumption is high, and the nature of the simulation chair 410 viewed by a large number of unspecified visitors may give a burden to the weak. On the other hand, if the number of actuators is reduced to limit the movement, it is impossible to provide various motions of the chair to the audience.

Accordingly, the present inventors believe that it is most preferable that the simulation chair 410 drives the roll, pitch and heave, and for this purpose, the simulation chair 410 can provide various movements with three actuators and a spline, while a plurality of It is preferable because the structure is relatively simple compared to that including the actuator, so the manufacturing cost is low, and the power used when the simulation chair is moved is small.

The actuator includes one central actuator and two side actuators. Although more actuators may be employed as described above, it is most preferred to consist of three actuators. This is because the use of a 3-axis actuator can bend the chair depending on the number of surfaces. For example, four points in space have one or four sides, so a chair can be bent to create a new surface, whereas three points can make only one surface spatially, so the chair does not bend.

The lower plate is installed in contact with the floor of the vehicle. The lower plate may be fastened to the floor structure of the vehicle by fastening means such as bolts and anchor bolts.

The upper plate is positioned above and spaced apart from the lower plate. A chair is fastened to this upper plate.

The first actuator is installed on the left side between the lower plate and the upper plate to have a first angle with the horizontal centerline of the lower plate. The first actuator drives the left side of the upper plate.

The second actuator is installed on the right side between the lower plate and the upper plate to have a second angle with the horizontal centerline of the lower plate. The second actuator drives the right side of the upper plate.

The third actuator is installed in a central portion between the lower plate and the upper plate so as to be parallel to the horizontal center line on the same line as the longitudinal center line. The third actuator mainly drives the central portion of the upper plate.

Each of the actuators is fixedly installed on the upper plate and the lower plate, and is connected to the guide part on which the rail is formed, so that each actuator slides back and forth along the rail. In addition, when the angle is not changed because the fixing part is further included so that the actuators can be fixed, each actuator is fixed.

A spline is installed between the lower plate and the upper plate. A spline is located in the center of the lower plate adjacent to the third actuator. The spline connects the lower plate and upper plate to support stable movement.

A central horizontal axis along the direction in which the four chairs are arranged is defined as an x-axis, a central vertical axis connecting the front and rear surfaces of the simulation chair 410 as a y-axis, and a central axis connecting the upper and lower sides of the simulation chair 410 as a z-axis.

The roll driving refers to driving in which the left side of the motion chair assembly rises and the right side descends at the same time, or, conversely, the left side descends and the right side rises about the y-axis. The pitch driving refers to driving in which the front side of the motion chair assembly rises and the rear side descends at the same time, or, conversely, the front side descends and the rear side rises about the x-axis. Heave actuation refers to actuation in which the entire motion chair assembly rises or descends along the z-axis.

During roll driving, one of the side actuators rises and the other side actuator descends. In pitch driving, either the side actuators are all raised and the center actuator is lowered, or both the side actuators are lowered and the center actuator is raised. Upon heave actuation, all actuators are raised or all actuators are lowered.

The actuator includes a servo motor, a speed reducer, a crank rod, a bearing, and a speed reducer shaft, the servo motor generates a rotational driving force, and the speed reducer is a power generating device connected to the motor shaft to decrease the number of rotations to increase the torque, The crank rod receives power from the servo motor to perform vertical translational motion with a cam motion, the bearing transmits and supports the rotation motion of the servo motor to the crank rod, and the reducer shaft transmits power from the servo motor to the crank rod.

Meanwhile, the virtual reality content screening system configured as described above may further include a content providing server that provides content to the content transmission device. A content providing server may be separately connected to a network to receive a content providing request from the content transmitting apparatus 100 , and may provide content to the content transmitting apparatus 100 in response to the received content providing request.

2 is a diagram illustrating a method for providing virtual reality content according to an embodiment of the present invention.

Referring to FIG. 2 , the content transmission device 100 transmits content to the HMD device 300 ( S210 ), the HMD device 300 displays the content ( S220 ), and transmits time information according to content reproduction. It is transmitted to the device 100 (S230). When the HMD device 300 displays content, a virtual reality effect is provided.

The content transmission device 100 synchronizes the time information transmitted from the HMD device 300 through communication with the simulator 400 (S240), and transmits an effect control signal for an effect to occur at the corresponding time to the simulation device. do (S250). The effect control signal may be a signal for generating an effect suitable for content reproduced by the HMD device 300 .

Upon receiving the effect control signal, the simulator 400 generates an effect synchronized with the content (S260). That is, when the content starts, the simulation chair 410 provides motion or vibration according to the content. The simulation effect device 420 generates simulation effects such as snow, rain, wind, dew, fog, heavy rain, lightning, fragrance, and light in real time according to the contents.

3 is a diagram illustrating a method for providing virtual reality content according to another embodiment of the present invention.

Referring to FIG. 3 , the content transmission apparatus 100 transmits the content to the mobile device 200 connected to the HMD apparatus 300 ( S310 ), and the mobile device 200 stores the transmitted content ( S320 ). The content transmission apparatus 100 and the mobile device 200 adjust the luminance (S330). The content transmission apparatus 100 transmits a content reproduction start signal to the mobile device 200 (S340), and the mobile device 200 transmits the content to the HMD apparatus 300 (S350). In this case, the mobile device 200 transmits the content to the HMD device 300 through a mirrorcast technology or a wifi-direct technology.

Then, the HMD device 300 displays the content (S360) and transmits time information according to the content reproduction to the content transmission device 100 (S370).

The content transmission device 100 performs synchronization through communication with the simulator 400 using the time information transmitted from the HMD device 300 (S380), and transmits an effect control signal to be generated at the corresponding time to the simulation device. (S390).

The simulation device receiving the effect control signal generates an effect synchronized with the currently reproduced content (S400).

4 is a block diagram schematically showing the configuration of the content transmission apparatus 100 according to an embodiment of the present invention.

Referring to FIG. 4 , the content transmission apparatus 100 includes a database 110 , a communication unit 120 , a content service unit 130 , a start signal transmission unit 140 , a mobile device control unit 150 , and a time information receiving unit 160 . ), and an effect control unit 170 , and a terminal control unit 180 .

The database 110 stores information about content.

The communication unit 120 is configured to transmit/receive data to and from various electronic devices. Specifically, the communication unit 120 is configured to connect the content transmission apparatus 100 to the mobile device 200 , the HMD apparatus 300 , the simulator 400 , or the content providing server through a wired communication network or a wireless communication network.

The content service unit 130 extracts the content from the database 110 and transmits it to the mobile device 200 or the HMD device 300 .

When the communication unit 120 receives a content provision request from the content transmission apparatus 100 , the content service unit 130 provides the content to the content transmission apparatus 100 in response to the received content provision request.

The start signal transmitter 140 transmits the content reproduction start signal to the mobile device.

The mobile device controller 150 transmits the content to the HMD apparatus through the mobile device, and causes the HMD apparatus to display the content.

The time information receiving unit 160 receives the time information according to the content reproduction, and the effect control unit 170 receives the time information according to the content reproduction from the HMD device, and synchronizes the time information with the simulator through communication with the simulator. and transmits an effect control signal to be generated at a corresponding time to the simulator, and synchronizes with the content in the simulator according to the effect control signal.

Also, the effect control unit 170 transmits an effect control signal for an effect to be generated at a corresponding time to the corresponding simulator. Here, the effect control signal may be a signal to implement any one or more effects of motion, vibration effect, snow, rain, wind, dew, fog, fragrance, and light.

Meanwhile, each of the content service unit 130 and the effect control unit 170 may be implemented by a processor or the like required to execute a program on a computing device. As such, each of the content service unit 130 and the effect control unit 170 may be implemented by each physically independent configuration, or may be implemented in a functionally separate form within one processor.

The terminal control unit 180 includes a database 110 , a communication unit 120 , a content service unit 130 , a start signal transmission unit 140 , a mobile device control unit 150 , a time information receiving unit 160 , and an effect control unit 170 . ) is a configuration for controlling the operation of various components of the content transmission apparatus 100 including The terminal control unit 180 may include at least one arithmetic unit, where the arithmetic unit is a general-purpose central processing unit (CPU), a programmable device device (CPLD, FPGA) implemented appropriately for a specific purpose, and an application-specific semiconductor. It may be an arithmetic unit (ASIC) or a microcontroller chip.

The terminal controller 180 may control to display the content in the eyesight protection mode. That is, the reference length of time is stored inside the content transmission device 100 so that if the time of the contents exceeds this, the contents are automatically displayed in the eyesight protection mode, or initially stored in the contents transmission device 100 or selected by the user. When a program using the eyesight protection mode is executed, content may be displayed in the eyesight protection mode.

In addition, when the terminal controller 180 receives the user biometric information from the mobile device 200 and it is confirmed that the user is in a tired state, the method may include providing content in an eyesight protection mode according to the command of the terminal controller 180. can

In addition, the terminal controller 180 may control to end the eyesight protection mode and display the screen in the normal mode. The eyesight protection mode end command may be defined in various ways, such as clicking or touching an end icon or using a separate button to end the eyesight protection mode.

5 is a block diagram schematically illustrating a configuration of a mobile device 200 according to an embodiment of the present invention.

In FIG. 5 , the mobile device 200 includes a processor 210 , a display unit 220 , a communication unit 230 , a proximity sensor unit 240 , a memory unit 250 , an environmental luminance measurement unit 260 , and a light emitting module ( 270 , the mobile device 200 may include other electronic components, a USB terminal, a Mobile High-Definition Link (MHL) terminal, and the like.

In the mobile device 200 , the first type is to receive content from the content transmission apparatus 100 through the communication unit 230 and transmit the content to the HMD apparatus, and in the second type, the processor 210 directly uses the display unit 220 . ) to receive the user's input and transmit the content to the HMD device.

The processor 210 controls the display 220 . The processor 210 determines a screen to be displayed by the display 220 . When the processor 210 identifies a connection with the HMD device 300 , the processor 210 may display image content lists on the display unit 220 .

Also, when the processor 210 identifies a connection with the HMD device 300 , the processor 210 executes a program or application related to the HMD device 300 , and the processor 210 may access a site providing content.

The user may select any one from the displayed content list, and the processor 210 transmits the selected content to the HMD device 300 . The content may be downloaded through the Internet or stored in the memory unit 250 .

The processor 210 receives a user input from the display 220 . The processor 210 may change the state of the display 220 or transmit data to the HMD device 300 according to a user's input.

The processor 210 may transmit content to the HMD device 300 based on a signal received from the proximity sensor unit 240 . The proximity sensor unit 240 measures the distance between the mobile device 200 and the user, and outputs the measured distance to the processor 210 . The processor 210 may determine whether to transmit the content to the HMD device based on the measured distance. For example, the processor 210 transmits the content to the HMD device 300 when the measured distance is equal to or less than a threshold value.

The environmental luminance measuring unit 260 measures the environmental luminance of the screen portion when the mobile device 200 is connected to the HMD apparatus 300 and then worn by the user.

The light emitting module 270 includes a light emitting means to adjust the luminance of the mobile device.

6 is a block diagram schematically showing the configuration of the HMD device 300 according to an embodiment of the present invention.

Referring to FIG. 6 , the HMD device 300 includes a communication unit 310 , a display unit 320 , a control unit 330 , and a memory unit 340 .

The communication unit 310 is configured to transmit/receive data to and from various electronic devices. Specifically, the communication unit 310 is configured to transmit and receive information necessary for enabling the HMD apparatus 300 to display content and change the displayed content with the content transmission apparatus 100 or the mobile device 200 .

The display unit 320 displays information processed by the HMD device 300 . In particular, the display unit 320 may display content.

Content output through the display unit 320 may overlap with a general view.

The memory unit 340 stores information necessary for enabling the HMD device 300 to display content and change the displayed content.

The controller 330 typically controls the overall operation of the HMD device 300 . For example, the controller 330 may control the communication unit 310 and the display unit 320 by executing programs stored in the memory unit 340 .

The control unit 330 controls the content received through the communication unit 310 to be displayed on the display unit 320 .

Also, the control unit 330 provides time information according to content reproduction to the content transmission apparatus 100 in real time.

The HMD apparatus 300 may be connected to at least one of the content transmission apparatus 100 and the mobile device 200 , and by receiving content from at least one of the content transmission apparatus 100 and the mobile device 200 , the HMD apparatus Content can be displayed on the screen of 300 .

The control unit 330 is a component that controls operations of various components of the HMD device 300 including the communication unit 310 , the display unit 320 , and the memory unit 340 . The control unit 330 may include at least one arithmetic unit, where the arithmetic unit is a general-purpose central processing unit (CPU), a programmable device device (CPLD, FPGA) implemented appropriately for a specific purpose, and an application-specific semiconductor operation. It can be a device (ASIC) or a microcontroller chip.

7 is a block diagram showing the configurations of the content transmission apparatus 100 and the mobile device 200 involved in luminance control according to an embodiment of the present invention, and FIG. 8 is a luminance control according to an embodiment of the present invention. It is a diagram for explaining the content transmission apparatus 100 involved.

Referring to FIG. 7 , the content transmission apparatus 100 includes an average luminance level calculator 181 , a threshold determiner 182 , a storage 183 , and a luminance controller 184 , and the mobile device 200 ) includes an environmental luminance measuring unit 260 and a light emitting module 270 .

The terminal controller 180 causes the mobile device 200 to allow the environment luminance measuring unit 260 of the mobile device to measure the ambient luminance of the mobile device 200 . The environmental luminance measuring unit 260 is preferably installed to measure the environmental luminance of the screen portion when the mobile device 200 is connected to the HMD apparatus 300 and then worn by the user.

The threshold value determining unit 182 of the content transmission apparatus 100 uses the environmental luminance measured by the environmental luminance measuring unit 260 and a preset glare index value for the threshold of the mobile device 200 at which the glare phenomenon starts to occur. Calculate the screen luminance. The glare index (UGR: Unified Glare Rating) is proposed by the CIE technical committee 3-31 as a practical glare rating system based on general parameters affecting unpleasant glare. Such a glare index is obtained through Equation 1 below, and looking at the relationship between the glare index and subjective feeling, when the glare index value is "10" or more, glare starts to be felt, and when the glare index value is "16" or more When the glare index value is "22" or higher, you start to feel uncomfortable, and when the glare index value is "28" or higher, you start to feel too severe. Accordingly, it is an object of the present invention to provide a mobile device that adjusts the emission luminance of the light emitting module 270 so that the glare index value is “10” or less.

Equation 1

Here, Lb is the luminance of the surrounding environment, Ls is the luminance of the light source within the observer's line of sight, ω is the solid angle of the light source within the eye of the observer, and p is the position index of Guth of each light source within the eye of the observer. The units of Lb (peripheral luminance) and Ls (luminescence luminance) are [cd/m 2 ].

That is, the threshold determining unit 182 substitutes the environmental luminance measured by the environmental luminance measuring unit 260 and the glare index value “10” in Equation 1 to calculate Ls, where Ls is the glare phenomenon starts to occur. is the threshold screen luminance of the mobile device 200 .

In addition, the threshold determining unit 182 derives a threshold average luminance level corresponding to the threshold emission luminance, which is derived from the stored value by measuring the screen luminance of the mobile device 200 for each value of the average luminance level. Accordingly, the threshold determining unit 182 further includes a storage unit 183 to store data for determining the threshold emission luminance and the threshold average luminance level.

The average luminance level (APL) calculator 181 calculates an average luminance level of the content based on the luminance of each pixel constituting the frame of the input content. The input content is a content signal processed by the content service unit 130 or a content signal input to the content service unit 130 .

The luminance control unit 184 is configured to control the mobile device ( The luminance of the light emitting module 270 is controlled so that the luminance of the screen 200) does not exceed the threshold luminance of the screen. Preferably, the light emitting means provided in the light emitting module 270 is an LED or CCFL, and when the light emitting module 270 is a liquid crystal display, it is preferably a backlight module.

Since the screen luminance of the mobile device 200 does not exceed the threshold screen luminance to prevent glare, when the average luminance level of the content exceeds the threshold average luminance level, the light emitting luminance of the light emitting module 270 is controlled. The screen luminance of the mobile device 200 does not exceed the threshold screen luminance.

That is, when the average luminance level of the content calculated by the average luminance level calculator 181 exceeds the threshold average luminance level of the content derived from the threshold value determiner 182, the luminance control unit 184 controls the light emitting module. Reference numeral 270 reduces the emission luminance of light. For example, the closer the value is to the average luminance level, the smaller the degree of reducing the emission luminance of the light emitting module 270 is.

In addition, the luminance control unit 184 is in a state in which the emission luminance of the light emitting module 270 is reduced by a predetermined value from the maximum value that can emit light, and the average luminance level of the content calculated by the average luminance level calculation unit 181 is equal to that of the content. When the content derived from the threshold determining unit 182 is less than the threshold average luminance level, the light emitting luminance of the light emitting module 270 is increased. Through this, it provides a clear and bright screen brightness.

As a result, the content transmission apparatus 100 of the present invention configured as described above appropriately maintains the screen brightness of the mobile device 200 to prevent glare from occurring according to the environmental brightness, while providing a clear and bright screen brightness to the viewer. allows you to enjoy content comfortably.

In addition. The content transmission apparatus 100 of the present invention configured as described above reduces power consumption by preventing the screen brightness from exceeding the threshold screen brightness, so that the power of the mobile device 200 can be maintained for a long time.

9 is a flowchart illustrating a luminance control method according to an embodiment of the present invention.

The content transmission apparatus 100 allows the mobile device 200 to measure the ambient environment luminance and transmit the measured environment luminance to the content transmission apparatus 100 (S910), and the content transmission apparatus 100 measures the measured environment luminance (S910). The threshold screen luminance of the mobile device 200 at which glare starts to occur is calculated using the luminance and a preset glare index value ( S920 ). The glare index value is a value determined by the CIE technical committee 3-31 (CIE technical committee 3-31), and "10" is applied to start to feel the glare.

Then, an average picture level (APL) threshold value of content corresponding to the calculated threshold screen luminance is derived (S930). This is derived from the stored value by measuring the screen luminance of the mobile device 200 for each value of the average luminance level in advance.

Then, the content transmission apparatus 100 calculates the average luminance level of the content by using the luminance of each pixel constituting the frame of the input content (S940), and the calculated average luminance level of the content is the average luminance level of the content. When the threshold is exceeded (S950), the brightness of the light emitting module 370 is adjusted to prevent the screen brightness of the mobile device 200 from exceeding the threshold screen brightness (S960). The input content is a content signal processed by the content service unit 130 or a content signal input to the content service unit 130 .

10 is a flowchart illustrating a method of providing content when a distance between a mobile device and a user is less than or equal to a threshold value according to an embodiment of the present invention.

In step S1010 , the mobile device 200 identifies a connection between the mobile device 200 and the HMD apparatus 300 . When the mobile device 200 and the HMD apparatus 300 are connected, the mobile device 200 may execute a program or an application.

In step S1020 , when the mobile device 200 and the HMD apparatus 300 are connected, the mobile device 200 displays a content list on the HMD apparatus 300 . The list may be content provided from the Internet or content stored in the memory unit 250 .

In step S1030 , the mobile device 200 receives an input for selecting any one content from the list from the user.

In steps S1040 and S1050 , the mobile device 200 may measure the distance between the mobile device 200 and the user, and determine whether to transmit the content to the HMD apparatus 300 based on the measured distance. For example, the processor 210 transmits the content to the HMD device 300 when the measured distance is equal to or less than a threshold value.

If the measured distance is equal to or less than the threshold value, it may be a case in which the user brings the HMD device 300 to the face to view the content. If the measured distance is equal to or greater than the threshold, the mobile device 200 does not transmit the content because the user does not view the content.

In steps S1040 and S1050 , in addition to the distance between the user and the mobile device 200 , the mobile device 200 includes means for recognizing the user's wearing of the mobile device 200 . Examples include dimming of ambient brightness, iris recognition, and biometric recognition such as face recognition.

In step S1060 , the mobile device 200 transmits the content to the HMD device 300 .

Each of the steps described in FIG. 10 may be stored in the memory unit 250 in the form of a program or may be executed by the processor 210 .

11 is a flowchart illustrating a method of providing an eyesight protection mode of the content transmission apparatus 100 according to an embodiment of the present invention.

The method of providing the eyesight protection mode of the content transmission apparatus 100 according to an embodiment of the present invention shown in FIG. 11 may be performed by the content transmission apparatus 100 described above with reference to FIG. 4 . That is, the method of providing the eyesight protection mode of the content transmission device 100 may be performed by an application program such as application software that is stored in the database 110 and may be executed by the terminal controller 180 .

Referring to FIG. 11 , in the method for providing the eyesight protection mode of the content transmission apparatus according to an embodiment of the present invention, when the eyesight protection mode use program initially stored in the contents transmission apparatus 100 or selected by the user is executed, the eyesight It may include displaying the content in a protected mode.

For example, when the program for using the eyesight protection mode includes a virtual reality content providing program, a web browser program, an e-book program, etc., when the user executes a web browser program or an e-book program, the terminal controller 180 automatically The content transmission apparatus 100 may be controlled to display the screen in the eyesight protection mode. The list of programs using the eyesight protection mode may be stored in the database 110 of the content transmission device 100, may be initially stored in the contents transmission device 100, and the user may select a specific program to use the eyesight protection mode You can also add it to your program list.

When the eyesight protection mode use program is executed, the step of displaying the screen in the eyesight protection mode may be performed at various time points. As an example, the step of adjusting the brightness of the content provided by the content transmission apparatus 100 involved in brightness control of the present invention and the step of displaying the screen in the eyesight protection mode may occur simultaneously. For example, the content transmission apparatus 100 may adjust the luminance of the content of the mobile device according to the ambient luminance, while adjusting the luminance, contrast ratio, and color temperature of the mobile device 200 according to the time of the content or the user's state. .

As an example, the eyesight protection mode sets the luminance of the content transmitted from the content transmission device 100 to 180 to 185 nits, and sets the contrast ratio (C/R) to 30:1 to 32:1, The color temperature may be set to 5000 to 6000K, preferably 5600K. In other words, in general, content is displayed with a luminance of 500 needs, a contrast ratio of 1000:1, and a color temperature of 6000 to 7000 K. will be. In addition, in general, the color gamut can display the screen by about 72%, whereas the eye protection mode can display the screen with the color gamut lowered by about 25%. As described above, the eyesight protection mode provides a screen similar to an actual paper by lowering luminance, contrast ratio, and color temperature, so that the user can comfortably view the screen.

The method of providing the eyesight protection mode of the content transmission apparatus according to an embodiment of the present invention may include the step of determining, by the terminal control unit 180, the length of time the user has used the content transmission apparatus 100 (S1110).

In the method for providing an eyesight protection mode of a content transmission apparatus according to an embodiment of the present invention, when the length of the usage time of the content transmission apparatus 100 has a value greater than the reference time length, according to the command of the terminal controller 180 It may include providing the content in the eyesight protection mode (S1120). Otherwise, the content transmission apparatus 100 may further include receiving the user's biometric information from the biometric information measuring unit of the mobile device 200 (S1130). The reference time length may have an initial value stored in the content transmission apparatus 100, and may be changed by a user's selection.

In addition, in the method for providing the eyesight protection mode of the content transmission apparatus according to an embodiment of the present invention, the biometric information measuring unit may be included in the mobile device 200 , and the user's biometric information may be measured and transmitted to the terminal controller 180 , , the user's biometric information may include, as an example, at least one of blood pressure, body temperature, heart rate, activity amount, electrocardiogram, body fat mass, water content, stress response, blood sugar, and oxygen saturation in blood.

In addition, in the method for providing the eyesight protection mode of the content transmission apparatus according to an embodiment of the present invention, when the content transmission apparatus 100 receives the user's biometric information from the mobile device 200 and it is confirmed that the user is in a tired state, the terminal controller It may include the step of providing the content in the eyesight protection mode according to the command of (180) (S1140, S1150).

Also, the method for providing the eyesight protection mode of the content transmission apparatus 100 according to an embodiment of the present invention may include displaying a screen in a normal mode according to a user's command to end the eyesight protection mode.

That is, when the user inputs a command to end the eyesight protection mode to the content transmission device 100 , the terminal controller 180 may control the end of the eyesight protection mode and display the screen in the normal mode. The eyesight protection mode end command may be defined in various ways, such as clicking or touching an end icon or using a separate button to end the eyesight protection mode.

12 is a flowchart illustrating a method in which a stop signal is applied to a control device according to an embodiment of the present invention.

In the following embodiment, in addition to the simulation chair 410 according to the present invention, there may be a simulation effect device 420 for imparting a special effect.

First, a control signal is separately set according to the provided content (S1210). This may be set according to a separate standard for maximizing the effect of receiving the content from the person receiving the content.

Next, the set signal is input to the simulator (S1220). Then, the content is provided according to the input control signal (S1230), and the simulation chair 410 and the simulation effect device 420 are driven (S1240). Since the control signal is synchronized with the signal controlling the simulation chair 410 and the simulation effect device 420 according to the content time, the steps S1230 and S1240 are performed simultaneously. According to the synchronized signal, the simulation chair 410 and the simulation effect device 420 are driven according to the content of the provided content.

An unexpected situation may occur during content provision, and in some cases, it may be necessary for a person to be provided with the content to move outside the content providing facility.

In an embodiment of the present invention, a separate stop signal is applied to the control device when an unexpected situation occurs (S1250). The procedure for applying the stop signal may be manually applied by a separate operating person located at the seat, or a switch may be located adjacent to the person receiving the content from the seat and may be applied by that person, or It can also be automatically applied by a separate device that monitors the status.

When the stop signal is applied manually or automatically, the control device may stop the driving of the simulation chair 410 and the simulation effect device 420 (S1251).

Thereafter, when a return signal is manually or automatically applied to the control device (S1252), the simulation chair 410 and the simulation effect device 420 are re-driven.

13 is a flowchart illustrating a method in which an angle adjustment signal is applied to a simulator according to an embodiment of the present invention.

The content transmission device 100 measures the pressure applied to the simulator 400 by the sensor unit (S1310). When the weight is greater than a certain weight, a large load is applied when the simulator 400 is driven, making it difficult to stably drive the simulator 400 , and the friction generated in the simulator 400 by the load, and noise and vibration caused by the load are also greater. For example, when a user with a large weight rides on the simulator 400 , a load on each actuator is greater when the simulator is driven than when a user with a small weight rides on the simulator 400 .

At this time, as the actuators are more widely distributed under the simulator, more stable operation is possible. Therefore, the actuator of the simulator moves according to the user's weight to provide stable driving.

The content transmission device 100 receives the pressure information measured by the sensor unit from the simulator 400 (S1320).

The content transmission apparatus 100 identifies the position of the actuator included in the simulator 400 and receives the corresponding position information (S1330). Based on the current position of the actuator of the simulator, the position may be changed according to the pressure signal in the following step.

The content transmission device 100 calculates the angle of the actuator included in the simulator 400 according to the pressure information (S1340). The angle that needs to be corrected is calculated based on the pressure information corresponding to the user's weight.

The content transmission apparatus 100 adjusts the angle of the actuator by changing the position of the actuator according to the calculated angle (S1350). In the simulator, by changing the position of the actuator by the corrected angle, the simulator can be driven stably, while the angle of the actuator is changed within an angle where the component in the Y-axis direction is minimized to generate noise and vibration caused by friction in the simulator. can be reduced and power loss can also be prevented.

However, in the simulator 400, the position of the actuator adjusted according to the user's weight may not be limited to the angle at which the component force in the Y-axis direction is minimized. For example, since the stability of the simulator decreases as the weight of the user increases, the position of the actuator may be adjusted with the stability of the simulator as the center rather than friction generated in the simulator.

The actuators may adjust the angle formed with the horizontal axis direction of the lower plate by sliding forward and backward along the guide unit connected to each other. The first actuator and the second actuator allow the first angle and the second angle to have the same angle.

Each of the actuators is fixed by the fixing unit at an angle changed according to the angle control signal.

According to another preferred embodiment of the present invention, the first angle and the second angle are formed to have an angle between 10 degrees and 25 degrees. If it is less than 10 degrees or more than 25 degrees, the component force in the Y-axis direction is increased, and a large moment is generated around the spline, resulting in greater vibration and noise in the simulator.

Accordingly, the content transmission device 100 is configured such that the first angle between the horizontal center line of the lower plate and the first actuator and the second angle between the horizontal center line of the lower plate and the second actuator are 15 degrees. can be adjusted. In this case, the moment due to the component force in the Y-axis direction generated in the process of changing the rotational motion of the push rod of the first and second actuators from the rotational motion of the second actuator to a linear motion is minimized, thereby reducing noise and vibration, and providing immersive virtual reality contents. can provide Furthermore, unnecessary power consumed by vibration can be saved, thereby maintaining the power for a long time.

14 is a block diagram illustrating a system in which an angle adjustment signal is applied to the simulator 400 according to an embodiment of the present invention.

The system in which the angle adjustment signal according to the present invention is applied to the simulator 400 includes a sensor controller 185 for measuring the pressure applied to the simulator 400 by the sensor unit 401; a pressure information receiving unit 190 for receiving the pressure information measured by the sensor unit 401 from the simulator 400; a location information receiving unit 191 that identifies a location of an actuator included in the simulator 400 and receives the location information; an angle calculator 186 for calculating an angle of the actuator included in the simulator 400 according to the pressure information; and an angle control unit 187 for adjusting the angle of the actuator by changing the position of the actuator according to the calculated angle.

15 is a flowchart illustrating a method of controlling the mobile device 200 and the simulator 400 using a sensor according to an embodiment of the present invention.

The method for controlling the mobile device 200 and the simulator 400 using the sensor according to the present invention is made through the processes of a control decision determining step (S1510), a control signal receiving step (S1520), and a control step (S1530). .

First, in the control decision step (S1510), when a user is seated among a plurality of seats in which a sensor unit is installed, the sensor unit measures the pressure applied to the corresponding seat, and when the pressure exceeds a certain value, the content is transmitted The device 100 receives a control signal according to the control signal receiving step (S1520).

At this time, the sensor unit is set to operate only when a pressure greater than or equal to a predetermined value set within the range of 0.1 to 20 kilograms [kg] is applied, thereby preventing malfunction by objects such as a user's bag or clothes.

Accordingly, by receiving the signal, the content transmission apparatus 100 may control the mobile device 200 and the simulator 400 to turn on (S1530). Accordingly, limited power of the mobile device 200 and the simulator 400 can be efficiently managed. Furthermore, as a service provided in a vehicle, long-time operation is possible by controlling the mobile device 200 and the simulator 400 within limited power.

16 is a block diagram illustrating a system for controlling the mobile device 200 and the simulator 400 using a sensor according to an embodiment of the present invention.

The system for controlling the mobile device 200 and the simulator 400 using the sensor according to the present invention checks whether a predetermined value or more of pressure is applied in the sensor unit 401 and the simulation chair respectively installed in a plurality of seats provided in the vehicle. a sensor control unit 185 for determining by the sensor unit; A control signal receiving unit 192 connected to each sensor unit 401 through a network to receive a control signal from each sensor unit 401, and controlling the mobile device and the simulator according to the received control signal and a terminal control unit 180 .

Here, the sensor unit 401 is installed in each of a plurality of seats provided in the vehicle, measures the pressure corresponding to a specific object when a specific object is seated on the seating portion of the seat, and then sends the pressure to the content transmission device 100 . When this predetermined value is exceeded, a control signal is transmitted.

At this time, the sensor unit 401 is more than a certain value set within the range of 0.1 to 20 kilograms [kg] to prevent the sensor unit 401 from malfunctioning when the user places belongings on the empty seat. It is configured to generate a corresponding control signal only when pressure is applied.

The sensor unit 401 may include a limit sensor, an infrared sensor, a proximity sensor, a load cell, and the like.

The content transmission device 100 may receive all information on the seats to which a predetermined value or more of the pressure is applied, control whether the seat is used or not, output through the display unit, and store the information input from the sensor unit into a database. have.

In the method of providing virtual reality content for education in a vehicle such as a bus of the present invention, the vehicle may include a content transmission apparatus 100, a mobile device 200, an HMD apparatus 300, a simulator 400, and seats. In order to form an interior space, the seat except for the driver's seat of the vehicle may be removed, and may be customized according to the user's request to form or utilize a large space.

It is possible to view a virtual reality image in the space, and it is possible to provide a comfortable rest environment by having a heating and cooling facility, and it may be provided with at least one seat. In addition, it may include convenience facilities, a refrigerator, a sink, a toilet, a sofa and a table on one side.

Since the vehicle is equipped with a virtual reality content providing means, it is possible to provide a variety of content, while having mobility, it is possible to directly visit the virtual reality content to a place where a consumer has poor accessibility to virtual reality.

The steps of a method or algorithm described in connection with the embodiments of the present invention may be directly implemented in a hardware module executed by a processor, a software module, or a combination of the two. A software module may be a computer-readable form of random access memory (RAM), ROM, EPROM, EEPROM, flash memory, registers, hard disk, removable disk, CD-ROM, or any form well known in the art. It may reside on a recording medium. An exemplary recording medium is coupled to the processor, and the processor can derive information from, and write information to, the recording medium. Alternatively, the recording medium may be integral with the processor. The processor and recording medium may reside within an application specific integrated circuit (ASIC). An ASIC may reside within a mobile device. Alternatively, the processor and the recording medium may reside as separate components within the mobile device.

Although embodiments of the present invention have been described above with reference to the accompanying drawings, those skilled in the art will understand that the present invention may be embodied in other specific forms without changing the technical spirit or essential features thereof. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

In addition, it is natural that embodiments in which components and steps of the server or method of the present invention described above are selectively combined also fall within the scope of the present invention.

100: content transmission device
110: database
120: communication department
130: content service department
140: start signal transmitter
150: mobile device control unit
160: time information receiving unit
170: effect control unit
180: terminal control unit
181: average luminance level calculation unit
182: threshold determination unit
183: storage
184: brightness control unit
185: sensor control unit
186: angle calculation unit
187: angle control
190: input information receiving unit
191: location information receiving unit
192: control signal receiver
200: mobile device
210: processor
220: display unit
230: communication department
240: proximity sensor unit
250: memory unit
260: environmental luminance measurement unit
270: light emitting module
300: HMD device
310: communication unit
320: display unit
330: control unit
340: memory unit
400: simulator
410: simulation chair
411: sensor unit
420: simulation effect device

Claims (10)

A method of providing virtual reality content for education using a content transmission device in a vehicle such as a bus,
(a) connecting the content transmission apparatus to a mobile device through wireless or wired communication;
(b) connecting the content transmission device to a head-mounted display (HMD) device arranged for each vehicle seat through a connection with the mobile device through wireless or wired communication;
(c) transmitting, by the content transmission apparatus, the content to the mobile device;
(d) causing the content transmission apparatus to measure the ambient environment luminance of the mobile device in the mobile device, and to transmit the measured environment luminance to the content transmission apparatus;
(e) the content transmission apparatus calculates a threshold screen luminance at which glare starts to occur in the mobile device using the measured environmental luminance and a preset glare index value, and the content corresponding to the calculated threshold screen luminance deriving an average luminance level threshold;
(f) the content transmission device calculates the average luminance level of the content by using the luminance of each pixel constituting the frame of the content input, and the calculated average luminance level of the content is the average luminance level threshold of the content adjusting the luminance of the light emitting module of the mobile device so that the screen luminance of the mobile device does not exceed the threshold screen luminance when it exceeds;
(g) transmitting, by the content transmission apparatus, the content reproduction start signal to the mobile device;
(h) transmitting, by the content transmission apparatus, the content to the HMD apparatus through the mobile device, so that the HMD apparatus displays the content;
(i) receiving, by the content transmission apparatus, time information according to the content reproduction transmitted by the HMD apparatus under the control of the mobile device;
(j) the contents transmission device synchronizes the contents transmission device and the simulator by using the time information, and transmits an effect control signal to be generated at a corresponding time to the simulator, and the effect of the simulator according to the effect control signal and the contents synchronizing;
including,
The content transmission device transmits a command for simultaneous playback to the mobile device, so that a screen appears on the HMD device and the simulator moves at the same time;
The length of the content may be determined according to the characteristics of the content or the characteristics of the user,
The length of the content may be controlled by cutting off the power provided to the HMD device,
The simulator is a method for providing virtual reality content, characterized in that the simulation chair swings according to the effect control signal transmitted by the content transmission device. According to claim 1,
The method for providing virtual reality content, characterized in that the content transmission device is selected from a group comprising a desktop (desk top), a laptop (lap top), a mobile terminal, and a smart phone. According to claim 1,
The method of providing virtual reality content comprising the step of stopping the simulator by applying a stop signal to a control device included in the simulator. According to claim 1,
The method of providing virtual reality content, characterized in that the content is educational content. The method of claim 1,
The method of providing virtual reality content, comprising measuring a distance between the mobile device and the user, and determining whether to transmit the content to the HMD device according to the measured distance. In a system for providing educational virtual reality content using a content transmission device in a vehicle such as a bus,
The content transmission device,
a communication unit connecting the mobile device or the HMD device through wireless or wired communication;
a content service unit transmitting the content to the mobile device or the HMD device;
a terminal control unit configured to measure the ambient environment luminance by the environmental luminance measuring unit of the mobile device and transmit the measured environmental luminance to the content transmission apparatus;
The threshold screen luminance of the mobile device at which glare starts to occur is calculated using a preset glare index value and the environmental luminance measured by the environmental luminance measuring unit, and the average luminance level threshold of the content corresponding to the calculated threshold screen luminance Threshold determining unit for deriving;
an average luminance level calculator for calculating an average luminance level of the content by using the luminance of each pixel constituting the input frame of the content;
A light emitting module to prevent the screen luminance of the mobile device from exceeding the threshold screen luminance when the average luminance level of the content calculated by the average luminance level calculator exceeds the average luminance level of the content derived by the threshold determiner a luminance control unit for adjusting the luminance of light emission;
a start signal transmitter for transmitting the content reproduction start signal to the mobile device;
a mobile device control unit that transmits the content to the HMD apparatus through the mobile device and causes the HMD apparatus to display the content;
a time information receiving unit for receiving time information according to the content reproduction; and
an effect control unit that synchronizes the content transmission device and the simulator using the time information, transmits an effect control signal to be generated at a corresponding time to the simulator, and synchronizes the effect of the simulator according to the effect control signal and the content;
including,
The content transmission device transmits a command for simultaneous playback to the mobile device, so that a screen appears on the HMD device and the simulator moves at the same time;
The length of the content may be determined according to the characteristics of the content or the characteristics of the user,
The length of the content may be controlled by cutting off the power provided to the HMD device,
The simulator is a system for providing virtual reality content, characterized in that it is a simulation chair that is oscillated according to the effect control signal. 7. The method of claim 6,
The system for providing virtual reality content, characterized in that it further comprises a control device for stopping the simulator by applying a stop signal. 7. The method of claim 6,
The system for providing virtual reality content, characterized in that the content is educational content. 7. The method of claim 6,
The mobile device may include a proximity sensor unit for measuring a distance between the mobile device and a user; and a processor that determines whether to transmit the content to the HMD device according to the measured distance. A vehicle comprising a system for providing virtual reality content according to any one of claims 6 to 9.

Images