KR102396832B1 - Virtual reality simulator and method for experience of aerodynamic environment in agricultural facilities - Google Patents

Abstract

The present invention relates to virtual reality technology, and more particularly, to a virtual reality apparatus and method for experiencing the internal air environment of an agricultural facility that can experience the internal air environment of the agricultural facility in a virtual reality space. To this end, the virtual reality device for experiencing the internal air environment of an agricultural facility according to the present invention displays a virtual space that visualizes the internal space of the agricultural facility and changes a specific section of the virtual space while changing the specific section in temperature, humidity and wind It is characterized in that the selected one air environment state is visualized.

Description

{Virtual reality simulator and method for experience of aerodynamic environment in agricultural facilities}

The present invention relates to virtual reality technology, and more particularly, to a virtual reality apparatus and method for experiencing the internal air environment of an agricultural facility that can experience the internal air environment of the agricultural facility in a virtual reality space.

Agricultural production facilities such as greenhouses are getting larger, and difficulties in maintaining the stability and uniformity of major environmental factors for an appropriate growth environment are increasing.

Various factors such as temperature, humidity, thermal environment, air flow, and air medium (gas, dust, etc.) in the facility are related to the air environment in the facility, so various sensors and analysis equipment are required and time-consuming for measurement.

The main mechanism of their transition and distribution is air flow, and since it is difficult to track the invisible air flow, it is difficult for farm operators, consultants, local governments, researchers, etc. to improve the environment and make wrong judgments. It often happens that Accordingly, there is a need for technology that can indirectly experience and educate the air flow of agricultural production facilities.

The virtual reality device is a device in the form of a module in which a user can experience effects such as sight and sound through a virtual object.

In virtual reality, a user can manipulate or execute an object in a desired direction. Unlike 3D animation, virtual reality can control movement and operation in a three-dimensional virtual space by allowing the performer to judge and select on his/her own.

The virtual reality industry is an applied industry that has the characteristics of several industries. In the medical field, it is used for surgery and anatomical practice, and in the aviation and military field, it is used in a variety of industries for clear decision-making by users. is becoming

Until now, the utilization of virtual reality techniques in the agricultural field is very low, and if you look for application examples, some technologies such as virtual farmer training programs and agricultural machine simulators exist, but research that can be practically used in rural areas is very insufficient. In particular, there is no study on the visualization of air flow and thermal environment that can easily determine the environmental control inside agricultural facilities.

Korean Patent Registration No. 10-1980845

The present invention was created in view of the above situation, and an object of the present invention is to provide an experiential virtual reality device and method that can understand the air flow inside an agricultural facility and experience the air environment.

To this end, the virtual reality device for experiencing the internal air environment of an agricultural facility according to the present invention displays a virtual space that visualizes the internal space of the agricultural facility and changes a specific section of the virtual space while changing the specific section in temperature, humidity and wind It is characterized in that the selected one air environment state is visualized.

In addition, the virtual reality device for experiencing the internal air environment of an agricultural facility according to the present invention includes a display unit that displays content for an air environment experience reproduced in a user terminal and superimposes a VR menu on the content, and eye tracking information of the experiencer. The user terminal includes: an eye tracking unit that generates, a motion recognition unit that detects the movement direction and movement distance of the user; and a communication unit for receiving content for an air environment experience reproduced in , and transmitting the eye tracking information, a moving direction and a moving distance, and a menu command signal to the user terminal.

In addition, the virtual reality method for experiencing the internal air environment of an agricultural facility according to the present invention is a method of displaying the state of the air environment of the virtual space in the virtual reality device for experiencing the internal air environment of the agricultural facility. The steps of displaying , setting the type of the air environment displayed in the virtual space, setting a specific section of the virtual space, and setting the air environment as the set type of the air environment in the set specific section Visualizing the state.

As described above, the present invention visualizes the internal space of an agricultural facility and displays the air environment conditions such as temperature, humidity, gas, wind, etc. according to the selection of an experienced person or an education manager in a specific section of the virtual space, thereby allowing users (trainees, agricultural Manager, etc.) has the effect of visually checking and understanding the air environment that cannot be seen with the naked eye in actual agricultural facilities.

The virtual reality device according to the present invention can be widely used in the development of a simulator for experiencing the air environment in other facilities or buildings as well as the internal space of agricultural facilities such as greenhouses.

1 is a view showing a schematic configuration of a virtual reality device for experiencing the internal air environment of an agricultural facility according to the present invention.
2 is a view showing the internal configuration of the head worn display (HMD) according to the present invention.
3 is a flowchart showing a processing process for experiencing the internal air environment of an agricultural facility according to the present invention.
4 is a view showing a visualization setting VR menu that is displayed overlaid on content for an air environment experience according to the present invention.
5 to 10 are views showing a temperature contour that is one of the air environment according to the present invention.
11 to 14 are views showing a wind field, which is one of the air environments according to the present invention.

Hereinafter, with reference to the accompanying drawings, embodiments of the present invention will be described in detail so that those of ordinary skill in the art can easily carry out the present invention.

However, the present invention may be embodied in several different forms and is not limited to the embodiments described herein.

And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part "includes" a certain component, it means that other components may be further included, rather than excluding other components, unless otherwise stated.

In addition, the terms "... unit" and "... module" described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software or a combination of hardware and software.

Hereinafter, a virtual reality apparatus and method for experiencing the internal air environment of an agricultural facility according to an embodiment of the present invention will be described in detail with reference to the drawings.

1 shows a schematic configuration of a virtual reality device for experiencing the internal air environment of an agricultural facility according to the present invention.

Referring to FIG. 1 , a virtual reality device (hereinafter, a virtual reality device) for experiencing the internal air environment of an agricultural facility according to the present invention includes a head mounted display 100 and a user terminal 200 .

By using the virtual reality device according to the present invention, it is possible to experience the air environment inside agricultural facilities such as greenhouses.

That is, the virtual reality device according to the present invention is a VR-based immersive educational device, and the temperature, humidity, gas concentration, and wind strength of the air environment inside the agricultural facility that are difficult for agricultural facility managers or students receiving agricultural education to grasp in reality. I can visually check the direction, etc.

When the virtual reality experiencer wears the head wearing display 100 on the head and the education manager executes the air environment experience virtual reality software (program) on the user terminal 200, the air environment experience virtual reality (VR) on the head worn display 100 ) image is displayed, and the VR menu is overlaid on the virtual reality image and output.

The air environment experience software according to the present invention may use images such as augmented reality (AR) and mixed reality as well as virtual reality images. Virtual reality, augmented reality, and mixed reality images are all immersive content.

The virtual reality experiencer can visually check the air environment inside the agricultural facility while viewing the air environment experience virtual reality image through the head-wearing display 100. In particular, while selecting the type and condition of the air environment through the VR menu, various types of You can see the air environment.

The user terminal 200 according to the present invention may be a personal computer, a notebook computer, a tablet PC, a smart phone, etc., but is not limited thereto, and may execute air environment experience software and communicate with the head worn display 100 by wire or wirelessly. Any device that can do it can do it.

2 shows an internal configuration of a head worn display (HMD) according to the present invention.

The display unit 10 may display content (virtual reality image) for air environment experience reproduced in the user terminal 200, and superimpose a VR menu for setting the type or condition of the air environment on the content. .

The input unit 20 recognizes the part where the user's finger is positioned in the VR menu and outputs a menu command signal corresponding to the part where the finger is positioned.

The input unit 20 detects the tip of the finger through the camera, calculates the position coordinate of the fingertip in the coordinate system of the virtual reality image displayed to the user, and outputs a menu command signal corresponding to the position coordinate.

The eye tracking unit 30 generates eye tracking information by detecting eye movement through an eye sensor that detects eye movement or a camera installed around the eye.

The eye tracking unit 30 detects eye movement by acquiring eye-related information such as pupil size, reflection point, and feature point through an eye sensor or camera, and based on the eye movement, gaze gaze coordinates indicating the location of the subject's gaze can be calculated.

Here, the gaze-gaze coordinates are coordinates corresponding to the position pointed by the gaze of the experiencer in the coordinate system of the virtual reality image displayed to the subject.

The motion recognition unit 40 detects the movement of the user. The motion recognition unit 60 may detect the movement direction (forward, backward, left and right movement) and the movement distance of the user by using an acceleration sensor, a gyro sensor, or the like.

The communication unit 50 receives the virtual reality image from the user terminal 200 and transmits it to the display unit 10 , or to the user terminal 200 , the user's eye tracking information, motion recognition information such as movement direction and movement distance, and menu Send a command signal.

The communication unit 50 according to an embodiment of the present invention may be configured as a short-range wireless communication module such as Bluetooth or Wi-Fi or a wired communication module.

The user terminal 200 receives eye tracking information, motion recognition information (moving direction and distance), menu command signals, etc. from the head worn display 100 and reflects them in a virtual reality image in real time on the head worn display 100 . Change the displayed virtual reality image.

3 shows a processing process for experiencing the internal air environment of an agricultural facility according to the present invention.

The processing process for experiencing the internal air environment of the agricultural facility shown in FIG. 3 will be sequentially described in detail with reference to FIGS. 4 to 14 .

4 shows a visualization setting VR menu that is displayed superimposed on content for an air environment experience according to the present invention, and FIGS. 5 to 10 show a temperature contour, which is one of the air environments according to the present invention, 11 to 14 show a wind field, which is one of the air environments according to the present invention.

First, the visualization mode is entered by selecting a visualization setting button (not shown) from the VR menu that is displayed overlaid on the content (S10).

When the visualization setting button is selected in the VR menu, the visualization setting VR menu, that is, the air environment selection menu appears, as shown in Fig. 4 (a), and in the air environment selection menu, the air environment type selection button array (2), the contour setting button ( 3), a range adjustment indicator (4), and a contour thumbnail (5) are included.

The air environment type selection button array 2 is composed of temperature, humidity, and wind buttons. If you select a temperature in the air environment type selection button array (2), you can set the contour for the temperature using the contour setting button (3). Similarly, if you select humidity or wind, you can set each humidity contour or wind field. there is.

On the other hand, when a current location button (not shown) is selected from the VR menu, a mini map 6 is displayed as shown in FIG. 4B to determine the user's current location.

The mini map 6 reflects the experiencer's eye tracking information, movement direction, and movement distance to indicate the current location of the experiencer and the gaze direction the experiencer is looking at in the virtual space. The image of the contour is changed according to the position of the experiencer and the direction of his gaze.

The VR menu superimposed on the virtual reality image of the head-wearing display 100 may be displayed identically on the screen of the user terminal 200 or may be displayed in a slightly different menu format. The VR menu displayed on the user terminal 200 is specifically referred to as an operator menu.

The VR menu and the operator menu are synchronized, so selecting a specific function in the VR menu selects the same function in the operator menu, and on the contrary, selecting a specific function in the operator menu selects the same function in the VR menu.

The VR menu is selected by detecting the user's finger and the corresponding function is executed, whereas the operator menu can be selected and executed through touch or mouse click.

Meanwhile, the VR menu may not be displayed on the head worn display 100 for the convenience of the experiencer. In this case, the experiencer does not operate the VR menu and only the person in charge of education can set the type of air environment and environmental conditions in the operator menu displayed on the user terminal 200 to provide the virtual reality image to the experiencer.

When entering the visualization mode in this way, the type of the air environment is selected from the air environment type selection button array 2 (S20).

In the embodiment of the present invention, temperature, humidity, and wind are exemplified as the types of air environment, but the present invention is not limited thereto, and various types of air environment such as odor, dust, dust, and gas may be added.

When the type of air environment is set, the temperature contour, humidity contour, wind field, etc. are set using the contour setting button 3 corresponding to the selected air environment (S30).

When the air environment contour is set, a temperature range, a humidity range, a wind speed range, etc. can be set using the range control indicator 4 (S40).

In this way, after selecting the type of air environment and setting the contour or wind field for the air environment (temperature, humidity, etc.), when the numerical range (section) of the air environment is set, the air environment in the virtual space is based on the set value. The state is visualized and expressed (S50).

According to this air environment experience processing process, first, a temperature contour is set by selecting a temperature as an air environment, and the process of experiencing the air environment according to the temperature contour will be described in detail.

After selecting the temperature button in the air environment type selection button array (2), use the temperature contour setting button (3) to determine the temperature state in a specific section (plane, front, side) of the virtual space, the temperature state around the experiencer in the virtual space, You can check the temperature state in the set temperature range, the problematic location in the virtual space, that is, the part showing the unusual temperature distribution.

5 shows a case in which the temperature front contour is set. When the temperature front is selected using the temperature contour setting button 3 as shown in (a), it is expressed as a temperature data value of the XY section as shown in (b), and the Z-axis It is changed to the temperature data value of the corresponding XY section while moving to .

At this time, the temperature distribution state corresponding to the temperature data value of the corresponding XY section is displayed on the contour thumbnail 5, and the actual temperature distribution state is displayed as shown in (b) when Close is selected from the VR menu.

6 shows a case in which the temperature side contour is set. When the temperature side is selected using the temperature contour setting button 3 as shown in (a), it is expressed as a temperature data value of the YZ section as shown in (b), and the X-axis It is changed to the temperature data value of the corresponding YZ section while moving to .

7 shows a case in which a temperature plane contour is set. When a temperature plane is selected using the temperature contour setting button 3 as shown in (a), it is expressed as a temperature data value of the XZ section as shown in (b), and the Y-axis It is changed to the temperature data value of the corresponding XZ section while moving to .

8 shows a case in which a temperature short-distance contour is set. As shown in (a), when a temperature short-range is selected using the temperature contour setting button (3), the current location of the experiencer is checked in the virtual space, It is expressed as a temperature data value of

9 shows a case in which the temperature range is set with the range control indicator in the state where the temperature front contour is set, and the temperature front is selected using the temperature contour setting button 3 as shown in (a), and then the range control indicator 4 ), only the temperature data values within the temperature range set as in (b) are expressed, and other temperature data values are not expressed. With these features, you can see the temperature in a specific range more clearly.

10 shows a case in which a temperature problem contour is set, and when a temperature problem is selected using the temperature contour setting button 3 as shown in (a), the problematic location in the virtual space, that is, a specific temperature as shown in (b) It can be seen that the distribution is visible.

As such, temperature contours allow you to check the temperature state with various cross-sections (front, side, plane) and conditions in the virtual space, and the temperature data displayed in the virtual space can be checked in various colors, so you can see how the temperature changes in the virtual space. It is easy to find out.

So far, the temperature contour has been described above, but the same can be applied to the humidity contour.

Next, the wind field will be described in detail. 11 to 14 show the wind field.

In the case of temperature and humidity, since the value is a scalar, the distribution of temperature or humidity is expressed as a contour, whereas in the case of wind, the value is a vector, so the word field is used to estimate the distribution of wind. It is expressed as a wind field.

There are 4 methods of displaying wind, including the whole, outside air, and smoke effect, in addition to the section (front, side, flat) such as temperature or humidity.

11 shows a case in which the entire wind field is set, and when the entire wind is selected using the wind field setting button 3 as shown in (a), the direction and strength of the wind can be checked in the virtual space as a whole as shown in (b). can

12 shows a case where the front wind field is set, and when the wind front is selected using the wind field setting button 3 as shown in (a), it is expressed as wind data values of the XY section as shown in (b), and the Z axis It is changed to the wind data value of the corresponding XY section while moving to . Likewise, the same can be applied to the wind plane and the wind front.

13 shows a case in which the outdoor air wind field is set, and when the wind outdoor air is selected using the wind field setting button 3 as shown in (a), the direction and strength of the wind flowing in from the outdoor air are checked as shown in (b). can

Outdoor wind data is expressed in the same format as general wind data, but leaves an afterimage so that the movement of wind can be seen from beginning to end.

14 shows a case in which a smoke effect contour is set. As shown in (a), when a smoke effect is selected using the wind contour setting button (3), the wind flowing in from the outside air moves inside and disappears as shown in (b). express it through acting.

In this way, the wind conditions can be checked in various sections and conditions in the virtual space through the wind field, and the color of the wind data displayed in the virtual space changes according to the speed, so the flow and speed of the wind can be easily grasped.

The above description is merely illustrative of the present invention, and various modifications may be made by those of ordinary skill in the art to which the present invention pertains without departing from the technical spirit of the present invention.

Therefore, the embodiments disclosed in the specification of the present invention do not limit the present invention. The scope of the present invention should be interpreted by the following claims, and all technologies within the scope equivalent thereto should be construed as being included in the scope of the present invention.

10: display unit 20: input unit
30: eye tracking unit 40: motion recognition unit
50: communication department
100: head worn display 200: user terminal

Claims (15)

Displays a virtual space that visualizes the internal space of agricultural facilities and visualizes the air environment state of any one selected from temperature, humidity, and wind in a specific section of the virtual space while changing a specific section,
In the virtual space, the VR menu is displayed overlapping,
The VR menu includes an air environment type selection button array composed of temperature, humidity, and wind buttons, a contour setting button for setting a specific section of the virtual space, a range control indicator for setting a numerical section of the air environment, and a A virtual reality device for experiencing the internal air environment of an agricultural facility, characterized in that it includes a contour thumbnail that displays the state of the air environment as a reduced image. delete According to claim 1,
It is characterized in that by using the contour setting button, it is possible to check the state of the air environment in a specific section of the virtual space, the state of the air environment around the experiencer in the virtual space, and the state of the air environment in the numerical section set by the range control indicator. A virtual reality device to experience the internal air environment of agricultural facilities. According to claim 1,
When wind is selected as an air environment through the air environment type selection button array, the state of the total wind in the virtual space and the state of the wind flowing in from outside air can be checked using the contour setting button. Air environment experience virtual reality device. 5. The method of claim 4,
The state of the wind flowing in from the outside air is a virtual reality device for experiencing the internal air environment of an agricultural facility, characterized in that it is indicated by smoke that the wind flowing in from the outside air moves inside and then disappears. A display unit that displays content for an air environment experience reproduced in the user terminal and superimposes a VR menu on the content;
An eye tracking unit that generates eye tracking information of the experiencer;
A motion recognition unit that detects the moving direction and moving distance of the experiencer;
an input unit that detects the user's finger and generates a menu command signal corresponding to the part where the finger is located in the VR menu;
and a communication unit for receiving content for air environment experience reproduced in the user terminal and transmitting the eye tracking information, movement direction and movement distance, and menu command signal to the user terminal,
The content for the air environment experience displays the air environment state of any one of temperature, humidity, and wind in a virtual space that visualizes the internal space of an agricultural facility,
The VR menu includes an air environment type selection button array composed of temperature, humidity, and wind buttons, a contour setting button for setting a specific section of the virtual space, a range control indicator for setting a numerical section of the air environment, and a A virtual reality device for experiencing the internal air environment of an agricultural facility, characterized in that it includes a contour thumbnail that displays the state of the air environment as a reduced image. delete 7. The method of claim 6,
It is characterized in that by using the contour setting button, it is possible to check the state of the air environment in a specific section of the virtual space, the state of the air environment around the experiencer in the virtual space, and the state of the air environment in the numerical section set by the range control indicator. A virtual reality device to experience the internal air environment of agricultural facilities. 7. The method of claim 6,
When wind is selected as an air environment through the air environment type selection button array, the state of the total wind in the virtual space and the state of the wind flowing in from outside air can be checked using the contour setting button. Air environment experience virtual reality device. 10. The method of claim 9,
The state of the wind flowing in from the outside air is a virtual reality device for experiencing the internal air environment of an agricultural facility, characterized in that it is indicated by smoke that the wind flowing in from the outside air moves inside and then disappears. In the method of displaying the air environment state of a virtual space in a virtual reality device for experiencing the internal air environment of an agricultural facility,
A step of displaying a virtual space that visualizes the internal space of the agricultural facility;
setting the type of the air environment displayed in the virtual space;
setting a specific section of the virtual space;
Visualizing the air environment state by the set air environment type in the set specific cross section,
Further comprising the step of displaying the VR menu superimposed in the virtual space,
The VR menu includes an air environment type selection button array composed of temperature, humidity, and wind buttons, a contour setting button for setting a specific section of the virtual space, a range control indicator for setting a numerical section of the air environment, and a A method characterized in that it includes a contour thumbnail that displays the air environment state as a reduced image. delete 12. The method of claim 11,
In the step of visualizing the air environment state, the air environment state in a specific section of the virtual space using the contour setting button, the air environment state around the experiencer in the virtual space, and the air environment in the numerical section set by the range adjustment indicator A method comprising displaying a status. 12. The method of claim 11,
In the step of visualizing the air environment state, when wind is selected as an air environment through the air environment type selection button array, the state of the total wind in the virtual space and the state of the wind flowing from outside air are displayed using the contour setting button. A method characterized in that. 15. The method of claim 14,
The state of the wind introduced from the outside air is a method, characterized in that the smoke that the wind introduced from the outside air moves inside and disappears is displayed as smoke.

Images