KR20110075450A - Display apparatus of virtual outdoor-view of moving object - Google Patents

Abstract

PURPOSE: A virtual external view display device of a carriage is provided to supply virtual panorama image information to a passenger of a carriage. CONSTITUTION: Virtual external view is built in a virtual space unit(30). Virtual external image information is displayed through a control unit(40). A virtual camera module(50) is connected according to the movement of a carriage. The camera module photographs the virtual external view. The movement of the camera module is synchronized through a synchronization processing unit(60).

Description

Display apparatus of virtual outdoor-view of moving object

The present invention relates to a technology for displaying a virtual foreground on the wall surface of a closed space of a vehicle such as an elevator or a subway, and more particularly, a virtual camera module existing in the virtual space according to the movement of the vehicle. Synchronized and synchronized with the movement of the vehicle, and displays the foreground video in the virtual space taken by the camera module to be linked through the screen panel provided on the wall of the vehicle, the passengers in the closed space of the vehicle virtual The present invention relates to a virtual external view display device of a vehicle that enables users to watch a panoramic video.

In general, as a vehicle, an elevator is a lift that is installed in a building such as a high-rise apartment or building, and can easily move to and from each floor.The passengers inside the elevator use an operation panel (indicator) installed at one side of the elevator. Select the target floor to be used, and accordingly, the elevator moves up or down toward the target floor.

In addition, another transport chain subway is operated along the railway of the underground tunnel.

However, the conventional transportation chain elevators and subways are enclosed in narrow spaces, and thus passengers who ride in the elevators and subways complain of frustration in the closed spaces or have difficulty in handling each other's eyes. In the case of a subway that operates only an elevator or an underground tunnel installed in a good skyscraper, passengers cannot see the outside view at all.

Accordingly, in the case of an elevator, the outer wall was made of transparent special tempered glass so that the view was possible, and in the case of the subway, a monitor was installed inside to attract passengers' attention.

That is, from November 6, 2008, the Ministry of Knowledge Economy announced the revision of the elevator inspection standard, which allows the installation of an elevator with a view of the glass wall visible outside of the apartment. Although the wall of the elevator is made of glass, the amendment has been made to use glass or new materials if it satisfies the fire performance, and the restriction on the shape and dimensions of the elevator is also eliminated, allowing a unique design design according to the structure and form of the building. It is loosening the regulations on installation manufacturing.

However, despite the above amendments to the law, manufacturing the outer wall of the elevator with transparent special tempered glass as described above has a disadvantage in that it requires a lot of costs, and accordingly, conventionally, a plurality of elevators in one skyscraper Assuming that the installation was often installed so that only one elevator can be viewed.

In addition, in the case of the subway, various videos are screened through the monitor, but these videos are limited to the form of corporate advertisement or public service advertisement, and the outside views cannot be viewed.

Accordingly, the present invention is to solve the above-mentioned problems, the camera module is built in the virtual space is taken in synchronization with the movement of the vehicle body of the foreground is built in the virtual space of the photographed virtual foreground By displaying the image information through the screen panel that is configured on the wall of the vehicle that can not see the outside view, the passengers boredom by allowing passengers to view the virtual foreground image information in the sealed space of the vehicle It is an object of the present invention to provide a virtual exterior view display device of a vehicle to solve the problem, and to reduce the production cost increase by applying expensive transparent special tempered glass for viewing the outside view.

The present invention for achieving the above object is a virtual external foreground display device of the vehicle,

Sensor unit for detecting the speed and the destination (or destination floor) according to the operation of the vehicle; An information input unit for outputting input information required for operation of the vehicle; A virtual space unit in which a virtual external foreground processed by 3D by photographing an actual external foreground is constructed; A control unit configured to calculate information sensed by the sensor unit and input information output from the information input unit, and to display virtual foreground image information according to the calculated result; A virtual camera module located in the virtual space part and photographing a virtual external foreground constructed in the virtual space part while moving in association with the movement of the vehicle; A synchronization processor configured to drive the virtual camera module under the control of the controller so that the movement of the virtual camera module located in the virtual space is synchronized with the speed of the vehicle according to the speed information of the vehicle measured by the sensor unit; And a screen panel configured on a wall surface of the vehicle and displayed under the control of the controller and displaying image information of a virtual external foreground photographed from the virtual camera module. .

In addition, the vehicle is an elevator or subway having a closed space.

In addition, when the speed of the braking of the vehicle is within a certain range so that the movement of the virtual camera module driven and controlled by the synchronization processor is completely stopped when the vehicle is braked, it is treated as zero. A braking correction unit for outputting one braking correction data to the synchronization processing unit; It includes.

In addition, the predetermined range of the speed according to the braking of the vehicle is a speed of 0.3 or less.

In addition, the vehicle and the virtual camera module do not cause a speed difference according to the traveling distance (height) of the vehicle according to the space ratio error of the real space and the virtual space and the speed of the traveling distance of the virtual camera module. A speed correction unit for outputting speed correction data to the synchronization processing unit for averaging the speeds of the speed increasing section and the speed decreasing section of the circuit to be constantly corrected; It further includes.

In addition, the self-diagnosis and recovery module for self-diagnosing the abnormal occupancy of the control unit and abnormal leakage of the virtual space unit, as well as self-diagnosis when the temperature rises above a predetermined temperature to prevent malfunction. It includes more.

As described above, the present invention captures the camera module built in the virtual space while the camera module built in the virtual space is synchronized with the movement of the vehicle, and then photographs the image information of the virtual foreground. It is configured to display through the screen panel configured in the, so that the passengers can view the virtual foreground image information in the sealed space of the vehicle to eliminate the boredom of the passengers, especially as a vehicle to view the elevator for viewing You can use the virtual observation elevator in any environment without breaking down the wall to make transparent special tempered glass, as well as the ground view of the subway passing by instead of the dark window of the transport chain subway. The effect that you can enjoy from underground It can be.

Figure 1 is a schematic cross-sectional view showing a driving pattern of the vehicle (elevator) in an embodiment of the present invention, Figure 2 is a block diagram of a virtual external foreground display device of the vehicle in an embodiment of the present invention, Figure 3 As an embodiment of the present invention, a conceptual diagram of a state of displaying a virtual external foreground photographed by a virtual camera module on a screen panel is illustrated.

4 and 5 are graphs showing a speed correction state in an embodiment of the present invention, FIG. 6 is a graph showing a brake correction state in an embodiment of the present invention, and FIG. 7 is an operating state of a control unit in an embodiment of the present invention. Shows a program screen diagram for self-diagnosis.

FIG. 8 is a diagram illustrating a program screen for self-diagnosing an operating state of a virtual space unit according to an embodiment of the present invention. FIG. 9 is a diagram illustrating a program screen for self-diagnosing a temperature according to an operation of a controller according to an embodiment of the present invention. An embodiment of the present invention shows a state diagram of displaying a virtual external foreground on the screen panel.

1 to 10, the virtual exterior view display apparatus of a vehicle according to an embodiment of the present invention is applied to a vehicle 200 such as an elevator or a subway in which a sealed space is provided, and the sensor unit 10. , Information input unit 20, virtual space unit 30, control unit 40, virtual camera module 50, synchronization processing unit 60, screen panel 70, braking correction unit 80, speed correction unit 90 And a self-diagnosis and recovery module 100.

The sensor unit 10 is configured to detect not only the speed information according to the operation of the vehicle 200, but also the information of the destination (or the target floor) and output them to the control unit 40 and the synchronization processing unit 60, respectively. do.

The information input unit 20 is configured to output information (for example, a target floor selection key, etc.) required for the operation of the vehicle 200 to the controller 40, which is a vehicle 200 is an elevator. In this case, it may be an indicator, or when the vehicle 200 is a subway, it may be an operation unit for operating the subway.

The virtual space unit 30 is a virtual external foreground obtained by photographing an actual external foreground and processed into 3D data, and the virtual space unit 30 is also formed by processing 3D data.

That is, the virtual space unit 30 may be made through, for example, VRML (virtual reality modeling language, hereinafter referred to as VRML).

The VRML is configured using virtual reality software that is operated in personal computers, workstations, etc., which are various operating systems, and supports import of computer aided design (CAD) data format and graphic image data format. If the data format is not used, a conversion tool that can be imported using a separate development tool can be produced and used, and can be imported using a digitizer and a scanner.

In addition, the VRML supports keyframe animation of arbitrary objects in a simpler and easier graphical user environment, making it easier to animate scenarios, for example TCP / IP (Transmission Control Protocol / Using the Internet protocol (transmission control protocol / internet protocol), you can use a tool that allows multiple people to work in one virtual workspace at the same time.

In addition, it requires modeling tools to build visual databases faster and more efficiently for real-time simulation applications, and various performance and sophisticated modeling tools that are not supported by general modeling and animation programs.

In other words, in real-time applications, each object requires a refresh rate of 30 to 60 frames per second in order to be effectively simulated, which requires special structure and properties in the image.

In VRML, three-dimensional objects are depicted geometrically and hierarchically, and the properties of each object can be loaded, database can be loaded, special effects, model and observer control, program execution, and the system can be easily reconfigured. You can simulate multi-gen generated models by optimizing the morphing of the base model, and portability to various models, and fast graphics processing ability by directly using the graphic library of the corresponding system such as OpenGL, Direct 3D, etc. This can be done using tools such as dVISE, MultiGen II, Vega, World Toolkit or VRT, which can be used by developers and with easy-to-use scripts and user interface enhancements.

In this case, in order to move the virtual space output on the screen, for example, a dashboard may be output at the bottom of the screen, and may be configured to arbitrarily manipulate the movement direction and the movement amount using a mouse, a joystick, or a track ball.

In addition, the virtual distance and the building on the screen is output as a stereoscopic image updated according to the direction of the first-person view, and forward, left turn, right turn, view shift up, view shift down, parallel move left If you output a button that can change the movement direction or the point of view, such as parallel movement to the right, and drag the mouse in the direction to move or change the point of view with this button selected using the mouse, By displaying the three-dimensional stereoscopic image is updated, it can be configured to feel as if moving in a three-dimensional space.

In addition, on the three-dimensional street displayed on the screen, outdoor signage can be displayed in a three-dimensional image as in the real world, and on the inner wall of the building, images of actors, corporate logos, and letters related to advertisements are displayed in the form of images. If it is displayed as a choice for this, the advertisement may be outputted and displayed as a video.

The control unit 40 calculates the information detected by the sensor unit 10 and the input information output from the information input unit 20, and the virtual foreground image information is converted into the screen panel 70 according to the calculated result. The control operation is performed so that it can be displayed through).

The virtual camera module 50 is programmatically configured and positioned in the virtual space unit 30 as shown in FIG. 3. The virtual camera module 50 controls the movement of the vehicle 200 by the synchronization processor 60. It is configured to shoot a virtual external foreground built in the virtual space 30 while moving in conjunction with.

The synchronization processor 60 moves the virtual camera module 50 located in the virtual space 30 according to the speed information of the vehicle 200 measured by the sensor unit 10. Under the control of the control unit 40 to be synchronized with the speed of the 200 is configured to drive the virtual camera module 50, the braking correction data of the braking correction unit 80 and the speed correction for the synchronization 90 speed correction data.

The screen panel 70 is configured on the wall surface of the vehicle 200 as shown in FIG. 3 and FIG. 10, under the control of the control unit 40, and photographed from the virtual camera module 50. And display image information about an external foreground of the.

As shown in FIG. 6, the braking correction unit 80 may completely stop the movement of the virtual camera module 50 controlled by the synchronization processing unit 60 when the vehicle 200 is braked. When the speed, such as the slack generated during braking of the vehicle 200, is within a certain range (0.3 or less speed), it is configured to output braking correction data, which has been processed to zero, to the synchronization processor 60. do.

The speed correction unit 90 is a speed according to the traveling distance (height) of the vehicle 200 according to the space ratio error of the real space and the virtual space unit 30 as shown in FIG. Speed correction data for averaging and uniformly correcting the speeds of the speed increase and deceleration sections of the vehicle 200 and the virtual camera module 50 so that a speed difference does not occur according to the traveling distance of the virtual camera module 50. It is configured to output to the synchronization processing unit 60.

The self-diagnosis and recovery module 100 includes an abnormal occupancy rate of the control unit 40 as shown in FIG. 7 and an abnormal leak of the virtual space unit 30 as shown in FIG. 8. As described above, when the temperature according to the drive of the control unit 40 rises above a predetermined temperature, it is configured to prevent a malfunction by self-diagnosing it.

That is, the embodiment of the present invention is to synchronize the virtual camera module 50, which is programmatically located in the virtual space 30, with the moving object in reality, as shown in FIGS.

At this time, in order to interlock the vehicle 200 in the real space and the virtual camera module 50 of the virtual space unit 30, there are considerable variables in addition to the essential information.

That is, in the real space, there are air resistance, frictional resistance, etc. in addition to the part controlled by the program, but such analog information cannot be transmitted to the virtual camera module 50 one by one. The virtual camera module 50 is to be interlocked similar to the vehicle 200 actually running.

Accordingly, in the present invention, the synchronization processing unit 60 driven under the control of the control unit 40 is input through the speed correction unit 90 as well as the speed information of the vehicle 200 input by the sensor unit 10. The virtual camera module 50 existing in the virtual space unit 30 at the same speed as the speed of the vehicle 200 through the speed correction data may be a traveling direction of the vehicle 200, that is, a vertical or forward or backward direction. Perform a synchronization operation so that you can move it.

That is, the speed correction unit 90 is the speed according to the progress distance (height) of the vehicle 200 according to the space ratio error of the real space and the virtual space 30 and the virtual camera module 50 of the In order to prevent a difference in speed according to the traveling distance, speed synchronization data for averaging and continuously correcting the speeds of the speed increasing and decelerating sections of the vehicle 200 and the virtual camera module 50 to the synchronization processor 60. Output

Then, the synchronization processor 60 corrects the speed according to the movement of the virtual camera module 50 in consideration of the error according to the space ratio between the real space and the virtual space 30 from the speed correction data. It is synchronized with the vehicle 200.

At this time, the virtual camera module 50 is a movement occurs in conjunction with the moving direction of the vehicle 200 as well as the speed, while photographing a virtual external foreground built in the virtual space 30 This is transmitted to the screen panel 70.

That is, the virtual camera module 50 is a d3d virtual Direct3d camera, rendering is performed from the following program,

m_d3dProjXform.m [2] [2] = yon * oneOverDepth;

m_d3dProjXform.m [2] [3] = 1.0f;

m_d3dProjXform.m [3] [2] =-(yon * hither * oneOverDepth);

m_d3dProjXform.m [3] [3] = 0.0f;

Accordingly, the virtual external foreground photographed from the virtual camera module 50 moves to the screen panel 70 in a state where a flat blind spot is created and rendered at the same ratio as that of the screen panel 70 based on the virtual viewpoint. Will be sent.

At this time, the screen panel 70 is driven under the control of the control unit 40, the screen panel 70 as shown in FIG. The virtual external foreground is displayed, and when the virtual external foreground is displayed through the screen panel 70, the displayed virtual external foreground screen is displayed according to the speed correction data of the speed correction unit 90. It can be processed smoothly without trembling.

On the other hand, when the operation of the vehicle 200 is stopped, the stop of the vehicle 200 is not completely made, but some speed data (eg, 0.3) while generating a slight vibration up and down (or front and rear direction) Speed), and the speed data is detected by the sensor unit 10 and then transmitted to the control unit 40 as well as the braking correction unit 80.

Then, the braking correction unit 80 may stop the movement of the virtual camera module 50 driven and controlled by the synchronization processor 60 when the vehicle 200 is braked. When the speed, such as a wobbling generated during braking of the 200, is within a certain range, that is, a speed of 0.3 or less, the braking correction data obtained by processing the zero is output to the synchronization processor 60.

Then, the synchronization processing unit 60 may stop the virtual camera module 50 under the control of the control unit 40 while ignoring the same speed as the slack of the vehicle 200.

That is, as shown in FIG. 6, the X-axis is time and the Y-axis is speed, and the value of the boxed residual data correction portion is oscillated when braking to a value between 0 and 1, and the braking correction unit ( 80 processes all the speeds of 0.3 or less to 0 and outputs them to the synchronization processing unit 60 so that the virtual camera module 50 can be stopped by the synchronization processing unit 60. .

The present invention is not limited to the above-described specific preferred embodiments, and various modifications can be made by any person having ordinary skill in the art without departing from the gist of the present invention claimed in the claims. Of course, such changes will fall within the scope of the claims.

1 is a schematic cross-sectional view showing a driving pattern of a vehicle (elevator) in an embodiment of the present invention.

2 is a block diagram of a virtual external foreground display device of a vehicle according to an embodiment of the present invention.

3 is a conceptual diagram of a state in which a virtual external foreground photographed by a virtual camera module is displayed on a screen panel according to an embodiment of the present invention.

4 and 5 is a graph showing a speed correction state in an embodiment of the present invention.

6 is a graph showing a braking correction state in an embodiment of the present invention.

7 is a program screen diagram for self-diagnosing the operating state of the control unit in the embodiment of the present invention.

8 is a program screen diagram for self-diagnosing the operating state of the virtual space unit in an embodiment of the present invention.

9 is a program screen diagram for self-diagnosing the temperature according to the operation of the control unit in the embodiment of the present invention.

10 is a state diagram for displaying a virtual external foreground on the screen panel according to an embodiment of the present invention.

* Description of the symbols for the main parts of the drawings *

10; Sensor unit 20; Information input unit

30; Virtual space part 40; Control

50; Virtual camera module 60; Synchronization processing unit

70; Screen panel 80; Braking government

90; Speed compensation 100; Self Diagnosis and Recovery Module

200; Vehicle

Claims (6)

Sensor unit for detecting the speed and the destination (or destination floor) according to the operation of the vehicle; An information input unit for outputting input information required for operation of the vehicle; A virtual space unit in which a virtual external foreground processed by 3D by photographing an actual external foreground is constructed; A control unit configured to calculate information sensed by the sensor unit and input information output from the information input unit, and to display virtual foreground image information according to the calculated result; A virtual camera module located in the virtual space part and photographing a virtual external foreground built in the virtual space part while moving in association with the movement of the vehicle; A synchronization processor configured to drive the virtual camera module under the control of the controller so that the movement of the virtual camera module located in the virtual space is synchronized with the speed of the vehicle according to the speed information of the vehicle measured by the sensor unit; And A screen panel configured on a wall of the vehicle and controlled by the controller and displaying image information on a virtual external foreground photographed from the virtual camera module; Virtual outer view display device of the vehicle, characterized in that comprising a. The apparatus of claim 1, wherein the vehicle is an elevator or a subway having a closed space. According to claim 1, When the speed of the braking of the vehicle is within a certain range so that the movement of the virtual camera module driven and controlled by the synchronization processing unit during braking of the vehicle is zero ( a braking correction unit for outputting braking correction data processed to zero) to the synchronization processing unit; Virtual outer view display device of the vehicle, characterized in that it further comprises a. The apparatus of claim 3, wherein a predetermined range of the speed according to the braking of the vehicle is less than or equal to 0.3 according to the rocking of the vehicle. The vehicle according to claim 1, wherein a speed difference according to a traveling distance (height) of the vehicle according to a space ratio error of a real space and the virtual space part and a speed depending on the traveling distance of the virtual camera module do not occur. And a speed compensator for outputting speed correction data to the synchronization processing unit to average the speeds of the speed-up section and the speed-down section of the virtual camera module and to constantly correct them. Virtual outer view display device of the vehicle, characterized in that it further comprises a. The self-diagnosis and recovery module according to claim 1, wherein the controller occupies an abnormal occupancy rate and an abnormal leak of the virtual space, as well as self-diagnosis when the temperature rises above a predetermined temperature to prevent malfunction. ; Virtual outer view display device of the vehicle, characterized in that it further comprises a.

Images