KR101348723B1 - Apparatus and method for generating multi-3d image - Google Patents

Abstract

According to the present invention, a multi-dimensional 3D screen is composed of a plurality of image display apparatuses, and then the depth of the virtual screen that the bezel is optically removed from the 3D image of each display apparatus is calculated using the position and bezel information of the image display apparatus. The 3D image is converted into the calculated depth value of the virtual screen, and the divided 3D image is divided and displayed according to each image display device. Therefore, in the present invention, when the plurality of image display apparatuses are connected to form one large 3D screen, the screen dropping phenomenon may be corrected by the 3D image (3D optical illusion image) with the adjusted depth. In addition, the present invention can correct the color distortion caused by the bezel by correcting the color of the portion overlapping the bezel of the image display device in each divided 3D image.

Description

Multi-dimensional 3D image generation method and apparatus therefor {APPARATUS AND METHOD FOR GENERATING MULTI-3D IMAGE}

The present invention relates to a multi-dimensional 3D image generating method and apparatus capable of correcting screen cut-outs and color distortions caused by screen edges when a large 3D screen is composed of a plurality of image display devices.

The mobile terminal may be configured to perform various functions. Examples of such various functions include a data and voice communication function, a function of photographing a video or a moving image through a camera, a voice storage function, a music file playback function through a speaker system, and an image or video display function. Some mobile terminals include additional functions to execute games, and some other mobile terminals are also implemented as multimedia devices. Moreover, recent mobile terminals can receive broadcast or multicast signals to watch video or television programs.

Further, efforts for supporting and increasing the functions of the mobile terminal continue. Such efforts include not only changes and improvements in structural components that form the mobile terminal, but also improvements in software or hardware. Among them, the touch function of the mobile terminal allows a user who is unfamiliar with the button / key input to conveniently perform the operation of the terminal by using the touch screen. In recent years, not only simple input but also user interface (UI) Is becoming an important function of Accordingly, as the touch function is applied to a mobile terminal in various forms, development of a user interface (UI) corresponding thereto is further demanded.

With the recent development of display technology, mobile terminals have evolved to display three-dimensional (3D) stereoscopic images that enable depth perception or stereovision beyond the display level of two-dimensional images. A variety of related products are also available. Accordingly, the user can use a more realistic user interface or content through the 3D stereoscopic image.

In general, the video display device has a white bezel, that is, the edge of the screen. Therefore, when a plurality of image display apparatuses are connected to form a single large two-dimensional or three-dimensional screen, there is a problem in that a screen break occurs when the two-dimensional object or the three-dimensional object is disconnected due to the bezel.

Accordingly, an object of the present invention is a method and apparatus for generating a multi-dimensional 3D image which can correct a screen breakup by outputting a 3D optical illusion image on a bezel area when a plurality of image display devices are connected to form a single large 3D screen. To provide.

Another object of the present invention is to provide a multi-dimensional 3D image generating method and apparatus capable of correcting color distortion of a 3D object generated when outputting a 3D optical illusion image on a bezel area.

In order to achieve the above object, a method of generating a multiple 3D image according to an embodiment of the present invention comprises the steps of: configuring a single multiple 3D screen with a plurality of image display devices; Calculating a sense of depth of the virtual screen, in which the bezel is optically removed from the 3D image of each display device by using the position and the bezel information of the image display device; Converting the 3D image into the calculated depth value of the virtual screen; And dividing and displaying the converted 3D image according to each image display device.

The multi-dimensional 3D screen is configured by calculating a position of a peripheral display device based on a reference image display device.

The depth value of the virtual screen is determined based on the device having the lowest resolution among the plurality of image display devices.

The multi-dimensional 3D screen may be a 3D screen implemented by a toed-in stereo method or an Asymmetric frustum shift method.

The virtual screen has a sense of depth different from that of the multiple 3D screen such that a 3D image is shown in front of a bezel of each image display device.

The depth of the virtual screen is a difference in depth between the multiple 3D screen and the virtual screen.

The calculating of the depth of the virtual screen may include obtaining an angle θ of the multiple 3D screen for each eye based on the distance d between the eye and the multiple 3D screen and the distance f between the left and right eyes; And calculating a depth (D) of the virtual screen for the multiple 3D screen by using the calculated angle (θ) and the length (d) of the bezel.

The method of generating a multi-D 3D image of the mobile terminal may further include correcting a color of a portion overlapping the bezel of the image display apparatus in each divided 3D image.

Compensating the color may include obtaining a position of a reference device in a plurality of image display devices; Acquiring connection information of the peripheral device of the reference device; Calculating a portion overlapping the bezel of the image display apparatus in each of the divided 3D images based on the position of the reference apparatus and the connection information of the peripheral apparatus; And distorting the calculated color of the calculated portion by the color of the bezel.

 The connection information of the peripheral device includes position coordinates, resolution, inch, bezel width, and color information of each device.

In order to achieve the above object, a multiple 3D image generating apparatus according to an embodiment of the present invention comprises a plurality of image display devices constituting one multiple 3D screen; A memory for storing connection information of each image display device; And using the connection information of the image display device, calculating the depth of the virtual screen, in which the bezel is optically removed from the 3D image of each display device, and converting the 3D image to the calculated depth value of the virtual screen to display each image. It includes a control unit to display on the device.

The 3D screen is a 3D screen implemented by a Toed-in stereo method or an Asymmetric frustum shift method.

The connection information includes position coordinates, resolution, inch, bezel width, and color information of each device.

The virtual screen is a screen for visually displaying a 3D image in front of the bezel of each image display device.

The depth of the virtual screen represents a difference in depth between the multiple 3D screen and the virtual screen.

The controller calculates an angle θ of the multiple 3D screen for each eye based on the distance d between the eye and the multiple 3D screen and the distance f between the left and right eyes, and then calculates the calculated angle θ and the length of the bezel. Using the (d) to calculate the depth (D) of the virtual screen for the multiple 3D screen.

The controller corrects a color of a portion overlapping the bezel of the image display device in each divided 3D image.

The controller calculates an overlapping portion of the bezel of the image display device in each of the divided 3D images based on the position of the reference device and the connection information of the peripheral device among the plurality of image display devices, and calculates the color of the calculated portion. Distort as much as the color to output.

According to the embodiment of the present invention, when a plurality of image display devices are connected to each other to form one large 3D screen, the screen drop phenomenon may be corrected by outputting a 3D image (3D optical illusion image) with a controlled depth. By distorting the color of the portion overlapping the bezel of the image display device in the 3D image in advance, the color distortion of the 3D object due to the 3D optical illusion image can be corrected.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention;
2 is a block diagram of a wireless communication system in which a mobile terminal may operate in accordance with an embodiment of the present invention.
3 is a diagram illustrating an example of screen disconnection due to a bezel when a plurality of video display devices are connected to form one large screen.
4 is a conceptual diagram of a method for generating a multi-dimensional 3D image according to an embodiment of the present invention.
5A and 5B are diagrams illustrating an example of configuring a single large screen by connecting a plurality of video display devices in the present invention.
6 is a flowchart illustrating a method of generating a multi-dimensional 3D image according to an embodiment of the present invention.
7 is a conceptual diagram for implementing a 3D image by the Toed-in method.
8 is an example in which the screen shown in FIG. 7 is composed of two screens.
9A and 9B are examples of obtaining bezel control values.
10 is a conceptual diagram for implementing a 3D image by the Asymmetric frustum shigt method.
FIG. 11 shows an example in which the screen shown in FIG. 10 is composed of two screens.
12A and 12B show examples of obtaining bezel control values (D).
FIG. 13 is a flowchart illustrating color correction of the bezel area illustrated in FIG. 6.
14 illustrates an example of color correction for bezel removal.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, it should be noted that the above-mentioned "module" and "part"

The terminal may be implemented in various forms. For example, the terminal described in this specification may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player) And fixed terminals such as a digital TV, a desktop computer, and the like. In the following description, it is assumed that the terminal is a mobile terminal. However, it will be readily apparent to those skilled in the art that the configuration according to the following description may be applied to the fixed terminal, except for components specifically configured for mobile use.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. 1 shows a mobile terminal having various components. However, not all illustrated components are required. A mobile terminal may be implemented by more components than the illustrated components, or a mobile terminal may be implemented by fewer components.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more components that allow wireless communication between the mobile terminal 100 and the wireless communication system or wireless communication between the mobile terminal 100 and a network on which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcasting signals using various broadcasting systems. In particular, the broadcasting receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) Only Digital Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

In addition, the mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data depending on a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and the wireless Internet module 113 can be built in or externally. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. A typical example of the position information module 115 is a Global Position System (GPS) module. According to the current technology, the GPS module calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to obtain three-dimensional current position information according to latitude, longitude, and altitude It can be calculated accurately. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module can calculate speed information by continuously calculating the current position in real time.

An audio / video (A / V) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame such as a still image or a moving image obtained by the image sensor in the video communication mode or the photographing mode. Then, the processed image frame can be displayed on the display module 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like. Particularly, when the touch pad has a mutual layer structure with the display module 151 described later, it can be called a touch screen.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. Also, it is responsible for a sensing function related to whether or not the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141. This will be discussed later in connection with touch screens.

The sensing unit 140 includes a geomagnetic sensor for calculating a moving direction when a user moves, a gyro sensor for calculating a rotating direction, and an acceleration sensor.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, Video input / output (I / O) ports, earphone ports, and the like.

Here, the identification module is a chip that stores various information for authenticating the use right of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identity module (SIM) ), A Universal Subscriber Identity Module (" USIM "), and the like. In addition, an apparatus having an identification module (hereinafter referred to as 'identification device') can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port. The interface unit 170 receives data from an external device or receives power from the external device to transfer the data to each component in the mobile terminal 100 or to transmit data in the mobile terminal 100 to an external device.

The interface unit 170 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, Various command signals may be transmitted to the mobile terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display module 151, an audio output module 152, and an alarm unit 153.

The display module 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed.

Meanwhile, as described above, when the display module 151 and the touch pad have a mutual layer structure to constitute a touch screen, the display module 151 can be used as an input device in addition to the output device. The display module 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display 3D display). Some of these displays can be configured to be transparent so that they can be viewed from outside. This may be referred to as a transparent display. A typical example of the transparent display is a transparent organic light emitting diode (TOLED) or the like. In addition, there may be two or more display modules 151 according to the embodiment of the mobile terminal 100. For example, the mobile terminal 100 may be provided with an external display module (not shown) and an internal display module (not shown) at the same time. The touch screen may be configured to detect not only the touch input position and area but also the touch input pressure.

The audio output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 outputs an acoustic signal related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for informing occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. When a call signal is received or a message is received, the alarm unit 153 can output a vibration to notify it. Alternatively, when the key signal is input, the alarm unit 153 can output the vibration by the feedback to the key signal input. The user can recognize the occurrence of an event through the vibration output as described above. Of course, a signal for notifying the occurrence of an event may also be output through the display module 151 or the sound output module 152.

The memory 160 may store a program for processing and controlling the control unit 180 and may store a function for temporarily storing input / output data (e.g., a phone book, a message, a still image, . In addition, the memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory) SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read- And an optical disc. Also, the mobile terminal 100 may operate a web storage for performing a storage function of the memory 160 on the Internet.

The control unit 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. In addition, the control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the control unit 180 as a battery, and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases, And may be implemented by the control unit 180.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. In addition, the software codes may be stored in the memory 160 and executed by the control unit 180. [

The terminal 100 shown in Fig. 1 is configured to be operable in a communication system capable of transmitting data through a frame or packet, including a wired / wireless communication system and a satellite-based communication system .

Hereinafter, a communication system capable of operating a terminal according to the present invention will be described with reference to FIG.

The communication system may use different air interfaces and / or physical layers. For example, wireless interfaces that can be used by communication systems include, but are not limited to, Frequency Division Multiple Access ('FDMA'), Time Division Multiple Access ('TDMA'), Code Division Multiple Access (CDMA), Universal Mobile Telecommunications Systems (UMTS) (especially Long Term Evolution (LTE)), Global System for Mobile Communications (GSM) . Hereinafter, for convenience of description, the description will be limited to CDMA. However, the present invention is applicable to all communication systems including CDMA wireless communication systems.

2, the CDMA wireless communication system includes a plurality of terminals 100, a plurality of base stations (BSs) 270, and base station controllers (BSCs) 275 , And a mobile switching center ('MSC') 280. The MSC 280 is configured to be connected to a public switched telephone network (PSTN) 290 and is also configured to be connected to BSCs 275. BSCs 275 may be coupled in pairs with BS 270 through a backhaul line. The backhaul line may be provided according to at least one of E1 / T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. Thus, a plurality of BSCs 275 may be included in the system shown in FIG.

Each BS 270 may comprise at least one sector, and each sector may comprise an omnidirectional antenna or an antenna pointing to a particular direction of radial from BS 270. [ In addition, each sector may include two or more antennas of various types. Each BS 270 may be configured to support a plurality of frequency assignments, each of which has a specific spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of sectors and frequency assignments may be called a CDMA channel. BS 270 may be referred to as a Base Station Transceiver Subsystem (BTSs). In this case, the word "base station" may be referred to as a combination of one BSC 275 and at least one BS 270. [ The base station may also indicate “cell site”. Alternatively, each of the plurality of sectors for a particular BS 270 may be referred to as a plurality of cell sites.

2, a broadcasting transmitter (BT) 295 transmits a broadcasting signal to the terminals 100 operating in the system. The broadcast receiving module 111 shown in FIG. 1 is provided in the terminal 100 to receive a broadcast signal transmitted by the BT 295.

In addition, FIG. 2 illustrates several Global Positioning System ('GPS') satellites 300. The satellites 300 help to locate at least one of the plurality of terminals 100. Although two satellites are shown in FIG. 2, useful location information may be obtained by two or more satellites. The location information module 115 shown in FIG. 1 cooperates with satellites 300 to obtain desired location information. Here, you can track your location using all of the technologies that can track your location, as well as your GPS tracking technology. Also, at least one of the GPS satellites 300 may optionally or additionally be responsible for satellite DMB transmission.

Among the typical operations of a wireless communication system, the BS 270 receives a reverse link signal from the various terminals 100. At this time, the terminals 100 are connecting a call, transmitting or receiving a message, or performing another communication operation. Each of the reverse link signals received by the particular base station 270 is processed by the particular base station 270. The data resulting from the processing is transmitted to the connected BSC 275. The BSC 275 provides call resource allocation and mobility management functions, including the organization of soft handoffs between the base stations 270. The BSC 275 also transmits the received data to the MSC 280 and the MSC 280 provides additional transmission services for connection with the PSTN 290. [ Similarly, the PSTN 290 connects to the MSC 280, the MSC 280 connects to the BSCs 275, and the BSCs 275 communicate with the BSs 270 ).

The present invention uses a 3D optical illusion to correct a screen cut-out caused by a bezel when a plurality of image display devices are connected to form a single large 3D screen. In addition, the present invention outputs by distorting the color of the portion corresponding to the bezel area of the 3D optical illusion in advance in order to correct the color distortion of the 3D object by the color of the bezel when outputting the 3D optical illusion.

To this end, the present invention calculates the position of the virtual screen in which the 3D images of two adjacent display apparatuses optically meet by using the position and bezel information of each image display apparatus, and the 3D illusion image to be displayed at the position of the virtual screen. The 3D optical illusion is generated by dividing the generated 3D optical illusion in accordance with each image display device.

The 3D optical illusion image has a depth that is different from that of the original 3D image, and has a depth (-depth) to make it appear closer to the user. The depth of the 3D optical illusion image is determined according to the device having the lowest resolution because dizziness may be caused when the device is fitted with the device having the maximum resolution.

The one large three-dimensional screen is configured by calculating the positions of the plurality of peripheral devices around the reference device.

Generation of the optical illusion image and color correction are performed based on connection information of a peripheral device. The connection information of the peripheral device includes coordinates, resolutions and inches of each device, and bezel width and color information of each device.

3 illustrates an example of screen disconnection due to a bezel when a plurality of video display devices are connected to form one large screen.

As shown in FIG. 3, when a plurality of image display apparatuses are connected to form a single large screen, the 2D object or the 3D object may be disconnected due to the bezel of each image display apparatus.

4 is a conceptual diagram of a method for generating a multi-dimensional 3D image according to an embodiment of the present invention.

According to the present invention, when a plurality of video display devices are connected to form a large screen, the bezel is corrected when the user views one large screen while wearing 3D glasses by controlling the depth of the 3D image output through the large screen. Allows viewing of 3D objects.

5A and 5B illustrate an example of configuring a single large screen by using a plurality of video display devices in the present invention.

As shown in FIG. 5A, each image display device has a white bezel 50 corresponding to an edge of the display unit 151. Therefore, in order to increase the 3D depth, at least one image display device may be combined to form one large 3D screen. At this time, the three-dimensional depth is increased by the pixels stretched by the combination of devices (or devices).

The large 3D screen is constructed using one Mother device and N Child devices. In this case, by calculating the position of each child device centering on the mother device (coordinate 0,0), a large screen can be configured as shown in FIG. 5B. After calculating the position and bezel area of each child device, By adjusting the depth of the bezel area, the image displayed through the large 3D screen is displayed without a break.

6 is a flowchart illustrating a method of generating a multi-dimensional 3D image according to an embodiment of the present invention.

When the user configures a multi-dimensional 3D screen, the user can set information on the size of the screen to be configured, that is, the number of devices to be controlled, on / of the bezel removal function, and a reference device as a reference for the screen configuration.

When a plurality of 3D (3D) screens (images) are configured by the plurality of image display apparatuses, the controller 180 checks on / of the bezel removing function (S10 and S11). When the bezel removal function is set to on, the controller 180 obtains location information (eg, position coordinates) of the reference device constituting the multi-dimensional 3D screen and connection information of the peripheral device (S12 and S13). . The connection information of the peripheral device includes location coordinates, resolution and inch of each device, and bezel width and color information of each device. In addition, the connection information may be determined by the type and configuration location of the video display device when configuring a multi-dimensional 3D screen, and the determined information may be stored in the memory 160.

For example, as shown in FIG. 6, when a multi-dimensional 3D screen is composed of four image display devices, the reference device is device 2 and the peripheral devices are devices 1, 3, and 4. In this case, the coordinate of the second device is (0.1), and the coordinates of the peripheral device are (0,0), (1,0) and (1,1), respectively. In addition, the bezel width and color information of the peripheral device are fixedly provided according to the type of the device.

When the location information of the reference device and the connection information of the peripheral devices are obtained, the controller 180 calculates a bezel control value D to perform a control operation for correcting the bezel (S14). The bezel control value (D) controls the depth of the 3D image (control to protrude), so that when viewed by the user, the screens of all the devices are not connected by the bezel but are connected to each other (optical illusion). In this case, the depth of the 3D image is controlled according to the device or the screen having the lowest resolution among the components or the screen.

Therefore, when the bezel control value D is calculated, the controller 80 controls the depth of the 3D image using the bezel control value. As a result, the 3D image is placed in front of the bezel by optical illusion, and the screens of all devices appear to be connected to each other.

However, when the 3D image is placed in front of the bezel due to optical illusion, the color of the object of the portion is displayed by mixing the output color of the image display device and the bezel color (white). Therefore, the controller 180 corrects the distortion of the 3D optical illusion image due to the bezel color by distorting the color of the bezel area in advance (S17 and S18). That is, the controller 180 outputs an image by subtracting the bezel color (white) from the output color of the image display device, so that the user can normally see the output color of the image display device even if the bezel color is affected by the bezel area.

On the other hand, when the bezel removal function is set to off, the controller 180 divides the image and outputs the image as in the prior art (S19). Hereinafter, the operation will be described in more detail.

FIG. 7 is a conceptual diagram of implementing a 3D image by a crossed-in stereo method. Referring to FIG.

The 3D image is displayed by rotating the left and right images along the rendering plane about the Y axis by the distance of both eyes with respect to the center eye. Therefore, the 3D image is displayed or protruded based on the current screen Z, that is, a screen viewpoint. .

FIG. 8 shows an example in which the screen shown in FIG. 7 is composed of two screens.

As shown in FIG. 8, when two screens to be combined are located at the left and right, the screen is rotated about the X axis to form one large screen. When the large screen is configured, a bezel is generated between the screen 1 and the screen 2, so that the seamless screen cannot be seen in the 2D (2D) image.

Therefore, the present invention assumes a point where the 3D image meets as the virtual screen Z 'and outputs the pre-distorted images X', Y ', and Z', that is, the 3D image is virtual. If the depth of the image is controlled to be displayed on the screen Z ', the screen breakage caused by the bezels 1 and 2 is corrected on the virtual screen Z', so that the user can see a seamless 3D image as shown in FIG. 5B. .

However, in order to output the pre-distortion image (optical illusion image), the depth D between the current screen Z and the virtual screen Z 'must be known. In the present invention, the depth sense D is referred to as a bezel control value.

9A and 9B show an example of obtaining a bezel control value (D).

As shown in FIG. 9A, the angle θ for each eye (left eye or right eye) is obtained by using Equation 1 using the distance between the eye and the screen d and the distance between the left and right eyes f. Can be.

[Equation 1]

θ = arctan (0.5f / d)

In addition, the distance between the virtual screen Z 'from the screen Z, that is, the Jebel control value D, is determined by using the eye angle θ and the bezel length b as shown in FIG. 9B. Equation 2 can be obtained.

&Quot; (2) "

D = b / (tanθ)

In addition, the matrix for converting the coordinates Z (X, Y, Z, 1) on the actual screen into the coordinates X ', Y', Z ', 1 on the virtual screen Z' is a direction close to the user. Same as the matrix used to move D in the (near Z) direction.

Therefore, the controller 180 controls the depth of the image of the bezel area so that the image on the actual screen is displayed at the coordinates X ', Y', Z ', 1 of the virtual screen Z'.

FIG. 10 is a conceptual diagram of realizing a 3D image by an asymmetric frustum shift method, in which a 3D image is expressed by shifting one eye (right eye) image by a distance f between a left eye and a right eye.

FIG. 11 shows an example in which the screen shown in FIG. 10 is composed of two screens.

As shown in FIG. 11, when two screens to be combined are positioned to the left and right, the screen is shifted based on the X axis to form one large 3D screen. Even in this case, a bezel is generated between the screen 1 and the screen 2 so that the seamless screen cannot be seen in the 2D (2D) image.

Accordingly, the present invention assumes a point where the 3D image meets as the virtual screen Z 'and outputs the pre-shifted images X', V ', Z' (optical illusion), that is, If the depth of the image is controlled so that the 3D image is displayed on the virtual screen Z ', the screen breakage caused by the bezels 1 and 2 is corrected on the virtual screen Z', so that the user can see the seamless 3D image as shown in FIG. 5B. I can see it.

However, in order to output the pre-shifted image, as shown in FIG. 8, the depth D between the current screen Z and the virtual screen Z ′ must be known.

12A and 12B show an example of obtaining a bezel control value (D).

As shown in FIG. 12A, the angle θ for each eye (left eye or right eye) is obtained using Equation 3 using the distance d between the eye and the screen and the distance f between the left and right eyes. Can be.

&Quot; (3) "

θ = arctan (f / d)

In addition, the distance between the virtual screen Z 'from the screen Z, that is, the Jebel control value D, is determined by using the angle [theta] of the eye and the length b of the bezel as shown in FIG. 12B. It can be obtained as shown in Equation 2]. The matrix for converting the coordinates Z on the actual screen (X, Y, Z, 1) to the coordinates X ', Y', Z ', 1 on the virtual screen Z' is near as described previously. It is the same as the matrix used when moving D in the Z direction.

Therefore, the controller 180 controls the depth of the image of the bezel area so that the image on the actual screen is displayed at the coordinates X ', Y', Z ', 1 of the virtual screen Z'.

In general, if you mix the color of each pixel output from the video device, it becomes white as below (the light plus white). 1 pixel of white color = (R, G, B) = (255, 255, 255) In addition, sampling the color of the bezel and expressing it equal to the image pixel is the following (object color plus black). (R, G, B) = (0,0,0)

However, when the 3D image is placed in front of the bezel due to the optical illusion, the color of the object is distorted as follows.

Color of the object = output color of the video device + bezel color

Accordingly, if the color of the image overlapping the bezel is distorted in advance as shown below, the distortion of the 3D optical illusion image due to the bezel color may be corrected.

Object's color-bezel color = output color of video device

By this concept, the depth of the image is controlled so that the image on the actual screen appears at the coordinates (X ', Y', Z ', 1) of the virtual screen Z', and the color of the image overlapping the bezel is controlled. By distorting and outputting in advance as below, it is possible to correct screen breakage and color distortion caused by the bezel.

FIG. 13 is a flowchart illustrating color correction of the bezel area illustrated in FIG. 6.

As shown in FIG. 13, when a 3D image (optical illusion image) is divided for each device based on the position (coordinate) of each image device by performing the operation of FIG. 6, the controller 180 controls the bezel area of each device. In operation S20, color distortion of the bezel is corrected by distorting and outputting the color of the 3D image corresponding to the calculated bezel area (S21 and S22).

14 shows an example of color correction for removing bezels.

First, the controller 180 controls the depth of the 3D image (e.g. hexahedron) based on the position of each device, and divides and displays the 3D image into four images based on the position of each device. However, the color of the bezel portion in the four images is distorted by the color (white) of the bezel. For example, assuming that the color of the cube is orange, a portion of the cube corresponding to the bezel is distorted and displayed in a light running color.

Therefore, in the present invention, if the color of the bevel portion is distorted to red in advance in four images, the user can see the original cube of orange by the color of the bezel.

Meanwhile, when constructing a large 3D screen, the controller 180 detects the bezel area and performs the above-described various operations. Therefore, in order to overcome the limitation of the associative capability of the mobile terminal, various operations required for the bezel region dropping and color correction may be provided through the cloud-based device using a cloud computing environment.

In addition, the present invention has been described by taking a mobile terminal as an example for convenience of description, but the present invention is not limited thereto and is equally applicable to various image display fields having bezels.

As described above, in the present invention, when a plurality of image display apparatuses are connected to form a single large 3D screen, a depth of 3D image (3D optical illusion image) is adjusted to prevent screen breakage caused by a bezel. 3D image is not distorted and the 3D image is not distorted when the user views the large 3D image while wearing 3D glasses by correcting the color of the portion overlapping the bezel of the image display device in the 3D image. I can see it.

Further, according to an embodiment of the present invention, the above-described method can be implemented as computer-readable code on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . Further, the computer may include a control unit of the terminal.

The mobile terminal described above can be applied to not only the configuration and method of the embodiments described above but also all or some of the embodiments may be selectively combined so that various modifications may be made to the embodiments It is possible.

50: Pattern Area 51: Screen Setting Menu
110: wireless communication unit 111: broadcast receiving module
112: mobile communication module 113: wireless Internet module
140: sensing unit 150: output unit
151: display unit 160: memory
180:

Claims (20)

Constructing one multiple 3D screen with a plurality of video display devices;
Calculating a sense of depth of a virtual screen in which 3D images of two adjacent display devices abut each other on the multiple 3D screen by using the position and bezel information of each image display device;
Converting the 3D image into the calculated depth; And
And displaying the converted 3D image by dividing the converted 3D image according to each image display device. The method of claim 1, wherein the multiple 3D screen is
A method for generating a multi-dimensional 3D image by calculating a position of a peripheral display device based on a reference image display device. According to claim 1, wherein the depth of the virtual screen
A multi-dimensional 3D image generating method determined based on a device having a lowest resolution among a plurality of image display devices. The method of claim 1, wherein the multiple 3D screen is
A multi-dimensional 3D image generating method, characterized in that the 3D screen implemented by a to-in stereo method or an asymmetric frustum shift method. The method of claim 1, wherein the virtual screen
Multi-D 3D, characterized in that the 3D image has a different depth than the multi-D 3D screen so that the 3D image is shown in front of the bezel of each image display device, and the 3D images of two adjacent display devices are in contact with each other. How to create an image. According to claim 1, wherein the depth of the virtual screen
A multi-dimensional 3D image generating method, characterized in that the difference in depth between the multi-dimensional 3D screen and the virtual screen. The method of claim 1, wherein the calculating of the depth of the virtual screen
Obtaining an angle θ of the multiple 3D scene for each eye based on the distance d between the eye and the multiple 3D scene and the distance f between the left and right eyes; And
And calculating a depth (D) of the virtual screen for the multiple 3D screen by using the calculated angle (θ) and the length (b) of the bezel.
θ = arctan (0.5f / d)
D = b / (tanθ) The method of claim 7, further comprising correcting a color of a portion overlapping the bezel of the image display device in each of the divided 3D images. The method of claim 8, wherein the correcting the color is
Acquiring the positions of the reference apparatus in the plurality of image display apparatuses;
Acquiring connection information of the peripheral device of the reference device;
Calculating a portion overlapping the bezel of the image display apparatus in each of the divided 3D images based on the position of the reference apparatus and the connection information of the peripheral apparatus; And
And distorting the calculated color of the calculated portion by the color of the bezel. The method of claim 9, wherein the connection information of the peripheral device is
A method for generating multiple 3D images including position coordinates, resolution, inch, bezel width, and color information of each device. The method of claim 1, wherein the various calculations and image divisions related to the 3D image are performed.
Method for generating a multi-dimensional 3D image, characterized in that received by the cloud interface after performing the calculation in the mobile terminal or an external cloud computing device. A plurality of video display devices that constitute one multiple 3D screen;
A memory for storing connection information and bezel information of each image display apparatus; And
The depth of the virtual screen in which 3D images of two adjacent display apparatuses touch each other in the multiple 3D screen is calculated using the stored position and bezel information of the image display device, and the 3D image is converted into the calculated depth. And a control unit to display on an image display device. The method of claim 12, wherein the multiple 3D screen is
A multi-dimensional 3D image generating apparatus, characterized in that the 3D screen implemented in a toed-in stereo or asymmetric frustum shift. The method of claim 12, wherein the connection information
Multiple 3D image generating device including position coordinates, resolution, inch, bezel width and color information of each device. The method of claim 12, wherein the virtual screen
3D image is an optical illusion in front of the bezel of each video display device, the 3D image generating device, characterized in that the bezel is removed because the 3D images of two adjacent display devices are in contact with each other. The depth of the virtual surface of claim 12, wherein
A multi-dimensional 3D image generating apparatus, characterized in that it represents the difference in depth between the multiple 3D screen and the virtual screen. 13. The apparatus of claim 12, wherein the control unit
Based on the distance (d) between the eye and the multiple 3D screen and the distance (f) between the left and right eyes, the angle (θ) of the multiple 3D screen for each eye is obtained, and the calculated angle (θ) and the length of the bezel (b) And a depth (D) of the virtual screen for the multiple 3D screen is calculated.
θ = arctan (0.5f / d)
D = b / (tanθ) 13. The apparatus of claim 12, wherein the control unit
A multi-dimensional 3D image generating device, characterized in that for correcting the color of the portion overlapping the bezel of the image display device in each divided 3D image. The method of claim 18, wherein the control unit
Based on the position of the reference apparatus and the connection information of the peripheral apparatus among the plurality of image display apparatuses, a portion overlapping the bezel of the image display apparatus is calculated in each divided 3D image, thereby distorting the color of the calculated portion by the color of the bezel. Multi 3D image generating device that outputs. The method of claim 12, wherein the various calculations and image segmentation related to the 3D image are performed.
The multi-dimensional 3D image generating apparatus, characterized in that received by the cloud interface after performing in the control unit or an external cloud computing device.

Images