KR101341521B1 - Terminal having function for rendering image and program recording medium - Google Patents

Abstract

The present invention estimates a plurality of planes forming at least one vanishing point and one spatial concept on a two-dimensional image input through a camera, and uses the estimated vanishing point and the plane to input the two-dimensional image. It relates to a terminal having an image conversion function including a control unit for converting the to a three-dimensional image.

Description

A terminal having an image conversion function and a medium recording a program for implementing the function {TERMINAL HAVING FUNCTION FOR RENDERING IMAGE AND PROGRAM RECORDING MEDIUM}

The present invention relates to a terminal capable of converting a two-dimensional image input through a camera into a three-dimensional image, and a medium for recording a program for implementing such a function.

Generally, a terminal refers to a device having at least one of a voice / video call function, an information input / output function, and a data storage function.

In recent years, in addition to the above-mentioned functions, the terminal can perform various functions such as video shooting of a still image or a moving image, playback of a multimedia file such as a music file or a moving picture file, game, broadcast reception / As a result, it is implemented as a comprehensive multimedia player.

In these multimedia devices, various new attempts are being applied in terms of hardware or software to implement complex functions. For example, a user interface (UI) environment implemented in various forms is provided to allow a user to easily and conveniently search for or select a function.

In particular, according to the image conversion method according to the prior art, the terminal performs the image conversion process in accordance with the operation from the user. Therefore, when there is no user's operation, the image conversion process cannot be performed.

In addition, according to the prior art, it is possible to convert from a two-dimensional image to a three-dimensional image only by a box model method. That is, various conversion methods to three-dimensional images are not provided.

It is an object of the present invention to provide a terminal and a program capable of automatically performing an image conversion process even when there is no user's operation.

Another object of the present invention is to provide a terminal and a program capable of efficiently and variously performing an image conversion process by applying various three-dimensional model methods.

In order to achieve the above object, the terminal having an image conversion function according to the present invention, the camera receiving a two-dimensional image (image); And estimating a plurality of planes forming at least one vanishing point and one spatial concept on the input two-dimensional image, and using the estimated vanishing point and the plane, three-dimensional image of the input two-dimensional image. The control unit to convert to.

In addition, in order to achieve the above object, a medium in which a program according to the present invention is recorded, the method comprising: receiving a dimensional image; Estimating at least one vanishing point on the input two-dimensional image; Estimating a plurality of planes forming one spatial concept on the input two-dimensional image based on the estimated at least one vanishing point; And a program for performing the step of converting the input two-dimensional image into a three-dimensional image by using the estimated vanishing point and plane.

The effects of a terminal having an image conversion function and a medium on which a program implementing the function according to the present invention described above are described as follows.

First, an image conversion process from an input two-dimensional image to a three-dimensional image may be automatically performed without a user's manipulation.

Second, various three-dimensional model methods can be applied in the process of converting an image from two to three dimensions.

The above objects, features and advantages will become more apparent from the following detailed description in conjunction with the accompanying drawings. Hereinafter, a terminal having an image conversion function and a medium on which a program for implementing the function are recorded will be described in more detail with reference to the accompanying drawings. In addition, the detailed description of the known technology, which is considered to be a possibility of blurring the gist of the present invention, will be omitted.

A mobile terminal, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigation device, A digital camera, and an MPEG layer 3 player (MP3P).

Referring to FIG. 1, a terminal related to the present invention will be described in terms of functional components. 1 is a block diagram of a terminal related to an embodiment of the present invention.

1 includes a wireless communication unit 110, an audio / video (A / V) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a control unit 180, a power supply unit 190, and the like. Figure 1 shows a terminal with various components. However, not all illustrated components are required. A terminal may be implemented by more components than the components shown, or a terminal may be implemented by fewer components.

Hereinafter, the components constituting the terminal 100 shown in FIG. 1 will be described in order.

The wireless communication unit 110 may include at least one component that performs wireless communication between the terminal 100 and the wireless communication system or wireless communication between the terminal 100 and the network in which the terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, a location information module 115, have.

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel.

Here, the broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may be a server for generating and transmitting broadcast signals and / or broadcast-related information, or a server for receiving broadcast signals and / or broadcast-related information generated by the broadcast server and transmitting the generated broadcast signals and / or broadcast- In addition, the broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. In addition, the broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may also be provided through a mobile communication network, in which case it may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems. In particular, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) ), Digital Video Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all the broadcasting systems that provide broadcast signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160. [

In addition, the mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built in or externally attached to the terminal 100.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, RFID (Radio Frequency Identification), IrDA (Infrared Data Association), UWB (Ultra Wideband), ZigBee, etc. may be used as the short distance communication technology.

In addition, the position information module 115 is a module for confirming or obtaining the position of the terminal 100. One example is a Global Position System (GPS) module. The GPS module receives position information from a plurality of satellites. Here, the location information may include coordinate information indicated by latitude and longitude. For example, the GPS module can calculate the current location according to the triangular method at three different distances, using the time and distance accurately measured from three or more satellites. For example, a method of obtaining distance and time information from three satellites and correcting the error by one satellite may be used. Particularly, the GPS module can obtain not only the latitude, longitude, and altitude, but also the three-dimensional speed information and the accurate time from the position information received from the satellite.

The A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame such as a still image or a moving image obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 can be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be provided in two or more according to the configuration of the terminal 100.

The microphone 122 receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 in the case of the call mode, and output. The microphone 122 may implement various noise reduction algorithms for eliminating noise generated in the process of receiving an external sound signal.

The user input unit 130 receives the input operation from the user and generates input data for controlling the operation of the terminal 100. [ The user input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like. Particularly, when the touch pad has a mutual layer structure with the display unit 151, which will be described later, it can be called a touch screen.

The sensing unit 140 senses the current position of the terminal 100 such as the open / close state of the terminal 100, the position of the terminal 100, the user's contact, the orientation of the terminal 100, And generates a sensing signal for controlling the operation of the terminal 100. For example, when the terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. In addition, the power supply unit 190 may also be responsible for sensing functions related to whether or not the power supply unit 190, the interface unit 170 is coupled to the external device.

The interface unit 170 serves as an interface with all the external devices connected to the terminal 100. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, Video input / output (I / O) ports, earphone ports, and the like.

The identification module includes a user identification module (UIM), a subscriber identity module (SIM) module, and the like. The identification module includes various information for authenticating the use right of the terminal 100, ), A Universal Subscriber Identity Module (" USIM "), and the like. In addition, an apparatus having an identification module (hereinafter referred to as 'identification device') can be manufactured in a smart card format. Thus, the identification device can be connected to the terminal 100 via the port. The interface unit 170 receives data from an external device or receives power from the external device and transmits the data to each component in the terminal 100 or transmits data in the terminal 100 to an external device.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.

The display unit 151 displays and outputs information processed by the terminal 100. [ For example, when the terminal is in the call mode, a UI (User Interface) or GUI (Graphic User Interface) associated with the call is displayed. When the terminal 100 is in the video communication mode or the photographing mode, the captured or / and received image or UI and GUI are displayed.

Meanwhile, as described above, when the display unit 151 and the touch pad have a mutual layer structure to constitute a touch screen, the display unit 151 can be used as an input device in addition to the output device. The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display (3D display). According to the embodiment of the terminal 100, two or more display units 151 may exist. For example, the terminal 100 may be provided with an external display unit (not shown) and an internal display unit (not shown) at the same time.

The audio output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a communication mode or a recording mode, a voice recognition mode, and a broadcast reception mode. The sound output module 152 outputs an acoustic signal related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the terminal 100. [ The audio output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the terminal 100. [ Examples of events that occur in a terminal include receiving a call signal, receiving a message, and inputting a key signal. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. When a call signal is received or a message is received, the alarm unit 153 can output a vibration to notify it. Alternatively, when the key signal is input, the alarm unit 153 can output the vibration by the feedback to the key signal input. The user can recognize the occurrence of an event through the vibration output as described above. Of course, the signal for notifying the occurrence of an event may also be output through the display unit 151 or the sound output module 152. [

The memory 160 may store a program for processing and controlling the control unit 180 and may have a function for temporarily storing input / output data (e.g., a phone book, a message, a still image, . ≪ / RTI >

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) A random access memory (SRAM), a read only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM) , An optical disc, and the like. Also, the terminal 100 may operate a web storage that performs a storage function of the memory 160 on the Internet.

The control unit 180 typically controls the overall operation of the terminal. For example, it carries out related control and processing for voice call, data communication, video call, and the like. In addition, the control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or separately from the control unit 180.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power required for operation of the respective components.

The various embodiments described herein may be embodied in a computer-readable recording medium, for example, using software, hardware, or a combination thereof.

In accordance with a hardware implementation, the embodiments described herein may be implemented in the form of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs) ), Processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases, such embodiments may be implemented by the controller 180.

In accordance with a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. Also, the software codes may be stored in the memory 160 and executed by the control unit 180. [

Hereinafter, with reference to FIG. 1, in order to perform the image conversion function according to the present invention, the organic operation relationship between each component of the terminal will be described in detail.

First, the camera 121 receives a two-dimensional image from the outside.

As the controller 180 receives the image input signal from the camera 121, the controller 180 estimates a plurality of planes forming at least one vanishing point and one spatial concept on the two-dimensional image input through the camera 121, The 2D image may be converted into a 3D image using the estimated vanishing point and the plane.

In the foregoing, the terminal related to the present invention has been examined from the viewpoint of components according to functions. Hereinafter, referring to FIGS. 2 and 3, the terminal related to the present invention will be further described in terms of components according to appearance. Hereinafter, for simplicity of explanation, a slider type terminal will be exemplified among various types of terminals such as a folder type, a bar type, a swing type, a slider type, and the like. Therefore, the present invention is not limited to a slider type terminal, and can be applied to all types of terminals including the above-mentioned types.

2 is a perspective view of a terminal according to an embodiment of the present invention, viewed from the front.

The terminal 100 according to the present invention includes a first body 200 and a second body 205 configured to be slidable along at least one direction on the first body 200.

Meanwhile, in the case of a folder type, the terminal 100 according to the present invention includes a first body and a second body configured to be folded or unfolded at least one side of the first body.

The state where the first body 200 is disposed in a state of being overlapped with the second body 205 may be referred to as a closed configuration and the first body 200 may be referred to as a second body 205 ) May be referred to as an open configuration.

Although the terminal 100 operates mainly in the standby mode in the closed state, the standby mode is also canceled by the user's operation. The terminal 100 operates mainly in the communication mode in the open state, but is also switched to the standby mode after the user's operation or a predetermined time elapses.

The casing (casing, housing, cover, etc.) constituting the outer appearance of the first body 200 is formed by the first front case 220 and the first rear case 225. Various electronic components are embedded in the space formed by the first front case 220 and the first rear case 225. At least one intermediate case may be additionally disposed between the first front case 220 and the first rear case 225.

The cases may be formed by injecting a synthetic resin or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the sound output module 152, the camera 121, or the first user input unit 210 may be disposed on the first body 200, specifically, the first front case 220.

The display unit 151 includes a liquid crystal display (LCD), an OLED (Organic Light Emitting Diodes), and the like that visually express information.

In addition, the touch pad is superimposed on the display unit 151 in a layer structure, so that the display unit 151 may operate as a touch screen to enable information input by a user's touch.

The sound output module 152 may be implemented in the form of a speaker.

The camera 121 may be implemented so as to be suitable for photographing an image or a moving image for a user or the like.

As in the case of the first body 200, the case constituting the outer appearance of the second body 205 is formed by the second front case 230 and the second rear case 235.

The second user input unit 215 may be disposed on the front surface of the second body 205, specifically, the second front case 230.

The third user input unit 245, the microphone 122, and the interface unit 170 may be disposed in at least one of the second front case 230 and the second rear case 235.

The first to third user input units 210, 215, and 245 may be collectively referred to as a user input unit 130 and may be employed in any manner as long as the user operates in a tactile manner with a tactile impression .

For example, the user input unit 130 may be implemented as a dome switch or a touch pad that may receive a command or information by a user's push or touch operation, or may be operated as a wheel or jog method or a joystick that rotates a key. It may also be implemented in a manner and the like.

In terms of functions, the first user input unit 210 is for inputting commands such as start, end, and scroll, and the second user input unit 215 is for inputting numbers, characters, symbols, will be. Also, the third user input unit 245 can operate as a hot-key for activating a special function in the terminal.

The microphone 122 may be implemented in a form suitable for receiving a user's voice, other sounds, and the like.

The interface unit 170 is a channel through which a terminal related to the present invention can exchange data with an external device. For example, the interface unit 170 may be a wired or wireless connection terminal for connecting to an earphone, a port for short-range communication (for example, an IrDA port, a Bluetooth port, a wireless LAN port a wireless Lan port), or power supply terminals for supplying power to the terminal.

The interface unit 170 may be a card socket that accommodates an external card such as a SIM (subscriber identification module) or a UIM (user identity module), a memory card for information storage, and the like.

A power supply unit 190 for supplying power to the terminal 100 is mounted on the second rear case 235 side.

The power supply unit 190 may be detachably coupled to a rechargeable battery for charging or the like.

3 is a perspective view of the terminal shown in FIG.

Referring to FIG. 3, a camera 121 may further be mounted on the rear surface of the second rear case 235 of the second body 205. The camera 121 mounted on the second body 205 has a photographing direction which is substantially opposite to that of the camera 121 of the first body 200 and is different from the camera 121 of the first body 200 Pixel.

For example, the camera 121 of the first body 200 has low pixels so that it is easy to capture a face of the user and transmit the captured image to the other party in case of a video call or the like, and the camera 121 of the second body 205 It is preferable to have a high pixel since a general subject is photographed and is not immediately transferred.

A flash 250 and a mirror 255 may be additionally disposed adjacent to the camera 121 of the second body 205. The flash 250 shines light toward the subject when the subject of the subject is photographed by the camera 121 of the second body 205. The mirror 255 makes it possible for the user to illuminate the user's own face or the like in the case where the user intends to photograph (self-photograph) himself / herself using the camera 121 of the second body 205. [

The second rear case 235 may further include an acoustic output module 152.

The sound output module 152 of the second body 205 may implement the stereo function together with the sound output module 152 of the first body 200 and may be used for the talk in the speakerphone mode.

In addition, an antenna 260 for receiving broadcast signals may be disposed on one side of the second rear case 235 in addition to the antenna for communication. The antenna 260 may be installed to be detachable from the second body 205.

A portion of the slide module 265 that slidably couples the first body 200 and the second body 205 is disposed on the first rear case 225 side of the first body 200.

The other part of the slide module 265 may be disposed on the second front case 230 side of the second body 205 and may not be exposed to the outside as in this figure.

In the above description, the camera 121 or the like is disposed on the second body 205, but the present invention is not limited thereto.

For example, at least one of the configurations described as being disposed in the second rear case 235, such as the camera 121 of the second body 205, may include the first body 200, 225). In such a case, there is an advantage that the configuration (s) disposed in the first rear case 225 in the closed state is protected by the second body 205. Even if the camera 121 of the second body 205 is not separately provided, the camera 121 of the first body 200 is rotatably formed so that the photographing direction of the camera 121 of the second body 205 As shown in FIG.

The terminal 100 shown in Figs. 1 to 3 is operable in a communication system capable of transmitting data through a frame or a packet, including a wired / wireless communication system and a satellite-based communication system .

Hereinafter, a wireless communication system in which a terminal according to an embodiment of the present invention can operate will be described with reference to FIG. 4.

The communication system may use different air interfaces and / or physical layers. For example, wireless interfaces that can be used by communication systems include, but are not limited to, Frequency Division Multiple Access ('FDMA'), Time Division Multiple Access ('TDMA'), Code Division Multiple Access (CDMA), Universal Mobile Telecommunications Systems (UMTS), in particular Long Term Evolution (LTE), Global System for Mobile Communications (GSM) However, the present invention is applicable to all communication systems including a CDMA wireless communication system.

4, the CDMA wireless communication system includes a plurality of terminals 100, a plurality of base stations (BSs) 270, and base station controllers (BSCs) 275 , And a mobile switching center ('MSC') 280. The MSC 280 is configured to be connected to a public switched telephone network (PSTN) 290 and is also configured to be connected to BSCs 275. BSCs 275 may be coupled in pairs with BS 270 through a backhaul line. The backhaul line may be provided according to at least one of E1 / T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. Thus, a plurality of BSCs 275 may be included in the system shown in FIG.

Each BS 270 may comprise at least one sector, and each sector may comprise an omnidirectional antenna or an antenna pointing to a particular direction of radial from BS 270. [ In addition, each sector may include two or more antennas of various types. Each BS 270 may be configured to support a plurality of frequency assignments, each of which has a specific spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of sectors and frequency assignments may be called a CDMA channel. The BS 270 may be referred to as a Base Station Transceiver Subsystem (BTSs). In this case, the word "base station" may be referred to as a combination of one BSC 275 and at least one BS 270. [ The base station may also indicate “cell site”. Alternatively, each of the plurality of sectors for a particular BS 270 may be referred to as a plurality of cell sites.

As shown in FIG. 4, a broadcasting transmitter (BT) 295 transmits a broadcast signal to terminals 100 operating in the system. The broadcast module 111 shown in FIG. 1 is provided in the terminal 100 to receive a broadcast signal transmitted by the BT 295.

In addition, FIG. 4 illustrates multiple satellite positioning systems (GPS) satellites 300. The satellites 300 help to locate at least one of the plurality of terminals 100. Although two satellites are shown in FIG. 4, useful location information may be obtained by two or less or more satellites. The GPS module 115 shown in FIG. 1 cooperates with satellites 300 to obtain desired location information. Here, you can track your location using all of the technologies that can track your location, as well as your GPS tracking technology. Also, at least one of the GPS satellites 300 may optionally or additionally be responsible for satellite DMB transmission.

Among the typical operations of a wireless communication system, the BS 270 receives a reverse link signal from the various terminals 100. At this time, the terminals 100 are in the process of connecting a call, transmitting or receiving a message, or performing another communication operation. Each of the reverse link signals received by the particular base station 270 is processed by the particular base station 270. The data resulting from the processing is transmitted to the connected BSC 275. The BSC 275 provides call resource allocation and mobility management functions, including the organization of soft handoffs between the base stations 270. The BSC 275 also transmits the received data to the MSC 280 and the MSC 280 provides additional transmission services for connection with the PSTN 290. [ Similarly, the PSTN 290 connects to the MSC 280, the MSC 280 connects to the BSCs 275, and the BSCs 275 communicate with the BSs 270 ).

Prior to the detailed description of the present invention, it is assumed that the present invention relates to a method of converting a two-dimensional image into a three-dimensional image by applying the two-dimensional image to a three-dimensional model in order to breathe vitality into the two-dimensional image. In particular, as an example of a three-dimensional model method, unlike a conventional image-based rendering method requiring multiple reference images, a tour into a picture that constructs and renders an environment model from only one input image (Tour Into the the Picture; 'TIP').

Hereinafter, referring to FIG. 5, an image conversion process performed by a program according to the present invention will be described step by step. 5 is a flowchart of an image conversion process performed by a program related to an embodiment of the present invention. Hereinafter, for convenience of description, it is assumed that the image conversion process illustrated in FIG. 5 is performed by the terminal 100 illustrated in FIG. 1.

As shown in FIG. 5, the terminal 100 receives a 2D image from the outside through the camera 121 (S510).

When the image capturing mode is set according to the user's selection, the terminal 100 turns on the camera 121 to set a state capable of inputting and capturing images.

The terminal 100 estimates at least one vanishing point on the two-dimensional image input in the input step S510 (S520).

Here, the vanishing point means that the extension lines of all the objects shown on the two-dimensional image meet by the perspective view method. Depending on the number of vanishing points, it may be divided into one-point perspective, two-point perspective, and the like, and depending on the height of the vanishing point, it may be divided into an angular perspective, a central perspective, and a bird's eye view.

The terminal 100 estimates a plurality of planes forming one spatial concept on the two-dimensional image input in the input step S510 based on the vanishing point estimated in the estimation step S520 (S530).

Estimating vanishing points and planes (S520, S530) will be described in more detail with reference to FIG. For convenience of explanation, it is assumed that one vanishing point and five planes are estimated on the two-dimensional image shown in FIG. 6.

As illustrated in FIG. 6, the vanishing point may be a point 611 that meets inside (or toward the center) of the 2D image among points where the extension lines of the objects illustrated in the 2D image meet.

Also, as shown in FIG. 6, the plurality of planes may include rear wall 621, ceiling 622, floor 623, left wall 624, and right. It may include a wall (625). More specifically, after the area and location of the rear wall 621 are determined around the vanishing point 611, the positions of the remaining planes are determined. Therefore, the plurality of planes described above have a form in which one space is opened.

Here, the conditions for the plurality of planes to which the present invention is applied are listed as follows. All adjacent planes must be perpendicular to each other, the back wall must be parallel to the viewing face, the floor and ceiling must be perpendicular to the viewing face, and the composition of all the planes that will make up the 3D image is the 2-dimensional image plane. Should come from them.

Returning to FIG. 5, the terminal 100 converts the two-dimensional image input in the input step S510 into a three-dimensional image by using the vanishing points and the plane estimated in the estimating steps S520 and S530 (S540). .

In the conversion step (S540), the terminal 100 may perform a rendering process of adding a three-dimensional texture, such as shadows, colors, density changes, etc. to the two-dimensional image to add realism.

Hereinafter, an image conversion process according to an embodiment of the present invention will be described in detail with reference to FIGS. 7 to 9.

7 is a first diagram illustrating an image conversion process according to an embodiment of the present invention.

The terminal 100 receives a 2D image through the camera 121 (a).

In addition, the terminal 100 detects a plurality of corners on the input two-dimensional image (b). Here, the plurality of edges mean the edges of all objects shown on the two-dimensional image.

In addition, the terminal 100 detects a plurality of dominant lines using the detected plurality of edges (c). Here, the dominant line may be detected according to the direction and pattern of the plurality of edges.

In addition, the terminal 100 may estimate the vanishing point using the detected dominant lines (d). Here, the vanishing point can be estimated from the intersection of the detected dominant lines.

In addition, the terminal 100 estimates the size of the first plane (for example, the back wall of FIG. 6) based on the estimated vanishing point. Here, the size of the first plane is determined by the width and height of the first plane, and the first plane is preferably rectangular.

After determining the position on the two-dimensional image of the first plane 721, the terminal 100 determines an edge of the two-dimensional image corresponding to the upper side, the lower side, the left side, and the right side of the first plane 721, respectively. We can estimate each plane 722, 723, 724, 725 heading to (e). Here, the position of the first plane 721 may be determined using the distance between the first plane 721 and the dominant line.

Therefore, the terminal 100 may convert the 2D image into the 3D image by using the 3D model shown in FIG. 7.

8 is a second diagram illustrating an image conversion process according to an embodiment of the present invention.

As shown in FIG. 8A, the terminal 100 first estimates a vanishing point 811 and a plurality of planes on the input two-dimensional image. In addition, the terminal 100 may generate a plurality of circles toward the edge of the two-dimensional image from the first circle after generating a first circle centered on the vanishing point 811 to implement a three-dimensional model method. have. At this time, the radius of the circle increases from the vanishing point 811 toward the edge of the two-dimensional image. The vanishing point is also the center of all circles.

A plurality of circles shown in (a) of FIG. 8, when viewed in a three-dimensional image, will form a geometric paraboloid 821 as shown in (b) of FIG. 8. In this case, the formed geometric paraboloid 821 is in contact with the estimated plurality of planes.

In this case, the terminal 100 may generate the geometric paraboloid by adjusting at least one of the degree of warpage, the trajectory size, and the position of the geometric paraboloid.

Therefore, the terminal 100 may convert the 2D image into the 3D image by using the 3D model method using the geometric paraboloid shown in FIG. 8.

9 is a third diagram illustrating an image conversion process according to an embodiment of the present invention.

As shown in FIG. 9, the terminal 100 determines a plurality of main edges 912 on the input two-dimensional image. In addition, the terminal 100 may estimate at least one vanishing point and a plurality of planes on the 2D image by using the determined main corners 912.

In addition, the terminal 100 may determine positions of intersection lines and vanishing points 911-1 and 912-2 where a plurality of planes intersect using the determined main corners. In particular, the locations of vanishing points 911-1 and 912-2 may be points where at least two intersection lines meet.

In addition, the terminal 100 may correct the camera by using the determined positions of the vanishing points 911-1 and 911-2.

Therefore, the terminal 100 may convert the 2D image into the 3D image by using the 3D model method using the edges shown in FIG. 9.

In addition, according to an embodiment of the present invention, the above-described image conversion method may be embodied as computer readable codes on a medium in which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disks, optical data storage devices, and the like, which are also implemented in the form of carrier waves (eg, transmission over the Internet). It also includes. In addition, the computer may include a control unit 180 of the terminal.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, And are not limited by the accompanying drawings. In addition, all or some of the embodiments may be selectively combined so that various modifications may be made to the embodiments described above.

1 is a block diagram of a terminal according to an embodiment of the present invention;

2 is a front perspective view of a terminal according to an embodiment of the present invention;

3 is a rear view of a terminal according to an embodiment of the present invention;

4 is a block diagram of a wireless communication system in which a terminal can operate in accordance with an embodiment of the present invention.

5 is a flowchart of an image conversion process performed by a program related to an embodiment of the present invention.

6 is a view showing a process of estimating vanishing point and plane on a two-dimensional image in accordance with an embodiment of the present invention.

7 is a first diagram illustrating an image conversion process according to an embodiment of the present invention.

8 is a second diagram illustrating an image conversion process according to an embodiment of the present invention.

9 is a third diagram illustrating an image conversion process according to an embodiment of the present invention.

Claims (13)

A camera receiving a two-dimensional image; And Estimating a plurality of planes forming at least one vanishing point and one spatial concept on the input two-dimensional image, and converting the input two-dimensional image into a three-dimensional image using the estimated vanishing point and plane A terminal having an image conversion function comprising a control unit for converting. The apparatus of claim 1, A plurality of dominant lines are detected using the plurality of edges detected in the input two-dimensional image, and the image conversion function of estimating the at least one vanishing point is detected using the plurality of detected dominant lines. terminal. The method of claim 2, wherein the control unit, In estimating the plurality of planes, the first plane is estimated based on the estimated at least one vanishing point, and the input 2 corresponding to each of the input planes is respectively corresponding to an upper side, a lower side, a left side, and a right side of the estimated first plane. A terminal having an image conversion function for estimating each plane facing the edge of the dimensional image. The apparatus of claim 3, And a terminal having an image conversion function for determining a position of the first plane on the input two-dimensional image by using a distance between the first plane and the dominant line. The apparatus of claim 1, An image conversion function for generating a geometric parabola in contact with the estimated plurality of planes based on one of the estimated at least one vanishing point, and performing a conversion operation to the three-dimensional image by using the generated geometric parabola Terminal having. 6. The apparatus of claim 5, A terminal having an image conversion function for generating the geometric parabola by adjusting at least one of the degree of warpage, the trajectory size, and the position of the geometric parabola. The apparatus of claim 1, An image conversion function for determining a position of each of the estimated at least one vanishing point and an intersection line between the estimated plurality of planes on the input two-dimensional image by using the plurality of major edges determined in the input two-dimensional image Terminal having. The apparatus of claim 1, The terminal having an image conversion function for correcting the camera using the estimated position of the vanishing point. Receiving a two-dimensional image; Estimating at least one vanishing point on the input two-dimensional image; Estimating a plurality of planes forming one spatial concept on the input two-dimensional image based on the estimated at least one vanishing point; And And converting the input two-dimensional image into a three-dimensional image by using the estimated vanishing point and the plane. The method of claim 9, Detecting a plurality of corners on the input two-dimensional image; And Using the detected plurality of edges, further performing a step of detecting a plurality of dominant lines, The vanishing point is, And a program recorded with the detected plurality of dominant lines. The method of claim 10, wherein the plane estimation step, Estimating a first plane based on the estimated at least one vanishing point; And And estimating each plane from the upper side, the lower side, the left side, and the right side of the estimated first plane to the edge of the two-dimensional image corresponding thereto. The method of claim 9, Generating a geometric parabola centered on any one of the estimated at least one vanishing point and in contact with the estimated plurality of planes, The conversion step, And a program for converting the program into the three-dimensional image using the generated geometric parabola. The method of claim 9, Determining a plurality of major edges on the input two-dimensional image; Determining a location of each of the estimated at least one vanishing point on the input two-dimensional image using the determined plurality of major edges; And And detecting the intersection line between the estimated plurality of planes using the determined plurality of major edges.

Images