KR101783608B1 - Electronic device and method for dynamically controlling depth in stereo-view or multiview sequence image - Google Patents

Abstract

An electronic device and a stereoscopic effect adjustment method are disclosed. The receiving unit receives image data including left eye view image data and right eye view image data. The controller determines the stereoscopic effect adjustment value based on the stereoscopic effect setting information and the genre of the image data. The image processing unit reconstructs the left eye view image data and the right eye view image data according to the determined stereoscopic effect adjustment value.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to an electronic device and a stereoscopic effect adjusting method,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an electronic device and a stereoscopic effect adjusting method, and more particularly, to an electronic device and a stereoscopic effect adjusting method capable of adjusting a stereoscopic effect of a stereoscopic image in a two-eye stereoscopic image technique or a multi-view stereoscopic image technique.

The commercialization of 3D content and 3D broadcasting are mainly based on binocular disparity. The binocular parallax is a positional difference between the image seen by the left eye and the image seen by the right eye when the person looks at a single object using two eyes. Therefore, if the same image as the actual image seen in two eyes of the person can be input into the two eyes, the image can be sensed in three dimensions. Accordingly, a stereoscopic effect can be provided by capturing an actual subject with a binocular camera to obtain an image, mapping the image to a binocular camera in the case of a CG (Computer Graphic) subject, and displaying the generated image to both eyes of the user .

An aspect of the present invention is to provide an electronic device and a stereoscopic effect adjusting method capable of providing a custom stereoscopic effect according to a stereoscopic image content, a user, and a broadcasting display environment.

According to another aspect of the present invention, there is provided a stereoscopic effect adjustment method comprising: receiving image data including left eye view image data and right eye view image data; generating a stereoscopic effect image based on stereoscopic effect setting information and a genre of the image data; Determining the adjustment value, and reconstructing the left-eye view image data and the right-eye view image data according to the determined stereoscopic effect adjustment value.

The step of determining the stereoscopic effect adjustment value may include a step of searching a stereoscopic effect adjustment value associated with the genre of the image data in the stereoscopic effect setting information.

The reconstructing step may include calculating a displacement value of the object included in the image data, changing the calculated displacement value using the stereoscopic image adjustment value, and calculating a displacement value of the object according to the changed displacement value And reconstructing the left eye view image data and the right eye view image data so that the left eye view image data and the right eye view image data are changed.

The step of changing the calculated displacement value may include calculating the changed displacement value based on the stereoscopic image adjustment value and the squared value of the calculated displacement value.

The reconstructing step may further include the step of providing a fisheye lens effect to the left eye view image data and the right eye view image data.

The stereoscopic effect adjustment method may include determining a method of reconstructing the left eye view image data and the right eye view image data based on the received broadcast information.

The stereoscopic effect adjustment method may further include sensing a user action requesting a graphical user interface (GUI) for setting the stereoscopic effect setting information, and in response to detecting the user action, And generating a signal for displaying a screen including an interface (GUI: Graphical User Interface) and an area where the image data is displayed. Here, the screen may further display an indication indicating a genre of the image data.

The stereoscopic effect adjustment method may further comprise reconstructing the left-eye view image data and the right-eye view image data included in the image data according to the stereoscopic effect setting information set through the GUI.

The stereoscopic effect adjustment method may further include storing stereoscopic effect setting information set through the GUI in association with information indicating a genre of the image data.

According to another aspect of the present invention, there is provided an electronic device including a receiving unit for receiving image data including left eye view image data and right eye view image data, three-dimensional sense setting information, And a video processing unit for reconstructing the left eye view image data and the right eye view image data according to the determined stereoscopic effect adjustment value.

The control unit may retrieve a stereoscopic effect adjustment value associated with a genre of the image data from the stereoscopic effect setting information.

The image processing unit may further include a displacement calculating unit for calculating a displacement value of the object included in the image data, a displacement changing unit for changing the calculated displacement value using the stereoscopic image adjustment value, Eye view image data and the right-eye view image data so that the displacement value of the object is changed. Here, the displacement changing unit may calculate the changed displacement value based on the cubic image adjustment value and the squared value of the calculated displacement value.

The image processing unit may give a fisheye lens effect to the left eye view image data and the right eye view image data.

The control unit may determine a method of reconstructing the left eye view image data and the right eye view image data based on the received broadcast information.

Wherein the control unit detects a user action requesting a graphical user interface (GUI) for setting the three-dimensional setting information, and in response to detecting the user action, : Graphical User Interface) and an area in which image data is displayed. Here, the screen may further display a display indicating a genre of the image data.

The image processing unit may reconstruct left eye view image data and right eye view image data included in the image data according to the three-dimensional setting information set through the GUI.

The control unit may control the stereoscopic effect setting information set through the GUI to be stored in association with information indicating a genre of the image data.

According to the electronic device and the stereoscopic effect adjustment method of the present invention, the stereoscopic effect can be adjusted according to the setting information, thereby minimizing the stereoscopic effect (3D fatigue) caused by the variation of individual viewers. And the stereoscopic effect can be adjusted by using the received broadcast information, so that the stereoscopic effect can be appropriately adjusted according to the type of the stereoscopic image.

1 is a block diagram showing a configuration of a preferred embodiment of an electronic device according to the present invention;
2 is a block diagram showing a configuration of a preferred embodiment of a signal processing unit,
FIG. 3A and FIG. 3B are flowcharts showing a process of performing a preferred embodiment of a stereoscopic effect adjustment method according to the present invention,
4 is a diagram illustrating a binocular disparity system,
5 is a view showing a distance feeling of an object according to the size of a binocular parallax,
6 is a view for explaining an embodiment of a method of largely expressing a stereoscopic effect of an image,
7 is a view for explaining an embodiment of a method of rendering a three-dimensional sensation of a picture small,
FIGS. 8A and 8B are views showing a screen on which an image of an embodiment is displayed;
9 is a view showing an embodiment of a screen that largely represents the stereoscopic effect of the image shown in FIG. 8A,
FIG. 10 is a view showing an embodiment of a screen in which the three-dimensional effect of the image shown in FIG.
11 is a diagram showing coordinates of an object included in an image,
FIG. 12 is a diagram showing the coordinates of an object after the displacement of the object shown in FIG. 11 is transformed;
13 is a view showing a screen on which an image of another embodiment is displayed,
14 is a view showing a fisheye lens effect for enlarging a three-dimensional effect,
FIG. 15 is a view showing a screen to which the fisheye lens effect shown in FIG. 14 is applied to the image shown in FIG. 13,
16 is a view showing a fisheye lens effect for reducing stereoscopic effect,
FIG. 17 is a view showing a screen to which the fisheye lens effect shown in FIG. 16 is applied to the image shown in FIG. 13,
18A to 18C show an embodiment of a screen for adjusting three-dimensional setting information,
19 is a diagram showing an embodiment of the syntax of a three-dimensional information descriptor,
20 is a table showing one embodiment of the values of the effect_status field, and
FIG. 21 is a table showing one embodiment of the values held in the rating field.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. The structure and operation of the present invention shown in the drawings and described by the drawings are described as at least one embodiment, and the technical ideas and the core structure and operation of the present invention are not limited thereby.

Although the terms used in the present invention have been selected in consideration of the functions of the present invention, it is possible to use general terms that are currently widely used, but this may vary depending on the intention or custom of a person skilled in the art or the emergence of new technology. Also, in certain cases, there may be a term selected arbitrarily by the applicant, in which case the meaning thereof will be described in detail in the description of the corresponding invention. Therefore, it is to be understood that the term used in the present invention should be defined based on the meaning of the term rather than the name of the term, and on the contents of the present invention throughout.

1 is a block diagram showing a configuration of a preferred embodiment of an electronic device according to the present invention.

1, an electronic device 100 according to the present invention includes a receiving unit 101, a signal processing unit 140, a display 150, a voice output unit 160, an input device 170, a storage unit 180, And a control unit 190.

The receiving unit 101 receives image data including left eye view image data and right eye view image data. The receiving unit 101 may further receive broadcast information on the video data. The image data may be a stereo view image or a multi-view image. That is, the image data may include at least one left eye view image data and at least one right eye view image data.

The receiving unit 101 may include a tuner unit 110, a demodulation unit 120, a mobile communication unit 115, a network interface unit 130, and an external signal receiving unit 130.

The tuner unit 110 selects an RF broadcast signal corresponding to a channel selected by a user from among RF (Radio Frequency) broadcast signals received through an antenna, converts the selected RF broadcast signal into an intermediate frequency signal, a baseband image, Conversion.

The demodulator 120 receives the digital IF signal DIF converted by the tuner 110 and performs a demodulation operation. For example, when the digital IF signal output from the tuner unit 110 is the ATSC scheme, the demodulation unit 120 performs 8-VSB (8-Vestigial Side Band) demodulation. As another example, when the digital IF signal output from the tuner unit 110 is a DVB scheme, the demodulator 120 performs CODDMA (Coded Orthogonal Frequency Division Modulation) demodulation.

Also, the demodulation unit 120 may perform channel decoding. To this end, the demodulator 120 includes a trellis decoder, a de-interleaver, and a reed solomon decoder to perform trellis decoding, deinterleaving, Solomon decoding can be performed.

The demodulation unit 120 may perform demodulation and channel decoding, and then output a stream signal TS. At this time, the stream signal may be a signal in which a video signal, a voice signal, or a data signal is multiplexed. For example, the stream signal may be an MPEG-2 TS (Transport Stream) multiplexed with an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, or the like. Specifically, the MPEG-2 TS may include a header of 4 bytes and a payload of 184 bytes.

The stream signal output from the demodulation unit 120 may be input to the signal processing unit 140.

The mobile communication unit 115 transmits / receives a radio signal to / from at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

 The external signal receiving unit 135 may provide an interface for connecting the external device and the electronic device 100. The external device may refer to various types of video or audio output devices such as a DVD (Digital Versatile Disk), a Blu-ray, a game device, a camcorder, a computer (notebook) Device. The electronic device 100 can control the display of the video signal and the voice signal received from the external signal receiving unit 135 and can store or use the data signal.

The external device may also be a photographing device 90. [ The photographing apparatus 90 may include a plurality of cameras. The photographing apparatus 90 can photograph a person. The photographing apparatus 90 recognizes a hand region of a person, focuses on the hand region, and can zoom in to pick up the image. The hand shape captured here can be recognized as a space gesture. That is, the control unit 190 can execute the instructions for recognizing the captured hand shape as a space gesture and performing operations associated with the recognized space gesture. Where a spatial gesture can be defined as a gesture recognized from an image frame or image received from the imaging device 90, which is mapped to one or more specific computing operations.

The photographing apparatus 90 may be a Depth camera. The photographing apparatus 90 can photograph the position of the viewer and can transmit information indicating the position of the viewer who captured it to the control unit 190. [ The control unit 190 may determine the stereoscopic effect adjustment value based on the information indicating the position of the received viewer.

In some embodiments, the electronic device 100 may include a photographing device 90.

The signal processing unit 140 demultiplexes the stream signal output from the demodulation unit 210 and performs signal processing on the demultiplexed signal and then outputs an image to the display 150 and outputs the image to the audio output unit 160 And outputs the sound 161. The signal processing unit 140 may receive video data, audio data, and broadcast data from the mobile communication unit 115, the network interface unit 130, and the external signal receiving unit 135.

The signal processing unit 140 may receive a signal from the control unit 190 indicating a method of reconstructing the stereoscopic effect adjustment value and the image data. The signal processing unit 140 may reconstruct left eye view image data and right eye view image data of the image data according to the received stereoscopic effect adjustment value. Here, the signal processing unit 140 can reconstruct the left eye view image data and the right eye view image data according to a method determined by the controller 190, and can reconstruct the left eye view image data and the right eye view image data by a directly determined method.

In some embodiments, the signal processing unit 140 may calculate the displacement value of the object included in the image data and change the displacement value calculated using the stereoscopic image adjustment value. The signal processing unit 140 may reconstruct the left view image data and the right view image data so that the displacement value of the object is changed according to the changed displacement value.

In some embodiments, the signal processing unit 140 may give a fisheye lens effect to the left eye view image data and the right eye view image data.

The display 150 displays an image 152. Here, the image 152 may be one in which image data reconstructed by the signal processing unit 140 is displayed.

In addition, the display 150 may operate in conjunction with the control unit 190. [ Display 150 may display a graphical user interface (GUI) 153 that provides an easy to use interface between a user of the electronic device and an application running on the operating system or operating system. The GUI 153 represents a program, a file, and operation options in the form of a graphic image. A graphical image may include a window, a field, a dialog box, a menu, an icon, a button, a cursor, a scroll bar, and the like. This image can be arranged in a predefined layout, or it can be dynamically created to help the user take the specific action taken. During operation, the user may select and activate the image to raise the functions and tasks associated with the various graphic images. By way of example, the user may select a button to open, close, minimize, or maximize a window, or an icon to activate a particular program.

In some embodiments, the display 150 may display a graphical user interface (GUI) for setting three-dimensional setting information and a screen including an area in which image data is displayed. Here, the screen may further display a display indicating a genre of the image data.

Also, the display 150 can display the reconstructed left-eye view image data and right-eye view image data on the screen in accordance with the three-dimensional setting information set through the GUI.

The audio output unit 160 may receive the audio data from the signal processing unit 140 and the control unit 190 and may output the audio 161 on which the received audio data is reproduced.

The input device 170 may be a touch screen disposed on or in front of the display 150. The touch screen may be integral with the display 150 or may be a separate component. As the touch screen is disposed in front of the display 150, the user can manipulate the GUI 153 directly. For example, a user may simply place his finger on an object to be controlled. On the touchpad, there is no one-to-one relationship like this.

In the touchpad, the touchpad is generally away from the display 150 and lies in a different plane. For example, the display 150 is generally located in a vertical plane, and the touchpad is generally located in a horizontal plane. This makes his use less intuitive and therefore more difficult when compared to the touch screen. In addition to being a touch screen, the input device 170 may be a multipoint input device.

The storage 180 provides a location for storing program codes and data typically used by the electronic device 100. By way of example, the storage unit 180 may be implemented as a read only memory (ROM), a random access memory (RAM), a hard disk drive, or the like. The program code and data may reside on a removable storage medium and may be loaded or installed onto the electronic device 100 as needed. Here, the removable storage medium includes a CD-ROM, a PC-CARD, a memory card, a floppy disk, a magnetic tape, and a network component.

The storage unit 180 stores the three-dimensional setting information. Here, the three-dimensional setting information may include genre information indicating a genre of a content, a stereoscopic effect adjustment value set for each genre of the content, and association information associating the genre information and a stereoscopic effect adjustment value. Here, the association information may be a table name of a relational database.

In addition, the storage unit 180 stores image data for each genre. Here, the image data may be a stereo view image or a multi-view image. That is, the image data may include at least one left eye view image data and at least one right eye view image data.

The control unit 190 executes an instruction and performs an operation associated with the electronic device 100. For example, using the instructions retrieved from storage 180, controller 190 may control input and output between components of electronic device 100, and the reception and processing of data. The control unit 190 may be implemented on a single chip, a plurality of chips, or a plurality of electrical components. Various architectures may be used for the controller 190, including, for example, a dedicated or embedded processor, a single purpose processor, a controller, an ASIC,

The control unit 190 executes the computer code together with the operating system and generates and uses data. The operating system is generally known and will not be described in more detail. By way of example, the operating system may be a Windows-based OS, Unix, Linux, Palm OS, DOS, Android and Macintosh. The operating system, other computer code, and data may reside within the storage 180 operating in conjunction with the controller 190.

The control unit 190 can recognize the user action and control the electronic device 100 based on the recognized user action. Wherein the user action comprises selecting a physical button on the electronic device or remote control, performing a predetermined gesture on the touch screen display surface or selecting a soft button, performing a predetermined gesture recognized from the image photographed by the imaging device, And may include the implementation of certain vocalizations that are recognized. The external signal receiving unit 135 can receive a signal for a user action for selecting a physical button of the remote control through a remote controller.

Gestures can include touch gestures and space gestures. The touch gesture can be defined as a stylized interaction with the input device 170, which is mapped to one or more specific computing operations. The touch gesture can be done through various hands, and more particularly through finger movements. Alternatively or additionally, the gesture can be done with a stylus.

The input device 170 receives the gesture 171 and the control 190 executes the instructions that perform the actions associated with the gesture 171. In addition, the storage 180 may include a gesture operating program 181 that may be an operating system or part of a separate application. Gesture activation program 181 generally includes a series of instructions to recognize the occurrence of gestures 171 and to inform one or more software agents of what action (s) should be taken in response to gestures 171 and / or gestures 171 . ≪ / RTI >

When the user performs one or more gestures, the input device 170 delivers the gesture information to the control unit 190. [ The control unit 190 analyzes the gesture 171 using the instruction from the storage unit 180 and more specifically the gesture operation program 181 and controls the storage unit 180, the display 150, the audio output unit The signal processing unit 140, the network interface unit 130 and the input device 170 of the electronic device 100 according to an embodiment of the present invention. The gesture 171 performs operations in the application stored in the storage unit 180, modifies the GUI object displayed on the display 150, modifies the data stored in the storage unit 180, ), And can be identified as an instruction to perform an operation in the signal processing unit 140. [ By way of example, these commands may be associated with zooming, panning, scrolling, turning pages, rotating, resizing, changing video channels, receiving content, accessing the Internet, and so on. As a further example, the command may also be used to activate a particular program, to open a file or document, to view a menu, to make a selection, to execute a command, to log onto an Internet site system, Allowing access to a limited area of the computer system, loading a user profile associated with the user preference array of the desktop, and / or the like.

In some embodiments, depending on the magnitude of the parameter (e.g., capacitance) between the finger and the touch screen display, when the parameter exceeds a predetermined threshold, a down event occurs and the parameter exceeds a predetermined threshold A dragging event occurs when the corresponding cursor position of the finger moves from position A to position B and an up event occurs when this parameter falls below the threshold level.

The controller 190 may determine a stereoscopic effect adjustment value. In some embodiments, the controller 190 may determine the stereoscopic effect adjustment value based on the stereoscopic effect setting information. Here, the stereoscopic effect setting information may be set according to the detected user action, and may be set based on the received broadcast information. Further, the three-dimensional setting information may be set at the time of manufacture of the electronic device 100, set at the time of software installation of the electronic device 100, and updated at the time of software update of the electronic device 100. [

In some embodiments, the controller 190 may determine the stereoscopic effect adjustment value based on the stereoscopic effect setting information and the genre of the image data. Here, the control unit 190 may retrieve the stereoscopic effect adjustment value associated with the genre of the image data from the stereoscopic effect setting information. Also, the controller 190 may retrieve the stereoscopic effect adjustment value from the stereoscopic effect setting information using the association information.

In some embodiments, the control unit 190 may determine a stereoscopic effect adjustment value based on the position of the viewer. When the position of the viewer is close, the controller 190 can determine the stereoscopic effect adjustment value so that the stereoscopic effect is lowered. If the position of the viewer is far away, the control unit 190 can determine the stereoscopic effect adjustment value .

In some embodiments, the controller 190 may determine a stereoscopic effect adjustment value based on the received broadcast information.

The control unit 190 can determine a method of reconstructing the left eye view image data and the right eye view image data based on the received broadcast information. Alternatively, the controller 190 may determine a method of reconstructing the left eye view image data and the right eye view image data based on a user command. Here, the method of reconstructing the left eye view image data and the right eye view image data may be one of the object displacement changing method and the fisheye lens effect.

The control unit 190 can reconstruct left eye view image data and right eye view image data of the image data according to the determined stereoscopic effect adjustment value. Alternatively, the control unit 190 may control the signal processing unit 140 to reconstruct left-eye view image data and right-eye view image data of the image data according to the stereoscopic effect adjustment value determined by the determined method.

Also, the controller 190 may detect a user action requesting a graphical user interface (GUI) for setting three-dimensional setting information. In response to the detection of the user action, the controller 190 may control to generate a signal for displaying a screen including the graphical user interface (GUI) and the area where the image data is displayed. Here, the screen may further display a display indicating a genre of the image data.

The control unit 190 can reconfigure the left eye view image data and the right eye view image data included in the image data or reconfigure the signal processor 140 according to the three-dimensional setting information set through the GUI.

Also, the control unit 190 may control the stereoscopic effect setting information set through the GUI to be stored in association with the information indicating the genre of the image data.

2 is a block diagram showing a configuration of a preferred embodiment of the signal processing unit.

2, the signal processing unit 140 includes a demultiplexing unit 210, an audio decoder 220, a video decoder 230, a video processing unit 240, a scaler 260, a mixer 270, 280).

The demultiplexing unit 210 can receive a stream signal from the mobile communication unit 115, the network interface unit 130 and the external signal input unit 135. The demultiplexing unit 210 demultiplexes the received stream signal into video data, Demultiplexed into voice data and data, and output to the video decoder 230, the audio decoder 220, and the controller 190, respectively.

The audio decoder 220 receives voice data from the demultiplexing unit 210 and restores the received voice data to output the restored data to the scaler 260 or the voice output unit 160.

The video decoder 230 receives the video data from the demultiplexer 210, restores the received video data, and outputs the restored video data to the video processor 240. Here, the image signal may include a stereoscopic image signal. The video decoder 230 and the image processing unit 240 may be configured as a single module. When the control unit 190 performs the role of the video processing unit 240, the video decoder 230 may output the restored video data to the control unit 190. [

The image processing unit 240 can reconstruct the left eye view image data and the right eye view image data included in the reconstructed image data according to the three-dimensional adjustment value. The image processing unit 240 may include a displacement calculating unit 245, a displacement changing unit 250, and an image reconstructing unit 255.

The displacement calculating unit 245 calculates the displacement value of the object included in the image data.

The displacement changing unit 250 changes the displacement value calculated by the displacement calculating unit 245 using the stereoscopic image adjustment value. Here, the displacement changing unit may calculate the changed displacement value based on the stereoscopic image adjustment value and the squared value of the calculated displacement value.

The image reconstructing unit 255 may reconstruct the left eye view image data and the right eye view image data of the image data so that the displacement value of the object is changed according to the displacement value changed by the displacement changing unit 250. [

The scaler 260 outputs video data and audio data processed by the video decoder 230, the video processor 240, the controller 190 and the audio decoder 220 through a display 150 or a speaker (not shown) (Scaling) to a signal of the appropriate size to be used for the signal. The scaler 260 receives the stereoscopic image and scales the stereoscopic image according to a resolution or a predetermined aspect ratio of the display 150. The display 150 may be manufactured to output an image screen having a predetermined resolution for each product specification, for example, 720x480 format, 1024x768, and the like. Accordingly, the scaler 260 can convert the resolution of the stereoscopic image, which can be input with various values, according to the resolution of the display.

In addition, the scaler 260 adjusts the aspect ratio of the stereoscopic image according to the type of content to be displayed or a user setting. The aspect ratio value may be a value such as 16: 9, 4: 3, or 3: 2, and the scaler 260 may adjust the aspect ratio of the screen in the horizontal direction and the aspect ratio in the vertical direction to a specific ratio.

The mixer 270 mixes and outputs the outputs of the scaler 260 and the controller 190.

The formatter 280 may output the converted image data to the display 150 to generate a stereoscopic image, and may generate a synchronizing signal to the stereoscopic image signal to be output to the glasses 201. The formatter 280 may include an infrared ray output unit (not shown) for transmitting a synchronization signal. Here, the synchronizing signal is a signal for synchronizing the display time of the left eye view image or the right eye view image according to the stereoscopic image signal with the opening / closing time of the left eye lens or the right eye lens of the shutter glasses 201.

FIGS. 3A and 3B are flowcharts illustrating a method of adjusting a stereoscopic effect according to an exemplary embodiment of the present invention.

Referring to FIGS. 3A and 3B, the receiving unit 101 receives image data including left eye view image data and right eye view image data (S100). Here, the receiving unit 101 can further receive broadcast information on the video data.

The controller 190 determines a stereoscopic effect adjustment value (S105). Here, the controller 190 may determine the stereoscopic effect adjustment value based on the stereoscopic effect setting information, and may determine the stereoscopic effect adjustment value based on the stereoscopic effect setting information and the genre of the image data. Also, the controller 190 can determine the stereoscopic effect adjustment value based on the position of the viewer and can determine the stereoscopic effect adjustment value based on the received broadcast information.

In step S105, the control unit 190 may retrieve the stereoscopic effect adjustment value associated with the genre of the image data from the stereoscopic effect setting information, and determine the stereoscopic effect adjustment value based on the stereoscopic effect adjustment value.

The control unit 190 determines a method of reconstructing left eye view image data and right eye view image data of the image data received by the receiving unit 101 based on the received broadcast information (S110). Here, the method of reconstructing the left eye view image data and the right eye view image data may be one of the object displacement changing method and the fisheye lens effect.

If the reconstruction method is determined by the object displacement changing method, the signal processing unit 140 calculates the displacement value of the object included in the image data (S115).

The signal processing unit 140 changes the displacement value calculated using the stereoscopic image adjustment value (S120). Here, the signal processing unit 140 may calculate the changed displacement value based on the stereoscopic image adjustment value and the squared value of the calculated displacement value.

The signal processing unit 140 reconstructs the left eye view image data and the right eye view image data so that the displacement value of the object is changed according to the changed displacement value (S125).

If the reconstruction method is a fisheye lens effect, the signal processing unit 140 gives the fisheye lens effect to the left-eye view image data and the right-eye view image data included in the image data (S130).

The display 150 displays the reconstructed left eye view image data and right eye view image data (S135).

The controller 190 detects a user action requesting a graphical user interface (GUI) for setting the three-dimensional setting information (S140).

In response to the detection of the user action, the control unit 190 controls to generate a signal for displaying a screen including the graphical user interface (GUI) and the area where the image data is displayed (S145). Here, the screen may further display an indication indicating a genre of the image data.

The controller 190 detects a user action for setting the three-dimensional setting information (S150).

In response to the detected user action, the control unit 190 sets the three-dimensional setting information (S155).

The signal processing unit 140 reconstructs the left eye view image data and the right eye view image data included in the image data according to the three-dimensional setting information set by the controller 190 (S160).

The display 150 displays the left eye view image data and the right eye view image data reconstructed by the signal processing unit 140 in the area (S165).

The controller 190 detects a user action instructing completion of the setting of the three-dimensional setting information (S170).

In response to the user action, the control unit 190 stores the stereoscopic effect setting information set through the GUI in association with the information indicating the genre of the image data (S175).

4 is a view showing a binocular disparity system.

4, the binocular disparity system provides at least a left eye view image 401 and a right eye view image 402, which are captured by a binocular camera or the like, on both eyes 411 and 412 of a viewer, respectively, It is a three-dimensional display system. The binocular disparity between the left eye view image 401 and the right eye view image 402 varies depending on the binocular disparity. As the interval between the left eye view image 401 and the right eye view image 402 is narrowed, images are perceived to form at distances far from the left eye 411 and the right eye 412, so that the sense of space or stereoscopic effect provided to viewers can be reduced . As the interval between the left eye view image 401 and the right eye view image 402 is wider, it is recognized that the image is formed at a distance from the left eye 411 and the right eye 412, so that the sense of space or stereoscopic effect provided to the viewer can be increased.

5 is a diagram showing the difference in binocular disparity according to the distance of an object.

5, when the distant object 510 is viewed from both eyes, the distance between the image 511 formed on the left eye and the image 512 formed on the right eye is narrowed, Is small. However, as the distance between the image 521 formed in the left eye and the image 522 formed in the right eye is enlarged when the object 520 in close proximity to the eye is viewed from both sides, the binocular parallax when viewing a nearby object 520 is large . The binocular parallax of the object 520 is larger than the binocular parallax of the object 510. [

The three-dimensional feeling referred to in the present invention may mean a difference in binocular disparity when expressing an object close to a distant object. A large stereoscopic effect of the image may mean that there is a large difference between the binocular disparity expressing the farthest object in the image and the binocular disparity expressing the closest object in the image. On the other hand, the smaller dimensionality of the image may mean that the difference between the binocular parallax expressing the farthest object in the image and the binocular parallax expressing the closest object in the image is small.

6 is a diagram for explaining an embodiment of a method of largely expressing a stereoscopic effect of an image.

6, the electronic device 100 reduces the parallax of the distant object 610 in the image 600 and increases the parallax of the object 620 in the image 600, It is possible to increase the stereoscopic effect. In other words, by controlling the binocular parallax of the object 610 to be smaller, the object 610 is made to appear farther away from the viewer than the original distance, and the binocular parallax of the object 620 is further adjusted to be larger than the original distance By making the viewer closer to the viewer, the stereoscopic effect of the image 600 can be increased.

Fig. 7 is a diagram for explaining an embodiment of a method of representing a three-dimensional effect of a picture in a small size.

7, the electronic device 100 increases the binocular disparity of a distant object 710 in an image 700 and reduces a binocular disparity of a nearby object 720 in the image 700, It is possible to reduce the stereoscopic effect. In other words, by controlling the binocular disparity of the object 710 to be large, the object 710 is made closer to the viewer than the original distance, and the binocular parallax of the object 720 is made small, The three-dimensional effect of the image 700 can be reduced.

When the image 600 and the image 700 are reconstructed from the same original image, the three-dimensional sensation of the image 600 becomes larger than the three-dimensional sensation of the original image and the three-dimensional sensation of the image 700 becomes smaller than that of the original image.

8A and 8B are views showing a screen in which an image of an embodiment is displayed, FIG. 9 is a view showing an embodiment of a screen in which a three-dimensional effect of the image shown in FIG. 8A is largely expressed, In which a stereoscopic effect of an image shown in FIG.

8A to 10, in the image 800, the object 810, 820, and 830 are located farther away from the viewer than the object 840. Objects 810, 820, and 830 in the image 900 are displayed to appear farther away, and object 840 is displayed to appear closer. Accordingly, it can be seen that the image 900 feels a larger stereoscopic feeling than the image 800. Here, the object can indicate the object included in the image.

Also, in the image 1000, the objects 810, 820 and 830 are displayed to be closer to the original distance, and the object 840 is displayed to appear farther than the original distance. As a result, it can be seen that the image 1000 is felt to have a smaller stereoscopic feeling than the image 800. [

The stereoscopic effect of the image can form a trade-off relationship with stereoscopic fatigue. As the stereoscopic effect of the image becomes larger, the user can see a video full of hot feeling, but this can cause visual fatigue in the viewer's brain. In addition, when the stereoscopic effect of the image is extremely high, the effect of the fish-eye lens may appear on the image. On the other hand, lowering the stereoscopic effect reduces the feeling of motion but the stereoscopic fatigue can be reduced. Therefore, the electronic device according to the present invention can reduce the stereoscopic fatigue due to the stereoscopic effect by appropriately adjusting the stereoscopic effect of the image, and can enhance the feeling of the magnitude of the content.

Also, the electronic device according to the present invention adjusts the stereoscopic effect according to the genre, so that the stereoscopic effect of the image can be appropriately adjusted. In the case of a sport (for example, boxing, badminton, table tennis) that provides a relatively dynamic feeling of space and a short playing time among sports genres or sports genres, the electronic device according to the present invention increases the stereoscopic effect of the image, Can be overflowing. On the other hand, in the case of a video that is somewhat static, such as a cycle game, and requires a long time of viewing, the electronic device according to the present invention can minimize stereoscopic fatigue by reducing stereoscopic effect of an image.

How to reconstruct video data

In this section, we describe a reconstruction method of image data that can control the stereoscopic effect of the image. The stereoscopic effect can be formed by distorting the binocular image of the original image with respect to the stereoscopic image using the binocular disparity method.

The distortion method may vary depending on the characteristics of the received image. Digital images are divided into vector graphics and bitmap graphics. The former has the coordinate information of the subject in the image, and displays the image through it. The latter appears as a sequence of generic bits.

The signal processing unit 140 may determine the method of reconstructing the image data according to the characteristics of the image and may reconstruct the image data according to the decided image data reconstruction method. As described above, the signal processing unit 140 can reconstruct the image data according to the image data reconstruction method determined by the controller 190.

First, a method of changing an object displacement by a video data reconstruction method will be described. The electronic device 100 can adjust the stereoscopic effect by reconstructing the binocular image of the stereoscopic image using the object displacement changing method.

11 is a diagram showing coordinates of an object included in an image.

Referring to FIG. 11, when a stereoscopic image comes in as a vector graphic that indicates the coordinates of a subject, the coordinates of the subject can be expressed in accordance with Equations (1) and (2).

는 오브젝트의 좌안 오브젝트의 위치와 상기 오브젝트의 우안 오브젝트의 위치의 차이를 의미하며, 오브젝트 간의 거리를 다음의 수학식 3으로 나타내질 수 있다. 여기서 좌안 오브젝트는 좌안 시점 영상 데이터에 포함된 오브젝트 또는 상기 오브젝트의 이미지를 표시하는 좌표를 의미하고, 우안 오브젝트는 우안 시점 영상 데이터에 포함된 오브젝트 또는 상기 오브젝트의 이미지를 표시하는 좌표를 의미한다. 즉 오브젝트(1110)의 좌안 오브젝트는 오브젝트(1111)이고 오브젝트(1110)의 우안 오브젝트는 우안 오브젝트(1112)이다.Object distance

Means the difference between the position of the left eye object of the object and the position of the right eye object of the object, and the distance between the objects can be expressed by the following equation (3). Here, the left eye object refers to the object included in the left eye view image data or the coordinate for displaying the image of the object, and the right eye object refers to the object included in the right eye view image data or the image for displaying the image of the object. The left eye object of the object 1110 is the object 1111 and the right eye object of the object 1110 is the right eye object 1112. [

The object distance of the object 1110 is 1, the object distance of the object 1120 is 2, and the object distance of the object 1130 is 3.

는 다음의 수학식 4로 나타낼 수 있다.Also,

Can be expressed by the following equation (4).

The object distance can be changed using the following equation (5).

은 변경된 오브젝트 거리이다. a 는 입체감 정도를 나타내는 변수를 뜻하고, 변수 a의 값은 입체영상 조절값 또는 입체영상 조절값에 함수 관계를 갖는 값으로 설정될 수 있다.here,

Is the changed object distance. a denotes a variable indicating the degree of cubic effect, and the value of the variable a can be set to a value having a function relationship with the stereoscopic image adjustment value or the stereoscopic image adjustment value.

In the binocular parallax system, the object distance may be regarded as the perspective of the object, and may represent the binocular parallax of the object. Therefore, in equation (5), the closer the variable a is to O, the greater the stereoscopic effect of the image, and the closer to 1 the stereoscopic effect is. In addition, if the object distance is a square shape, the larger the object distance, the larger the distance becomes, and the far object becomes farther away from the closer object, resulting in a larger stereoscopic effect of the image.

는 다음의 수학식 6으로 나타낼 수 있다.Also, a set of changed object distances

Can be expressed by the following equation (6).

12 is a diagram showing the coordinates of an object after the displacement of the object shown in Fig. 11 is transformed. Fig.

12, when a is 0 in the equation (5), the object distance of the object 1110 is maintained at 1, the object distance of the object 1120 is changed from 2 to 4, and the object distance of the object 1130 is 3 to 9 is changed. Accordingly, the object 1120 and the object 1130 appear farther to the viewer.

The fisheye lens effect will be explained by the image data reconstruction method. The electronic device 100 can reconstruct a stereoscopic effect by reconstructing a stereoscopic image of a stereoscopic image using a fisheye lens effect. That is, the electronic device 100 can process the left eye view image data and the right eye view image data in a manner that gives a fisheye lens effect to the left eye view image data and the right eye view image data, thereby adjusting the degree of three-dimensional sensation.

13 is a diagram showing a screen on which an image of another embodiment is displayed.

13, when a fisheye lens filter is applied to the center of the image 1300, the three-dimensional effect can be enlarged around the center of the image and the three-dimensional effect can be reduced around the center of the image.

FIG. 14 is a view showing a fish-eye lens effect for enlarging the three-dimensional effect, and FIG. 15 is a view showing a screen to which the fish-eye lens effect shown in FIG. 14 is applied to the image shown in FIG.

Referring to Figs. 14 and 15, the fisheye lens effect 1400 is a fisheye lens effect for enlarging the three-dimensional feeling. When the fisheye lens effect 1400 is applied to the image 1300, the image 1300 is processed into the image 1500. The image (1500) enlarges the stereoscopic effect of the viewer due to the source visual perspective effect. The center of the image 1500 is wider than the center of the image 1300 and the edge of the image 1500 is more dense than the edge of the image 1300. The center of the image 1500 is closer to the viewer, The edge of the image 1500 becomes farther away from the viewer, and the image 1500 enlarges the stereoscopic effect of the viewer.

FIG. 16 is a view showing a fisheye lens effect for reducing a stereoscopic effect, and FIG. 17 is a view showing a screen to which the fisheye lens effect shown in FIG. 16 is applied to the image shown in FIG.

16 and 17, the fisheye lens effect 1600 is a fisheye lens effect for reducing the stereoscopic effect. When the fisheye lens effect 1700 is applied to the image 1300, the image 1300 is processed into the image 1700. [ The fisheye lens effect 1700 is applied so that the center of the image 1700 becomes denser than the center of the image 1300 and the edge of the image 1700 is wider than the edge of the image 1300. [ When the fisheye lens effect 1700 is applied to a two-dimensional image, the stereoscopic effect may become large. However, when a fish-eye lens effect 1700 is applied to a stereoscopic image in which the central portion of the image appears closer to the viewer, the stereoscopic effect of the stereoscopic image is reduced. In addition, since the three-dimensional image generally has a depth value coming from the center, applying the fisheye lens effect 1700 to the stereoscopic image reduces the stereoscopic effect of the stereoscopic image.

Since the fisheye lens effect does not require the individual coordinates of the subject in the image to change the stereoscopic effect of the image, it can be used more effectively when the image is a bitmap graphic.

How to set stereoscopic adjustment value

This section explains how to set the three-dimensional adjustment value. The electronic device 100 can set the stereoscopic effect adjustment value based on the stereoscopic effect setting information. The three-dimensional setting information may be set to an initial value, and the user may set or change the three-dimensional setting information.

18A to 18C are views showing an embodiment of a screen for adjusting three-dimensional setting information.

18A-18C, the display 150 may display a screen 1810, a screen 1820, and a screen 1830.

The screen 1810 includes a GUI 1811 for setting three-dimensional setting information, an area 1812 in which image data is displayed, and an indication 1813 indicating a genre of an image displayed in the area 1812. Here, the display 1813 indicates a baseball, and the area 1812 displays an image of a baseball game. The stereoscopic effect of the image 1812 is changed according to the value indicated by the slide bar 1815 of the GUI 1811. [

The screen 1820 includes a GUI 1821 for setting three-dimensional setting information, an area 1822 in which image data is displayed, and an indication 1823 indicating a genre of an image to be displayed in the area 1822. Here, the display 1823 indicates boxing, and the area 1822 displays an image of a boxing match. Also, the stereoscopic effect of the image 1822 is changed according to the value indicated by the slide bar 1825 of the GUI 1821.

The screen 1830 includes a GUI 1831 for setting three-dimensional setting information, an area 1832 in which image data is displayed, and an indication 1833 indicating a genre of an image displayed in the area 1832. Where indication 1833 indicates a movie, and area 1832 displays a movie. The stereoscopic effect of the image 1832 is changed in accordance with the value indicated by the slide bar 1835 of the GUI 1831. [

The user can perform a user action of selecting a genre to which the three-dimensional setting information is to be set. The control unit 190 may display a screen for displaying the representative stereoscopic image of the genre selected by the user action. For example, in a genre in which a sporting time is short but requires a dynamic stereoscopic effect in a sports genre, the control unit 190 can control the screen 1810 to be displayed. Also, in the case of a genre requiring a long time of viewing due to a long playing time among the sports genres, the control unit 190 can control the screen 1820 to be displayed. In the case of a movie in which the narrative is important and the viewing time is very long, the control unit 190 can display the screen 1830.

The control unit 190 can display the three-dimensional setting information set in default for each genre on the GUI (for example, the GUI 1811, the GUI 1821, and the GUI 1831). The user can set the three-dimensional setting information in a user-customized manner for each genre through the slide bar of the GUI (for example, the GUI 1815, the GUI 1825, and the GUI 1835).

The control unit 190 displays the left eye view image and the right eye view image of the images (for example, the image 1813, the image 1823, and the image 1833) displayed on the screen according to the three-dimensional setting information set through the GUI, To be displayed. Accordingly, the user can adjust the three-dimensional setting information while confirming the reconstructed image according to the set three-dimensional setting information.

The receiving unit 101 can receive the three-dimensional setting information. That is, the tuner unit 110, the mobile communication unit 115, the network interface unit 130, and the external signal receiving unit 135 can receive the three-dimensional setting information. Further, the stereoscopic effect setting information may be included in the broadcast information and transmitted. For example, the three-dimensional setting information may be transmitted in an EIT (Event Information Table) of a DVB SI standard, and may be included in a BCG discovery record.

19 is a diagram showing an embodiment of the syntax of a three-dimensional information descriptor.

Referring to FIG. 19, the cubic setting information may be transmitted in a cubic information descriptor (cubic_effect_information_descriptor ()). The cubic_effect_information_descriptor () may include a descriptor_tag field, a descriptor_length field, an effect_status field, and a type_of_filter field. The cubic_effect_information_descriptor () may include N country_code fields, a rating field, and a filter_weight field. The cubic_effect_information_descriptor () can be included in the EIT and included in the BCG discovery record.

The descriptor_tag field includes a tag number for identifying cubic_effect_information_descriptor (). When the cubic_effect_information_descriptor () is included in the EIT, the descriptor_tag may include a tag number between 0x80 and OxFE.

The descriptor_tag field contains a value indicating the total length of the descriptor. The number of the country_code field, the rating field, and the filter_weight field can be known through the above values.

FIG. 20 is a table showing one embodiment of the values of the effect_status field.

Referring to FIG. 20, the effect_status field includes information indicating an effect status of a current broadcast. The field effect_status may have a length of 8 bits, and the information may be a value between 0 and 7. A value of 0 may mean that the value of the table shown in FIG. 20 is not applied. A value of 1 may also indicate that the image data reconstruction method is not applied. And a value of 2 may indicate that the image data reconstruction method is applied. The value of 3 to 7 may be the value reserved for future use.

The Type_of_filter field may contain information indicating the applied image data reconstruction method and may be defined as 8 bits. A value of 0 indicates that no filter effect is applied, a value of 1 indicates a fisheye lens effect, and a value of 2 indicates a method of changing an object displacement.

The Country_code field may contain information indicating a country indication. The above information is intended to prepare for the fact that the method of reconstructing video data to be applied may be different depending on the broadcasting system, broadcasting system and broadcasting environment of each country. The information may be defined by tags such as KOR, GER, FRA, GBR, etc. defined in ISO 3166 and may be encoded by ISO 8859-1. For example, the information may be encoded as "0100 0111 0100 0010 0101 0010" if the information is "GBR "

FIG. 21 is a table showing one embodiment of the values held in the rating field.

Referring to FIG. 21, the rating field may include information indicating age restriction to which the image data reconstruction method is applied. The information may indicate a video data reconstruction method recommended by age. Ox00 indicates all ages and 0x01 to 0x0F indicates the age calculated by adding the value of 3, and the above values can be freely defined and used by individual broadcasting stations.

The filter_weight field may contain a cubic adjustment value. The stereoscopic effect adjustment value may have a value of 0x00 to Oxff, and a of Equation (5) may be set according to the stereoscopic effect adjustment value.

The present invention can also be embodied as computer-readable codes on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer apparatus is stored. Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may be implemented in the form of a carrier wave (for example, transmission via the Internet) . The computer-readable recording medium may also be distributed to networked computer devices so that computer readable code can be stored and executed in a distributed manner.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be taken by way of limitation in the embodiment in which said invention is directed. It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the scope of the appended claims.

Claims (20)

delete delete delete delete delete delete delete delete delete delete A receiving unit for receiving image data including left eye view image data and right eye view image data;
A controller for determining a stereoscopic effect adjustment value based on stereoscopic effect setting information; And
And a signal processing unit for determining a graphic type of the received image data, determining a method of reconstructing the image data based on the determination result, and reconstructing the image data according to the determined method,
The graphic type may include:
A vector graphics type including coordinate information of a subject in the image data, or a bitmap graphic type not including the coordinate information. 12. The method of claim 11,
Wherein,
And detects a stereoscopic effect adjustment value associated with a genre of the image data from the stereoscopic effect setting information. 12. The method of claim 11,
If the determined graphic type is a vector graphic type,
The signal processing unit,
Calculating a displacement value of the object included in the image data according to the determined stereoscopic effect adjustment value, changing the calculated displacement value using the stereoscopic effect adjustment value, and changing the displacement value of the object according to the changed displacement value Eye view image data and the right-eye view image data so that the left-eye view image data and the right-eye view image data are reconstructed. 14. The method of claim 13,
The signal processing unit,
And calculates the changed displacement value based on the cubic adjustment value and the squared value of the calculated displacement value. 12. The method of claim 11,
If the determined graphic type is a bitmap graphic type,
The signal processing unit,
Eye view image data and the right-eye view image data to a fisheye lens effect. 12. The method of claim 11,
Wherein,
Eye view image data and the right-eye view image data based on the received broadcast information. 12. The method of claim 11,
Wherein,
Detects a user action requesting a graphical user interface (GUI) for setting the three-dimensional setting information,
In response to the detection of the user action, controls to generate a signal for displaying a screen including the graphical user interface (GUI) and an area where the image data is displayed. 18. The method of claim 17,
The signal processing unit,
And reconstructs the left-eye view image data and the right-eye view image data included in the image data according to the three-dimensional setting information set through the GUI. 18. The method of claim 17,
Wherein the screen further displays an indication indicating a genre of the image data. 18. The method of claim 17,
Wherein,
And controls the stereoscopic effect setting information set through the GUI to be stored in association with information indicating a genre of the image data.

Images