WO2019017700A1

WO2019017700A1 - Display device and control method therefor

Info

Publication number: WO2019017700A1
Application number: PCT/KR2018/008145
Authority: WO
Inventors: 무크타로브파리드; 한승룡
Original assignee: 삼성전자주식회사
Priority date: 2017-07-20
Filing date: 2018-07-19
Publication date: 2019-01-24
Also published as: KR20190010060A

Abstract

The present invention relates to a display device and a control method therefor. The present display device comprises: an actuator; a display panel including a plurality of pixels; a processor for displaying, on the display panel, a multi-view image generated on the basis of a plurality of images corresponding to a plurality of viewpoints; and a viewing zone separation unit arranged on the front surface of the display panel, and for separating a viewing zone to which the multi-view image displayed on the display panel is provided, so as to provide images of different viewpoints from each other to each viewing zone, wherein the processor controls the actuator such that the display panel is vibrated, and sequentially displays, while the display panel is vibrated, a first multi-view image including images of partial areas of each of a plurality of images and a second multi-view image including images of the other areas of each of the plurality of images, and the images of the partial areas and the images of the other areas can be provided to the same viewing zone.

Description

Display device and control method thereof

The present invention relates to a display device and a control method thereof, and more particularly, to a display device and a control method thereof for providing a 3D image to a user.

Various types of electronic devices are being developed and distributed due to the development of electronic technologies. Especially, a display device such as a TV, which is one of household appliances most commonly used in general households, is developing rapidly.

As the performance of the display device becomes higher, the kinds of contents provided by the display device are also diversified. Particularly, in recent years, a stereoscopic display device that provides 3D images has been developed and popularized.

The stereoscopic display device can be implemented not only in a 3D TV used in a home, but also in various types of display devices such as various monitors, mobile phones, PDAs, PCs, set-top PCs, tablet PCs, electronic frames, kiosks and the like. In addition, 3D display technology is being used in various fields that require 3D image such as science, medicine, design, education, advertisement, computer game as well as domestic use.

The stereoscopic display device can be classified into a spectacular display device that watches 3D images by wearing glasses, and an unsharp display device that watches 3D images without glasses.

Although the spectacles-type display device can provide a satisfactory stereoscopic effect, there is an inconvenience that the viewer can watch the 3D image only by wearing glasses. In contrast, the non-eye-saving display device has an advantage that 3D images can be viewed without glasses, and in recent years, the development of a non-eye-wear display device has been continuously being discussed.

On the other hand, in the conventional non-eye-warming display device, a plurality of images are displayed on a single screen, resulting in deterioration of image quality. Particularly, in the case of a display device having a display having a predetermined size or more, the image deterioration phenomenon becomes more serious, and therefore, the conventional non-anion-based display device is provided only on a display of a certain size or less.

In addition, the non-eye-warming display device has a limitation on a viewing zone, i.e., a space in which the viewer can view the 3D image, and when the viewer moves out of the viewing zone, the non- There was no problem.

SUMMARY OF THE INVENTION The present invention has been conceived to solve the above-mentioned problems, and it is an object of the present invention to provide a display device capable of providing a high-quality 3D image to a user through vibration of a display panel, And a control method thereof.

A display device according to an embodiment of the present invention includes an actuator, a display panel including a plurality of pixels, a processor that displays a multi-view image generated based on a plurality of images corresponding to a plurality of viewpoints on a display panel, And a field of view separating unit for separating the field of view provided with the multi-view image displayed on the display panel and providing images at different viewpoints in each field of view, wherein the processor controls the actuator to vibrate the display panel And sequentially displaying a first multi-view image including an image of a partial area of each of the plurality of images and a second multi-view image including an image of another area of each of the plurality of images while the display panel is vibrating, The image of the partial area and the image of the other area can be provided in the same view area.

According to the magnitude of the vibration of the display panel, the processor confirms the pixels displaying the image of the partial region and the image of the other region among the plurality of pixels, and displays the image of the other region Respectively.

Here, the image of the partial region and the image of the other region are provided at different positions in the same view region, and the position where the image of the different region and the image of the partial region is provided in the same view region, And may correspond to the position of an image in a different area from the image.

Here, the image of the other region may be an image of a region adjacent to a partial region in the image corresponding to each viewpoint, and may be an image not included in the first multi-view image.

Meanwhile, the display panel includes a plurality of display modules, and the actuator includes a plurality of actuators for vibrating the plurality of display modules, and the processor can control the plurality of actuators to vibrate the plurality of display modules .

The processor divides the first multi-view image into a plurality of first multi-view sub-images, divides the second multi-view image into a plurality of second multi-view sub-images, and a plurality The first multi-view sub-image and the second multi-view sub-image may be sequentially displayed on the display module of the display unit.

The display device according to an embodiment of the present invention further includes a camera and is capable of adjusting the vibration amplitude of the actuator based on at least one position of the user's eyes and head included in the image captured through the camera have.

Further, the processor can adjust the vibration magnitude of the plurality of actuators based on the position of at least one of the user's eyes and the head included in the image photographed through the camera.

A method of controlling a display device according to an embodiment of the present invention includes displaying a multi-view image generated based on a plurality of images corresponding to a plurality of views on a display panel of a display device, Providing a viewpoint image at different viewpoints in each of the viewports and vibrating the display panel and displaying a first multi view image including an image of a partial area of each of the plurality of images and a plurality of And sequentially displaying the second multi-view image including the images of the different regions of the image in the same view area.

The step of displaying the multi-view image may include the steps of: identifying pixels of the image of a part of the pixels included in the display panel and images of other areas, respectively, according to the magnitude of vibration of the display panel; And displaying the image of the partial region and the image of the different region, respectively.

The image of the other region may be an image of a region adjacent to a certain region in the image corresponding to each viewpoint, and may be an image not included in the first multi-view image.

Meanwhile, the display panel includes a plurality of display modules, and the vibrating step may vibrate the plurality of display modules.

Dividing the first multi-view image into a plurality of first multi-view sub-images, and dividing the second multi-view image into a plurality of second multi-view sub-images; And sequentially displaying the first multi-view sub-image and the second multi-view sub-image on the display module.

According to another aspect of the present invention, there is provided a method of controlling a display device, the method comprising: capturing at least one of a user's eyes and a head; and displaying, based on at least one of a user's eyes and a head included in the captured image, And adjusting the vibration amplitude of the display panel.

The method may further include adjusting the vibration amplitude of the plurality of display modules based on the position of at least one of the user's eyes and the head and the position of at least one of the user's eyes and head included in the captured image .

According to various embodiments of the present invention as described above, it is possible to improve the image quality of the 3D image provided by the non-eye-warming display device and to use the non- There is an effect that a 3D image can be viewed in a viewing zone.

1 is a view for explaining an operation of a display apparatus for displaying a multi-view image according to an embodiment of the present invention.

2A to 2C are views showing the configuration of a display device according to an embodiment of the present invention.

3 is a detailed block diagram illustrating the configuration of a spectacle-free 3D display device according to an embodiment of the present invention.

4 is a view for explaining a multi-view image according to an embodiment of the present invention.

5 is a view for explaining an operation of displaying a first multi-view image by a display apparatus according to an embodiment of the present invention.

6 and 7 are views for explaining an operation of displaying a second multi-view image according to an exemplary embodiment of the present invention.

8 is a diagram for explaining a case where a display device includes a plurality of modules according to an embodiment of the present invention.

9 is a flowchart illustrating an operation of a display apparatus according to an exemplary embodiment of the present invention.

-

These embodiments are capable of various modifications and various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the description. It is to be understood, however, that it is not intended to limit the scope of the specific embodiments but includes all transformations, equivalents, and alternatives falling within the spirit and scope of the disclosure disclosed. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In the following description of the embodiments of the present invention,

The terms first, second, etc. may be used to describe various elements, but the elements should not be limited by terms. Terms are used only for the purpose of distinguishing one component from another.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the scope of the claims. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the term " includes " Or " configured. &Quot; , Etc. are intended to designate the presence of stated features, integers, steps, operations, components, parts, or combinations thereof, may be combined with one or more other features, steps, operations, components, It should be understood that they do not preclude the presence or addition of combinations thereof.

In the embodiment, 'module' or 'sub' performs at least one function or operation, and may be implemented in hardware or software, or a combination of hardware and software. In addition, a plurality of 'modules' or a plurality of 'parts' may be integrated into at least one module except for 'module' or 'module' which need to be implemented by specific hardware, and implemented by at least one processor (not shown) .

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a view for explaining the operation of a display device for displaying a multi-view image according to an embodiment of the present invention.

Referring to FIG. 1, a display device according to an exemplary embodiment of the present invention may display a multi-view image. Here, the multi-view image means an image generated based on a plurality of images corresponding to a plurality of viewpoints. Specifically, the multi-view image means an image in which a plurality of images obtained by photographing the same object at different angles are arranged in a predetermined arrangement pattern.

For example, as shown in FIG. 1, the multi-view image may be an image in which first to seventh images photographed at seven viewpoints are sequentially arranged. In FIG. 1, an image photographed at seven viewpoints is shown. However, the number of viewpoints is not limited thereto.

Then, the display device projects a plurality of images photographed at different viewpoints at different angles, and provides a focused image at a position (for example, about 3 meters) apart by a predetermined distance called a viewing distance. Thus, the position where the focused image is formed is referred to as a viewing zone.

On the other hand, when one eye is located in the first viewing area and the other eye is located in the second viewing area, the user can simultaneously view images at different viewpoints, thereby enabling a three-dimensional feeling to be felt.

For example, referring to FIG. 1, the display device displays light (or an optical view) corresponding to a first viewpoint image of seven viewpoints in the left eye of a user, and light corresponding to a second viewpoint image can do. Accordingly, the user can simultaneously view the images of different viewpoints with the left and right eyes, respectively, so that the user can feel the stereoscopic effect.

1, light corresponding to the first viewpoint image is projected on the left eye of the user, and light corresponding to the second viewpoint image is projected on the right eye. However, the present invention is not limited thereto. For example, when light corresponding to the first and second viewpoint images is projected on the left eye of the user and light corresponding to the third and fourth viewpoint images is projected on the right eye, It may be projected in the right eye.

On the other hand, the view mapping method includes a linear mapping method and a cyclic mapping method. In FIG. 1, a linear mapping method is shown. However, in some cases, a multi-view image may be generated based on a cyclic mapping method.

2A, the display device 100 may include a display panel 110, an actuator 120, a field-of-view separation unit 130, and a processor 140.

The display device 100 may be implemented as various types of display devices such as a TV, a monitor, a PC, a kiosk, a tablet PC, an electronic frame, a mobile phone, and the like.

An image input unit (not shown) of the display device 100 can receive an image. Specifically, the image input unit (not shown) can receive various images from an external storage medium, a broadcasting station, a web server, and the like. Here, the input image may be at least one of a single view image, a stereo image, and a multi-view image. A single viewpoint image is an image captured by a general photographing apparatus, and a stereoscopic image is a three-dimensional video image expressed by only a left eye image and a right eye image, and is a stereoscopic image photographed by a stereo photographing apparatus. Generally, a stereo photographing apparatus is used for photographing a stereoscopic image with a photographing apparatus having two lenses. The multi-view image refers to a three-dimensional video image that geometrically corrects images photographed through one or more photographing apparatuses and provides various viewpoints in various directions through spatial synthesis.

The display panel 110 may include a plurality of pixels composed of a plurality of sub-pixels. Here, the subpixel may be composed of R (Red), G (Green), and B (Blue). That is, the display panel 110 can be configured by arranging pixels composed of R, G, and B subpixels in a plurality of rows and columns. In this case, the display panel 110 may include a liquid crystal display panel (LCD panel), a plasma display panel (PDP), an organic light emitting diode (OLED), a vacuum fluorescent display ), An FED (Field Emission Display), an ELD (Electro Luminescence Display), and the like.

The display panel 110 can display an image. Specifically, the display panel 110 may display a multi-view image generated based on a plurality of images corresponding to a plurality of viewpoints. As described above, a multi-view image refers to an image in which a plurality of images at different viewpoints are arranged in a predetermined arrangement pattern. For example, when a first image corresponding to a first viewpoint and a second image corresponding to a second viewpoint are input through an image input unit (not shown), the display panel 110 displays a part of the first image and a second image View image generated by disposing a part of the multi-view image.

2A, when the display panel 110 is implemented as an LCD panel, the display device 100 includes a backlight unit (not shown) for supplying a backlight to the display panel 110 and a backlight unit And a panel driving unit (not shown) for driving the pixels of the display panel 110 according to pixel values of the respective pixels.

The actuator 120 can vibrate the display panel 110. [ Here, the actuator 120 may be physically coupled to the display panel 110 and may be implemented by various motors such as a linear motor, a piezo motor, and a step motor. Meanwhile, the actuator 120 may be implemented as a single unit to vibrate the display panel 110, or may be implemented as a plurality of actuators. When a plurality of actuators 120 are implemented, the actuators 120 are preferably disposed on the left and right sides of the display panel 110, but are not limited thereto.

The actuator 120 can vibrate the display panel 110 in the horizontal direction. Accordingly, the present invention can display, on the display panel 110, an image before being generated as a multi-view image, that is, an image of an area not included in the multi-view image among the original images. A detailed description thereof will be described later.

The viewing area separating unit 130 may be disposed on the front surface of the display panel 110 to separate the viewing area provided with the multi view image displayed on the display panel 110 and provide images at different viewing points in each viewing area.

Herein, the field-of-view separation unit 130 may be implemented as a lenticular lens including a plurality of lens regions. In this case, the lenticular lens can separate the view area by refracting the multi-view image displayed on the display panel 110 through the plurality of lens areas. Specifically, each lens region of the lenticular lens is formed to have a size corresponding to at least one pixel, so that light transmitted through each pixel can be refracted differently. Accordingly, the respective images corresponding to the different viewpoints included in the multi-view image displayed on the display panel 110 provide different viewports, and images at different viewpoints are provided in the respective viewports.

Meanwhile, the field-of-view separation unit 130 may be implemented as a parallax barrier. In this case, the parallax barrier may be implemented as a transparent slit array including a plurality of barrier regions. Accordingly, each of the images corresponding to the different viewpoints included in the multi-view image through the slit between the barrier regions provide different view areas, and images at different viewpoints are provided in each view field.

2B illustrates a case where the viewing area separator 120 is implemented as a lenticular lens, the display panel 110 is implemented as an LCD panel, and the backlight 115 is implemented as an LED, for example, according to an embodiment of the present invention. Fig.

Referring to FIG. 2B, a display unit according to an exemplary embodiment of the present invention includes a display panel 110, a backlight 115, and a lenticular lens 130. Here, the display unit of the present invention is described as having the backlight 115, but it is not necessarily required to have the backlight 115. For example, the display unit of the present invention may be implemented as an OLED (organic light emitting diode) that does not require a separate backlight.

The display panel 110 includes a plurality of pixels divided into a plurality of columns. Then, images of different viewpoints are arranged for each pixel in each column. For example, the first to eighth images, which are a plurality of images at different viewpoints, may be sequentially and repeatedly arranged in each pixel column. That is, each pixel column may be arranged in groups numbered 1, 2, 3, 4, 5, 6, 7,

The backlight 115 may include a light emitting diode (LED). The plurality of light sources constituting the backlight may be arranged in various forms, and various local dimming techniques may be applied. For example, the backlight may be a direct type backlight in which a plurality of light sources are arranged in a matrix form and are uniformly arranged over the entire liquid crystal screen. In this case, the backlight can operate with full-array local dimming or direct local dimming. In addition, the backlight may be an edge type backlight in which a plurality of light sources are disposed only at the edge of the LCD. In this case, the backlight can operate with Edge-lit local dimming.

The backlight 115 provides light to the display panel 110. Each image formed on the display panel 110 is projected onto the lenticular lens 130 by the light provided from the backlight 115 and the lenticular lens 130 refracts the light of each projected image and transmits do.

Accordingly, the lenticular lens 130 generates exit pupils at the position of the user, i.e., the viewing distance. As shown in the figure, the thickness and the diameter of the lenticular lens can be designed such that the exit pupil generated by each pixel column is divided into an average binocular center distance of less than 65 mm when the viewfinder unit 130 is implemented as a lenticular lens. In addition, when the field-of-view separation unit 130 is implemented as a parallax barrier, the spacing of the slits and the like can be designed such that the exit pupil generated by each pixel column is divided into an average binocular center distance of less than 65 mm. Then, the lights of the separated images form an optical view, respectively. That is, as shown in FIG. 2B, when a plurality of optical views are formed in the viewing area and the left and right eyes of the user are respectively located in different optical views, 3D images can be viewed.

Meanwhile, the field-of-view separation unit 130 may be tilted at an angle to improve picture quality. The processor 140 may divide each of the plurality of multi-view images based on the angle of the Slanted part of the field separator 130, and combine them to generate a multi-view image frame for output. Accordingly, the user can view an image tilted in a specific direction, rather than viewing the image displayed in the vertical direction or the horizontal direction in the sub-pixels of the display panel 110. [ Thus, the viewer can view a portion of the subpixel that is not one complete subpixel for at least some pixels. For example, as shown in FIG. 2C, the user views the tilted region 210 at a predetermined angle by the view-of-view separating unit 130. Particularly, by the optical operation of the view- The user views the pixel region (hereinafter referred to as the visible pixel region) in the inclined region as shown. In this case, the size of the pixels A, B, and C provided in the visible pixel region can be determined by the pitch of the lenticular lens.

The processor 140 controls the overall operation of the display device 100. To that end, the processor 140 may include one or more of a central processing unit (CPU), an application processor (AP), or a communication processor (CP) .

First, the processor 140 may render a plurality of images at different viewpoints.

Specifically, when the input image is a 2D image, the processor 140 may render a plurality of images at different points of view based on the depth information extracted by the 2D / 3D conversion. Or when a plurality of images at different viewpoints and a plurality of depth information corresponding thereto are input, a plurality of images may be rendered based on at least one image and depth information among a plurality of input image and depth information. Alternatively, when only a plurality of images at different viewpoints are input, a plurality of images can be rendered based on the extracted depth information after extracting depth information from a plurality of images.

For example, the processor 140 may select one of a 3D image, that is, a left eye image and a right eye image, as a reference image (or a center image) to generate the leftmost image and the rightmost image as the basis of the multi-view image. In this case, the processor 140 may generate the leftmost image and the rightmost image based on the corrected depth information corresponding to one of the left eye image and the right eye image selected as the reference image. When the leftmost and rightmost images are generated, the processor 140 generates a plurality of interpolated images between the center image and the leftmost image, and generates a plurality of interpolated images between the center image and the rightmost image, Lt; / RTI > However, the present invention is not limited to this, and it is also possible to generate an extrapolation view generated by an extrapolation technique. On the other hand, when an image is rendered based on the 2D image and the depth information, the 2D image can be selected as the center image.

However, the above-described rendering operation is merely an example, and it goes without saying that a plurality of images can be rendered by various methods other than the rendering operation described above. In some cases, the processor 140 may adjust the depth of the input image based on the depth information according to various criteria. In this case, the processor 140 may render a plurality of images based on the adjusted depth image .

The processor 140 may provide a multi-view image by arranging a plurality of rendered images on the display panel 110 in a predetermined arrangement pattern. Hereinafter, for convenience of description, the operation of the present invention will be described by taking as an example a multi-view image generated based on images at two view points.

The processor 140 may provide a multi view image in which a first view image corresponding to the first viewpoint rendered and a second viewpoint image corresponding to the rendered viewpoint are arranged in a predetermined arrangement pattern.

Here, the multi-view image may include a first multi-view image and a second multi-view image. Specifically, the first multi-view image is an image including a first view image and a second view image, and the second multi-view image is a first view image not included in the first multi- It may be an image including another region of the image.

An image of another area included in the second multi-view image may be an image of an area adjacent to each of the partial areas of the first multi-view image, and may be an image of an area not included in the first multi-view image. For example, when the first viewpoint image is rendered with 1-1 to 1-5 images from left to right and the second viewpoint image is rendered with 2-1 to 2-5 images from left to right, 1 multi view image may be a multi view image in which the first and second view images are arranged in the order of 1-1, 2-2, 1-3, 2-4, and 1-5, The first and second viewpoint images may be multi-view images arranged in the order of 2-1, 1-2, 2-3, 1-4, 2-5.

The processor 140 may then control the display panel 110 to display the first multi-view image. In this case, a part of the first viewpoint image included in the first multi-view image is provided to the left eye of the user by the view-point separating unit 130, and a part of the second viewpoint image included in the first multi- And can be provided to the right side of the user by the view / That is, in the above-described embodiment, images 1-1, 1-3, 1-5 are provided in the left eye of the user, and images 2-4 and 2-4 are provided in the right eye of the user. As described above, since images of different viewpoints are provided to both sides of the user, the user can feel a three-dimensional feeling.

Then, the processor 140 may control the display panel 110 to display the second multi-view image. That is, in the above-described embodiment, the processor 140 displays the second multi-view image arranged in the order of 2-1, 1-2, 2-3, 1-4, 2-5 on the display panel 110 .

At this time, among the plurality of pixels included in the display panel 110, pixels displaying a partial area included in the first multi-view image and pixels displaying another area of the adjacent area included in the second multi- can be different. Specifically, the processor 140 identifies a pixel providing a partial area of the first multi-view image and a pixel providing a neighboring area of the second multi-view image, based on the magnitude of vibration of the display panel 110 , And may display the first and second multi-view images respectively on the identified pixels. For example, the pixels displaying the second multi-view image may be pixels adjacent to the pixels displaying the first multi-view image. This is to maintain the continuity of the objects included in the 3D image in providing images at the same time at different times.

The processor 140 may transmit an electrical signal to the actuator 120 to vibrate the display panel 110. Specifically, the processor 140 controls the display panel 110 to move the pixels providing adjacent regions of the second multi-view image to a position close to the position where the pixels that present a portion of the first multi- Can be vibrated in the horizontal direction.

For example, if the pixel providing the 1-2 video included in the second multi-view video and the pixel providing the 1-2 video included in the second multi-view video are located in the vicinity of the position where the pixel providing the 1-3 video included in the first multi- The display panel 110 can be vibrated in the horizontal direction so that the pixel providing the display panel 110 is moved.

Accordingly, the 1-2 video and the 1-4 video of the second multi-view video can be provided in the same viewing area as the 1-3 video of the first multi-view video. More specifically, in a state where the lenticular lens is fixed, the pixel providing the 1-2 video and the 1-4 video of the second multi-view video is connected to the 1- When the display panel 110 is vibrated such that the pixel providing the 3-image is located, the 1-2 and 1-4 images of the second multi-view image are displayed on the 1- 3 video in the same viewing area. On the other hand, the concept of the viewing zone should be understood as a specific area in which a 3D image can be viewed, not a point to be a specific point.

On the other hand, by oscillating the display panel 110 in the horizontal direction, a part of the first multi-view image and a neighboring area of the second multi-view image can be provided at different positions in the same view area.

Specifically, by causing the processor 140 to vibrate the display panel 110 in the horizontal direction, the adjacent area of the second multi-view image can be sequentially displayed on the display panel 110 near a part of the first multi- have. For example, in the above-described embodiment, when the processor 140 vibrates the display panel 110 in the left direction when viewed from the area 1-3 of the areas included in the first multi-view, The image of the area 1-4 is displayed near the area 1-3 and the image of the area 1-2 is included in the area of the second multi view when the display panel 110 is vibrated in the right direction. Can be displayed near the 1-3 region.

As described above, since the partial area of the first multi-view image and the adjacent area of the second multi-view image are sequentially displayed on the display panel 110, the continuity of objects included in the 3D image can be maintained.

In addition, by displaying an image of an area not included in the first multi-view through the second multi-view as described above, it is possible to provide a seamless 3D image without deterioration of image quality.

Meanwhile, according to another embodiment of the present invention, the display panel 110 may include a plurality of display modules. In this case, the present invention may further comprise a plurality of actuators for vibrating each of the plurality of display modules.

In this case, the processor 140 may divide the first multi-view image into a plurality of first multi-view sub-images. Specifically, the processor 140 may divide the first multi-view image into the same number as the number of the display modules. For example, when a plurality of display modules is implemented with four, the processor 140 may divide the first multi-view image into four first multi-view sub-images by dividing the first multi-view image into four regions.

The processor 140 may provide the first multi-view sub-image to each of the plurality of display modules based on the position of the plurality of display modules in the display panel 110. [ For example, when the first multi-view sub-image is divided into four first multi-view sub-images, the processor 140 converts the image displayed at the position corresponding to the (1,1) coordinates of the first multi- To a display module at a position corresponding to the (1,1) coordinates on the display panel 110. Similarly, the processor 140 displays the images displayed at the positions corresponding to the (1,2), (2,1), (2,2) coordinates of the first multi-view image on the display panel 110, 2) and (2,1) (2,2) coordinates, respectively.

Similarly to the first multi-view image, the processor 140 can divide the second multi-view image into a plurality of sub-images, and provide each sub-image to the corresponding display module. The description thereof will be omitted because it is redundant to the above-mentioned portion.

Then, the processor 140 displays the first multi-view sub-image on each display module of the display panel 110, and then displays the second multi-view sub-image on each display module of the display panel 110, The display module can be vibrated. In this case, the processor 140 may vibrate the display module so as to have antiphase between adjacent display modules in order to minimize vibration of the display device 100 itself.

Thus, by vibrating the plurality of display modules, the processor 140 can sequentially display the first multi-view sub-image and the second multi-view sub-image.

Accordingly, the present invention is capable of displaying an image of an area not included in the first multi-view sub-image through the second multi-view sub-image, and providing a non-tight 3D image without deterioration of image quality.

In addition, since the display panel 110 can be implemented with a plurality of display modules, high-quality, non-limiting 3D images can be provided even in a large-sized display.

In the above-described embodiment, the operation of the present invention has been described with reference to a multi-view image generated based on images at two viewpoints for convenience of explanation. However, the number of viewpoints is not necessarily limited to this, The present invention can be applied to multi-view images generated on the basis of the multi-view images.

3, the display device 100 'includes a display panel 110, an actuator 120, a field separator 130, a processor 140, an audio processor 150, a video interface 160, and a camera 170 ). Hereinafter, a detailed description of a part overlapping with the above description will be omitted.

The processor 140 includes a RAM 141, a ROM 142, a main CPU 143, a graphics processing unit 144, first through n interfaces 145-1 through 145-n,

The RAM 141, the ROM 142, the main CPU 143, the graphics processing unit 144, the first to n interfaces 145-1 to 145-n, etc. may be connected to each other via the bus 146.

The first to n interfaces 145-1 to 145-n are connected to the various components described above. One of the interfaces may be a network interface connected to an external device via a network.

The main CPU 143 accesses a storage unit (not shown) and performs booting using the O / S stored in the storage unit (not shown). Various operations are performed using various modules, various programs, contents, and data stored in a storage unit (not shown).

The ROM 142 stores a command set for booting the system and the like. The main CPU 143 copies the O / S stored in the storage unit (not shown) to the RAM 141 according to the instruction stored in the ROM 142, and executes the O / S To boot the system. When the booting is completed, the main CPU 143 copies various programs stored in a storage unit (not shown) to the RAM 141, executes the program copied to the RAM 141, and performs various operations.

The graphic processing unit 144 generates a screen including various objects such as an icon, an image, and a text using an operation unit (not shown) and a rendering unit (not shown). The operation unit (not shown) calculates an attribute value such as a coordinate value, a shape, a size, and a color to be displayed by each object according to the layout of the screen based on the received control command. The rendering unit (not shown) creates screens of various layouts including the objects based on the attribute values calculated by the operation unit (not shown).

The camera 170 can take an image. Specifically, the camera 170 can photograph a user existing in front of the display device 100 '.

The camera 170 may be implemented as an external device separate from the display device 100 ', or may be implemented as a device embedded in the display device 100'.

The processor 140 may adjust the magnitude of the vibration of the actuator 120 based on the position of at least one of the user's eyes and the head included in the image photographed by the camera 170. [

Specifically, when the position of at least one of the eyes and the head of the user included in the image photographed by the camera 170 is changed, the processor 140 adjusts the vibration magnitude of the actuator 120 so that the visual field is formed at the changed position. Can be adjusted.

More specifically, the processor 140 can vibrate the display panel 100 to adjust the position of the pixels included in the display panel 110. [ Here, the position of the adjusted pixel may be a position at which the field of view can be formed at the position of the user included in the photographed image, thereby forming the field of view at the changed position of at least one of the user's eyes and head .

To this end, the display device 100 'may further include an eye tracking module (not shown) and a head tracking module (not shown). In the meantime, the specific operation of the eye tracking module (not shown) and the head tracking module (not shown) is omitted because each module is a known technology.

Meanwhile, even when the display panel 110 is implemented by a plurality of display modules, the processor 140 can adjust the magnitude of vibration of the actuator 120 based on at least one position of the user's eyes and the head. A detailed description thereof will be omitted since it is redundant with the above-mentioned portion.

Meanwhile, in the present invention, the distance between the lenticular lens and the display module can be calculated by the following equation (1).

[Equation 1]

Dm ≥ Do * IPD / Hs

(Where Dm is the distance between the lenticular lens and the display module, Do is the distance between the display module and the viewer, IPD is the pupil distance of the viewer, and Hs is the horizontal size of the light source).

The effective focal length (EFL) of the lenticular lens can be calculated by the following equation (2).

&Quot; (2) "

EFL = (Dm * Do) / (Dm + Do)

(Where EFL is the focal length of the lenticular lens, Dm is the distance between the lenticular lens and the display module, and Do is the distance between the display module and the viewer).

The width W1 of the lenticular lens can be calculated by the following equation (3).

&Quot; (3) "

Wl? Hs * N

(Where Wl is the width of the lenticular lens, Hs is the horizontal size of the light source, and N is the number of viewable areas).

The above equations (1), (2) and (3) are only one equation for obtaining the parameters related to the lenticular lens, and in implementing the present invention, the parameters related to the lenticular lens are not necessarily calculated by the above- . That is, the parameters related to the lenticular lens may be calculated in other manners.

As described above, the multi-view image means an image in which the images corresponding to the respective viewpoints are arranged in a predetermined arrangement pattern.

Referring to FIG. 4, the first view image 410 may include an image of a region 1-1 to 1-5, and the second view image 420 may include an image of regions 2-1 to 2-5. can do. In addition, the multi-view image 430 generated based on the first and second view-point images may be an image in which a part of the images included in the first and second view-point images are arranged in a predetermined arrangement pattern.

In the conventional display device, only the multi-view image 430 shown in FIG. 4 is displayed, and the image of the area not included in the multi-view image, that is, the first view image 410, And the image of the area 2-1, 2-3, and 2-5 in the second viewpoint image 420 is not displayed, thereby causing image quality deterioration.

Accordingly, when viewing the multi-view image 430 as a first multi-view image, the present invention can provide a second multi-view image including an image of an area not included in the first multi-view image. Here, the second multi-view image may be an image in which the images of the regions 2-1, 1-2, 2-3, 1-4, and 2-5 are sequentially arranged.

Hereinafter, for the sake of convenience of explanation, the first multi-view image is viewed as an image in which the images at the first and second viewpoints are arranged in the order of 1-1, 2-2, 1-3, 2-4, , And the second multi-view image will be described as an image in which the images at the first and second viewpoints are arranged in the order of 2-1, 1-2, 2-3, 1-4, 2-5.

First, the processor 140 may display the first multi-view image on the display panel 110, as described above.

In this case, the

pixels

511, 512, and 513 included in the display panel 110 may provide images of different regions. For example, the first pixel 511 may provide an image of a region 2-2 of the first multi-view image, and the second pixel 512 may provide an image of an area 1-3 of the first multi- And the third pixel 513 can provide images of the 2-4 regions of the first multi-view image. Meanwhile, in the figure, the pixels related to the image in the other area are omitted for convenience of explanation.

The processor 140 provides a first viewpoint image (for example, images in the areas 1-1, 1-3, and 1-5) included in the first multi-view image through the view / The second viewing image included in the first multi-view image is provided to the right eye of the viewer through the viewing area separating unit, thereby providing the 3D image to the user.

The processor 140 may provide a first multi-view image and then a second multi-view image. At this time, the first pixel 511 may provide an image of a first area of the second multi-view image, and the second pixel 512 may provide an image of a second area of the second multi-view image And the third pixel 513 may provide an image of a region 1-4 of the second multi-view image.

The processor 140 may transmit an electrical signal to the actuator to vibrate the display panel.

Fig. 6 shows a case where the display panel is vibrated to the left, and Fig. 7 is a view to explain a case where the display panel is vibrated to the right.

Referring to FIG. 6, the processor 140 may vibrate the display panel to the left. Accordingly, an image of the area 1-4 of the second multi-view image provided by the third pixel 513 in the same view area can be provided in the left eye of the user.

7, the processor 140 may vibrate the display panel to the right. Accordingly, an image of the area 1-4 of the second multi-view image provided by the first pixel 511 in the same view area can be provided in the left eye of the user.

On the other hand, the second view image may be provided to the user in the same manner as described above. The detailed description will be omitted because it overlaps with the case of the first view image.

Since the partial area of the first multi-view image and the adjacent area of the second multi-view image are sequentially displayed on the display panel 110, the continuity of the objects included in the 3D image can be maintained, May be provided to the user.

That is, the conventional non-eyeglass display apparatus has a problem that image quality deterioration occurs due to displaying only the first multi-view image and not providing an image of an area not included in the first multi-view image. However, By providing an image of an area not included in the first multi-view image as the second multi-view image, it is possible to provide a high-quality 3D image to the user without a problem of deterioration of image quality.

The display panel of the present invention may include a plurality of display modules 111, 112, 113, and 114.

Here, a sub-image corresponding to each area of one multi-view image may be displayed on each display module. For example, when the multi-view sub-image is divided into four sub-images, the processor 140 displays an image displayed at a position corresponding to the (1,1) coordinates of the multi-view image on the display panel 110 , 1) coordinates to the display module 111 at a position corresponding to the coordinates. Likewise, the processor 140 displays the images displayed on the display panel 110 at positions corresponding to the (1,2), (2,1), (2,2) coordinates of the multi- , And (2,1) (2,2) coordinates of the display module 112, 113, and 114, respectively.

In this way, the processor 140 displays the first multi-view sub-image on each display module of the display panel 110, and then displays the second multi-view sub-image on each display module of the display panel 110 The plurality of display modules can be vibrated.

9 is a flowchart illustrating an operation of a display apparatus according to an embodiment of the present invention.

First, the display device displays a multi-view image generated on the display panel based on a plurality of images corresponding to a plurality of viewpoints. In one embodiment, the multi-view image may include a first multi-view image and a second multi-view image.

The display device separates the view areas provided with the multi-view images, and provides images at different view points in each view area. Specifically, the first viewpoint image included in each of the first and second multi-view images may be provided to the left eye of the user, and the second viewpoint image may be provided to the right eye of the user.

The display device vibrates the display panel, and while the display panel is being vibrated, a first multi-view image including an image of a partial area of each of the plurality of images, and a second multi-view image including an image of another area of each of the plurality of images, The multi-view images are sequentially displayed in the same view area.

Accordingly, an image of an area not included in the first multi-view sub-image can be displayed through the second multi-view sub-image, and an unshallow 3D image can be provided without deterioration of image quality.

Meanwhile, the control method according to the various embodiments described above can be implemented by a program and provided to an electronic device. In particular, a program including a control method may be stored in a non-transitory computer readable medium.

A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. In particular, the various applications or programs described above may be stored on non-volatile readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM,

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of this disclosure.

-

Claims

In the display device,

Actuator;

A display panel including a plurality of pixels;

A processor for displaying on the display panel a multi-view image generated based on a plurality of images corresponding to a plurality of viewpoints; And

And a field of view separator disposed on a front surface of the display panel for separating a field of view provided with the multi-view image displayed on the display panel and providing images at different viewpoints in each field of view,

The processor comprising:

A first multi-view image including an image of a partial area of each of the plurality of images and an image of another area of each of the plurality of images while the display panel is vibrating; View image sequentially including the first multi-view image and the second multi-

Wherein the image of the partial area and the image of the other area are provided in the same viewing area.
The method according to claim 1,

The processor comprising:

The method comprising the steps of: identifying pixels of the partial area and images of the other area, respectively, of the plurality of pixels according to the magnitude of vibration of the display panel; Respectively.
The method according to claim 1,

The image of the partial area and the image of the other area are provided at different positions in the same view area,

Wherein the position of the image of the partial area and the image of the other area in the same view area correspond to the image of the partial area and the image of the other area in the image corresponding to each view point.
The method according to claim 1,

Wherein the image of the other area includes:

Wherein the image is an image of an area adjacent to the partial area in an image corresponding to each viewpoint, and is not included in the first multi-view image.
The method according to claim 1,

The display panel includes a plurality of display modules,

Wherein the actuator includes a plurality of actuators for vibrating the plurality of display modules,

The processor comprising:

And controls the plurality of actuators to vibrate the plurality of display modules.
6. The method of claim 5,

The processor comprising:

The first multi-view image is divided into a plurality of first multi-view sub-images, the second multi-view image is divided into a plurality of second multi-view sub-images, and the plurality And sequentially displays the first multi-view sub-image and the second multi-view sub-image on a display module of the display unit.
The method according to claim 1,

Further comprising a camera,

And adjusts the magnitude of vibration of the actuator based on at least one position of the user's eyes and head included in the image photographed through the camera.
6. The method of claim 5,

Further comprising a camera,

The processor

And adjusts the magnitude of vibration of the plurality of actuators based on a position of at least one of a user's eyes and a head included in an image photographed through the camera.
A method of controlling a display device,

Displaying a multi-view image generated based on a plurality of images corresponding to a plurality of viewpoints on a display panel of the display device;

Separating the view area provided with the multi view image and providing images at different view points in each view area; And

A first multi-view image including an image of a partial area of each of the plurality of images, and a second multi-view image including an image of another area of each of the plurality of images while the display panel is being vibrated, And displaying the view images sequentially in the same view area.
10. The method of claim 9,

Wherein the displaying the multi-view image comprises:

Identifying pixels in which the image of the partial area and the image of the other area are respectively displayed among the pixels included in the display panel according to the magnitude of vibration of the display panel; And

And displaying the image of the partial region and the image of the different region in the identified pixels, respectively.
10. The method of claim 9,

The image of the partial area and the image of the other area are provided at different positions in the same view area,

Wherein the position of the image of the partial area and the image of the other area in the same view area corresponds to the position of the image of the partial area and the image of the other area in the image corresponding to each viewpoint, .
10. The method of claim 9,

Wherein the image of the other area includes:

Wherein the image is an image of an area adjacent to the partial area in an image corresponding to each viewpoint and is not included in the first multi-view image.
10. The method of claim 9,

The display panel includes a plurality of display modules,

Wherein the vibrating step comprises:

And vibrates the plurality of display modules.
14. The method of claim 13,

Dividing the first multi-view image into a plurality of first multi-view sub-images, and dividing the second multi-view image into a plurality of second multi-view sub-images; And

And sequentially displaying the first multi-view sub-image and the second multi-view sub-image on the plurality of display modules while the plurality of display modules are vibrated.
10. The method of claim 9,

Photographing at least one of a user's eyes and a head; And

And adjusting a magnitude of vibration of the display panel based on at least one position of a user's eye and a head included in the photographed image.