WO2022245194A1 - 이미지를 처리하기 위한 방법 및 장치 - Google Patents
이미지를 처리하기 위한 방법 및 장치 Download PDFInfo
- Publication number
- WO2022245194A1 WO2022245194A1 PCT/KR2022/095094 KR2022095094W WO2022245194A1 WO 2022245194 A1 WO2022245194 A1 WO 2022245194A1 KR 2022095094 W KR2022095094 W KR 2022095094W WO 2022245194 A1 WO2022245194 A1 WO 2022245194A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- view area
- view
- sub
- area
- degree
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 72
- 238000000926 separation method Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 description 47
- 238000010586 diagram Methods 0.000 description 40
- 230000014509 gene expression Effects 0.000 description 10
- 238000004590 computer program Methods 0.000 description 8
- 238000003860 storage Methods 0.000 description 7
- 230000007423 decrease Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 230000004888 barrier function Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 2
- 238000009826 distribution Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000002096 quantum dot Substances 0.000 description 1
- 229910052709 silver Inorganic materials 0.000 description 1
- 239000004332 silver Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/122—Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
- H04N13/305—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using lenticular lenses, e.g. arrangements of cylindrical lenses
Definitions
- the present disclosure relates to a method for processing an image and an electronic device thereof.
- the present disclosure provides a method for processing an image and an electronic device thereof.
- One aspect of the present disclosure includes obtaining a plurality of images corresponding to a plurality of views; identifying at least one view region overlapping a sub-pixel from among a plurality of view regions corresponding to the plurality of views; identifying a data value corresponding to the sub-pixel for each of at least one image corresponding to the at least one view area; The degree of reflection of the data value for each of the at least one image is determined based on the degree of overlap between the subpixel and the at least one view area, and the degree of reflection of the data value is adjusted according to the determined degree of reflection, and the subpixel is adjusted according to the degree of reflection. determining the output value of; and outputting an image based on output values determined for each of a plurality of subpixels including the subpixel.
- a method may be provided in which the degree of reflection of the data value increases as the degree of overlap between the sub-pixel and the at least one view region increases.
- the degree of overlap between the subpixel and the at least one view region is determined based on an overlapping area between the subpixel and the at least one view region.
- the degree of overlap between the sub-pixel and the at least one view area may increase.
- the degree of overlap between the subpixel and the at least one view area is determined based on an overlapping length between the subpixel and the center line of the at least one view area. , can provide a method.
- the method may provide a method characterized in that the degree of overlap between the sub-pixel and the at least one view region increases as the length of the overlap increases.
- the at least one view area may be a view area in which an area overlapping the sub-pixel is greater than or equal to a predetermined value.
- the at least one view area is a view area in which a value generated by dividing an area overlapping the sub-pixel by an area of the sub-pixel is equal to or greater than a predetermined value. can do.
- the at least one view area may be a view area in which a center line overlapping the sub-pixel is equal to or greater than a predetermined value.
- FIG. 1 Another aspect of the present disclosure is a viewing area separation unit; a memory storing at least one instruction; and at least one processor, wherein the at least one processor executes the at least one instruction to acquire a plurality of images corresponding to a plurality of views, and to display the plurality of views based on the characteristics of the viewing area separator.
- the at least one processor executes the at least one instruction to acquire a plurality of images corresponding to a plurality of views, and to display the plurality of views based on the characteristics of the viewing area separator.
- a plurality of view regions determined to correspond to each other at least one view region overlapping with a sub-pixel is identified, and data corresponding to the sub-pixel is identified for each of at least one image corresponding to the at least one view region.
- a value is identified, a degree of reflection of the data value is determined for each of the at least one image based on an overlapping degree between the sub-pixel and the at least one view region, and a data value adjusted according to the determined degree of reflection is determined. It is possible to provide an electronic device that determines an output value of the subpixel based on the subpixel and outputs an image based on the determined output value for each of a plurality of subpixels including the subpixel.
- the electronic device may provide an electronic device characterized in that the degree of reflection of the data value increases as the degree of overlap between the sub-pixel and the at least one view area increases.
- the degree of overlap between the sub-pixel and the at least one view area is determined based on an area where the sub-pixel and the at least one view area overlap. can provide.
- the electronic device may provide an electronic device characterized in that the degree of overlap between the sub-pixel and the at least one view area increases as the overlapping area increases.
- the degree of overlap between the subpixel and the at least one view area is determined based on an overlapping length between the subpixel and the center line of the at least one view area.
- an electronic device may be provided.
- the electronic device may provide an electronic device characterized in that the degree of overlap between the sub-pixel and the at least one view area increases as the length of the overlap increases.
- the electronic device may be characterized in that the at least one view area is a view area in which an area overlapping the sub-pixel is greater than or equal to a predetermined value.
- the at least one view area is a view area in which a value generated by dividing an area overlapping the subpixel by the area of the subpixel is equal to or greater than a predetermined value, characterized in that, the electronic device can provide
- the electronic device may be characterized in that the at least one view area is a view area in which a length where a center line overlaps with the sub-pixel is equal to or greater than a predetermined value.
- an electronic device characterized in that the viewing area separation unit includes a lenticular lens or a parallax barrier may be provided.
- Another aspect of the present disclosure may provide a computer-readable recording medium on which a program for implementing a method performed by the electronic device is recorded.
- FIG. 1 is a block diagram of an electronic device according to an embodiment of the present disclosure.
- 2A is a diagram for explaining a process of determining an output value of a subpixel in an existing display device.
- 2B is a diagram for explaining a process of determining an output value of a subpixel in an existing display device.
- 2C is a diagram for explaining a process of determining an output value of a sub-pixel in an existing display device.
- 3A is a diagram for explaining a process of determining an output value of a subpixel in an existing display device.
- 3B is a diagram for explaining a process of determining an output value of a subpixel in an existing display device.
- 3C is a diagram for explaining a process of determining an output value of a subpixel in an existing display device.
- 4A is a diagram for explaining a process of determining an output value of a subpixel by an electronic device according to an embodiment of the present disclosure.
- 4B is a diagram for explaining a process of determining an output value of a subpixel by an electronic device according to an embodiment of the present disclosure.
- 4C is a diagram for explaining a process of determining an output value of a subpixel by an electronic device according to an embodiment of the present disclosure.
- 5A is a diagram for explaining a process of determining an output value of a subpixel by an electronic device according to an embodiment of the present disclosure.
- 5B is a diagram for explaining a process of determining an output value of a sub-pixel by an electronic device according to an embodiment of the present disclosure.
- 6A is a diagram for explaining a process of determining an output value of a subpixel by an electronic device according to an embodiment of the present disclosure.
- 6B is a diagram for explaining a process of determining an output value of a subpixel by an electronic device according to an embodiment of the present disclosure.
- 6C is a diagram for explaining a process of determining an output value of a sub-pixel by an electronic device according to an embodiment of the present disclosure.
- FIG. 7A is a diagram for explaining a process of determining an output value of a sub-pixel by an electronic device according to an embodiment of the present disclosure.
- 7B is a diagram for explaining a process of determining an output value of a sub-pixel by an electronic device according to an embodiment of the present disclosure.
- 7C is a diagram for explaining a process of determining an output value of a subpixel by an electronic device according to an embodiment of the present disclosure.
- FIG. 8A is a diagram for explaining a process of determining, by an electronic device, an output value of a subpixel except for a view area in which an overlapping area or ratio with a subpixel is equal to or less than a predetermined value, according to an embodiment of the present disclosure.
- FIG. 8B is a diagram for explaining a process of determining, by an electronic device, an output value of a subpixel except for a view area in which an overlapping area or ratio with a subpixel is equal to or less than a predetermined value, according to an embodiment of the present disclosure.
- FIG. 8C is a diagram for explaining a process of determining, by an electronic device, an output value of a subpixel except for a view area in which an overlapping area or ratio with a subpixel is equal to or less than a predetermined value, according to an embodiment of the present disclosure.
- 9A is a diagram for explaining a process of identifying, by an electronic device, at least one view area overlapping a sub-pixel based on the number of views, according to an embodiment of the present disclosure.
- 9B is a diagram for explaining a process of identifying, by an electronic device, at least one view area overlapping a sub-pixel based on the number of views, according to an embodiment of the present disclosure.
- 9C is a diagram for explaining a process of identifying, by an electronic device, at least one view region overlapping a sub-pixel based on the number of views, according to an embodiment of the present disclosure.
- 10A is a diagram for explaining a process of identifying, by an electronic device, at least one view area overlapping a sub-pixel based on a pixel per inch (PPI) of a display according to an embodiment of the present disclosure.
- PPI pixel per inch
- 10B is a diagram for explaining a process of identifying, by an electronic device, at least one view area overlapping a sub-pixel based on a PPI of a display according to an embodiment of the present disclosure.
- 11A is a diagram for explaining a process of identifying, by an electronic device, at least one view area overlapping a sub-pixel based on a slant angle of a lenticular lens, according to an embodiment of the present disclosure.
- 11B is a diagram for explaining a process of identifying, by an electronic device, at least one view area overlapping a sub-pixel based on an inclination angle of a lenticular lens according to an embodiment of the present disclosure.
- FIG. 12 is a flowchart illustrating a process of outputting an image by an electronic device according to an embodiment of the present disclosure.
- FIG. 13 is a block diagram of an electronic device according to an embodiment of the present disclosure.
- each block of the process flow chart diagrams and combinations of the flow chart diagrams can be performed by computer program instructions.
- These computer program instructions may be embodied in a processor of a general purpose computer, special purpose computer, or other programmable data processing equipment, so that the instructions executed by the processor of the computer or other programmable data processing equipment are described in the flowchart block(s). It creates means to perform functions.
- These computer program instructions may also be stored in a computer usable or computer readable memory that can be directed to a computer or other programmable data processing equipment to implement functionality in a particular way, such that the computer usable or computer readable memory
- the instructions stored in are also capable of producing an article of manufacture containing instruction means that perform the functions described in the flowchart block(s).
- the computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operational steps are performed on the computer or other programmable data processing equipment to create a computer-executed process to generate computer or other programmable data processing equipment. Instructions for performing processing equipment may also provide steps for performing the functions described in the flowchart block(s).
- each block may represent a module, segment or portion of code including at least one executable instruction for executing specified logical function(s). It should also be noted that in some alternative implementation examples it is possible for the functions mentioned in the blocks to occur out of order. For example, two blocks shown in succession may in fact be executed substantially concurrently, or the blocks may sometimes be executed in reverse order depending on their function.
- a device-readable storage medium may be provided in the form of a non-transitory storage medium.
- 'non-temporary storage medium' only means that it is a tangible device and does not contain signals (e.g., electromagnetic waves), and this term refers to the case where data is stored semi-permanently in the storage medium and temporary It does not discriminate if it is saved as .
- a 'non-temporary storage medium' may include a buffer in which data is temporarily stored.
- the method according to various embodiments disclosed in this document may be provided by being included in a computer program product.
- Computer program products may be traded between sellers and buyers as commodities.
- a computer program product is distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store TM ) or between two user devices ( It can be distributed (eg downloaded or uploaded) online, directly between smartphones.
- a portion of a computer program product eg, a downloadable app
- a machine-readable storage medium such as a memory of a manufacturer's server, an application store's server, or a relay server. It can be stored or created temporarily.
- a view area may mean a virtual area corresponding to a view.
- an image corresponding to a view may be rendered by one or more sub-pixels overlapping a virtual view area corresponding to the view.
- a sub-pixel constituting one pixel means a sub-pixel of any one color component among R, G, and B color components constituting the corresponding pixel, or a sub-pixel constituting the corresponding pixel. It may mean a sub-pixel of any one color component among Y, U, and V color components.
- subpixels at a predetermined location in a plurality of images mean subpixels of any one color component among R, G, and B constituting pixels at the same location among a plurality of images, or pixels at the same location. It may refer to a sub-pixel of any one color component among Y, U, and V color components.
- the above definition assumes that the embodiment of the present disclosure follows an RGB color format or a YUV color format, and even when other color formats are followed, a sub-pixel may mean a sub-pixel of any one color component.
- FIG. 1 is a block diagram of an electronic device 100 according to an embodiment of the present disclosure.
- the electronic device 100 may include a display 110 , a processor 120 and a memory 130 .
- the configuration of the electronic device 100 is not limited to the above, and may include more or less configurations.
- the display 110 may display various contents such as text, images, videos, icons, or symbols.
- the display 110 may be a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a quantum dot light emitting diode (QLED) display, a microelectromechanical systems (MEMS) display, and an electronic paper display. It may include at least one of, but is not limited thereto.
- the display 110 may mean an autostereoscopic display.
- the display 110 may refer to a display that allows a user to view different images according to viewing positions using a viewing area separator such as a lenticular lens or a parallax barrier. , but not limited thereto.
- the processor 120 may control the overall operation of the electronic device 100 by executing at least one instruction stored in the memory 130 .
- the processor 120 may obtain a plurality of images corresponding to a plurality of views.
- the processor 120 may identify at least one view area overlapping a sub-pixel from among view areas determined to correspond to a plurality of views.
- the processor 120 may identify data values corresponding to sub-pixels for each of at least one image corresponding to at least one view area.
- the processor 120 determines the degree of reflection of data values for each of at least one image based on the degree of overlap between the subpixels and at least one view region, and uses the data values adjusted according to the determined degree of reflection to determine the degree of reflection of the subpixels. output value can be determined.
- the processor 120 may output an image using output values determined for each sub-pixel including the sub-pixel.
- the memory 130 may include a view area determination module 140 , a view area identification module 150 , a data value reflection degree determination module 160 and a subpixel output value determination module 170 .
- the view region determination module 140 may store instructions for determining a plurality of view regions corresponding to each of the plurality of views, based on the number of views and characteristics of a viewing area separator such as a lenticular lens or a parallax barrier. .
- the view area identification module 150 may store instructions for identifying at least one view area overlapping a sub-pixel among a plurality of view areas.
- the data value reflection degree determining module 160 identifies data values corresponding to sub-pixels for each of at least one image corresponding to at least one view area, and based on the overlapping degree between the sub-pixel and at least one view area, at least one Instructions for determining the degree of reflection of data values for each image may be stored.
- the sub-pixel output value determination module 170 may store instructions for determining the output value of the sub-pixel using the data value adjusted according to the determined reflection degree.
- 2A to 2C are diagrams for explaining a process of determining an output value of a subpixel in an existing display device.
- an existing display device may identify at least one view area overlapping a subpixel 200 among a plurality of view areas according to an exemplary embodiment.
- an existing display device includes a 10th view area 210, a first view area 220, a second view area 230, and a third view overlapping the sub-pixel 200 among 10 view areas.
- Region 240 can be identified.
- the tenth view area 210, the first view area 220, the second view area 230, and the third view area 240 are the tenth view (or tenth image), the first view (or first image), a second view (or second image), and a third view (or third image).
- an existing display device may determine a dominant view area from among at least one view area overlapping the subpixel 200 .
- a dominant view area For example, in an existing display device, subpixels among the tenth view area 210, the first view area 220, the second view area 230, and the third view area 240 overlap with the subpixel 200.
- the second view area 230 having the largest overlapping area with 200 may be determined as the dominant view area.
- an existing display device may determine a data value corresponding to a subpixel 200 in an image corresponding to a dominant view area as an output value of the subpixel 200 .
- a data value corresponding to the subpixel 200 may mean a data value at the first position in the image.
- the existing display device may determine the data value of the first position in the second image corresponding to the second view area 230 as the output value of the subpixel 200 by using the relational expression (1) below. have.
- Output means the output value of the subpixel 200, denotes a data value of a first position in the image corresponding to the dominant view area.
- the number of views in the stereo-view mode may be two.
- the existing display device may determine a dominant view area for each subpixel from among at least one view area overlapping the subpixel. For example, an existing display device determines a first view area overlapping the center of the subpixel 250 among the first view area and the second view area overlapping the subpixel 250 at the first position as the dominant view area. can Alternatively, the existing display device may determine the second view area overlapping the center of the subpixel 260 among the first view area and the second view area overlapping the subpixel 260 at the second position as the dominant view area. .
- an existing display device may determine a data value in an image corresponding to each of the dominant view regions as an output value of each subpixel. For example, the existing display device may determine the data value of the first position in the first image corresponding to the first view area as the output value of the subpixel 250 . Alternatively, the existing display device may determine the data value of the second position in the second image corresponding to the second view area as the output value of the subpixel 260 .
- 2C illustrates a process of determining an output value of a sub-pixel in a multi-view mode by an existing display device according to an embodiment of the present disclosure.
- the number of views in the multi-view mode may be plural.
- the existing display device may determine a dominant view area for each subpixel from among at least one view area overlapping the subpixel. For example, the existing display device determines a sixth view area overlapping the center of the subpixel 270 among the sixth view area and the seventh view area overlapping the subpixel 270 at the third position as the dominant view area.
- the 15th view area overlapping the center of the subpixel 280 among the 14th view area, the 15th view area, and the 16th view area overlapping the subpixel 280 in the fourth position is the dominant view. area can be determined.
- an existing display device may determine a data value within an image corresponding to each dominant view area as an output value of each sub-pixel. For example, the existing display device may determine the data value of the third position in the sixth image corresponding to the sixth view area as the output value of the subpixel 270 . Alternatively, the existing display device may determine the data value of the fourth position in the 15th image corresponding to the 15th view area as the output value of the sub-pixel 280 .
- 3A to 3C are diagrams for explaining a process of determining an output value of a sub-pixel in an existing display device.
- an existing display device may identify at least one view area overlapping a sub-pixel 300 among a plurality of view areas according to an exemplary embodiment.
- an existing display device includes a 10th view area 310, a first view area 320, a second view area 330, and a third view overlapping the sub-pixel 300 among 10 view areas.
- Region 340 can be identified.
- the tenth view area 310, the first view area 320, the second view area 330, and the third view area 340 are the tenth view (or tenth image), the first view (or first image), a second view (or second image), and a third view (or third image).
- an existing display device may determine a dominant view area and a sub view area from among at least one view area overlapping the subpixel 300 . For example, in an existing display device, subpixels among the tenth view area 310, the first view area 320, the second view area 330, and the third view area 340 overlap with the subpixel 300. The second view area 330 having the largest overlapping area with 300 may be determined as the dominant view area. Also, the existing display device may determine the first view area 320 as a sub view area based on the distance from the center of the sub pixel 300 . However, this is only an example, and an existing display device may not determine a sub-view area or may determine two or more view areas as a sub-view area.
- the conventional display device determines the degree of reflection of each data value corresponding to the sub-pixel 300 in the image corresponding to the dominant view area and the sub-view area, and outputs the adjusted data value according to the determined degree of reflection.
- An output value of the sub-pixel 300 may be determined using this.
- a data value corresponding to the subpixel 300 may mean a data value at the first position in the image.
- the existing display device adjusts each of the data value of the first position in the second image and the data value of the first position in the first image according to the determined degree of reflection using the relational expression (2) below, An output value of the pixel 300 may be determined.
- the degree of reflection of data values in each image may have the same value or may be determined in inverse proportion to the distance from the center of the subpixel 300, but is not limited thereto.
- Output means the output value of the sub-pixel 300, Means a data value of a first position in the image corresponding to the dominant view area, denotes a data value of a first position in the image corresponding to the sub-view area.
- Is and each level of reflection when the existing display device does not determine the sub-view area or determines two or more view areas as the sub-view area, relational expression (2) may be changed.
- an existing display device maps data values of images corresponding to each of the dominant view area and the sub view area to the output value of the subpixel 300
- the existing display device displays an image representing a smooth change at the boundary of the view area.
- gear-shaped artifacts occur at a boundary in a specific direction or stripe-shaped artifacts occur in a direction perpendicular to the lens grain in a homogeneous region.
- 3B illustrates a process of determining an output value of a sub-pixel in a stereo-view mode by an existing display device according to an embodiment of the present disclosure.
- the number of views in the stereo-view mode may be two.
- the existing display device may determine a dominant view area and a sub view area from among at least one view area overlapping the subpixel for each subpixel. For example, the existing display device determines a first view area overlapping the center of the subpixel 350 among the first view area and the second view area overlapping the subpixel 350 at the first position as the dominant view area. and determine the second view area as the sub view area. Alternatively, the existing display device determines a second view area overlapping the center of the subpixel 360 among the first view area and the second view area overlapping the subpixel 360 at the second position as the dominant view area, The first view area may be determined as a sub view area.
- an existing display device may determine an output value of a subpixel by adjusting each data value in an image corresponding to a dominant view area and a subview area according to a degree of reflection. For example, the existing display device may determine the output value of the sub-pixel 350 by adjusting each data value of the first position in the first image and the second image according to the degree of reflection. Alternatively, the existing display device may determine the output value of the sub-pixel 360 by adjusting each data value of the second position in the first image and the second image according to the degree of reflection.
- 3C illustrates a process of determining an output value of a sub-pixel in a multi-view mode by an existing display device according to an embodiment of the present disclosure.
- the number of views in the multi-view mode may be plural.
- the existing display device may determine a dominant view area and a sub view area from among at least one view area overlapping the subpixel for each subpixel. For example, the existing display device determines a sixth view area overlapping the center of the subpixel 370 among the sixth and seventh view areas overlapping the subpixel 370 at the third position as the dominant view area. And the seventh view area may be determined as the sub view area.
- the 15th view area overlapping the center of the subpixel 380 among the 14th view area, the 15th view area, and the 16th view area overlapping the subpixel 380 in the fourth position is the dominant view. area can be determined.
- the existing display device may not determine the sub-view area based on the overlapping area between the sub-pixel 380 and the 14th and 16th view areas.
- an existing display device may determine an output value of a subpixel by adjusting each data value in an image corresponding to a dominant view area and a subview area according to a degree of reflection. For example, the existing display device may determine the output value of the sub-pixel 370 by adjusting each data value of the third position in the sixth image and the seventh image according to the degree of reflection. Alternatively, the existing display device may determine the data value of the fourth position in the 15th image as the output value of the subpixel 380 .
- 4A to 4C are diagrams for explaining a process in which the electronic device 100 determines an output value of a sub-pixel according to an embodiment of the present disclosure.
- the electronic device 100 may identify at least one view area overlapping a sub-pixel 400 from among a plurality of view areas according to an embodiment.
- the electronic device 100 includes a tenth view area 410 overlapping the subpixel 400, a first view area 420, a second view area 430, and a second view area 430 among ten view areas.
- 3 view areas 440 can be identified.
- the tenth view area 410, the first view area 420, the second view area 430, and the third view area 440 are the tenth view (or tenth image), the first view (or first image), a second view (or second image), and a third view (or third image).
- the electronic device 100 may identify a data value corresponding to a sub-pixel for each of at least one image corresponding to at least one view area.
- a data value corresponding to the subpixel 400 may mean a data value at the first position in the image.
- the electronic device 100 identifies the data value of the first position for each of the tenth view area 410, the first view area 420, the second view area 430, and the third view area 440. can do. That is, the electronic device 100 includes the data value of the first position in the tenth image, the data value of the first position in the first image, the data value of the first position in the second image, and the data of the first position in the third image. Each value can be identified.
- the electronic device 100 determines the degree of reflection of data values corresponding to the subpixels 400 for each image, based on the degree of overlap between the subpixels 400 and at least one view area. can decide In this case, the degree of reflection of the data value may mean a weight applied to each data value. For example, in the electronic device 100, the subpixel 400 overlaps the tenth view area 410, the first view area 420, the second view area 430, and the third view area 440. Based on the degree, the reflection degree of the data value of the first position may be determined for each of the tenth image, the first image, the second image, and the third image.
- the electronic device 100 may determine an overlapping degree between the subpixel 400 and at least one view area based on an area where the subpixel 400 and at least one view area overlap. .
- the subpixel 400 overlaps each of the tenth view area 410, the first view area 420, the second view area 430, and the third view area 440. Based on the area of the sub-pixel 400 and the tenth view area 410, the first view area 420, the second view area 430, and the third view area 440 overlapping degree can be determined. have. This will be described later with reference to FIGS. 5A to 5C .
- the electronic device 100 determines the degree of overlap between the subpixel 400 and the at least one view area based on the overlap length between the center line of the subpixel 400 and the at least one view area. can decide For example, in the electronic device 100, the sub-pixel 400 and the tenth view area 410, the first view area 420, the second view area 430, and the third view area 440 are respectively centered.
- the degree to which the sub-pixel 400 overlaps the tenth view area 410, the first view area 420, the second view area 430, and the third view area 440 based on the overlapping length of the lines. can decide This will be described later with reference to FIGS. 6A to 6C.
- the electronic device 100 includes the subpixel 400, the tenth view area 410, and the first view area based on a distance from at least one view area to the center of the subpixel 400. 420 , the degree to which the second view area 430 and the third view area 440 overlap may be determined.
- the electronic device 100 includes the sub-pixel 400 and the tenth view area 410, the first view area 420, the second view area 430, and the third view area 440, respectively.
- the degree of overlap can be determined. This will be described later with reference to FIGS. 7A to 7C .
- the electronic device 100 may determine an output value of the sub-pixel 400 using a data value adjusted according to the degree of reflection determined for each image. For example, the electronic device 100 adjusts each of the data values of the first position in the tenth image, the first image, the second image, and the third image according to the determined degree of reflection using relational expression (3) below. By doing so, the output value of the sub-pixel 400 can be determined.
- Output means the output value of the sub-pixel 400, Means the data value of the first position in the image corresponding to each view area, silver each level of reflection.
- the electronic device 100 determines the output value of the subpixel 400 in consideration of all view areas overlapping with the subpixel 400, thereby effectively reducing and outputting artifacts.
- the technical effect of improving the image quality can be obtained.
- the pixel per inch (PPI) decreases, or the slant angle of the lenticular lens decreases, as more view areas are overlapped with sub-pixels, these technical effects can be increased. This will be described later with reference to FIGS. 9A to 11B .
- the electronic device 100 may determine the weight of at least one view area overlapping the sub-pixel 400 except for some view areas based on a predetermined rule, according to an embodiment. For example, the electronic device 100 may determine the weight except for a view area in which the overlapping area is equal to or less than a predetermined value among at least one view area overlapping the subpixel 400 . This will be described later with reference to FIGS. 8A to 8C .
- the 4B illustrates a process in which the electronic device 100 determines an output value of a sub-pixel in a stereo-view mode according to an embodiment of the present disclosure.
- the number of views in the stereo-view mode may be two.
- the electronic device 100 may identify at least one view area overlapping the sub-pixel for each sub-pixel. For example, the electronic device 100 may identify a first view area and a second view area overlapping the subpixel 450 at the first location. Alternatively, the electronic device 100 may identify the first view area and the second view area overlapping the subpixel 460 at the second location.
- the electronic device 100 may identify a data value corresponding to a sub-pixel for each of at least one image corresponding to at least one view area. For example, the electronic device 100 may identify the data value of the first position for each of the first image and the second image. Alternatively, the electronic device 100 may identify the data value of the second position for each of the first image and the second image.
- the electronic device 100 may determine the degree of reflection of data values corresponding to sub-pixels for each of at least one image, based on the degree to which each sub-pixel overlaps with at least one view area. For example, the electronic device 100 determines the degree of reflection of the data value of the first position in the first image based on the overlapping degree of the subpixel 450 with the first view area and the second view area, respectively. 2 It is possible to determine the degree of reflection of the data value of the first position in the image. Alternatively, the electronic device 100 determines the degree of reflection of the data value of the second position in the first image and the second image based on the overlapping degree of the subpixel 460 with the first view area and the second view area, respectively. The reflection degree of the data value of my second position may be determined.
- the electronic device 100 may determine an output value of a subpixel by adjusting each data value according to the degree of reflection determined for each image. For example, the electronic device 100 may determine the output value of the sub-pixel 450 by adjusting each data value of the first position for each of the first image and the second image according to the determined degree of reflection. Alternatively, the electronic device 100 may determine the output value of the sub-pixel 460 by adjusting each data value of the second position for each of the first image and the second image according to the determined degree of reflection.
- 4C illustrates a process in which the electronic device 100 determines an output value of a sub-pixel in a multi-view mode according to an embodiment of the present disclosure.
- the number of views in the multi-view mode may be plural.
- the electronic device 100 may identify at least one view area overlapping the sub-pixel for each sub-pixel. For example, the electronic device 100 may identify a sixth view area and a seventh view area overlapping the subpixel 470 at the third location. Alternatively, the electronic device 100 may identify the fourteenth view area, the fifteenth view area, and the sixteenth view area overlapping the subpixel 480 at the fourth position.
- the electronic device 100 may identify a data value corresponding to a sub-pixel for each of at least one image corresponding to at least one view area. For example, the electronic device 100 may identify the data value of the third position for each of the sixth image and the seventh image. Alternatively, the electronic device 100 may identify the data value of the fourth position for each of the 14th, 15th, and 16th images.
- the electronic device 100 may determine the reflection degree of data values corresponding to sub-pixels for each of at least one image, based on the degree to which each sub-pixel overlaps with at least one view area. For example, the electronic device 100 determines the degree of reflection of the data value of the third position in the sixth image based on the overlapping degree of the subpixel 470 with the sixth and seventh view regions, respectively. 7 It is possible to determine the degree of reflection of the data value of the third position in the image. Alternatively, the electronic device 100 determines the sub-pixel 480 for each of the 14th, 15th, and 16th images based on the degree of overlap with each of the 14th, 15th, and 16th view regions. The degree of reflection of data values at 4 positions can be determined.
- the electronic device 100 may determine an output value of a subpixel by adjusting each data value according to the degree of reflection determined for each image. For example, the electronic device 100 may determine the output value of the sub-pixel 470 by adjusting each data value of the third position for the sixth image and the seventh image according to the determined degree of reflection. Alternatively, the electronic device 100 may determine the output value of the sub-pixel 480 by adjusting each of the data values of the fourth position for each of the 14th, 15th, and 16th images according to the determined degree of reflection.
- 5A and 5B are diagrams for explaining a process in which the electronic device 100 determines an output value of a subpixel according to an embodiment of the present disclosure.
- the electronic device 100 may identify at least one view area overlapping the subpixel 500 at the first position among a plurality of view areas according to an embodiment.
- the electronic device 100 includes a 10th view area 510, a first view area 520, a second view area 530, and a 10th view area 510 overlapping the sub-pixel 500 among 10 view areas.
- a third view area 540 and a fourth view area 550 may be identified.
- the tenth view area 510, the first view area 520, the second view area 530, the third view area 540, and the fourth view area 550 each have a tenth view (or tenth view area).
- image a first view (or first image), a second view (or second image), a third view (or third image), and a virtual region corresponding to a fourth view (or fourth image). can do.
- the electronic device 100 may identify a data value corresponding to the sub-pixel 500 for each of at least one image corresponding to at least one view area. For example, the electronic device 100 may identify the data value of the first position for each of the tenth image, the first image, the second image, the third image, and the fourth image.
- the electronic device 100 determines the degree of reflection of data values corresponding to the subpixels 500 for each image, based on the degree of overlap between the subpixels 500 and at least one view area. can decide In this case, the electronic device 100 may determine an overlapping degree between the subpixel 500 and at least one view area based on an area where the subpixel 500 and at least one view area overlap.
- the electronic device 100 identifies an area where each subpixel 500 and at least one view area overlap, and based on the identified area, data of a first position in at least one image The degree of reflection of the value can be determined.
- a second column 560 of FIG. 5B represents an overlapping area between each view area and the sub-pixel 500, and a third column 570 represents the degree of reflection of data values at a first position in each image.
- the electronic device 100 may identify an overlapping area between the sub-pixel 500 and each of the at least one view area, assuming that each view area has a parallelogram shape having the same horizontal length. have.
- the electronic device 100 includes the sub-pixel 500, the tenth view area 510, the first view area 520, and the second view area by using the following relational expressions (4) to (9). Areas in which each of the area 530 , the third view area 540 and the fourth view area 550 overlap may be identified.
- the upper coordinate value and the lower coordinate value of the subpixel 500 are the inclination angles. It can be set to have a difference according to. in other words, The coordinate values of the upper end and the lower end of the sub-pixel 500 where the straight line having a slope of 500 intersect may have the same value. Accordingly, the four corners of the subpixel 500 may have coordinate values of (5.74, 3.25), (8.63, 3.25), (6.94, 8.46), and (9.83, 8.46), respectively.
- the coordinate axis value of the subpixel 500 is only an example and may vary according to the coordinate axis setting method, unit, etc., and accordingly , , , and Values may also vary.
- the electronic device 100 may determine the degree of reflection of the data value of the first position for each of the at least one image based on the overlapping area of the subpixel 500 and each of the at least one view region.
- the electronic device 100 includes a subpixel 500, a tenth view area 510, a first view area 520, a second view area 530, a third view area 540, and a fourth view area.
- the tenth, first, second, third, and fourth images are divided.
- a degree of reflection of the data value of the first position may be determined.
- the degree of overlap between the subpixel 500 and the view area may increase, and accordingly, the degree of reflection of data values in the image may increase.
- the electronic device 100 may determine the output value of the sub-pixel 500 by adjusting each data value of at least one image according to the determined degree of reflection. For example, the electronic device 100 determines the degree of reflection of each of the data values of the first position in the tenth image, the first image, the second image, the third image, and the fourth image as shown in relational expression (10) below.
- An output value of the subpixel 500 may be determined by adjusting according to .
- Output means the output value of the sub-pixel 500, Means a data value of a first position in an image corresponding to each view area.
- 6A to 6C are diagrams for explaining a process in which the electronic device 100 determines an output value of a subpixel according to an embodiment of the present disclosure. Operations overlapping those of FIGS. 5A and 5B will be briefly described or omitted.
- the electronic device 100 may identify at least one view area overlapping the subpixel 600 at the first position among a plurality of view areas according to an embodiment.
- the electronic device 100 includes a 10th view area 610, a first view area 620, a second view area 630, and a 10th view area 610 overlapping the sub-pixel 600 among 10 view areas.
- a third view area 640 and a fourth view area 650 may be identified.
- the tenth view area 610, the first view area 620, the second view area 630, the third view area 640, and the fourth view area 650 each have a tenth view (or tenth view area).
- image a first view (or first image), a second view (or second image), a third view (or third image), and a virtual region corresponding to a fourth view (or fourth image). can do.
- the electronic device 100 may identify a data value corresponding to the sub-pixel 600 for each of at least one image corresponding to at least one view area. For example, the electronic device 100 may identify the data value of the first position for each of the tenth image, the first image, the second image, the third image, and the fourth image.
- the electronic device 100 determines the degree of reflection of data values corresponding to the subpixels 600 for each image, based on the degree of overlap between the subpixels 600 and at least one view area. can decide In this case, the electronic device 100 may determine the degree to which the subpixel 600 and at least one view area overlap based on the overlapping length of the center line of the subpixel 600 and the at least one view area.
- the electronic device 100 may identify a coordinate value of a center line of each of the at least one view area, assuming that each view area has a parallelogram shape having the same horizontal length. For example, the electronic device 100 sets 6.5, which is the coordinate value of a point where a diagonal line connecting the lower left corner and upper right corner of the subpixel 600 and the center line 625 of the first view area meet, to the center line of the first view area. It can be identified by the coordinate value of (625). In the same way, the electronic device 100 sets the coordinate values of the center line 635 of the second view area, the center line 645 of the third view area, and the center line 655 of the fourth view area to 7.5 and 8.5, respectively. and 9.5.
- the center line 610 of the tenth view area is located outside the sub-pixel 600 but may have a coordinate value of 5.5.
- the electronic device 100 may determine the degree of reflection of data values in proportion to the overlapping length between the sub-pixel 600 and the center line of each view area. For example, when the length of the center line of the view area overlapping the sub-pixel 600 is maximum, the electronic device 100 may map the reflection degree 1 value to the corresponding view area. That is, a value of reflection degree 1 may be mapped to a view area in which the coordinate value of the center line is between 6.94 and 8.63. Also, when the center line of the view area does not overlap the sub-pixel 600, the electronic device 100 may map a reflection degree value of 0 to the corresponding view area.
- a reflection degree value of 0 may be mapped to a view area in which the coordinate value of the center line has a value of 5.74 or less or 9.83 or more. Accordingly, even in a view area in which an area overlapping with the sub-pixel 600 exists, when the center line does not overlap with the sub-pixel 600, a reflection degree value of 0 may be mapped.
- the electronic device 100 may map a reflection degree proportional to the overlapping length to the corresponding view area. That is, a reflection degree proportional to the length of the overlapping center line may be mapped to a view area in which the coordinate value of the center line has a value between 5.74 and 6.94 or between 8.63 and 9.83.
- the electronic device 100 may determine the degree of reflection of data values for each image based on the coordinate value of the center line of each view area according to an embodiment.
- a second column 660 of FIG. 6C represents the coordinate values of the center line of each view area
- a third column 670 represents the degree of reflection of the data value of the first position in each image
- a fourth column 680 represents a value obtained by normalizing the degree of reflection of the third column 670 .
- the electronic device 100 may map a reflection degree to each view area based on a coordinate value of a center line of each view area. For example, the electronic device 100 may map the reflection degree 1 value to the second view area 630 and the third view area 640 having coordinate values of the center line between 6.94 and 8.63. Also, the electronic device 100 may map a reflection degree value of 0 to the tenth view area 610 having a center line coordinate value of 5.74 or less. In the electronic device 100, the coordinate value of the center line is proportional to the length of the overlapping center line in the first view area 620 and the fourth view area 650 having a value between 5.74 and 6.94 or between 8.63 and 9.83. The degree of reflection can be mapped.
- a reflection degree value of 0.7652 may be mapped to the first view area 620
- a reflection degree value of 0.3472 may be mapped to the fourth view area 650 .
- the electronic device 100 may normalize the reflection degrees so that the sum of the values of the determined reflection degrees becomes 1.
- the electronic device 100 may determine the output value of the sub-pixel 600 by adjusting each data value of at least one image according to the normalized reflection degree. For example, the electronic device 100 adjusts each of the data values of the first position in the first image, the second image, the third image, and the fourth image according to the normalized reflection degree, as shown in relational expression (11) below. Thus, an output value of the subpixel 600 may be determined.
- Output means the output value of the sub-pixel 600, , , and Means a data value of a first position in an image corresponding to each view area.
- the electronic device 100 determines the degree of reflection of data values based on the length of the center line overlapping the sub-pixel 600, thereby determining the area of the view area overlapping the sub-pixel 600.
- the amount of computation required to calculate can be reduced.
- FIGS. 6A to 6C are views for explaining a process in which the electronic device 100 determines an output value of a sub-pixel according to an embodiment of the present disclosure. Operations overlapping with those of FIGS. 6A to 6C will be briefly described or omitted.
- the electronic device 100 may identify at least one view area overlapping a sub-pixel 700 at a first position among a plurality of view areas according to an embodiment.
- the electronic device 100 includes a 10th view area 710, a first view area 720, a second view area 730, and a 10th view area 710 overlapping the sub-pixel 700 among 10 view areas.
- a third view area 740 and a fourth view area 750 may be identified.
- the tenth view area 710, the first view area 720, the second view area 730, the third view area 740, and the fourth view area 750 each have a tenth view (or tenth view area).
- image a first view (or first image), a second view (or second image), a third view (or third image), and a virtual region corresponding to a fourth view (or fourth image). can do.
- the electronic device 100 may identify a data value corresponding to the sub-pixel 700 for each of at least one image corresponding to at least one view area. For example, the electronic device 100 may identify the data value of the first position for each of the tenth image, the first image, the second image, the third image, and the fourth image.
- the electronic device 100 determines the degree of reflection of data values corresponding to the sub-pixels 700 for each image, based on the degree of overlap between the sub-pixels 700 and at least one view area. can decide In this case, the electronic device 100 may determine the degree to which the subpixel 700 overlaps with the at least one view area based on the distance from the center line of the at least one view area to the center of the subpixel 700 . .
- the electronic device 100 may identify a coordinate value of the center of a subpixel 700 according to an embodiment. For example, the electronic device 100 identifies 7.785, which is an intermediate value between the coordinate value (5.74) of the lower left corner and the coordinate value (9.83) of the upper right corner of the subpixel 700, as the coordinate value of the center of the subpixel 700. can do. Alternatively, the electronic device 100 may identify 7.785, which is an intermediate value between the upper left coordinate value (6.94) and the lower right coordinate value (8.63) of the subpixel 700, as the coordinate value of the center of the subpixel 700. have. However, this is only an example, and the electronic device 100 may identify the coordinate value of the center of the sub-pixel 700 in a different way.
- the electronic device 100 may identify a distance from the center line of each of the at least one view area to the center of the sub-pixel 700 .
- the electronic device 100 sets 1.285, which is a difference between the coordinate value (6.5) of the center line 725 of the first view area and the coordinate value (7.785) of the center of the sub-pixel 700, to the first view area. It can be identified as the distance from the center line 725 to the center of the sub-pixel 700 .
- the electronic device 100 determines the center line of the subpixel 700 from the center line 735 of the second view area, the center line 745 of the third view area, and the center line 755 of the fourth view area.
- the distances to can be identified as 0.285, 0.715, and 1.715, respectively.
- the electronic device 100 may determine the degree of reflection of data values for each image based on the distance from the center line of each view area to the center of the subpixel 700 according to an embodiment.
- a second column 760 of FIG. 7C represents coordinate values of the center line of each view area
- a third column 770 represents the distance from the center line of each view area to the center of the subpixel 700 .
- a fourth column 780 of FIG. 7C represents the degree of reflection of data values at the first position in each image
- a fifth column 790 represents a normalized value of the degree of reflection of the fourth column 780 .
- the electronic device 100 may map a reciprocal number of a distance from the center line of each view area to the center of the sub-pixel 700 to a degree of reflection of data values in each image. For example, the electronic device 100 may determine 0.77821, which is a reciprocal number of 1.285, which is the distance from the center line 725 of the first view area to the center of the subpixel 700, to the degree of reflection of data values in the first image. . In the same way, the electronic device 100 may determine the degree of reflection of each of the data values in the second image, the third image, and the fourth image as 3.50877, 1.3986, and 0.58309. However, this is only one embodiment, and the method for determining the degree of reflection of the data value based on the distance from the view area to the center of the sub-pixel 700 is not limited to the above-described embodiment.
- the electronic device 100 may normalize the reflection degrees so that the sum of the values of the determined reflection degrees becomes 1.
- the electronic device 100 may determine the output value of the sub-pixel 700 by adjusting each data value of at least one image according to the normalized reflection degree. For example, the electronic device 100 adjusts each of the data values of the first position in the first image, the second image, the third image, and the fourth image according to the normalized reflection degree, as shown in relational expression (12) below.
- relational expression (12) shown in relational expression (12) below.
- Output means the output value of the sub-pixel 700, , , and Means a data value of a first position in an image corresponding to each view area.
- 8A to 8C illustrate a process in which the electronic device 100 determines an output value of a sub-pixel except for a view area in which an overlapping area or ratio with a sub-pixel is equal to or less than a predetermined value, according to an embodiment of the present disclosure. It is a drawing for Operations overlapping with those of FIGS. 5A to 5C will be briefly described or omitted.
- the electronic device 100 may identify at least one view area overlapping a subpixel 800 at a first position among a plurality of view areas according to an embodiment.
- the electronic device 100 includes a 10th view area 810, a first view area 820, a second view area 830, and a 10th view area 810 overlapping the sub-pixel 800 among 10 view areas.
- a third view area 840 and a fourth view area 850 may be identified.
- the tenth view area 810, the first view area 820, the second view area 830, the third view area 840, and the fourth view area 850 each have a tenth view (or tenth view area).
- image a first view (or first image), a second view (or second image), a third view (or third image), and a virtual region corresponding to a fourth view (or fourth image). can do.
- the electronic device 100 may identify a data value corresponding to the sub-pixel 800 for each of at least one image corresponding to at least one view area. For example, the electronic device 100 may identify the data value of the first position for each of the tenth image, the first image, the second image, the third image, and the fourth image.
- the electronic device 100 determines the degree of reflection of data values corresponding to the subpixels 800 for each image, based on the degree of overlap between the subpixels 800 and at least one view area. can decide In this case, the electronic device 100 may determine an overlapping degree between the subpixel 800 and at least one view area based on an area where the subpixel 800 and at least one view area overlap.
- the electronic device 100 may determine the reflection degree of data values excluding some view areas among at least one view area overlapping the sub-pixel 800 based on a predetermined rule. For example, the electronic device 100 may determine the degree of reflection of data values except for a view area in which an area overlapping the sub-pixel 800 is equal to or less than a predetermined value. Alternatively, the electronic device 100 may determine the degree of reflection of data values except for a view area in which a value generated by dividing the area overlapping the subpixel 800 by the area of the subpixel 800 is equal to or less than a predetermined value.
- the predetermined rule is not limited to the above.
- the electronic device 100 may determine the reflection degree of data values only for a view area in which an area overlapping a subpixel 800 is greater than or equal to a predetermined value.
- a second column 860 of FIG. 8B represents an overlapping area between each view region and the sub-pixel 800
- a third column 865 represents an overlapping area equal to or greater than a predetermined value
- a fourth column 870 represents the degree of reflection of the data value of the first position in each image.
- the electronic device 100 may exclude a view area in which an area overlapping the subpixel 800 is less than a predetermined value.
- a predetermined value For example, when the predetermined value is 1, the electronic device 100 may exclude the tenth view area 810 having an overlapping area of 0.146748 with the subpixel 800 .
- the predetermined value is only an example, and may be predefined differently or changed based on user input.
- the electronic device 100 may determine the output value of the sub-pixel 800 by adjusting each data value of at least one image according to the determined degree of reflection. For example, the electronic device 100 adjusts each of the data values of the first position in the first image, the second image, the third image, and the fourth image according to the determined degree of reflection, as shown in relational expression (13) below. , an output value of the sub-pixel 800 may be determined.
- Output means the output value of the sub-pixel 800, , , and Means a data value of a first position in an image corresponding to each view area.
- the electronic device 100 divides the area overlapping the subpixel 800 by the area of the subpixel, and the reflection degree of the data value only for a view area in which a value generated by dividing the area is equal to or greater than a predetermined value. can decide
- a second column 880 of FIG. 8C represents the overlapping area between each view region and the subpixel 800
- a third column 885 represents the overlapping area between each view region and the subpixel 800. It represents a value generated by dividing by the area of the pixel 800 or an area ratio.
- a fourth column 890 of FIG. 8C represents an area ratio equal to or greater than a predetermined value
- a fifth column 895 represents the degree of reflection of the data value of the first position in each image.
- the electronic device 100 may exclude a value generated by dividing the area overlapping the subpixel 800 by the area of the subpixel 800 or a view area in which the area ratio is equal to or less than a predetermined value.
- a predetermined value is 0.1
- the electronic device 100 excludes the tenth view area 810 having an area ratio of 0.009746 overlapping the subpixel 800 and the fourth view area 850 having an overlapping area ratio of 0.099322. can do.
- the predetermined value is only an example, and may be predefined differently or changed based on user input.
- the electronic device 100 may determine the output value of the sub-pixel 800 by adjusting each data value of at least one image according to the determined degree of reflection. For example, the electronic device 100 adjusts each of the data values of the first position in the first image, the second image, and the third image according to the determined degree of reflection, as shown in relational expression (14) below, so that the subpixel ( 800) can determine the output value.
- Output means the output value of the sub-pixel 800, , and Means a data value of a first position in an image corresponding to each view area.
- the electronic device 100 may determine the degree of reflection of data values only for a view area in which the length of the center line overlapping the sub-pixel 800 is greater than or equal to a predetermined value (not shown). For example, the electronic device 100 excludes view areas in which the length of the center line overlapping the sub-pixel 800 is less than 1, and the electronic device 100 has a data value only for view areas in which the length of the center line overlapping the sub-pixel 800 is 1 or more. degree of reflection can be determined.
- the predetermined value is only an example, and may be predefined differently or changed based on user input.
- 9A to 9C are diagrams for explaining a process of identifying, by the electronic device 100, at least one view region overlapping with a sub-pixel based on the number of views, according to an embodiment of the present disclosure.
- the electronic device 100 may determine a plurality of view regions corresponding to a plurality of views based on the number of views. For example, the electronic device 100 may equally divide one pitch of the lenticular lens by the number of views in a parallelogram shape having the same horizontal length. The electronic device 100 may map a plurality of view areas to each of the equally divided lenticular lens areas so as to correspond to the order of the plurality of views.
- the electronic device 100 divides one pitch of the lenticular lens into 5 parts and divides the plurality of view areas into 5 parts of the lenticular lens according to an embodiment. Each can be mapped to.
- the electronic device 100 may identify a first view area 910 overlapping the sub-pixel 900 from among a plurality of view areas. In this case, the first view area 910 may mean a virtual area corresponding to the first view.
- the electronic device 100 divides one pitch of the lenticular lens into 10 equal parts and divides the plurality of view areas into 10 equal parts of the lenticular lens according to an embodiment. Each can be mapped to.
- the electronic device 100 may identify a second view area 920 and a third view area 930 overlapping the subpixel 900 from among a plurality of view areas.
- the second view area 920 and the third view area 930 may mean virtual areas corresponding to the second view and the third view, respectively.
- the electronic device 100 divides one pitch of the lenticular lens into 20 equal parts and divides the plurality of view areas into 20 equal parts of the lenticular lens according to an embodiment. Each can be mapped to.
- the electronic device 100 may identify a fourth view area 940 , a fifth view area 950 , and a sixth view area 960 overlapping the subpixel 900 among a plurality of view areas.
- the fourth view area 940 , the fifth view area 950 , and the sixth view area 960 may mean virtual areas corresponding to the fourth view, the fifth view, and the sixth view, respectively.
- the electronic device 100 can increase a technical effect of reducing artifacts by considering all overlapping view areas.
- PPI pixel per inch
- the electronic device 100 may identify a first view area 1010 and a second view area 1020 overlapping the subpixel 1000 among a plurality of view areas.
- the first view area 1010 and the second view area 1020 may mean virtual areas corresponding to the first view and the second view, respectively.
- the electronic device 100 includes a third view area 1030, a first view area 1040, a second view area 1050, and a sub-pixel 1070 overlapping among a plurality of view areas.
- a fourth view area 1060 can be identified.
- the third view area 1030, the first view area 1040, the second view area 1050, and the fourth view area 1060 are the third view, the first view, the second view, and the fourth view, respectively. It may mean a virtual area corresponding to .
- the number of view regions overlapping the sub-pixel 1000 may increase.
- the electronic device 100 may increase a technical effect of reducing artifacts by considering all overlapping view areas.
- 11A and 11B are diagrams for explaining a process of identifying, by the electronic device 100, at least one view area overlapping a sub-pixel based on a slant angle of a lenticular lens, according to an embodiment of the present disclosure; to be.
- the electronic device 100 may identify a first view area 1110 and a second view area 1120 overlapping the subpixel 1100 among a plurality of view areas.
- the first view area 1110 and the second view area 1120 may mean virtual areas corresponding to the first view and the second view, respectively.
- the electronic device 100 includes a third view area 1140, a fourth view area 1150, and a first view area 1160 overlapping the sub-pixel 1100 among a plurality of view areas. can be identified.
- the third view area 1140, the fourth view area 1150, and the first view area 1160 may mean virtual areas corresponding to the third view, the fourth view, and the first view, respectively.
- the number of view regions overlapping the sub-pixel 1100 may increase.
- the electronic device 100 can increase the technical effect of reducing artifacts by considering all overlapping view areas.
- the inclination angle shown in FIGS. 11A and 11B and As an example, the inclination angle of the lenticular lens may be expressed in a different way. (For example, the inclination angle of a lenticular lens is or In this case, the inclination angle of the lenticular lens and the number of view regions overlapping the sub-pixel 1100 may have a tendency opposite to that described above.
- FIG. 12 is a flowchart illustrating a process of outputting an image by an electronic device according to an embodiment of the present disclosure.
- step S1210 the electronic device may acquire a plurality of images corresponding to a plurality of views.
- the electronic device may identify at least one view region overlapping a sub-pixel from among view regions determined to correspond to a plurality of views. According to an embodiment, the electronic device may determine a plurality of view regions corresponding to the plurality of views, based on the number of views and the characteristics of the viewing area separator.
- the number of at least one view area overlapping with the sub-pixel may increase as the PPI of the display decreases.
- the number of at least one view area overlapping the sub-pixel may increase as the number of views increases.
- the number of at least one view area overlapping with the sub-pixel may increase as the inclination angle of the lenticular lens decreases.
- the electronic device may identify a data value corresponding to a sub-pixel for each of at least one image corresponding to at least one view area.
- a data value corresponding to the subpixel may mean a data value at a first position in the image.
- step S1240 the electronic device determines the degree of reflection of data values for each of at least one image based on the degree of overlap between the sub-pixels and at least one view region, and uses the data values adjusted according to the determined degree of reflection to determine the degree of reflection of the data values for each image.
- the output value of the pixel can be determined.
- the greater the degree of overlap between the sub-pixel and the at least one view region the greater the degree of reflection of data values.
- the electronic device may determine an overlapping degree between a subpixel and at least one view area based on an area where the subpixel and at least one view area overlap. In this case, the larger the area where the subpixel overlaps with the at least one view area, the greater the degree of overlap between the subpixel and the at least one view area.
- the electronic device may determine the degree of overlap between the subpixel and the at least one view area based on the length of the overlap between the center line of the subpixel and the at least one view area. In this case, the longer the overlapping length of the center line between the subpixel and the at least one view area, the greater the degree of overlap between the subpixel and the at least one view area.
- the electronic device may determine an overlapping degree between the subpixel and the at least one view area based on a distance from the at least one view area to the center of the subpixel. In this case, the shorter the distance from the at least one view area to the center of the subpixel, the greater the degree of overlap between the subpixel and the at least one view area.
- the electronic device may determine the reflection degree of data values except for some view areas among at least one view area overlapping the sub-pixel based on a predetermined rule. For example, the electronic device may determine the degree of reflection of data values only for a view area in which an area overlapping a subpixel is greater than or equal to a predetermined value. Alternatively, the electronic device may determine the reflection degree of the data value only for a view area in which a value generated by dividing an area overlapping a subpixel by an area of the subpixel is greater than or equal to a predetermined value. The electronic device may determine the degree of reflection of data values only for a view area in which the length of a center line overlapping a subpixel is greater than or equal to a predetermined value.
- the electronic device may output an image using output values determined for each of a plurality of sub-pixels including sub-pixels.
- the output image may mean a multi-view image.
- FIG. 13 is a block diagram of an electronic device 100 according to an embodiment of the present disclosure.
- the electronic device 100 may include a processor 1320, a memory 1340, and a viewing area separator 1360.
- the processor 1320 may correspond to the processor 120 of FIG. 1
- the memory 1340 may correspond to the memory 130 of FIG. 1 .
- the viewing area separator 1360 may be included in the display 110 of FIG. 1 and may include a lenticular lens or a parallax barrier.
- the configuration of the electronic device 100 is not limited to the above, and may include more or less configurations.
- the processor 1320 acquires a plurality of images corresponding to a plurality of views by executing at least one instruction stored in the memory 1340, and determines the view region corresponding to the plurality of views. ), at least one view region overlapping with the sub-pixel may be identified. Also, the processor 1320 may execute at least one instruction stored in the memory 1340 to identify a data value corresponding to a subpixel for each of at least one image corresponding to at least one view area.
- the processor 1320 executes at least one instruction stored in the memory 1340 to determine the degree of reflection of data values for each of the at least one image based on the overlapping degree between the sub-pixel and the at least one view region, and An output value of a subpixel may be determined using a data value adjusted according to a degree of reflection.
- the processor 1320 may execute at least one instruction stored in the memory 1340 to output an image by using an output value determined for each subpixel including the subpixel.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
Description
Claims (15)
- 복수의 뷰들에 대응하는 복수의 영상들을 획득하는 단계;상기 복수의 뷰들에 대응하는 복수의 뷰 영역(view region)들 중에서, 서브 픽셀과 중첩되는 적어도 하나의 뷰 영역을 식별하는 단계;상기 적어도 하나의 뷰 영역에 대응하는 적어도 하나의 영상 별로 상기 서브 픽셀에 대응하는 데이터 값을 식별하는 단계;상기 서브 픽셀과 상기 적어도 하나의 뷰 영역이 중첩되는 정도에 기초하여, 상기 적어도 하나의 영상 별로 상기 데이터 값의 반영 정도를 결정하고, 상기 결정된 반영 정도에 따라 조절된 데이터 값에 기초하여 상기 서브 픽셀의 출력 값을 결정하는 단계; 및상기 서브 픽셀을 포함하는 다수의 서브 픽셀 별로 결정된 출력 값에 기초하여 영상을 출력하는 단계를 포함하는, 방법.
- 제1 항에 있어서, 상기 서브 픽셀과 상기 적어도 하나의 뷰 영역이 중첩되는 정도가 클수록, 상기 데이터 값의 반영 정도가 커지는 것을 특징으로 하는, 방법.
- 제1 항에 있어서, 상기 서브 픽셀과 상기 적어도 하나의 뷰 영역이 중첩되는 정도는 상기 서브 픽셀과 상기 적어도 하나의 뷰 영역이 중첩되는 면적에 기초하여 결정되는 것을 특징으로 하는, 방법.
- 제3 항에 있어서, 상기 중첩되는 면적이 클수록 상기 서브 픽셀과 상기 적어도 하나의 뷰 영역이 중첩되는 정도가 커지는 것을 특징으로 하는, 방법.
- 제1 항에 있어서, 상기 서브 픽셀과 상기 적어도 하나의 뷰 영역이 중첩되는 정도는 상기 서브 픽셀과 상기 적어도 하나의 뷰 영역의 중심 선이 중첩되는 길이에 기초하여 결정되는 것을 특징으로 하는, 방법.
- 제5 항에 있어서, 상기 중첩되는 길이가 길수록 상기 서브 픽셀과 상기 적어도 하나의 뷰 영역이 중첩되는 정도가 커지는 것을 특징으로 하는, 방법.
- 제1 항에 있어서, 상기 적어도 하나의 뷰 영역은 상기 서브 픽셀과 중첩되는 면적이 기 결정된 값 이상인 뷰 영역인 것을 특징으로 하는, 방법.
- 제1 항에 있어서, 상기 적어도 하나의 뷰 영역은 상기 서브 픽셀과 중첩되는 면적을 상기 서브 픽셀의 면적으로 나누어서 생성된 값이 기 결정된 값 이상인 뷰 영역인 것을 특징으로 하는, 방법.
- 제1 항에 있어서, 상기 적어도 하나의 뷰 영역은 중심 선이 상기 서브 픽셀과 중첩되는 길이가 기 결정된 값 이상인 뷰 영역인 것을 특징으로 하는, 방법.
- 시역 분리부;적어도 하나의 인스트럭션을 저장하는 메모리; 및적어도 하나의 프로세서를 포함하고,상기 적어도 하나의 프로세서는 상기 적어도 하나의 인스트럭션을 실행하여,복수의 뷰들에 대응하는 복수의 영상들을 획득하고,상기 시역 분리부의 특성에 기초하여 상기 복수의 뷰들에 대응하도록 결정되는 복수의 뷰 영역(view region)들 중에서, 서브 픽셀과 중첩되는 적어도 하나의 뷰 영역을 식별하고,상기 적어도 하나의 뷰 영역에 대응하는 적어도 하나의 영상 별로 상기 서브 픽셀에 대응하는 데이터 값을 식별하고,상기 서브 픽셀과 상기 적어도 하나의 뷰 영역이 중첩되는 정도에 기초하여, 상기 적어도 하나의 영상 별로 상기 데이터 값의 반영 정도를 결정하고, 상기 결정된 반영 정도에 따라 조절된 데이터 값에 기초하여 상기 서브 픽셀의 출력 값을 결정하고,상기 서브 픽셀을 포함하는 다수의 서브 픽셀 별로 결정된 출력 값에 기초하여 영상을 출력하는, 전자 장치.
- 제10 항에 있어서, 상기 서브 픽셀과 상기 적어도 하나의 뷰 영역이 중첩되는 정도가 클수록, 상기 데이터 값의 반영 정도가 커지는 것을 특징으로 하는, 전자 장치.
- 제10 항에 있어서 상기 서브 픽셀과 상기 적어도 하나의 뷰 영역이 중첩되는 정도는 상기 서브 픽셀과 상기 적어도 하나의 뷰 영역이 중첩되는 면적에 기초하여 결정되는 것을 특징으로 하는, 전자 장치.
- 제12 항에 있어서, 상기 중첩되는 면적이 클수록 상기 서브 픽셀과 상기 적어도 하나의 뷰 영역이 중첩되는 정도가 커지는 것을 특징으로 하는, 전자 장치.
- 제10 항에 있어서, 상기 서브 픽셀과 상기 적어도 하나의 뷰 영역이 중첩되는 정도는 상기 서브 픽셀과 상기 적어도 하나의 뷰 영역의 중심 선이 중첩되는 길이에 기초하여 결정되는 것을 특징으로 하는, 전자 장치.
- 제1 항 내지 제9 항 중 어느 한 항의 방법을 컴퓨터에서 실행시키기 위한 프로그램을 기록한 컴퓨터로 읽을 수 있는 기록매체.
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202280036007.1A CN117337562A (zh) | 2021-05-20 | 2022-05-03 | 用于处理图像的方法和装置 |
EP22805047.2A EP4311233A1 (en) | 2021-05-20 | 2022-05-03 | Method and apparatus for processing images |
US17/743,019 US11961428B2 (en) | 2021-05-20 | 2022-05-12 | Method and device for processing image |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2021-0064977 | 2021-05-20 | ||
KR20210064977 | 2021-05-20 | ||
KR1020210112468A KR20220157270A (ko) | 2021-05-20 | 2021-08-25 | 이미지를 처리하기 위한 방법 및 장치 |
KR10-2021-0112468 | 2021-08-25 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/743,019 Continuation US11961428B2 (en) | 2021-05-20 | 2022-05-12 | Method and device for processing image |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022245194A1 true WO2022245194A1 (ko) | 2022-11-24 |
Family
ID=84140706
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2022/095094 WO2022245194A1 (ko) | 2021-05-20 | 2022-05-03 | 이미지를 처리하기 위한 방법 및 장치 |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2022245194A1 (ko) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20070019644A (ko) * | 2003-09-27 | 2007-02-15 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | 다중 시야 디스플레이 |
KR20120010363A (ko) * | 2010-07-26 | 2012-02-03 | 삼성전자주식회사 | 부화소 영역 가중치에 기반한 렌더링 시스템 및 방법 |
KR20140137971A (ko) * | 2013-05-24 | 2014-12-03 | 삼성전자주식회사 | 디스플레이 장치 및 그의 다시점 영상 디스플레이 방법 |
KR20150002159A (ko) * | 2013-06-28 | 2015-01-07 | 엘지디스플레이 주식회사 | 입체 영상 디스플레이 장치의 구동방법 |
KR20160136831A (ko) * | 2015-05-21 | 2016-11-30 | 삼성전자주식회사 | 다시점 영상 디스플레이 장치 및 그 제어 방법 |
-
2022
- 2022-05-03 WO PCT/KR2022/095094 patent/WO2022245194A1/ko active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20070019644A (ko) * | 2003-09-27 | 2007-02-15 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | 다중 시야 디스플레이 |
KR20120010363A (ko) * | 2010-07-26 | 2012-02-03 | 삼성전자주식회사 | 부화소 영역 가중치에 기반한 렌더링 시스템 및 방법 |
KR20140137971A (ko) * | 2013-05-24 | 2014-12-03 | 삼성전자주식회사 | 디스플레이 장치 및 그의 다시점 영상 디스플레이 방법 |
KR20150002159A (ko) * | 2013-06-28 | 2015-01-07 | 엘지디스플레이 주식회사 | 입체 영상 디스플레이 장치의 구동방법 |
KR20160136831A (ko) * | 2015-05-21 | 2016-11-30 | 삼성전자주식회사 | 다시점 영상 디스플레이 장치 및 그 제어 방법 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2020226316A1 (en) | Transfer apparatus and method of manufacturing micro led display using the same | |
WO2020101420A1 (ko) | 증강현실 기기의 광학 특성 측정 방법 및 장치 | |
WO2016143983A1 (en) | Method and device for radiating light used to capture iris | |
EP3850612A1 (en) | Display apparatus and control method thereof | |
WO2022108321A1 (ko) | 디스플레이 장치 및 그의 제어 방법 | |
WO2019135475A1 (en) | Electronic apparatus and control method thereof | |
WO2019035582A1 (en) | DISPLAY APPARATUS AND SERVER, AND METHODS OF CONTROLLING THE SAME | |
WO2019066594A1 (ko) | 디스플레이 장치 및 그 제어 방법 | |
WO2020246859A1 (en) | Method for compensating for screen movement of display and electronic device for supporting the same | |
WO2019226025A1 (ko) | 디스플레이를 통해 어플리케이션의 콘텐트를 표시하는 방법 및 전자 장치 | |
WO2016080653A1 (en) | Method and apparatus for image processing | |
WO2019088481A1 (ko) | 전자 장치 및 그의 영상 보정 방법 | |
WO2022245194A1 (ko) | 이미지를 처리하기 위한 방법 및 장치 | |
WO2023146326A1 (ko) | 개용 표시 장치 | |
WO2022108114A1 (ko) | 적층형 디스플레이 장치 및 이의 제어 방법 | |
WO2022245045A1 (ko) | 이미지를 처리하기 위한 방법 및 장치 | |
WO2016186442A1 (en) | Display panel, display apparatus and controlling method thereof | |
WO2021133139A1 (en) | Electronic apparatus and control method thereof | |
WO2019209013A1 (ko) | 확장현실 영상처리 방법 및 이를 위한 장치 | |
EP3259752A1 (en) | Display panel, display apparatus and controlling method thereof | |
WO2018113342A1 (zh) | 显示装置的驱动方法、装置及显示装置 | |
WO2020004941A1 (ko) | 디스플레이에서 출력된 광을 렌즈로 전달할 수 있는 반사 부재 및 반투명 반사 부재를 포함하는 전자 장치 | |
WO2017146314A1 (ko) | 디스플레이 패널과 무안경 다시점 렌티큘러시트를 통한 홀로그램 출력방법과 렌티큘러시트가 부착된 두 개의 디스플레이 패널을 통한 3차원 영상 생성방법 및 출력방법 | |
WO2019194588A1 (en) | Method for driving plurality of pixel lines and electronic device thereof | |
WO2020130737A1 (en) | Display apparatus and method of controlling the same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22805047 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2022805047 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2022805047 Country of ref document: EP Effective date: 20231017 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202280036007.1 Country of ref document: CN |
|
NENP | Non-entry into the national phase |
Ref country code: DE |