TWI527430B - 3d image processing methods and systems - Google Patents

Description

3D image processing method and system

The present invention relates to a 3D (three-dimensional) image processing method and system, and particularly relates to a specific position where the 3D image can be first decomposed into a left/right picture and/or related information is added to the left/right picture. Then, according to the left/right screen, the method and system for performing related control operations are performed.

In recent years, with the development of 3D image technology, electronic devices with display functions, such as televisions, projectors, and displays, are also provided with a three-dimensional space in addition to general images and colors to provide users with more A true, more realistic visual experience. At the same time, with the rapid development of 3D display technology, the application of 3D image display has become more and more diversified.

In general, image decoding operations are typically performed by an image decoding unit that includes a sequence of decoding subunits. For some video playback devices, such as televisions or projectors, each level of decoding sub-units in the image decoding unit can be responsible for different image processing. For example, display of user interface, color processing, motion image processing, and keystone correction. In most of the devices, the decoding subunit of the pre-stage mainly performs the functions of display, color processing, and trapezoidal correction of the user operation interface. Conventionally, the decoding subunit of the last stage in the image decoding unit will disassemble the 3D image into a left/right picture. Since the sequence of the left/right screen is known, the corresponding control signal of the 3D glasses can be issued, so that the user can see the 3D effect.

However, if the pre-decoding sub-unit directly performs the above processing on the unremoved 3D image, such as trapezoidal correction, then the post-decoding sub-unit will be 3D again. Disassembling the image as a left/right screen will result in the user interface disappearing or being cut, or the image being distorted. For example, FIG. 1A shows a 3D image 100 including a left picture L and a right picture R. When the current stage decoding sub-unit directly performs the trapezoidal correction on the 3D image 100 of FIG. 1A, the trapezoid-corrected 3D image 110 is displayed in FIG. 1B. At this time, if the rear-level decoding sub-unit disassembles the trapezoid-corrected 3D image 110 and superimposes it, distortion may occur, such as the superimposed image 200 shown in FIG. In order to see normal 3D images, these devices often have to sacrifice some functions, or most of the functions are transferred to the final stage of the decoding sub-unit, thus affecting the overall 3D decoding performance.

In view of this, the present invention provides a 3D image processing method and system. The 3D image can be first decomposed into left/right images, and/or related information can be added to a specific position of the left/right screen data, and then left/right. The screen performs related control operations, thereby avoiding distortion and errors that may be caused by image processing, and accelerating the efficiency of related control operations.

One embodiment of the present invention is applicable to a 3D image processing method having an electronic device of an image decoding unit. The image decoding unit has a sequence of complex decoding subunits. First, a first decoding subunit receives at least one 3D image. A second decoding sub-unit decomposes the 3D image into a left picture or a right picture according to a 3D format of the corresponding 3D image. Thereafter, a third decoding sub-unit performs a control operation according to the left picture or the right picture. The third decoding subunit is after the second decoding subunit in the sequence.

One embodiment of the present invention is applicable to a 3D image of an electronic device The system includes an image decoding unit having a sequence of complex decoding sub-units. The image decoding unit includes at least a first decoding subunit, a second decoding subunit, and a third decoding subunit. The first decoding subunit receives at least one 3D image. The second decoding sub-unit decomposes the 3D image into a left picture or a right picture according to a 3D format of the corresponding 3D image. The third decoding sub-unit performs a control operation according to the left picture or the right picture, wherein the third decoding sub-unit is after the second decoding sub-unit in the sequence.

In some embodiments, the second decoding subunit may store a picture type label, such as a left picture label and a right picture label, to a specific location of the data of the corresponding left picture or right picture.

In some embodiments, the third decoding subunit may obtain a picture type label from a specific location of the material of the corresponding left or right picture, and perform a management job according to the picture type label. In some embodiments, the control operation can include a 3D glasses control job.

In some embodiments, the second decoding subunit may store an image processing content to a specific location of the material of the corresponding left or right screen. The third decoding subunit may obtain the image processing content from a specific location of the data of the corresponding left or right screen, and perform the management operation according to the image processing content. In some embodiments, the managing the job may include performing an image processing on the left or right screen in accordance with the image processing content.

In some embodiments, the third decoding subunit in the sequence is immediately after or indirectly located after the second decoding subunit. In some embodiments, the first decoding subunit is the same as the second decoding subunit.

In some embodiments, the particular location may be the front rim or the back porch of the material of the left or right screen.

The embodiment of the present invention is applicable to a 3D image processing method having an electronic device of an image decoding unit. First, at least one 3D image is received. Then, the 3D image is decomposed into a left picture or a right picture according to a 3D format of the corresponding 3D image. Thereafter, a picture type tag is stored to a specific location of the material of the corresponding left or right picture. The picture type label includes a left picture label and a right picture label.

A 3D image processing system suitable for an electronic device according to an embodiment of the present invention includes at least one image decoding unit. The image decoding unit receives at least one 3D image, and decomposes the 3D image into a left picture or a right picture according to a 3D format of the corresponding 3D image. Thereafter, the image decoding unit stores a picture type tag to a specific location of the data of the corresponding left picture or right picture. The picture type label includes a left picture label and a right picture label.

In some embodiments, an image processing content may also be stored to a specific location of the material of the corresponding left or right screen.

In some embodiments, the particular location may be the leading or trailing edge of the material of the left or right picture.

The above method of the present invention can exist in a coded manner. When the code is loaded and executed by the machine, the machine becomes the means for practicing the invention.

The above described objects, features, and advantages of the invention will be apparent from the description and appended claims appended claims

Figure 3 shows a 3D image processing system in accordance with an embodiment of the present invention. The 3D image processing system 300 according to an embodiment of the present invention may be applied to an electronic device such as a television, a projector, a game machine, a display, and any A processor-based device for image processing functions, and the like. The 3D image processing system 300 includes at least one image decoding unit 310. In the present case, image decoding unit 310 may include a sequence of complex decoding sub-units (312, 314, 316) as described in FIG. Each decoding sub-unit can perform related image processing and/or related control on the image output by the pre-decoding sub-unit. The image decoding unit 310 can perform the 3D image processing method of the present invention, the details of which will be described later.

Figure 5 shows a 3D image processing method in accordance with an embodiment of the present invention. The 3D image processing method according to the embodiment of the present invention can be applied to an electronic device, a television, a projector, a game machine, a display, a device based on any processor having an image processing function, and the like. In this embodiment, the 3D image can be first decomposed into left/right images, and then related control operations are performed according to the left/right screen.

In step S510, one of the first decoding subunits of the image decoding unit receives at least one 3D image. Note that in some embodiments, the first decoding sub-unit may be the first one of the decoding sub-units in the sequence of decoding sub-units in the image decoding unit. Then, in step S520, one of the second decoding sub-units of the image decoding unit decomposes the 3D image into a left picture or a right picture according to a 3D format of the corresponding 3D image. It should be noted that in some embodiments, the first decoding subunit and the second decoding subunit may be the same decoding subunit. Then, in step S530, a third decoding sub-unit performs a control operation according to the left picture or the right picture obtained by the decomposition. It must be noted that in the sequence of decoding subunits in the image decoding unit, the third decoding subunit is located after the second decoding subunit. It is reminded that the third decoding subunit may be immediately after or indirectly behind the second decoding subunit. another In addition, in some embodiments, the foregoing control operation may perform display, color processing, motion image processing, and/or keystone correction of the user operation interface for the left or right screen. In addition, in some embodiments, the foregoing control operation may perform a control operation of a 3D glasses according to a left picture or a right picture.

Figure 6 shows a 3D image processing method in accordance with another embodiment of the present invention. The 3D image processing method according to the embodiment of the present invention can be applied to an electronic device, a television, a projector, a game machine, a display, a device based on any processor having an image processing function, and the like. In this embodiment, the 3D image can be first decomposed into a left/right picture, and the related information can be added to the specific position of the left/right picture data, and then the related control operation is performed according to the left/right picture.

In step S610, one of the first decoding subunits of the image decoding unit receives at least one 3D image. Note that in some embodiments, the first decoding sub-unit may be the first one of the decoding sub-units in the sequence of decoding sub-units in the image decoding unit. Then, in step S620, one of the second decoding sub-units of the image decoding unit decomposes the 3D image into a left picture or a right picture according to a 3D format of the corresponding 3D image. It should be noted that in some embodiments, the first decoding subunit and the second decoding subunit may be the same decoding subunit. In step S630, the second decoding subunit adds a related information to a specific location in the material corresponding to the picture. It is noted that the aforementioned related information may be different from the application according to different needs. In some embodiments, the related information may include a picture type label, such as a left picture label and a right picture label, to indicate that the picture is a left picture or a right picture. In some embodiments, the related information may include an image processing content, The related image processing is performed on the picture by providing the subsequent stage decoding subunit. In addition, in some embodiments, the aforementioned specific location may be the front edge or the back edge of the picture material. It should be noted that this embodiment adds relevant information to the data of the corresponding left or right picture by the second decoding subunit. However, in some embodiments, the operation of adding related information to the data of the corresponding left or right picture may also be performed by other subsequent stage decoding subunits.

Then, in step S640, one of the third decoding sub-units in the image decoding unit obtains related information of the corresponding picture from the specific position of the data of the corresponding left picture or the right picture. It should be noted that in some embodiments, in the sequence of decoding subunits in the image decoding unit, the third decoding subunit may be immediately after or indirectly behind the second decoding subunit. In step S650, it is determined whether an image processing content is included in the related information obtained by the specific location. If the related information does not include the image processing content (NO in step S650), the determination in step S670 is performed. If the related information includes the image processing content (YES in step S650), in step S660, the third decoding subunit performs an image processing on the screen according to the image processing content. It should be noted that in some embodiments, the image processing may be display, color processing, motion image processing, and/or keystone correction of the user interface. Next, in step S670, it is determined whether a picture type tag is included in the related information obtained by the specific location. If the related information does not include the picture type tag (No in step S670), the process ends. If the related information includes the picture type tag (YES in step S670), in step S680, a 3D glasses control job is executed in accordance with the picture type tag (left picture tag or right picture tag). Remind that in the 3D glasses control job, when the screen type label is the left screen label When signing, the left eye of the 3D glasses is opened, and the right eye of the 3D glasses is closed. It should be noted that this embodiment performs image processing on the screen by the third decoding subunit and performs a 3D glasses control operation. However, in some embodiments, image processing is performed on the screen, and the 3D glasses control job may be performed by different decoding sub-units.

Figure 7 shows a 3D image processing method in accordance with another embodiment of the present invention. The 3D image processing method according to the embodiment of the present invention can be applied to an electronic device, a television, a projector, a game machine, a display, a device based on any processor having an image processing function, and the like. In this embodiment, the 3D image can be first decomposed into left/right images, and the picture type tag of the corresponding picture can be added to the specific position of the data of the left/right picture.

In step S710, one of the first decoding subunits of the image decoding unit receives at least one 3D image. Note that in some embodiments, the first decoding sub-unit may be the first one of the decoding sub-units in the sequence of decoding sub-units in the image decoding unit. Then, in step S720, one of the second decoding sub-units of the image decoding unit decomposes the 3D image into a left picture or a right picture according to a 3D format of the corresponding 3D image. It should be noted that in some embodiments, the first decoding subunit and the second decoding subunit may be the same decoding subunit. In step S730, the second decoding sub-unit adds a picture type label, such as a left picture label and a right picture label, to a specific position in the data of the corresponding picture. It is noted that in some embodiments, the aforementioned particular location may be the leading or trailing edge of the picture material. It is reminded that the data in a specific location can provide subsequent decoding sub-units for related control and application.

The reminder is that in addition to the picture type label, other relevant information, For example, the image processing content may also be added to a specific location in the screen data to provide a subsequent decoding sub-unit to perform related processing on the screen according to the image processing content.

Therefore, through the 3D image processing method and system of the present invention, the 3D image can be first decomposed into left/right images, and then related control operations are performed, thereby avoiding distortion and errors that may be caused by the processing. In addition, related information, such as picture type tags and image processing content, can be added to specific locations of the left/right picture data, and the subsequent stage decoding sub-unit can directly read related information in a specific location to perform related control operations, thereby accelerating correlation. Control the efficiency of the operation.

The method of the invention, or a particular type or portion thereof, may exist in the form of a code. The code may be included in a physical medium such as a floppy disk, a CD, a hard disk, or any other machine readable (such as computer readable) storage medium, or is not limited to an external computer program product, wherein When the code is loaded and executed by a machine, such as a computer, the machine becomes a device for participating in the present invention. The code can also be transmitted via some transmission medium, such as a wire or cable, fiber optics, or any transmission type, where the machine becomes part of the program when it is received, loaded, and executed by a machine, such as a computer. Invented device. When implemented in a general purpose processing unit, the code combination processing unit provides a unique means of operation similar to application specific logic.

While the present invention has been described in its preferred embodiments, the present invention is not intended to limit the invention, and the present invention may be modified and modified without departing from the spirit and scope of the invention. The scope of protection is subject to the definition of the scope of the patent application.

100‧‧‧3D image

L‧‧‧ left screen

R‧‧‧Right screen

110‧‧‧3D image after trapezoidal correction

200‧‧‧Overlapping images

300‧‧3D Image Processing System

310‧‧‧Image decoding unit

312, 314, 316‧‧‧ decoding subunits

S510, S520, S530‧‧‧ steps

S610, S620, ..., S680‧‧‧ steps

S710, S720, S730‧‧ steps

Figure 1A shows a 3D image consisting of a left image and a right image.

Fig. 1B shows the 3D image in Fig. 1A after the trapezoidal correction.

Fig. 2 shows a 3D superimposed image in which the 3D image in Fig. 1B is disassembled and superimposed.

Figure 3 is a schematic diagram showing a 3D image processing system in accordance with an embodiment of the present invention.

Figure 4 is a schematic diagram showing an image decoding unit in accordance with an embodiment of the present invention.

Figure 5 is a flow chart showing a 3D image processing method in accordance with an embodiment of the present invention.

Figure 6 is a flow chart showing a 3D image processing method according to another embodiment of the present invention.

Figure 7 is a flow chart showing a 3D image processing method according to another embodiment of the present invention.

S610, S620, ..., S680‧‧‧ steps

Claims (20)

A 3D image processing method is applicable to an electronic device having an image decoding unit, wherein the image decoding unit has a sequence of complex decoding subunits, the method comprising the following steps: a first decoding subunit receives at least one 3D image; a second decoding sub-unit decomposes the 3D image into a left picture or a right picture according to a 3D format of the corresponding 3D image; a third decoding sub-unit performs a control operation according to the left picture or the right picture, where the The third decoding subunit is after the second decoding subunit in the sequence; the third decoding subunit obtains an image processing content from a specific location of the data corresponding to the left picture or the right picture; and the The third decoding sub-unit performs the management operation according to the image processing content, wherein the management operation comprises performing an image processing on the left picture or the right picture according to the image processing content. The 3D image processing method of claim 1, wherein the third decoding subunit is immediately after or indirectly behind the second decoding subunit. The 3D image processing method of claim 1, wherein the first decoding subunit is the same as the second decoding subunit. A 3D image processing method is applicable to an electronic device having an image decoding unit, wherein the image decoding unit has a sequence of complex decoding subunits, the method comprising the following steps: a first decoding subunit receives at least one 3D image; a second decoding subunit according to a 3D format corresponding to the 3D image The 3D image is decomposed into a left picture or a right picture; a third decoding subunit performs a control operation according to the left picture or the right picture, wherein the third decoding subunit is the second decoder in the sequence And after the unit; and storing, by the second decoding subunit, a picture type label to a specific location of the data of the left picture or the right picture, wherein the picture type label includes a left picture label and a right picture label. The 3D image processing method of claim 4, further comprising the step of: obtaining, by the third decoding subunit, the picture type label from the specific location of the material corresponding to the left picture or the right picture; The third decoding sub-unit performs the management operation according to the picture type label, wherein the management operation includes a 3D glasses control operation. The 3D image processing method of claim 1, further comprising the step of: storing the image processing content by the second decoding subunit to the specific location of the material corresponding to the left picture or the right picture. The 3D image processing method of claim 4, wherein the specific position is a leading edge or a trailing edge of the left picture or the right picture. A 3D image processing method is applicable to an electronic device having an image decoding unit, the method comprising the steps of: receiving at least one 3D image; and decomposing the 3D image into a left picture or a according to a 3D format of the corresponding 3D image. Right screen; A picture type tag is stored to a specific location of the data of the left picture or the right picture, wherein the picture type tag includes a left picture label and a right picture label. The 3D image processing method of claim 8, further comprising storing an image processing content to the specific location of the material corresponding to the left screen or the right screen. The 3D image processing method of claim 8, wherein the specific position is a leading edge or a trailing edge of the left picture or the right picture. A 3D image processing system, applicable to an electronic device, comprising: at least one image decoding unit, comprising a sequence of complex decoding subunits, the image decoding unit comprising: a first decoding subunit for receiving at least one 3D image; a second decoding subunit for decomposing the 3D image into a left picture or a right picture according to a 3D format of the corresponding 3D image; and a third decoding subunit for using the left picture or the right picture Performing a control operation, wherein the third decoding subunit is after the second decoding subunit in the sequence, and the third decoding subunit obtains one of a specific location of the data corresponding to the left picture or the right picture The image processing content, and performing the control operation according to the image processing content, wherein the controlling the operation comprises performing an image processing on the left screen or the right screen according to the image processing content. The 3D image processing system of claim 11, wherein the third decoding subunit is located immediately or indirectly in the sequence After the second decoding subunit. The 3D image processing system of claim 11, wherein the first decoding subunit is the same as the second decoding subunit. A 3D image processing system, applicable to an electronic device, comprising: at least one image decoding unit, comprising a sequence of complex decoding subunits, the image decoding unit comprising: a first decoding subunit for receiving at least one 3D image; a second decoding subunit for decomposing the 3D image into a left picture or a right picture according to a 3D format of the corresponding 3D image; and a third decoding subunit for using the left picture or the right picture Performing a control operation, wherein the third decoding subunit is after the second decoding subunit in the sequence, the second decoding subunit further storing a picture type label to the data corresponding to the left picture or the right picture a specific location, wherein the picture type tag includes a left picture label and a right picture label. The 3D image processing system of claim 14, wherein the third decoding subunit further obtains the picture type label from the specific location of the material corresponding to the left picture or the right picture, and according to the picture The type tag performs the control operation, wherein the control operation includes a 3D glasses control job. The 3D image processing system of claim 11, wherein the second decoding sub-unit further stores the image processing content to the specific location of the material corresponding to the left picture or the right picture. For example, the 3D image processing system described in claim 14 of the patent scope, Wherein the specific location is the leading or trailing edge of the data of the left picture or the right picture. A 3D image processing system is applicable to an electronic device, and includes at least: an image decoding unit, configured to receive at least one 3D image, and decompose the 3D image into a left picture or a right picture according to a 3D format of the corresponding 3D image. And storing a picture type tag to a specific location of the data of the left picture or the right picture, wherein the picture type tag includes a left picture label and a right picture label. The 3D image processing system of claim 18, wherein the image decoding unit further stores an image processing content to the specific location of the material corresponding to the left screen or the right screen. The 3D image processing system of claim 18, wherein the specific position is a leading edge or a trailing edge of the left picture or the right picture.