WO2014012242A1 - 影像产生方法 - Google Patents

影像产生方法 Download PDF

Info

Publication number
WO2014012242A1
WO2014012242A1 PCT/CN2012/078920 CN2012078920W WO2014012242A1 WO 2014012242 A1 WO2014012242 A1 WO 2014012242A1 CN 2012078920 W CN2012078920 W CN 2012078920W WO 2014012242 A1 WO2014012242 A1 WO 2014012242A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
solid color
generation method
background
color image
Prior art date
Application number
PCT/CN2012/078920
Other languages
English (en)
French (fr)
Inventor
吴丰嘉
Original Assignee
Wu Feng-Chia
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wu Feng-Chia filed Critical Wu Feng-Chia
Priority to EP12881426.6A priority Critical patent/EP2876545A4/en
Priority to KR1020157004290A priority patent/KR101665988B1/ko
Priority to JP2015521933A priority patent/JP5972462B2/ja
Priority to CN201280074605.4A priority patent/CN104488024B/zh
Priority to PCT/CN2012/078920 priority patent/WO2014012242A1/zh
Priority to US14/413,721 priority patent/US20150228247A1/en
Publication of WO2014012242A1 publication Critical patent/WO2014012242A1/zh

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/02Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/02Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed
    • G09G5/026Control of mixing and/or overlay of colours in general
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • G09G3/002Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/003Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
    • G09G5/006Details of the interface to the display terminal
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14Display of multiple viewports
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/18Timing circuits for raster scan displays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/2224Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
    • H04N5/2226Determination of depth image, e.g. for foreground/background separation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/272Means for inserting a foreground image in a background image, i.e. inlay, outlay
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/10Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/12Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/12Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
    • G09G2340/125Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels wherein one of the images is motion video
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/14Solving problems related to the presentation of information to be displayed
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00Aspects of interface with display user
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00Aspects of data communication
    • G09G2370/16Use of wireless transmission of display information

Definitions

  • the present invention relates to an image generating method, and more particularly to an image generating method for replacing a portion of a solid color image in an image. Background technique
  • FIG. 1 there is shown a schematic diagram of a film produced by taking pictures of activities performed in digital content in the prior art.
  • the digital content 101 and the presenter 102 are often placed in two separate blocks of the movie screen 100.
  • the presenter 102 cannot directly compare the corresponding blocks on the digital content 101 with his limbs, and thus the participant who watches the movie has a feeling of being in the scene.
  • FIG. 2 it is a schematic diagram of a shooting scene in which the digital content is active in the prior art.
  • the presenter 203 will be placed in front of a solid color screen 201 for camera 202.
  • the digital content is then composited into the captured movie, corresponding to the block of the solid color curtain 201.
  • a display component 204 is typically placed in the shooting scene for the presenter 203 to view the synthesized video in real time.
  • the eyes of the presenter 203 are often oriented toward the display element 204 placed aside.
  • an object of the present invention is to provide an image generating method for capturing an interlaced solid color image and a first image as a background to obtain a second image with a solid color image as a background. Image, and replace the portion of the solid image in the second image with the first image.
  • the image generation method includes the following steps:
  • the application of the present invention has the following advantages.
  • the presenter can look directly at the image displayed on the preset background display position without having to aim the eye at the additional display elements.
  • the presenter can have a more natural look in the captured image.
  • the application allows the presenter to interact or note directly with the content in the image, providing the speaker with more precise interactive manipulation.
  • the digital content on the generated image can be displayed better, and the display effect is not affected by the shooting environment factor.
  • FIG. 1 is a schematic diagram of a movie produced by taking digital content for activity in the prior art
  • FIG. 2 is a schematic diagram of a shooting scene in which digital content is active in the prior art
  • FIG. 3 is a schematic diagram of a shooting scene in which the digital content is active in the prior art
  • FIG. 4 is a schematic diagram of a scene in which the image generation method of FIG. 3 is applied;
  • Figure 5A is an embodiment of a solid color image
  • Figure 5B is an embodiment of a first image
  • 6A is an embodiment of a second image with a solid color image as a background
  • FIG. 6B is an embodiment of a third image after replacing the solid image portion with the first image.
  • FIG. 3 is a flowchart of an image generating method according to an embodiment of the present invention.
  • the image generating method the solid color image and the first image are displayed as a background to obtain a second image with the solid image as the background, and the portion of the solid image in the second image is replaced with the first image.
  • the image generating method can be implemented as a computer program and stored in a computer readable recording medium, and the computer can execute the image generating method after reading the recording medium.
  • the computer readable recording medium can be a read-only memory, a flash memory, a floppy disk, a hard disk, a compact disk, a portable disk, a magnetic tape, a database accessible by a network, or a computer that can be easily considered by those skilled in the art to have the same function. Read the recording medium.
  • the image generation method 300 includes the following steps:
  • step 310 a solid image and a first image are displayed in a predetermined background display position 401.
  • step 310 can be performed by interlacing in the optical field, interleaving in the time domain, spectrum Achieved by interlacing in the field, staggering in the field of space, or other interleaving.
  • Figure 5A which is an embodiment of a solid color image.
  • the solid image 501 can be a solid color image of green, blue, transparent, or other single color.
  • the solid color image may comprise a plurality of blocks of a single color image.
  • the display of a solid color image can be achieved by not displaying any image and displaying the solid color image and the first image as a solid color background.
  • the solid color image may be displayed by other means, and is not limited to the disclosure.
  • the first image 502 can include at least one text 502a.
  • the solid color image 501 and the first image 502 may be interleaved at a preset background display position 401.
  • the first image may include at least one text, at least one picture, at least one movie or other type of digital content, or a combination thereof, and is not limited to the disclosure.
  • a display element such as a cathode ray tube screen, a liquid crystal screen, or other type of display element
  • a display element may be disposed on the preset background display position 401 to enable a solid image and a An image is staggered on the display element.
  • a projector screen or other projection plane for projection may be disposed on the preset background display position 401 for the projector to interlace the solid image and the first image thereon. Wherein, the position 401 can be displayed on the preset background using a short throw projector.
  • the short-focus projector can be disposed closer to the preset background display position 401, and the speaker 402 before the preset background display position 401 is prevented from being shadowed on the projection path, resulting in poor projection effect.
  • the display may be performed by other means, and is not limited to the disclosure.
  • step 320 the solid image displayed on the preset background display position 401 and the first image are captured and processed as a background to obtain a second image (as shown in FIG. 6A) with the solid image as the background.
  • step 330 a portion of the solid image on the second image (601 of FIG. 6A) is replaced with the first image to generate a third image (as shown in FIG. 6B).
  • the portion of the solid image can be removed by a chroma key technique, and the first image is synthesized onto the area behind the third image to achieve step 330.
  • the presenter 402 can directly view the preset background display position 401, and does not need to aim the eye to the additional display element. .
  • the presenter 402 can have a more natural look in the third image produced.
  • the presenter 402 needs to interact with the image displayed on the preset background display position 401 (eg, writing text, drawing, and When the object interacts or otherwise interacts in the image, the application of the present invention allows the presenter to directly interact or note with the content in the image, providing the speaker with more precise interactive manipulation.
  • the digital content as the first image is passed through step 330, it is replaced with the generated third image. Therefore, the digital content replaced on the third image can have a better display effect, and the display effect is not affected by the shooting environment factor.
  • step 310 may display the solid color image and the first image in the preset background display position 401 by means of time division.
  • the solid image and the first image can be displayed in turn in the preset background display position 401.
  • step 320 may take a picture of the solid color image displayed in the background corresponding to the display of the solid color image to obtain a second image with the solid image as the background.
  • an active shutter can be mounted on the camera 403. Therefore, when displaying the timing of the first image, the active shutter can shield the shooting of the camera 403; at the timing of the solid image display, the active shutter does not shield the camera 403, and the camera 403 can capture the background with the solid image as the background. Two images.
  • the present invention can interleave the solid color image and the first image by optical division (step 310).
  • the optical division method may be a polarization division method, a spectrum division method, a color filter method, a spatial multiplexing method, a time multiplexing method, a color difference type, a lens method, a pointing light source method, a parallax shielding method, a grating method, an optical refraction method, and a viewpoint. Segmentation or other optical segmentation methods.
  • step 320 can use the optical shooting mode corresponding to the solid color image display to shoot with the displayed solid color image as the background to obtain the second image with the solid color image as the background.
  • step 310 can display the solid color image and the first image in the preset background display position 401 through different optical characteristics.
  • the solid image and the first image can be displayed using different optical characteristics on the preset background display position 401.
  • step 320 allows the camera 403 to be photographed to have an optical characteristic capable of capturing a solid color image display, and to capture a scene with the displayed solid color image as a background.
  • the camera 403 can be provided with a polarizing lens, a spectral lens, a color lens, a parallax barrier lens, a grating lens or other optical characteristics corresponding to the optical characteristics of the solid color image display, so that the camera 403 can only be photographed.
  • the optical properties of a solid image display can be provided with a polarizing lens, a spectral lens, a color lens, a parallax barrier lens, a grating lens or other optical characteristics corresponding to the optical characteristics of the solid color image display, so that the camera 403 can only be photographed.
  • a fourth image may be captured by using the displayed solid color image and the first image as the background.
  • the second image with the solid image as the background is filtered out from the fourth image.
  • an image corresponding to the display timing of the first image may be filtered from the fourth image to generate a second image with the solid image as the background.
  • step 310 may interleave the display frequency, interlace the solid color image, and display the first image at the preset background display position. Therefore, in some embodiments of step 320, a plurality of first images captured by the plurality of solid color image display timings during the solid color image display may be captured from the captured image according to the interlaced display frequency.
  • the captured first picture can be integrated into a second image for further processing by step 330.
  • the solid image may be displayed at 0 ⁇ l/60sec, 2/60sec ⁇ 3/60sec, 4/60sec ⁇ 5/60sec, and the first image is displayed. It may be displayed at l/60sec ⁇ 2/60sec, 3/60sec ⁇ 4/60sec, 5/60sec ⁇ 6/60sec. Therefore, the first picture taken by the solid color image display timing (0 to l/60 sec, 2/60 sec to 3/60 sec, 4/60 sec to 5/60 sec) at the time of the solid image display can be captured from the captured image to be integrated. For the second image.
  • the screen shooting frequency of step 320 may be an integer multiple of the interleaved display frequency of step 310.
  • the 120 Hz picture capture frequency (also 2 times the interlaced display frequency of 60 Hz) can be used to perform the shooting of step 320 for the first picture capture.
  • the execution timing of steps 310 and 320 can be performed by a wired or wireless data transfer protocol.
  • the wired or wireless data transmission protocol used for the same can be Digital Light Processing (DLP LINK) protocol, Radio Frequency (RF), Bluetooth (Bluetooth), Infrared (IR) or other Can be used in the same agreement.
  • DLP LINK Digital Light Processing
  • RF Radio Frequency
  • Bluetooth Bluetooth
  • IR Infrared
  • a plurality of shots of the captured image may be selected to have a plurality of solid background images with the solid image as the background.
  • a solid color background image can be integrated to produce a second image.
  • a preset marker can be displayed on the displayed solid color image in step 310.
  • the preset mark displayed may be at least one preset text, image, solid image or other type of mark.
  • step 320 may include the following steps: Selecting a plurality of labeled screens having preset marks among the plurality of shots of the captured photographed image. In other words, it is possible to detect whether there is a preset mark on the shooting picture of the captured image one by one to extract the picture with the preset mark.
  • the step 310 may display the preset mark on a preset block of the solid color image, and the step 320 detects the preset block, and the preset mark is extracted. Picture.
  • the labeled screen is integrated to produce a second image. In this way, the image with the solid image as the background can still be extracted without specifically adjusting the frequency of the error display of the step 310 or the shooting frequency of the step 320.
  • the image generating method may further include the following steps: detecting an interactive command when shooting.
  • the first image staggered by step 310 is modified in real time.
  • the content presented in the first image can be modified in real time, so that the presenter 402 can be not limited to the existing content of the first image, and the content of the speech is more flexible.
  • the application of the present invention has the following advantages.
  • the presenter can look directly at the image displayed on the preset background display position without having to aim the eye at the additional display elements.
  • the presenter can have a more natural look in the captured image.
  • the presenter needs to interact with the image displayed on the preset background display position (such as writing text on the image, drawing, interacting with objects in the image, or other interactions)
  • the application of the present invention enables the presenter to directly interact or note with the content in the image, providing the speaker with more precise interactive manipulation.
  • the digital content on the generated image can be displayed better, and the display effect is not affected by the shooting environment factor.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Studio Circuits (AREA)
  • Processing Of Color Television Signals (AREA)

Abstract

一种影像产生方法,包含:交错显示一纯色影像以及一第一影像(310)。以所显示的纯色影像以及第一影像(310)为背景进行拍摄以及处理,以取得以纯色影像为背景的一第二影像(320)。将第二影像(320)上纯色影像的部分替换为第一影像(310),以产生一第三影像(330)。

Description

影像产生方法 技术领域
本发明是有关于一种影像产生方法,且特别是有关于一种将影像中的纯色 影像部分进行替换的影像产生方法。 背景技术
随着计算机的普及, 各式各样的图像、 文字、 影像、 语音等数据的产品或 服务被运用信息技术, 加以数字化并整合应用。 因此, 越来越多人会通过数字 内容, 辅助其进行演讲、 开会、 教学等活动。
大部分活动在进行时,需通过摄影将其活动状况以现场直播或录影播出的 方式呈现给活动参与者。 参照图 1, 其是现有技术中拍摄以数字内容进行活动 所产生的影片的一示意图。 现有技术中, 常会将数字内容 101以及演讲者 102 分置于影片画面 100的两个分开的区块。然而, 以此方式所拍摄的影片中, 演 讲者 102无法直接以其肢体比划数字内容 101上的对应区块,因而无法让观看 影片的活动参与者有亲临现场的感觉。
参照图 2, 其是现有技术中以数字内容进行活动的拍摄场景的一示意图。 在此拍摄方式中, 演讲者 203会被安排于一纯色布幕 201 前, 供摄影机 202 拍摄。然后, 将数字内容合成至所拍摄出的影片中, 对应于纯色布幕 201的区 块上。为了使演讲者 203可了解其与数字内容相对应的位置,通常需在拍摄现 场摆设一显示元件 204, 供演讲者 203即时观看合成后的影片。 然而, 由于数 字内容是显示于显示元件 204而非纯色布幕 201上,因而造成演讲者 203的眼 睛常会朝向置于一旁的显示元件 204。 因此, 观看影片的活动参与者会觉得演 讲者的眼神不太自然。此外, 若演讲者 203需与所合成出的影片中的对象(如 人物或角色)进行互动时, 使用此拍摄方式常造成演讲者 203与影片中的对象 互动不精确且局限了演讲者 203的表演空间。 发明公开
因此, 本发明的一目的是在提供一种影像产生方法,用以将交错显示的纯 色画面以及一第一影像作为背景进行拍摄,以取得以纯色影像为背景的一第二 影像, 并将第二影像中纯色画面的部分替换为第一影像。影像产生方法包含以 下歩骤:
( a) 交错显示一纯色影像以及一第一影像。
(b) 以所显示的纯色影像以及第一影像为背景进行拍摄以及处理, 以取 得以纯色影像为背景的一第二影像。
( c ) 将第二影像上纯色影像的部分, 替换为第一影像, 以产生一第三影 像。
应用本发明具有下列优点。演讲者可直视预设背景显示位置上所显示的影 像, 不需将眼神瞄向置于一旁的额外显示元件。于是, 可使演讲者于所拍摄出 的影像中具有较自然的眼神。尤其, 在本发明的一实施例中, 若演讲者需与显 示位置上所显示的影像进行互动(如于影像上撰写文字、 画图、 与影像中的对 象互动或其他互动方式)时, 应用本发明可使演讲者直接与影像中的内容互动 或注记, 提供演讲者较精确的互动操控性。此外, 可使所产生的影像上的数字 内容可有较好的显示效果, 不会受到拍摄环境因素影响其显示效果。 附图简要说明
为让本发明的上述和其他目的、特征、优点与实施例能更明显易懂, 所附 附图的说明如下:
图 1是现有技术中拍摄以数字内容进行活动所产生的影片的一示意图; 图 2是现有技术中以数字内容进行活动的拍摄场景的一示意图; 图 3是依照本发明一实施方式的一种影像产生方法的流程图;
图 4为应用图 3影像产生方法的一场景的示意图;
图 5A是纯色影像的一实施例;
图 5B是第一影像的一实施例;
图 6A为以纯色影像为背景的第二影像的一实施例;
图 6B为以第一影像替换纯色影像部分后的第三影像的一实施例。
【主要元件符号说明】
100: 影片画面
101: 数字内容
102: 演讲者 201: 纯色布幕
202: 摄影机
203: 演讲者
204: 显示元件
300: 影像产生方法
310〜330: 歩骤
401: 预设背景显示位置
402: 演讲者
403: 摄影机
501: 纯色影像
502: 第一影像
502a: 文字
601: 第二影像上纯色影像的部分 实现本发明的最佳方式
以下将以附图及详细说明清楚说明本发明的精神,任何所属技术领域中具 有通常知识者在了解本发明的较佳实施例后, 当可由本发明所教示的技术, 加 以改变及修饰, 其并不脱离本发明的精神与范围。
图 3是依照本发明一实施方式的一种影像产生方法的流程图。在影像产生 方法中,将交错显示的纯色画面以及一第一影像作为背景进行拍摄, 以取得以 纯色影像为背景的一第二影像,并将第二影像中纯色画面的部分替换为第一影 像。影像产生方法可实作为一计算机程序, 并储存于一计算机可读取记录媒体 中, 而使计算机读取此记录媒体后执行影像产生方法。计算机可读取记录媒体 可为只读记忆体、 快闪记忆体、 软盘、 硬盘、 光盘、 随身盘、 磁带、 可由网络 存取的数据库或熟悉此技艺者可轻易思及具有相同功能的计算机可读取记录 媒体。
图 4为应用图 3影像产生方法的一场景的示意图。同时参照图 3以及图 4。 影像产生方法 300包含以下歩骤:
在歩骤 310中,交错显示一纯色影像以及一第一影像于一预设背景显示位 置 401。 其中, 歩骤 310可通过光学领域上的交错、 时间领域上的交错、 频谱 领域上的交错、 空间领域上的交错或其他交错方式而达成。 参照图 5A, 其是 纯色影像的一实施例。纯色影像 501可为绿色、蓝色、透明或其他单一颜色的 纯色影像。在本发明的另一实施例中, 纯色影像可包含多个单一颜色影像的区 块。在本发明的又一实施例中, 可通过不显示任何影像, 且用以显示纯色影像 以及第一影像的处为一纯色背景时, 即可达到一纯色影像的显示。然而, 在本 发明的其他实施例中, 可通过其他方式显示纯色影像, 并不限于本揭露。参照 图 5B, 其是第一影像的一实施例。 第一影像 502可包含至少一文字 502a。 于 是, 在歩骤 310的一实施例中, 可于预设背景显示位置 401, 交错显示纯色影 像 501以及第一影像 502。 在其他实施例中, 第一影像可包含至少一文字、 至 少一图片、至少一影片或其他类型的数字内容或其组合, 并不限于本揭露。此 夕卜,在歩骤 310的一实施例中, 可于预设背景显示位置 401上设置一显示元件 (如阴极射线管屏幕、液晶屏幕或其他类型的显示元件) , 而使纯色影像以及 第一影像交错显示于显示元件上。在歩骤 310的一实施例中, 可于预设背景显 示位置 401上设置一投影机布幕或其他可供投影的投影平面,供投影机将纯色 影像以及第一影像交错投影于其上。其中, 可使用一短焦投影机对预设背景显 示位置 401。 如此一来, 可将短焦投影机设置于离预设背景显示位置 401较近 之处,避免预设背景显示位置 401前的演讲者 402遮蔽在投影路径上, 造成投 影效果不佳。在歩骤 310的其他实施例中, 可通过其他方式进行显示, 并不限 于本揭露。
在歩骤 320中,以预设背景显示位置 401上所显示的纯色影像以及第一影 像为背景进行拍摄以及处理, 以取得以纯色影像为背景的一第二影像 (如图 6A所示) 。
在歩骤 330中, 将第二影像上纯色影像的部分 (如图 6A的 601 ) , 替换 为第一影像,以产生一第三影像(如图 6B所示)。其中,可通过颜色去背 (chroma key) 技术去除纯色影像的部分, 并将第一影像合成至第三影像上去背后的区 域, 以达成歩骤 330。 如此一来, 若将数字内容作为第一影像而交错显示于预 设背景显示位置 401时, 演讲者 402可直视预设背景显示位置 401, 不需将眼 神瞄向置于一旁的额外显示元件。于是, 可使演讲者 402于所产生的第三影像 中具有较自然的眼神。尤其, 在本发明的一实施例中, 若演讲者 402需与预设 背景显示位置 401上所显示的影像进行互动(如于影像上撰写文字、 画图、 与 影像中的对象互动或其他互动方式)时, 应用本发明可使演讲者直接与影像中 的内容互动或注记, 提供演讲者较精确的互动操控性。此外, 由于作为第一影 像的数字内容是通过于歩骤 330, 而替换至所产生的第三影像上。 因此, 可使 替换至第三影像上的数字内容可有较好的显示效果,不会受到拍摄环境因素影 响其显示效果。
在本发明的一实施例中, 歩骤 310可通过时序分割方式, 交错显示纯色影 像以及第一影像于预设背景显示位置 401。换言之,可于预设背景显示位置 401 依序轮流显示纯色影像以及第一影像。接下来, 歩骤 320可在对应纯色影像显 示的时序时, 以所显示的纯色影像为背景进行拍摄, 以取得以纯色影像为背景 的第二影像。其中, 若使用摄影机 403进行拍摄时, 可于摄影机 403上装设一 主动式快门。 于是, 在显示第一影像的时序时, 主动式快门可遮蔽摄影机 403 的拍摄; 在纯色影像显示的时序, 主动式快门不遮蔽摄影机 403, 而使摄影机 403可拍摄到以纯色影像为背景的第二影像。
此外, 本发明可通过光学分割方式, 交错显示纯色影像以及第一影像(歩 骤 310)。光学分割方式可为偏振光分割方式、频谱分割方式、颜色过滤方式、 空间多工方式、 时间多工方式、 色差式、 透镜方式、 指向光源方式、 视差屏蔽 方式、 光栅方式、 光学折射方式、 视点分割方式或其他光学分割方式。 于是, 歩骤 320可使用对应纯色影像显示的光学拍摄方式,以所显示的纯色影像为背 景进行拍摄, 以取得以纯色影像为背景的第二影像。
实作上, 歩骤 310可通过不同的光学特性, 交错显示纯色影像以及第一影 像于预设背景显示位置 401。 换言之, 可于预设背景显示位置 401上, 使用不 同的光学特性显示纯色影像以及第一影像。接下来, 歩骤 320可使拍摄的摄影 机 403具有可拍摄纯色影像显示的光学特性,而可拍摄以所显示的纯色影像为 背景的场景。举例来说, 可于摄影机 403装设对应于纯色影像显示的光学特性 的偏振光镜片、 频谱镜片、 颜色镜片、 视差屏蔽镜片、 光栅镜片或其他光学特 性的镜片, 而使摄影机 403具有仅可拍摄纯色影像显示的光学特性。
另外,在歩骤 320的另一实施例中, 可以所显示的纯色影像以及第一影像 为背景进行拍摄一第四影像。接下来, 自第四影像过滤出以纯色影像为背景的 第二影像。举例来说,可自第四影像过滤出对应于第一影像的显示时序的影像, 而产生以纯色影像为背景的第二影像。 在本发明的另一些实施例中, 歩骤 310可以一交错显示频率, 交错显示纯 色影像以及第一影像于预设背景显示位置。于是,在歩骤 320的一些实施例中, 可根据交错显示频率,自所拍摄出的拍摄影像撷取于纯色影像显示时的多个纯 色影像显示时序所拍摄的数个第一画面。接下来, 可将所撷取的第一画面整合 为第二影像, 供歩骤 330进一歩处理。 举例来说, 若在歩骤 310中, 交错显示 频率为 60Hz 时, 纯色影像可能于 0〜l/60sec、 2/60sec〜3/60sec、 4/60sec〜 5/60sec 时显示, 而第一影像则可能于 l/60sec〜2/60sec、 3/60sec〜4/60sec、 5/60sec〜6/60sec 时显示。 于是, 可自拍摄影像撷取于纯色影像显示时的纯色 影像显示时序 (0〜l/60sec、 2/60sec〜3/60sec、 4/60sec〜5/60sec)所拍摄的第 一画面, 以整合为第二影像。 其中, 歩骤 320 的画面拍摄频率可为歩骤 310 的交错显示频率的整数倍。 于本实施例中, 可用 120Hz 的画面拍摄频率 (也 是就交错显示频率 60Hz的 2倍) , 进行歩骤 320的拍摄, 以供上述第一画面 的撷取。此外, 可通过有线或无线数据传输通讯协定先同歩歩骤 310以及歩骤 320的执行时序。 其中, 用以同歩的有线或无线数据传输通讯协定可为数字光 处理 (Digital Light Processing, DLP LINK) 协定、 射频 (Radio Frequency, RF) 、 蓝牙 (bluetooth) 、 红外线 (Infrared, IR) 或其他可用以同歩的协定。
在歩骤 320的另一些实施例中,可选择所拍摄出的拍摄影像的多个拍摄画 面中, 具有以纯色影像为背景的数个具纯色背景画面。于是, 可整合具纯色背 景画面, 以产生第二影像。
在本发明的又一实施例中, 可于歩骤 310中,在所显示的纯色影像上显示 一预设标记。 其中, 所显示的预设标记可为至少一预设文字、 图像、 纯色影像 或其他类型的标记。于是, 歩骤 320可包含以下歩骤: 选择所拍摄出的拍摄影 像的多个拍摄画面中, 具有预设标记的数个具标记画面。换言之, 可逐一侦测 拍摄影像的拍摄画面上是否具有预设标记, 以撷取出具有预设标记的画面。此 外,在本发明的一些实施例中, 歩骤 310可将预设标记显示于纯色影像的一预 设区块, 供歩骤 320于此预设区块侦测, 而撷取出具有预设标记的画面。接下 来, 整合具标记画面, 以产生第二影像。 如此一来, 不需特地对歩骤 310的交 错显示频率或歩骤 320的拍摄频率调整或设定,仍可撷取出以纯色影像为背景 的影像。
此外,影像产生方法还可包含以下歩骤:在进行拍摄时,侦测一互动指令。 接下来,根据互动指令,即时修改歩骤 310所交错显示的第一影像。如此一来, 在本发明的一应用场景中, 可即时修改第一影像中所呈现的内容, 使得演讲者 402可不受限于第一影像现有的内容, 此其演讲内容更具弹性。
由上述本发明实施方式可知, 应用本发明具有下列优点。演讲者可直视预 设背景显示位置上所显示的影像, 不需将眼神瞄向置于一旁的额外显示元件。 于是, 可使演讲者于所拍摄出的影像中具有较自然的眼神。尤其, 在本发明的 一实施例中, 若演讲者需与预设背景显示位置上所显示的影像进行互动(如于 影像上撰写文字、 画图、 与影像中的对象互动或其他互动方式)时, 应用本发 明可使演讲者直接与影像中的内容互动或注记,提供演讲者较精确的互动操控 性。此外, 可使所产生的影像上的数字内容可有较好的显示效果, 不会受到拍 摄环境因素影响其显示效果。
虽然本发明已以实施方式揭露如上, 然其并非用以限定本发明, 任何熟悉 此技艺者, 在不脱离本发明的精神和范围内, 当可作各种的更动与润饰, 因此 本发明的保护范围当视所附的权利要求书所界定的范围为准。

Claims

权利要求书
1、 一种影像产生方法, 其特征在于, 包含:
(a) 交错显示一纯色影像以及一第一影像;
(b) 以所显示的该纯色影像以及该第一影像为背景进行拍摄以及处理, 以取得以该纯色影像为背景的一第二影像; 以及
( c ) 将该第二影像上该纯色影像的部分, 替换为该第一影像, 以产生一 第三影像。
2、 根据权利要求 1所述的影像产生方法, 其特征在于, 歩骤 (a) 包含: 以时序分割方式, 交错显示该纯色影像以及该第一影像。
3、 根据权利要求 2所述的影像产生方法, 其特征在于, 歩骤 (b) 包含: 在对应该纯色影像显示的时序时, 以所显示的该纯色影像为背景进行拍 摄, 以取得以该纯色影像为背景的该第二影像。
4、 根据权利要求 1所述的影像产生方法, 其特征在于, 歩骤 (a) 包含: 以一光学分割方式, 交错显示该纯色影像以及该第一影像。
5、 根据权利要求 4所述的影像产生方法, 其特征在于, 歩骤 (b) 包含: 使用对应该纯色影像显示的光学拍摄方式,以所显示的该纯色影像为背景 进行拍摄, 以取得以该纯色影像为背景的该第二影像。
6、 根据权利要求 4所述的影像产生方法, 其特征在于, 该光学分割方式 包含偏振光分割方式、 频谱分割方式、 颜色过滤方式、 空间多工方式、 时间多 工方式、 色差式、 透镜方式、 指向光源方式、 视差屏蔽方式、 光栅方式、 光学 折射方式或视点分割方式。
7、 根据权利要求 1所述的影像产生方法, 其特征在于, 歩骤 (b) 包含: 以所显示的该纯色影像以及该第一影像为背景进行拍摄一第四影像;以及 自该第四影像过滤出以该纯色影像为背景的该第二影像。
8、 根据权利要求 1所述的影像产生方法, 其特征在于, 歩骤 (a) 包含: 交错显示该纯色影像以及该第一影像于一显示元件。
9、 根据权利要求 1所述的影像产生方法, 其特征在于, 歩骤 (a) 包含: 交错投影该纯色影像以及该第一影像于一投影平面。
10、 根据权利要求 1所述的影像产生方法, 其特征在于, 还包含: 在进行拍摄时, 侦测一互动指令; 以及
根据该互动指令, 即时修改该第一影像。
11、 根据权利要求 1所述的影像产生方法, 其特征在于, 歩骤(b)包含: (bl )以所显示的该纯色影像以及该第一影像为背景进行拍摄而取得一拍 摄影像; 以及
(b2) 自该拍摄影像撷取以该纯色影像为背景的该第二影像。
12、 根据权利要求 11所述的影像产生方法, 其特征在于:
歩骤 (a) 以一交错显示频率执行;
歩骤 (b2 ) 包含:
根据该交错显示频率,自该拍摄影像撷取于该纯色影像显示时的至少一纯 色影像显示时序所拍摄的多个第一画面; 以及
将所述多个第一画面整合为该第二影像。
13、 根据权利要求 12所述的影像产生方法, 其特征在于, 歩骤 (bl ) 以 一画面拍摄频率拍摄该拍摄影像,且该画面拍摄频率为该交错显示频率的整数 倍。
14、 根据权利要求 12所述的影像产生方法, 其特征在于, 还包含: 同歩歩骤 (a) 以及歩骤 (bl ) 的执行时序。
15、 根据权利要求 14所述的影像产生方法, 其特征在于, 同歩歩骤 (a) 以及歩骤 (bl ) 的执行时序是通过有线或无线数据传输通讯协定进行同歩。
16、 根据权利要求 14所述的影像产生方法, 其特征在于, 同歩歩骤 (a) 以及歩骤(bl )的执行时序是通过数字光处理协定、射频、蓝牙或红外线同歩。
17、 根据权利要求 11所述的影像产生方法, 其特征在于, 该拍摄影像包 含多个拍摄画面, 歩骤 (b2) 包含:
选择所述多个拍摄画面中以该纯色影像为背景的多个具纯色背景画面;以 及
整合所述多个具纯色背景画面, 以产生该第二影像。
18、 根据权利要求 11所述的影像产生方法, 其特征在于,
歩骤 (a) 包含:
于该纯色影像上显示一预设标记;
该拍摄影像包含多个拍摄画面, 且歩骤 (b2) 包含:
选择所述多个拍摄画面中, 具有该预设标记的多个具标记画面; 以及 整合所述多个具标记画面, 以产生该第二影像。
19、 根据权利要求 18所述的影像产生方法, 其特征在于:
歩骤 (a) 是于该纯色影像上的一预设区块显示该预设标记; 以及 歩骤 (b2 ) 包含:
选择所述多个拍摄画面中,其该预设区块上具有该预设标记的多个具标记 画面。
PCT/CN2012/078920 2012-07-20 2012-07-20 影像产生方法 WO2014012242A1 (zh)

Priority Applications (6)

Application Number Priority Date Filing Date Title
EP12881426.6A EP2876545A4 (en) 2012-07-20 2012-07-20 IMAGE GENERATING METHOD
KR1020157004290A KR101665988B1 (ko) 2012-07-20 2012-07-20 영상 생성 방법
JP2015521933A JP5972462B2 (ja) 2012-07-20 2012-07-20 画像生成方法
CN201280074605.4A CN104488024B (zh) 2012-07-20 2012-07-20 影像产生方法
PCT/CN2012/078920 WO2014012242A1 (zh) 2012-07-20 2012-07-20 影像产生方法
US14/413,721 US20150228247A1 (en) 2012-07-20 2012-07-20 Image generating method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2012/078920 WO2014012242A1 (zh) 2012-07-20 2012-07-20 影像产生方法

Publications (1)

Publication Number Publication Date
WO2014012242A1 true WO2014012242A1 (zh) 2014-01-23

Family

ID=49948179

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/078920 WO2014012242A1 (zh) 2012-07-20 2012-07-20 影像产生方法

Country Status (6)

Country Link
US (1) US20150228247A1 (zh)
EP (1) EP2876545A4 (zh)
JP (1) JP5972462B2 (zh)
KR (1) KR101665988B1 (zh)
CN (1) CN104488024B (zh)
WO (1) WO2014012242A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101992837B1 (ko) * 2017-09-13 2019-09-30 주식회사 매크론 혼합현실 콘텐츠 생성 방법 및 그 장치
JP6855368B2 (ja) 2017-12-26 2021-04-07 関西テレビ放送株式会社 画像生成方法および画像合成方法
JP7267123B2 (ja) 2019-06-20 2023-05-01 日東電工株式会社 画像生成システム用光学フィルムのセット
JP7267122B2 (ja) 2019-06-20 2023-05-01 日東電工株式会社 画像生成システム用光学フィルムのセット

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101394475A (zh) * 2007-09-18 2009-03-25 鸿富锦精密工业(深圳)有限公司 影像撷取及处理装置和方法
TW201021551A (en) * 2008-11-27 2010-06-01 Inventec Corp Image generation method for a handheld electronic device
CN102098452A (zh) * 2009-12-09 2011-06-15 北京瑞诚时代投资顾问有限公司 一种通过遥控器控制的互动可视化拍照系统制作方法
TW201145143A (en) * 2010-06-14 2011-12-16 Acer Inc Wallpaper image generation method and portable electric device thereof

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0342788Y2 (zh) * 1984-12-26 1991-09-06
DE69736638T2 (de) 1996-02-01 2007-10-04 Vi[Z]Rt.Ltd Farbstanzen-Studiosystem
US6400374B2 (en) * 1996-09-18 2002-06-04 Eyematic Interfaces, Inc. Video superposition system and method
US6650771B1 (en) * 1999-11-22 2003-11-18 Eastman Kodak Company Color management system incorporating parameter control channels
FR2814309B1 (fr) * 2000-09-15 2002-10-25 France Telecom Systeme interactif audiovisuel
JP4039610B2 (ja) * 2002-04-04 2008-01-30 日本放送協会 画像合成装置およびその方法ならびに画像表示装置およびその方法
JP2005268838A (ja) * 2004-03-16 2005-09-29 Nippon Hoso Kyokai <Nhk> 映像表示装置及び映像表示制御装置
JP4933837B2 (ja) * 2006-05-23 2012-05-16 日本放送協会 時分割表示装置および映像撮影システム
KR20080006670A (ko) * 2006-07-13 2008-01-17 엠텍비젼 주식회사 텍스쳐 매핑을 이용한 영상 합성 방법 및 장치
US8045060B2 (en) * 2006-10-04 2011-10-25 Hewlett-Packard Development Company, L.P. Asynchronous camera/projector system for video segmentation
JP2008097191A (ja) * 2006-10-10 2008-04-24 Fujifilm Corp 画像合成システム
JP4753192B2 (ja) * 2008-06-27 2011-08-24 Nec液晶テクノロジー株式会社 位置合わせ用マーカ、それを用いた表示装置およびその製造方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101394475A (zh) * 2007-09-18 2009-03-25 鸿富锦精密工业(深圳)有限公司 影像撷取及处理装置和方法
TW201021551A (en) * 2008-11-27 2010-06-01 Inventec Corp Image generation method for a handheld electronic device
CN102098452A (zh) * 2009-12-09 2011-06-15 北京瑞诚时代投资顾问有限公司 一种通过遥控器控制的互动可视化拍照系统制作方法
TW201145143A (en) * 2010-06-14 2011-12-16 Acer Inc Wallpaper image generation method and portable electric device thereof

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2876545A4 *

Also Published As

Publication number Publication date
EP2876545A1 (en) 2015-05-27
JP5972462B2 (ja) 2016-08-17
KR101665988B1 (ko) 2016-10-13
EP2876545A4 (en) 2016-02-24
CN104488024A (zh) 2015-04-01
JP2015530004A (ja) 2015-10-08
KR20150038147A (ko) 2015-04-08
CN104488024B (zh) 2016-05-11
US20150228247A1 (en) 2015-08-13

Similar Documents

Publication Publication Date Title
US8212911B2 (en) Imaging apparatus, imaging system, and imaging method displaying recommendation information
EP1463310B1 (en) A projector with enhanced security camcorder defeat
WO2009141951A1 (ja) 映像撮影装置および映像符号化装置
JP7434288B2 (ja) デジタル写真用カメラと物理ディスプレイ上に示される代替画像コンテンツを同期させるための方法およびデバイス
WO2010130084A1 (zh) 远程呈现系统、方法及视频采集设备
EP1467572A2 (en) A projector with camcorder defeat
WO2021196599A1 (zh) 视频商品推送方法、装置、智慧屏和可读存储介质
CN105324993B (zh) 对多投影剧场中的内容的大小进行归一化的方法和装置以及计算机可读记录介质
JP5930276B2 (ja) 画像処理装置、画像処理方法、画像処理システム及びプログラム
WO2014012242A1 (zh) 影像产生方法
EP2936794A1 (en) Method and apparatus for forming a video sequence
US9491447B2 (en) System for providing complex-dimensional content service using complex 2D-3D content file, method for providing said service, and complex-dimensional content file therefor
JP4109580B2 (ja) 電子透かし提示装置
TWI472223B (zh) 影像產生方法
TWI493499B (zh) 影像產生方法
KR20170059310A (ko) 텔레 프레젠스 영상 송신 장치, 텔레 프레젠스 영상 수신 장치 및 텔레 프레젠스 영상 제공 시스템
CN201965308U (zh) 可立体成像及信号收发的头戴式即时录放影装置
JP6324829B2 (ja) 映像提供システムおよびプロラム
US20060050381A1 (en) Method and system for stereoscopic representation
TWM635659U (zh) 沉浸式串流影像擷取與成像之裝置
JP2014128008A (ja) 電子機器及びその制御方法
KR100792313B1 (ko) 무인 동영상 기록장치 및 그 방법
JP2005043542A (ja) 写真撮影システム
JP2013005254A (ja) 映像機器
Mills et al. BRITISH BROADCASTING CORPORATION

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201280074605.4

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12881426

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2012881426

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2015521933

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20157004290

Country of ref document: KR

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 14413721

Country of ref document: US