TWI700003B - Customized dynamic audio-visual scene generation system - Google Patents

Customized dynamic audio-visual scene generation system Download PDF

Info

Publication number
TWI700003B
TWI700003B TW106119502A TW106119502A TWI700003B TW I700003 B TWI700003 B TW I700003B TW 106119502 A TW106119502 A TW 106119502A TW 106119502 A TW106119502 A TW 106119502A TW I700003 B TWI700003 B TW I700003B
Authority
TW
Taiwan
Prior art keywords
data
image
processing unit
projection
unit
Prior art date
Application number
TW106119502A
Other languages
Chinese (zh)
Other versions
TW201904274A (en
Inventor
李霈恩
印秉宏
Original Assignee
李霈恩
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 李霈恩 filed Critical 李霈恩
Priority to TW106119502A priority Critical patent/TWI700003B/en
Priority to CN201810159788.9A priority patent/CN109040721B/en
Publication of TW201904274A publication Critical patent/TW201904274A/en
Application granted granted Critical
Publication of TWI700003B publication Critical patent/TWI700003B/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141—Constructional details thereof
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179—Video signal processing therefor
    • H04N9/3182—Colour adjustment, e.g. white balance, shading or gamut

Abstract

一種客製化動態影音場景生成系統，係至少具有一投影裝置及一運算裝置，其中該投影裝置用以將影像投影至不同的成像區，而該運算裝置係能夠與該投影裝置進行資料傳輸，其中該運算裝置係能夠將選取的投影圖像資料輸出至該投影裝置上，以透過該投影裝置將投影圖像資料投影至一具有至少一個載體的成像區上，而使用者於該載體的投影圖像上進行彩繪，並擷取該載體上彩繪完成後的影像特徵資料，之後將影像特徵資料之輪廓範圍內的顏色特徵擷取出來，再將該顏色特徵與一動態影像資料合成為一動態影像處理資料，而該動態影像處理資料能夠回存於該資料儲存單元中，並透過該投影影像輸出處理單元控制該投影裝置將該動態影像處理資料投影至另一成像區上。 A customized dynamic audio-visual scene generation system has at least one projection device and one computing device, wherein the projection device is used to project images to different imaging areas, and the computing device can perform data transmission with the projection device, The computing device is capable of outputting selected projection image data to the projection device to project the projection image data onto an imaging area with at least one carrier through the projection device, and the user’s projection on the carrier Perform color drawing on the image, and capture the image feature data after the color drawing on the carrier is completed, then extract the color features within the outline range of the image feature data, and then combine the color features and a dynamic image data into a dynamic Image processing data, and the dynamic image processing data can be stored in the data storage unit, and the projection device is controlled through the projection image output processing unit to project the dynamic image processing data onto another imaging area.

Description

客製化動態影音場景生成系統 Customized dynamic audio-visual scene generation system

本發明是有關一種客製化動態影音場景生成系統，特別是一種能夠將靜態影像轉換為動態影像之系統。 The invention relates to a customized dynamic audio-visual scene generation system, in particular to a system capable of converting static images into dynamic images.

現在為了培養兒童對於彩繪色彩及圖紋的敏感度及協調性，家長往往會購買各式彩繪工具讓小孩能夠在紙上隨意塗鴉，而目前傳統課程，也會使用的不同的彩繪工具(彩色筆、粉蠟筆或水彩等)來呈現出不同的彩繪效果及美感。 At present, in order to cultivate children’s sensitivity and coordination with painted colors and patterns, parents often buy all kinds of painting tools so that children can scribble on paper at will. At present, traditional courses also use different painting tools (color pens, Pastel or watercolor, etc.) to show different painting effects and beauty.

但由於彩繪後出來的圖像僅是靜態平面的，故缺少了動態感，也缺少了互動感，故若是能夠將彩繪後的圖像改變為動態影像，並能夠使彩繪的顏色特徵附加於動態影像，且以投影方式呈現空間中，同時可保存原畫作，將更能夠增加彩繪圖像的應用性，並提高彩繪的樂趣，如此應為一最佳解決方案。 However, since the painted image is only a static plane, it lacks a sense of dynamics and interaction. Therefore, if the painted image can be changed into a dynamic image, the color characteristics of the painted can be added to the dynamic The image is displayed in the space by projection, and the original painting can be saved. This will increase the applicability of the painted image and increase the fun of the painted image. This should be the best solution.

一種客製化動態影音場景生成系統，係至少包括：一投影裝置，用以將影像投影至成像區；一影像擷取裝置，用以擷取影像；一運算裝置，係能夠與該投影裝置及影像擷取裝置相連接，以進行資料傳輸，而該運算裝置係能夠控制該投影裝置產生的內容，且該運算裝置係至少包含：一中央處理單元， 係用以處理該運算裝置之運作；一操作暨顯示單元，係與該中央處理單元電性連接，用以顯示操作資訊並輸入控制指令之用，其中該控制指令能夠進行控制該運算裝置之運作；一資料儲存單元，係與該中央處理單元電性連接，而該資料儲存單元用以儲存數個投影圖像資料、數個對應於該投影圖像資料的動態影像資料及數個對應於該投影圖像資料的聲音資料；一投影影像輸出處理單元，係與該中央處理單元及該資料儲存單元電性連接，該投影影像輸出處理單元能夠將於該資料儲存單元中選取的投影圖像資料處理後輸出至該投影裝置上，以透過該投影裝置將投影圖像資料投影至一具有至少一個載體的成像區上；一影像擷取單元，係與該中央處理單元及影像擷取裝置電性連接，用以控制該影像擷取裝置擷取該載體上的圖像為一影像擷取資料；一影像特徵資料處理單元，係與該中央處理單元、該影像擷取單元及該資料儲存單元電性連接，該影像特徵處理單元用以能夠將該影像擷取資料之輪廓及該輪廓範圍內的顏色特徵與該原投影圖像資料進行比較，並將影像擷取資料之輪廓範圍內的顏色特徵擷取出來；以及一影像生成單元，係與該中央處理單元、該影像特徵資料處理單元、該資料儲存單元及該投影影像輸出處理單元電性連接，能夠將對應於該影像擷取資料之動態影像資料取出，並將該輪廓範圍內的顏色特徵與該動態影像資料合成為一動態影像處理資料，而該動態影像處理資料能夠回存於該資料儲存單元中，並透過該投影影像輸出處理單元將該動態影像處理資料投影至另一成像區上。 A customized dynamic audio-visual scene generation system includes at least: a projection device for projecting images to the imaging area; an image capturing device for capturing images; an arithmetic device capable of interacting with the projection device and The image capturing device is connected for data transmission, and the computing device can control the content generated by the projection device, and the computing device at least includes: a central processing unit, It is used to process the operation of the computing device; an operating and display unit is electrically connected to the central processing unit for displaying operating information and inputting control commands, wherein the control commands can control the operation of the computing device ; A data storage unit is electrically connected to the central processing unit, and the data storage unit is used to store a number of projection image data, a number of dynamic image data corresponding to the projection image data and a number of corresponding The sound data of the projected image data; a projected image output processing unit is electrically connected to the central processing unit and the data storage unit, and the projected image output processing unit is capable of converting the projected image data selected from the data storage unit After processing, output to the projection device to project the projected image data to an imaging area with at least one carrier through the projection device; an image capture unit is electrically connected to the central processing unit and the image capture device Connected to control the image capture device to capture the image on the carrier as an image capture data; an image characteristic data processing unit is connected to the central processing unit, the image capture unit and the data storage unit The image feature processing unit is used to compare the outline of the image captured data and the color features within the outline range with the original projection image data, and compare the color features within the outline range of the image captured data And an image generation unit, which is electrically connected to the central processing unit, the image characteristic data processing unit, the data storage unit, and the projection image output processing unit, and can correspond to the dynamics of the image captured data The image data is retrieved, and the color features in the outline range and the dynamic image data are combined into a dynamic image processing data, and the dynamic image processing data can be stored back in the data storage unit and output through the projection image processing unit Project the dynamic image processing data onto another imaging area.

於一較佳實施例中，該運算裝置係為一手機、一平板電腦、一電腦設備或是一主機設備。 In a preferred embodiment, the computing device is a mobile phone, a tablet computer, a computer device, or a host device.

於一較佳實施例中，該操作暨顯示單元係為顯示螢幕及操作介面，其中該顯示螢幕用以呈現操作資訊，而該操作介面用以輸入控制指令。 In a preferred embodiment, the operation and display unit is a display screen and an operation interface, wherein the display screen is used for presenting operation information, and the operation interface is used for inputting control commands.

於一較佳實施例中，該操作暨顯示單元係為觸控螢幕，其中該觸控螢幕能夠顯示操作資訊並輸入控制指令。 In a preferred embodiment, the operation and display unit is a touch screen, wherein the touch screen can display operation information and input control commands.

於一較佳實施例中，該載體係為能夠將該投影圖像資料投影於其表面上，並能夠於表面上彩繪顏色特徵的物件。 In a preferred embodiment, the carrier system is an object capable of projecting the projected image data on its surface and capable of drawing color features on the surface.

於一較佳實施例中，該資料儲存單元更儲存有數個對應於該投影圖像資料的聲音資料，而該運算裝置更包含有一與該中央處理單元及該資料儲存單元電性連接的聲音輸出單元，該聲音輸出單元能夠依據所選取的投影圖像資料控制一發聲裝置播放對應的聲音資料。 In a preferred embodiment, the data storage unit further stores a plurality of audio data corresponding to the projected image data, and the computing device further includes an audio output electrically connected to the central processing unit and the data storage unit Unit, the sound output unit can control a sound device to play corresponding sound data according to the selected projected image data.

於一較佳實施例中，更包含一與該中央處理單元電性連接的聲音擷取裝置，用以錄製客製化聲音資料，並儲存於資料儲存單元中。 In a preferred embodiment, it further includes a voice capture device electrically connected to the central processing unit for recording customized voice data and storing it in the data storage unit.

一種客製化動態影音場景生成系統，係至少包括：一投影裝置，用以將影像投影至不同的成像區；一影像擷取裝置，用以擷取影像；一運算裝置，係能夠與該投影裝置及該影像擷取裝置進行資料傳輸，而該運算裝置係能夠控制該投影裝置所投影之內容，且該運算裝置係至少包含：一中央處理單元，係用以處理該運算裝置之運作；一資料儲存單元，係與該中央處理單元電性連接，而該投影圖像資料顯示單元用以儲存數個投影圖像資料及數個對應於該投影圖像資料的動態影像資料；一操作資訊輸出單元，係與該中央處理單元電性連接，用以能夠將操作資訊輸出至該投影裝置上，而該投影裝置能夠將該操作資訊投影至一操作成像區上；一操作偵測單元，係與該中央處理單元電性連接，用以控制一感測器偵測該投影裝置上所投影之操作資訊的接觸位置，並 依據該操作資訊的接觸位置轉換為一控制指令輸入，而該控制指令能夠進行控制該運算裝置之運作；一資料儲存單元，係與該中央處理單元電性連接，而該資料儲存單元用以儲存數個投影圖像資料、數個對應於該投影圖像資料的動態影像資料及數個對應於該投影圖像資料的聲音資料；一投影影像輸出處理單元，係與該中央處理單元及該資料儲存單元電性連接，該投影影像輸出處理單元能夠將於該資料儲存單元中選取的投影圖像資料處理後輸出至該投影裝置上，以透過該投影裝置將投影圖像資料投影至一具有至少一個載體的成像區上；一影像擷取單元，係與該中央處理單元及影像擷取裝置電性連接，用以控制該影像擷取裝置擷取該載體上的圖像為一影像擷取資料；一影像特徵資料處理單元，係與該中央處理單元、該影像擷取單元及該資料儲存單元電性連接，該影像特徵處理單元用以能夠將該影像擷取資料之輪廓及該輪廓範圍內的顏色特徵與該原投影圖像資料進行比較，並將影像擷取資料之輪廓範圍內的顏色特徵擷取出來；以及一影像生成單元，係與該中央處理單元、該影像特徵資料處理單元、該資料儲存單元及該投影影像輸出處理單元電性連接，能夠將對應於該影像擷取資料之動態影像資料取出，並將該輪廓範圍內的顏色特徵與該動態影像資料合成為一動態影像處理資料，而該動態影像處理資料能夠回存於該資料儲存單元中，並透過該投影影像輸出處理單元將該動態影像處理資料投影至另一成像區上。 A customized dynamic audio-visual scene generation system includes at least: a projection device for projecting images to different imaging areas; an image capturing device for capturing images; and a computing device capable of interacting with the projection The device and the image capturing device perform data transmission, and the computing device can control the content projected by the projection device, and the computing device at least includes: a central processing unit for processing the operation of the computing device; The data storage unit is electrically connected to the central processing unit, and the projection image data display unit is used to store a plurality of projection image data and a plurality of dynamic image data corresponding to the projection image data; an operation information output The unit is electrically connected to the central processing unit for outputting operation information to the projection device, and the projection device can project the operation information onto an operation imaging area; an operation detection unit is connected to The central processing unit is electrically connected to control a sensor to detect the contact position of the operation information projected on the projection device, and The contact position based on the operation information is converted into a control command input, and the control command can control the operation of the computing device; a data storage unit is electrically connected to the central processing unit, and the data storage unit is used for storing Several projected image data, several dynamic image data corresponding to the projected image data, and several sound data corresponding to the projected image data; a projected image output processing unit is associated with the central processing unit and the data The storage unit is electrically connected, and the projection image output processing unit can process the projection image data selected in the data storage unit and output to the projection device, so as to project the projection image data to a projection device with at least On the imaging area of a carrier; an image capture unit is electrically connected to the central processing unit and the image capture device, and is used to control the image capture device to capture the image on the carrier as an image capture data ; An image feature data processing unit is electrically connected to the central processing unit, the image capture unit and the data storage unit, the image feature processing unit is used to be able to capture the outline of the image data and the outline range Compare the color characteristics of the original projection image data with the original projection image data, and extract the color characteristics within the outline range of the image captured data; and an image generation unit is connected to the central processing unit, the image characteristic data processing unit, The data storage unit and the projection image output processing unit are electrically connected, and can extract the dynamic image data corresponding to the image capture data, and synthesize the color characteristics in the outline range with the dynamic image data into a dynamic image processing Data, and the dynamic image processing data can be stored back in the data storage unit, and the dynamic image processing data can be projected onto another imaging area through the projection image output processing unit.

於一較佳實施例中，該運算裝置係為手機、平板電腦、電腦設備或是主機設備。 In a preferred embodiment, the computing device is a mobile phone, a tablet computer, a computer device, or a host device.

於一較佳實施例中，該感測器係為影像感測器、超音波感測器、紅外線感測器、雷射感測器。 In a preferred embodiment, the sensor is an image sensor, an ultrasonic sensor, an infrared sensor, or a laser sensor.

於一較佳實施例中，該載體係為能夠將該投影圖像資料投影於其表面上，並能夠於表面上彩繪顏色特徵的物件。 In a preferred embodiment, the carrier system is an object capable of projecting the projected image data on its surface and capable of drawing color features on the surface.

於一較佳實施例中，該資料儲存單元更儲存有數個對應於該投影圖像資料的聲音資料，而該運算裝置更包含有一與該中央處理單元及該資料儲存單元電性連接的聲音輸出單元，該聲音輸出單元能夠依據所選取的投影圖像資料控制一發聲裝置播放對應的聲音資料。 In a preferred embodiment, the data storage unit further stores a plurality of audio data corresponding to the projected image data, and the computing device further includes an audio output electrically connected to the central processing unit and the data storage unit Unit, the sound output unit can control a sound device to play corresponding sound data according to the selected projected image data.

於一較佳實施例中，更包含一與該中央處理單元電性連接的聲音擷取裝置，用以錄製客製化聲音資料，並儲存於資料儲存單元中。 In a preferred embodiment, it further includes a voice capture device electrically connected to the central processing unit for recording customized voice data and storing it in the data storage unit.

1:投影裝置 1: Projection device

2:運算裝置 2: Computing device

201:中央處理單元 201: Central Processing Unit

202:操作暨顯示單元 202: Operation and display unit

203:資料儲存單元 203: data storage unit

204:投影影像輸出處理單元 204: Projection image output processing unit

205:影像擷取單元 205: Image capture unit

206:影像特徵資料處理單元 206: Image feature data processing unit

207:影像生成單元 207: Image generation unit

208:聲音輸出單元 208: Sound output unit

209:操作資訊輸出單元 209: Operation information output unit

210:操作偵測單元 210: Operation detection unit

31:成像區 31: imaging area

32:成像區 32: imaging area

4:載體 4: carrier

41:圖像資料 41: image data

42:顏色彩繪 42: color painting

5:動態影像處理資料 5: Dynamic image processing data

6:影像擷取裝置 6: Image capture device

7:聲音擷取裝置 7: Voice capture device

8:發聲裝置 8: Sounding device

[第1圖]係本發明客製化動態影音場景生成系統之整體架構示意圖。 [Figure 1] is a schematic diagram of the overall architecture of the customized dynamic audio-visual scene generation system of the present invention.

[第2圖]係本發明客製化動態影音場景生成系統之運算裝置之架構示意圖。 [Figure 2] is a schematic diagram of the architecture of the computing device of the customized dynamic audio-visual scene generation system of the present invention.

[第3圖]係本發明客製化動態影音場景生成系統之於載體上彩繪之實施示意圖。 [Figure 3] is a schematic diagram of the implementation of color drawing on the carrier of the customized dynamic audio-visual scene generation system of the present invention.

[第4A圖]係本發明客製化動態影音場景生成系統之投影動態影像之實施示意圖。 [Figure 4A] is a schematic diagram of the implementation of the projected dynamic image of the customized dynamic audio-visual scene generating system of the present invention.

[第4B圖]係本發明客製化動態影音場景生成系統之投影動態影像之實施示意圖。 [Figure 4B] is a schematic diagram of the implementation of the projected dynamic image of the customized dynamic audio-visual scene generating system of the present invention.

[第4C圖]係本發明客製化動態影音場景生成系統之投影動態影像之實施示意圖。 [Figure 4C] is a schematic diagram of the implementation of the projected dynamic image of the customized dynamic audio-visual scene generating system of the present invention.

[第5A圖]係本發明客製化動態影音場景生成系統之投影動態影像之另一實施示意圖。 [Figure 5A] is another schematic diagram of the projected dynamic image of the customized dynamic audio-visual scene generating system of the present invention.

[第5B圖]係本發明客製化動態影音場景生成系統之投影動態影像之另一實施示意圖。 [Figure 5B] is another schematic diagram of the projected dynamic image of the customized dynamic audio-visual scene generating system of the present invention.

[第6圖]係本發明客製化動態影音場景生成系統之運算裝置之另一架構示意圖。 [Figure 6] is another schematic diagram of the architecture of the computing device of the customized dynamic audio-visual scene generation system of the present invention.

有關於本發明其他技術內容、特點與功效，在以下配合參考圖式之較佳實施例的詳細說明中，將可清楚的呈現。 The other technical content, features and effects of the present invention will be clearly presented in the following detailed description of the preferred embodiment with reference to the drawings.

如第1~2圖所示，為本發明客製化動態影音場景生成系統之整體架構示意圖及運算裝置之架構示意圖，由圖中可知，本發明之客製化動態影音場景生成系統係具有一投影裝置1、一運算裝置2、一影像擷取裝置6、一聲音擷取裝置7及一發聲裝置8，其中該運算裝置2係為一可攜式運算裝置、一平板電腦、一電腦設備或是一主機設備；該影像擷取裝置6可為攝影鏡頭，係與該運算裝置2電性連接，可接受來自運算裝置2的控制信號，並將所擷取的影像送回該運算裝置2；該聲音擷取裝置7可為麥克風，主要是讓使用者預錄聲音，並將信號傳送至該運算裝置2；該發聲裝置8可為喇叭，主要係依照該運算裝置2所傳送的控制信號進行聲音的播放；該運算裝置2係能夠與該投影裝置1進行資料傳輸，而該運算裝置2係能夠控制該投影裝置1所投影之內容，且該運算裝置2係包含一中央處理單元201、一操作暨顯示單元202、一資料儲存單元203、一投影影像輸出處理單元204、一影像擷取單元205、一影像特徵資料處理單元206、一影像生成單元207及一聲音輸出單元208； 其中該中央處理單元201用以處理該運算裝置2之運作，而該操作暨顯示單元202用以顯示操作資訊並輸入控制指令之用，其中該控制指令能夠進行控制該運算裝置2之運作，且該操作暨顯示單元202係能夠為顯示螢幕及操作介面，其中該顯示螢幕用以操作資訊，而該操作介面用以輸入控制指令，抑或能夠是單純能夠顯示操作資訊並輸入控制指令的觸控螢幕；其中該資料儲存單元203用以儲存數個投影圖像資料、數個對應於該投影圖像資料的動態影像資料及數個對應於該投影圖像資料的聲音資料；其中該投影影像輸出處理單元204能夠將該操作暨顯示單元202於該資料儲存單元203中選取的投影圖像資料輸出至該投影裝置1上，以透過該投影裝置1將投影圖像資料投影至一具有至少一個載體4的成像區31上，如第3圖所示，該載體4上能呈現要提供彩繪的圖像資料41，該圖像資料41具有輪廓區域，供使用者能夠於該輪廓區域內進行顏色彩繪42。另外，該載體4可為一物件，該物件係為布、紙、塑料、木材、石材或金屬其中之一或其結合；之後，透過該影像擷取單元205控制該影像擷取裝置6擷取該載體4上的圖像資料41為一影像擷取資料，而該影像特徵資料處理單元206能夠將該影像擷取資料之輪廓區域及該輪廓區域範圍內的顏色特徵與該投影圖像資料進行比較，並將影像擷取資料之輪廓範圍內的顏色特徵擷取出來；最後，透過該影像生成單元207將對應於該影像擷取資料之動態影像資料取出，並將該輪廓區域範圍內的顏色特徵與該動態影像資料合成為一動態影像處理資料，而該動態影像處理資料能夠回存於該資料儲存單元203中，並控制該投影裝置1將該動態影像處理資料投影至另一成像區上，如第4A~4C圖所示，將動態影像處理資料5投影至該成像區32(牆壁壁面)上，則會於該 成像區32上播放具有顏色特徵的滿月(如第4A圖所示)，而滿月會逐漸變成半弦月(如第4B圖所示)，最後變成如第4C圖的弦月，而且該圖像資料41所生成的動態影像處理資料5除了可做形態的動態變化處理外，亦可做位移動態變化處理，如第5A、B圖所示，該動態影像處理資料5(星星)由A位置移動到B位置；另外，該彩繪圖案41在形態或位移的動態變化處理過程中，該聲音輸出單元208能夠依據所選取的投影圖像資料控制該發聲裝置8進行播放對應的聲音資料，故除了影像的動態變化之外，更有聲音的配合，以形成整體類似於影片播放的效果。 As shown in Figures 1 to 2, it is a schematic diagram of the overall architecture of the customized dynamic audio-visual scene generation system and the architecture of the computing device of the present invention. It can be seen from the figure that the customized dynamic audio-visual scene generation system of the present invention has a Projection device 1, a computing device 2, an image capturing device 6, a sound capturing device 7 and a sound generating device 8, wherein the computing device 2 is a portable computing device, a tablet computer, a computer device or Is a host device; the image capturing device 6 can be a photographic lens, which is electrically connected to the computing device 2, can receive control signals from the computing device 2, and send the captured image back to the computing device 2; The sound capturing device 7 can be a microphone, which mainly allows users to pre-record the sound and transmit the signal to the computing device 2; the sounding device 8 can be a speaker, mainly based on the control signal sent by the computing device 2 Sound playback; the computing device 2 can transmit data with the projection device 1, and the computing device 2 can control the content projected by the projection device 1, and the computing device 2 includes a central processing unit 201, a Operation and display unit 202, a data storage unit 203, a projection image output processing unit 204, an image capture unit 205, an image characteristic data processing unit 206, an image generation unit 207, and a sound output unit 208; The central processing unit 201 is used to process the operation of the arithmetic device 2, and the operation and display unit 202 is used to display operation information and input control commands, wherein the control command can control the operation of the arithmetic device 2, and The operation and display unit 202 can be a display screen and an operation interface, wherein the display screen is used to operate information, and the operation interface is used to input control commands, or it can be a touch screen that can simply display operation information and input control commands ; Wherein the data storage unit 203 is used to store a plurality of projected image data, a number of dynamic image data corresponding to the projected image data and a number of sound data corresponding to the projected image data; wherein the projected image output processing The unit 204 can output the projection image data selected by the operation and display unit 202 in the data storage unit 203 to the projection device 1, so as to project the projection image data to a carrier 4 with at least one carrier through the projection device 1. As shown in Fig. 3, the image data 41 to be painted can be displayed on the imaging area 31 of the carrier 4. The image data 41 has an outline area for the user to perform color painting 42 in the outline area. . In addition, the carrier 4 may be an object, the object is one of cloth, paper, plastic, wood, stone, or metal, or a combination thereof; afterwards, the image capturing unit 205 controls the image capturing device 6 to capture The image data 41 on the carrier 4 is an image capture data, and the image feature data processing unit 206 can compare the contour area of the image capture data and the color features within the contour area with the projection image data. Compare and extract the color features within the outline range of the image captured data; finally, through the image generating unit 207, extract the dynamic image data corresponding to the image captured data, and extract the color within the outline region The feature and the dynamic image data are combined into a dynamic image processing data, and the dynamic image processing data can be stored in the data storage unit 203, and the projection device 1 is controlled to project the dynamic image processing data onto another imaging area , As shown in Figures 4A~4C, the dynamic image processing data 5 is projected onto the imaging area 32 (wall surface), The full moon with color characteristics (as shown in Figure 4A) is played on the imaging area 32, and the full moon will gradually become a half moon (as shown in Figure 4B), and finally become a quarter moon as shown in Figure 4C, and the image The dynamic image processing data 5 generated by the data 41 can not only be processed for dynamic change of form, but also can be processed for dynamic change of displacement. As shown in Figures 5A and B, the dynamic image processing data 5 (star) moves from position A To position B; in addition, the sound output unit 208 can control the sound device 8 to play the corresponding sound data according to the selected projected image data during the dynamic change processing of the shape or displacement of the painted pattern 41, so in addition to the image In addition to the dynamic changes, there is more sound coordination to form an overall effect similar to movie playback.

另外，使用者亦可自行透過該聲音擷取裝置7錄製聲音資料於運算裝置2中儲存，已播放客製化的影音資料。 In addition, the user can record audio data through the audio capture device 7 and store it in the computing device 2, and the customized audio-visual data has been played.

另外，該運算裝置2亦能夠為不具有螢幕的主機類的裝置，僅須連上該投影裝置1就能夠使用，如第6圖所示，該運算裝置2增加了該操作資訊輸出單元209及該操作偵測單元210，其中該操作資訊輸出單元209用以能夠將操作資訊輸出至該投影裝置上，而該投影裝置能夠將該操作資訊投影至一成像區上，而該操作偵測單元210用以偵測該投影裝置1上所投影之操作資訊的接觸位置，並依據該操作資訊的接觸位置轉換為一控制指令，而該控制指令能夠進行控制該運算裝置2之運作，另外該操作偵測單元210係能夠為用以偵測手勢動作或空間物件變化的鏡頭或是感測器，該感測器可為影像感測器、超音波感測器、紅外線感測器、雷射感測器。 In addition, the arithmetic device 2 can also be a host device without a screen, which can be used only by connecting to the projection device 1. As shown in Fig. 6, the arithmetic device 2 adds the operation information output unit 209 and The operation detection unit 210, wherein the operation information output unit 209 can output operation information to the projection device, and the projection device can project the operation information onto an imaging area, and the operation detection unit 210 It is used to detect the contact position of the operation information projected on the projection device 1, and convert the contact position according to the operation information into a control command, and the control command can control the operation of the computing device 2. In addition, the operation detection The sensing unit 210 can be a lens or a sensor used to detect gestures or changes in spatial objects. The sensor can be an image sensor, an ultrasonic sensor, an infrared sensor, or a laser sensor. Device.

本發明所提供之客製化動態影音場景生成系統，與其他習用技術相互比較時，其優點如下： When compared with other conventional technologies, the customized dynamic audio-visual scene generation system provided by the present invention has the following advantages:

1.本發明能夠將彩繪後的靜態圖像轉變為更豐富的動態影像場景，並能 夠使彩繪的顏色特徵附加於動態影像，將更能夠增加彩繪圖像的應用性，並提高彩繪的樂趣與學習效果。 1. The present invention can transform a painted static image into a richer dynamic image scene, and can Enough to add the color characteristics of the painting to the dynamic image will be able to increase the applicability of the painting image and improve the fun and learning effect of the painting.

2.本發明更能夠將動態影像搭配聲音，以達到影片的播放效果，故能夠大幅提高彩繪整體場景的氣氛與情緒張力。 2. The present invention can match dynamic images with sound to achieve the playback effect of the movie, so it can greatly improve the atmosphere and emotional tension of the overall scene of colorful painting.

3.本發明可融合知名故事內容，讓孩童成為故事角色的導演，創作出屬於自己喜好的動畫故事，並且可讓更多人同時欣賞，從中獲得更高成就感及樂趣。 3. The present invention can integrate well-known story content, make children become directors of story characters, create animation stories of their own preferences, and allow more people to appreciate them at the same time, and obtain a higher sense of accomplishment and fun from them.

4.本發明可與數學或語文或其他各類的知識性教材進行結合，增進孩童的學習動機，加速孩童學習上的增長，達到寓教於樂的效果。 4. The present invention can be combined with mathematics or Chinese or other kinds of knowledge teaching materials to enhance children's learning motivation, accelerate children's learning growth, and achieve the effect of entertaining and entertaining.

5.本發明已透過上述之實施例揭露如上，然其並非用以限定本發明，任何熟悉此一技術領域具有通常知識者，在瞭解本發明前述的技術特徵及實施例，並在不脫離本發明之精神和範圍內，不可作些許之更動與潤飾，因此本發明之專利保護範圍須視本說明書所附之請求項所界定者為準。 5. The present invention has been disclosed above through the above-mentioned embodiments, but it is not intended to limit the present invention. Anyone familiar with this technical field with ordinary knowledge should understand the aforementioned technical features and embodiments of the present invention without departing from this Within the spirit and scope of the invention, no changes or modifications can be made. Therefore, the patent protection scope of the invention shall be subject to the definition of the claims attached to this specification.

1:投影裝置 1: Projection device

2:運算裝置 2: Computing device

6:影像擷取裝置 6: Image capture device

7:聲音擷取裝置 7: Voice capture device

8:發生裝置 8: Generating device

Claims (10)

一種客製化動態影音場景生成系統，係至少包括：一投影裝置，用以將影像投影至成像區；一影像擷取裝置，用以擷取影像；一運算裝置，係能夠與該投影裝置及影像擷取裝置相連接，以進行資料傳輸，而該運算裝置係能夠控制該投影裝置產生的內容，且該運算裝置係至少包含：一中央處理單元，係用以處理該運算裝置之運作；一操作暨顯示單元，係與該中央處理單元電性連接，用以顯示操作資訊並輸入控制指令之用，其中該控制指令能夠進行控制該運算裝置之運作；一資料儲存單元，係與該中央處理單元電性連接，而該資料儲存單元用以儲存數個投影圖像資料、數個對應於該投影圖像資料的動態影像資料及數個對應於該投影圖像資料的聲音資料；一投影影像輸出處理單元，係與該中央處理單元及該資料儲存單元電性連接，該投影影像輸出處理單元能夠將於該資料儲存單元中選取的投影圖像資料處理後輸出至該投影裝置上，以透過該投影裝置將投影圖像資料投影至一具有至少一個載體的成像區上，而該載體係為能夠將該投影圖像資料投影於其表面上，並能夠於表面上彩繪顏色特徵的物件；一影像擷取單元，係與該中央處理單元及影像擷取裝置電性連接，用以控制該影像擷取裝置擷取該載體上的圖像為一影像擷取資料； 一影像特徵資料處理單元，係與該中央處理單元、該影像擷取單元及該資料儲存單元電性連接，該影像特徵處理單元用以能夠將該影像擷取資料之輪廓及該輪廓範圍內的顏色特徵與該原投影圖像資料進行比較，並將影像擷取資料之輪廓範圍內的顏色特徵擷取出來；以及一影像生成單元，係與該中央處理單元、該影像特徵資料處理單元、該資料儲存單元及該投影影像輸出處理單元電性連接，能夠將對應於該影像擷取資料之動態影像資料取出，並將該輪廓範圍內的顏色特徵與該動態影像資料合成為一動態影像處理資料，而該動態影像處理資料能夠回存於該資料儲存單元中，並透過該投影影像輸出處理單元將該動態影像處理資料投影至另一成像區上。 A customized dynamic audio-visual scene generation system includes at least: a projection device for projecting images to the imaging area; an image capturing device for capturing images; an arithmetic device capable of interacting with the projection device and The image capture device is connected for data transmission, and the computing device can control the content generated by the projection device, and the computing device at least includes: a central processing unit for processing the operation of the computing device; The operation and display unit is electrically connected to the central processing unit for displaying operation information and inputting control commands, wherein the control commands can control the operation of the computing device; a data storage unit is connected to the central processing unit The unit is electrically connected, and the data storage unit is used to store a plurality of projection image data, a plurality of dynamic image data corresponding to the projection image data, and a plurality of audio data corresponding to the projection image data; a projection image The output processing unit is electrically connected to the central processing unit and the data storage unit. The projection image output processing unit can process the projected image data selected in the data storage unit and output it to the projection device to pass The projection device projects the projected image data onto an imaging area with at least one carrier, and the carrier system is an object capable of projecting the projected image data on the surface and drawing color features on the surface; The image capture unit is electrically connected to the central processing unit and the image capture device, and is used to control the image capture device to capture the image on the carrier as an image capture data; An image feature data processing unit is electrically connected to the central processing unit, the image capturing unit, and the data storage unit. The image feature processing unit is used to capture the outline of the image data and the outline of the outline. The color feature is compared with the original projection image data, and the color feature within the outline range of the image captured data is extracted; and an image generation unit is connected to the central processing unit, the image feature data processing unit, and the The data storage unit and the projection image output processing unit are electrically connected, and can extract the dynamic image data corresponding to the image capture data, and synthesize the color characteristics in the outline range and the dynamic image data into a dynamic image processing data , And the dynamic image processing data can be stored back in the data storage unit, and the dynamic image processing data can be projected onto another imaging area through the projection image output processing unit. 如請求項1所述之客製化動態影音場景生成系統，其中該運算裝置係為一手機、一平板電腦、一電腦設備或是一主機設備。 The customized dynamic audio-visual scene generation system according to claim 1, wherein the computing device is a mobile phone, a tablet computer, a computer device or a host device. 如請求項1所述之客製化動態影音場景生成系統，其中該操作暨顯示單元係為顯示螢幕及操作介面，其中該顯示螢幕用以呈現操作資訊，而該操作介面用以輸入控制指令。 The customized dynamic audio-visual scene generation system according to claim 1, wherein the operation and display unit is a display screen and an operation interface, wherein the display screen is used for presenting operation information, and the operation interface is used for inputting control commands. 如請求項1所述之客製化動態影音場景生成系統，其中該操作暨顯示單元係為觸控螢幕，其中該觸控螢幕能夠顯示操作資訊並輸入控制指令。 The customized dynamic audio-visual scene generation system according to claim 1, wherein the operation and display unit is a touch screen, wherein the touch screen can display operation information and input control commands. 如請求項1所述之客製化動態影音場景生成系統，其中該資料儲存單元更儲存有數個對應於該投影圖像資料的聲音資料，而該運算裝 置更包含有一與該中央處理單元及該資料儲存單元電性連接的聲音輸出單元，該聲音輸出單元能夠依據所選取的投影圖像資料控制一發聲裝置播放對應的聲音資料。 The customized dynamic audio-visual scene generation system according to claim 1, wherein the data storage unit further stores a plurality of audio data corresponding to the projected image data, and the computing device The device further includes a sound output unit electrically connected to the central processing unit and the data storage unit, and the sound output unit can control a sound device to play corresponding sound data according to the selected projected image data. 如請求項1所述之客製化動態影音場景生成系統，更包含一與該中央處理單元電性連接的聲音擷取裝置，用以錄製客製化聲音資料，並儲存於資料儲存單元中。 The customized dynamic audio-visual scene generation system described in claim 1 further includes a voice capture device electrically connected to the central processing unit for recording customized voice data and storing it in the data storage unit. 一種客製化動態影音場景生成系統，係至少包括：一投影裝置，用以將影像投影至不同的成像區；一影像擷取裝置，用以擷取影像；一運算裝置，係能夠與該投影裝置及該影像擷取裝置進行資料傳輸，而該運算裝置係能夠控制該投影裝置所投影之內容，且該運算裝置係至少包含：一中央處理單元，係用以處理該運算裝置之運作；一資料儲存單元，係與該中央處理單元電性連接，而該投影圖像資料顯示單元用以儲存數個投影圖像資料及數個對應於該投影圖像資料的動態影像資料；一操作資訊輸出單元，係與該中央處理單元電性連接，用以能夠將操作資訊輸出至該投影裝置上，而該投影裝置能夠將該操作資訊投影至一操作成像區上；一操作偵測單元，係與該中央處理單元電性連接，用以控制一感測器偵測該投影裝置上所投影之操作資訊的接觸位置，並依據該操作資訊的接觸位 置轉換為一控制指令輸入，而該控制指令能夠進行控制該運算裝置之運作；一資料儲存單元，係與該中央處理單元電性連接，而該資料儲存單元用以儲存數個投影圖像資料、數個對應於該投影圖像資料的動態影像資料及數個對應於該投影圖像資料的聲音資料；一投影影像輸出處理單元，係與該中央處理單元及該資料儲存單元電性連接，該投影影像輸出處理單元能夠將於該資料儲存單元中選取的投影圖像資料處理後輸出至該投影裝置上，以透過該投影裝置將投影圖像資料投影至一具有至少一個載體的成像區上，而該載體係為能夠將該投影圖像資料投影於其表面上，並能夠於表面上彩繪顏色特徵的物件；一影像擷取單元，係與該中央處理單元及影像擷取裝置電性連接，用以控制該影像擷取裝置擷取該載體上的圖像為一影像擷取資料；一影像特徵資料處理單元，係與該中央處理單元、該影像擷取單元及該資料儲存單元電性連接，該影像特徵處理單元用以能夠將該影像擷取資料之輪廓及該輪廓範圍內的顏色特徵與該原投影圖像資料進行比較，並將影像擷取資料之輪廓範圍內的顏色特徵擷取出來；以及一影像生成單元，係與該中央處理單元、該影像特徵資料處理單元、該資料儲存單元及該投影影像輸出處理單元電性連接，能夠將對應於該影像擷取資料之動態影像資料取出，並將該輪廓範圍內的顏色特徵與該動態影像資料合成為一動態影像處理資料，而該動態影像處理資料能夠回存於該資 料儲存單元中，並透過該投影影像輸出處理單元將該動態影像處理資料投影至另一成像區上。 A customized dynamic audio-visual scene generation system includes at least: a projection device for projecting images to different imaging areas; an image capturing device for capturing images; and a computing device capable of interacting with the projection The device and the image capturing device perform data transmission, and the computing device can control the content projected by the projection device, and the computing device at least includes: a central processing unit for processing the operation of the computing device; The data storage unit is electrically connected to the central processing unit, and the projection image data display unit is used to store a plurality of projection image data and a plurality of dynamic image data corresponding to the projection image data; an operation information output The unit is electrically connected to the central processing unit for outputting operation information to the projection device, and the projection device can project the operation information onto an operation imaging area; an operation detection unit is connected to The central processing unit is electrically connected to control a sensor to detect the contact position of the operation information projected on the projection device, and according to the contact position of the operation information The setting is converted into a control command input, and the control command can control the operation of the arithmetic device; a data storage unit is electrically connected to the central processing unit, and the data storage unit is used to store several projection image data A plurality of dynamic image data corresponding to the projected image data and a plurality of audio data corresponding to the projected image data; a projection image output processing unit is electrically connected to the central processing unit and the data storage unit, The projection image output processing unit can process the projection image data selected in the data storage unit and output to the projection device, so as to project the projection image data onto an imaging area with at least one carrier through the projection device , And the carrier system is an object capable of projecting the projected image data on its surface and painting color features on the surface; an image capturing unit is electrically connected to the central processing unit and the image capturing device , Used to control the image capture device to capture the image on the carrier as an image capture data; an image characteristic data processing unit is electrically connected to the central processing unit, the image capture unit and the data storage unit Connected, the image feature processing unit is used to compare the outline of the image captured data and the color features within the outline range with the original projected image data, and capture the color features within the outline range of the image captured data Taken out; and an image generation unit, which is electrically connected with the central processing unit, the image characteristic data processing unit, the data storage unit, and the projection image output processing unit, and can convert the dynamic image corresponding to the image capture data The data is retrieved, and the color features in the outline range and the dynamic image data are combined into a dynamic image processing data, and the dynamic image processing data can be restored in the resource The dynamic image processing data is projected onto another imaging area through the projection image output processing unit. 如請求項7所述之客製化動態影音場景生成系統，其中該運算裝置係為手機、平板電腦、電腦設備或是主機設備。 The customized dynamic audio-visual scene generation system according to claim 7, wherein the computing device is a mobile phone, a tablet computer, a computer device or a host device. 如請求項7所述之客製化動態影音場景生成系統，其中該資料儲存單元更儲存有數個對應於該投影圖像資料的聲音資料，而該運算裝置更包含有一與該中央處理單元及該資料儲存單元電性連接的聲音輸出單元，該聲音輸出單元能夠依據所選取的投影圖像資料控制一發聲裝置播放對應的聲音資料。 The customized dynamic audio-visual scene generating system according to claim 7, wherein the data storage unit further stores a plurality of sound data corresponding to the projected image data, and the computing device further includes a connection with the central processing unit and the A sound output unit electrically connected to the data storage unit, and the sound output unit can control a sound device to play corresponding sound data according to the selected projected image data. 如請求項7所述之客製化動態影音場景生成系統，更包含一與該中央處理單元電性連接的聲音擷取裝置，用以錄製客製化聲音資料，並儲存於資料儲存單元中。 The customized dynamic audio-visual scene generation system described in claim 7 further includes a voice capture device electrically connected to the central processing unit for recording customized voice data and storing it in the data storage unit.
TW106119502A 2017-06-12 2017-06-12 Customized dynamic audio-visual scene generation system TWI700003B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
TW106119502A TWI700003B (en) 2017-06-12 2017-06-12 Customized dynamic audio-visual scene generation system
CN201810159788.9A CN109040721B (en) 2017-06-12 2018-02-26 Customized dynamic audio-visual scene generation system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW106119502A TWI700003B (en) 2017-06-12 2017-06-12 Customized dynamic audio-visual scene generation system

Publications (2)

Publication Number Publication Date
TW201904274A TW201904274A (en) 2019-01-16
TWI700003B true TWI700003B (en) 2020-07-21

Family

ID=64629302

Family Applications (1)

Application Number Title Priority Date Filing Date
TW106119502A TWI700003B (en) 2017-06-12 2017-06-12 Customized dynamic audio-visual scene generation system

Country Status (2)

Country Link
CN (1) CN109040721B (en)
TW (1) TWI700003B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201665111U (en) * 2009-09-04 2010-12-08 范学文 Sand-painting device
CN102480621A (en) * 2010-11-29 2012-05-30 扬智科技股份有限公司 Method for converting two dimensional (2D) film into three dimensional (3D) film and apparatus thereof
TW201317900A (en) * 2011-10-19 2013-05-01 Pixart Imaging Inc Image reading device and image reading system
CN103793891A (en) * 2012-10-26 2014-05-14 海法科技有限公司 Low-complexity panorama image joint method
TW201541407A (en) * 2014-04-21 2015-11-01 Tsu-Li Yang Method for generating three-dimensional information from identifying two-dimensional images
TW201616443A (en) * 2014-10-20 2016-05-01 陳金仁 A method, apparatus and computer program product for real-time images synthesizing

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201178467Y (en) * 2007-12-27 2009-01-07 黄振强 Interactive floor/wall system
TWI465959B (en) * 2011-04-28 2014-12-21 Teco Image Sys Co Ltd Interactive image projection system and interactive method for image projection system
JP6340958B2 (en) * 2014-07-02 2018-06-13 株式会社リコー Projector apparatus, interactive system, and interactive control method
CN104765614B (en) * 2015-04-24 2018-04-10 广东小天才科技有限公司 Color in processing method and processing device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201665111U (en) * 2009-09-04 2010-12-08 范学文 Sand-painting device
CN102480621A (en) * 2010-11-29 2012-05-30 扬智科技股份有限公司 Method for converting two dimensional (2D) film into three dimensional (3D) film and apparatus thereof
TW201317900A (en) * 2011-10-19 2013-05-01 Pixart Imaging Inc Image reading device and image reading system
CN103793891A (en) * 2012-10-26 2014-05-14 海法科技有限公司 Low-complexity panorama image joint method
TW201541407A (en) * 2014-04-21 2015-11-01 Tsu-Li Yang Method for generating three-dimensional information from identifying two-dimensional images
TW201616443A (en) * 2014-10-20 2016-05-01 陳金仁 A method, apparatus and computer program product for real-time images synthesizing

Also Published As

Publication number Publication date
CN109040721B (en) 2021-04-06
CN109040721A (en) 2018-12-18
TW201904274A (en) 2019-01-16

Similar Documents

Publication Publication Date Title
CN101523482B (en) Display device, display method, information recording medium and program
JP7242546B2 (en) Display processing device, display processing method, and program
JPWO2012173001A1 (en) Information input device
US20180197345A1 (en) Augmented reality technology-based handheld viewing device and method thereof
US20120113104A1 (en) Table type interactive 3d system
CN106652656A (en) Learning and playing method and device by means of virtual musical instrument and glasses or helmet using the same
TWI674529B (en) Mixed reality assembly and method of forming mixed reality
TW201029345A (en) Remote controller and function-setting and operating method of the same
JP6431259B2 (en) Karaoke device, dance scoring method, and program
US20140310640A1 (en) Interactive digital art apparatus
WO2016031254A1 (en) Information processing device, information processing system, information processing method, and program
TWI700003B (en) Customized dynamic audio-visual scene generation system
KR101192314B1 (en) System for Realistic 3D Game
US20220375362A1 (en) Virtual tutorials for musical instruments with finger tracking in augmented reality
JP2917404B2 (en) Audio signal generator
JP5318016B2 (en) GAME SYSTEM, GAME SYSTEM CONTROL METHOD, AND PROGRAM
CN201716666U (en) Multimedia interactive device for utilizing sound to detect and control images
TWM559424U (en) Customized animated video audio scene generation system
TW201839723A (en) Interactive animation display system
KR20200060202A (en) Implementing method and apparatus for children's story based on augmented reality
KR20180033738A (en) Detachable Touch Panel Device Equipped with Diplay Device
TW201316301A (en) Interactive teaching system and method
WO2018155234A1 (en) Control device, control method, program, and projection system
Ryokai et al. Tangible video bubbles
Setthawong et al. Extending a standard tablet into an ocarina playing gaming platform with projected parallax layers