JP3060617U - Image synthesis output device with voice synthesis output function - Google Patents

Abstract

(57) [Summary] [Problem] To be able to handle both images and sounds,
An image synthesizing output device with a voice synthesizing output function capable of giving a user a sense of realism from both eyes and ears.
To enable free editing and processing in addition to display and playback of image data and audio data. SOLUTION: Recording means for recording a user's voice and storing the same in a memory, sound data storage means for storing a plurality of sound data such as background sounds and background music, and a plurality of sounds stored in the sound data storage means A sound synthesis output for synthesizing sound data selected by the user among the data and voice data of the user recorded by the recording means is provided. In addition, the synthesized image data and sound data are output to various storage media or distributed to a designated mail address via a network,
Image data and sound data output to various storage media later are input, displayed on a monitor, and reproducible from a speaker.

Description

[Detailed description of the invention]

[0001]

[Technical field to which the invention belongs]

 The present invention relates to a device that is installed in an amusement park, a game center, or the like, combines an object (user) with an image pattern prepared in advance, shoots the image, and prints out the shot image as a sticker, business card, or the like. More specifically, the present invention relates to an image synthesizing output device with an audio synthesizing output function that synthesizes not only captured video but also sound such as audio so that the sound can be output from a predetermined output medium.

[0002]

[Prior art]

 In recent years, a portrait image of a user is photographed, and the user designates image data such as a background prepared in advance, thereby synthesizing the photographed portrait image with the designated image data, and synthesizing a print sheet / print sheet. Image printing devices for printing on stickers, business cards, etc. are installed at amusement parks, game centers, and so on. This image printing apparatus includes a camera for photographing a user who is a subject, a memory in which a plurality of image data for synthesis such as a background are stored in advance, an image synthesizing means for synthesizing a photographed image and image data for synthesis such as a background, A monitor that displays images and image data for compositing, a printer that prints composite images on stickers, business cards, and the like are provided as basic components.

[0003]

[Problems to be solved by the invention]

 The fact that the conventional image printing apparatus handles only image data is evident from the above-described object of printing a created composite image on a sticker, a business card, and the like, and the above-described configuration for achieving the object. is there. Conventional image printing devices consist only of means for handling images, such as cameras and monitors, or image synthesizing means and printers. There is no means for performing the processing related to the voice. In other words, conventional image printing devices do not target information on sound such as voice, music, and sound effects, and therefore, arbitrarily recorded background sounds such as user voices and natural sounds, and sounds such as background music. There was a problem that data could not be handled with images.

Further, in the conventional image printing apparatus, the output is only a two-dimensional development of printing on a print sheet / sticker, a postcard, or the like. After the printing of the composite image is completed, the composite image is further edited and processed. It is not possible to reprint a composite image, or to reprint a composite image like a reprint. In addition, the conventional image printing apparatus is used only for rewriting the background pattern and for maintaining the apparatus, even if the apparatus is connected to a network.

[0005] An object of the present invention is to provide a conventional image printing apparatus with a function of handling voice data such as recorded user voice, background sound such as natural sound, and sound data such as background music, so that both image and sound can be obtained. It is an object of the present invention to provide an image synthesizing output device with a voice synthesizing output function which can be handled and can give a sense of reality to the user from both eyes and ears.

Another object of the present invention is to handle images and sounds as digital data, print means on a print sheet / sticker as output means, storage means on various information storage media, and via a network. Providing a means for distributing to the designated e-mail address makes it possible to display and reproduce image data and audio data later, and also allows the user to freely edit and process the image or sound. An object of the present invention is to provide an image synthesis output device with a voice synthesis output function.

[0007]

[Means for Solving the Problems]

 An object of the present invention is to provide a recording means for recording a user's voice and storing it in a memory, a sound data storage means for storing a plurality of sound data such as a background sound and a background music, and a sound data storage means for storing the sound data. This is achieved by providing a sound synthesis output for synthesizing and outputting sound data selected by the user from the plurality of sound data and the user's voice data recorded by the recording means. Another object of the present invention is to provide means for outputting to various storage media such as an IC card and a floppy disk, means for delivering to a designated mail address via a network, means for inputting from various storage media, and monitoring of image data. The synthesized image data and sound data are output to various storage media using a display means for displaying the audio data and a means for reproducing the audio data from the speaker, or distributed to a designated e-mail address via a network, and later to the various storage media. This is achieved by inputting the output image data and sound data, displaying them on a monitor, and playing them back from speakers.

[0008]

[Embodiment of the invention]

 Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a hardware configuration diagram showing an embodiment of an image synthesizing output device with a voice synthesizing output function according to the present invention. The image synthesizing output device with a voice synthesizing output function of this embodiment is provided with a monitor / touch panel 1, a microphone 2, and a speaker 3, and these monitor / touch panel 1, microphone 2, and speaker 3 carry a user (subject). It is fixed to the turntable 4 so that even when the turntable 4 rotates, the user can operate the touch panel 1 while watching the monitor, record his own voice, and hear the guidance and the sound of the voice data. It is as follows. In addition, the turntable 4 is rotated by a driving device 5, and the camera 6 is configured to move up and down by a driving device 7, so that a user can be photographed in a free composition. In this case, the field of view of the camera 6 is set so that a whole body image from the head to the foot of the user can be captured. A processing device 8 that performs image processing and the like is provided inside the device that is invisible to the user. The processing device 8 is connected to a network 9 so that the created image data and audio data can be delivered to a mail address specified by the user via the network 9. The image data and audio data processed and combined in the processing device 8 are printed out on a sticker in the sticker printing machine 10. Further, in the READ / WRITE device 11 for a medium such as an IC card, image data and audio data can be output to a portable storage medium such as an IC card.

FIG. 2 is a block diagram showing a main part of the configuration of an embodiment of the present invention. The CPU 201 of the image synthesizing output device with the audio synthesizing output function according to the present invention includes a memory 202, an I / O control unit 203, an image / audio input unit 204, a pattern memory 205, an image / audio processing unit 206, an image / audio. The output unit 207, the data storage unit 208, and the data input unit 209 are connected. Each circuit block is formed, for example, on a semiconductor substrate or a glass epoxy substrate by a known semiconductor integrated circuit application technique. The CPU 201 receives the compressed digital signals from the digital camera I / F 211 and the microphone I / F 212, synthesizes the compressed digital signals by a program stored in the image / audio processing unit 206, and outputs the combined data to the video printer 217 (FIG. 1). The print output processing by the seal printer 10 and the output to the information storage medium by the READ / WRITE device 218 (corresponding to the READ / WRITE device 11 of the IC card in FIG. 1) are performed.

The memory 202 stores image data and audio data fetched from the image / audio input unit 204, and also stores a command issued to the CPU 201 and a command group as a control procedure of the image synthesis output device with the voice synthesis output function. It is remembered as. The processing data of the CPU 201 is also temporarily stored as a work memory. The image / voice input unit 204 converts the image data captured by the camera (corresponding to the camera 6 in FIG. 1) 220 and the voice data recorded by the microphone (corresponding to the microphone 2 in FIG. 1) 221 into an A / D converter (not shown). ) Converts an analog signal into a digital signal. At this time, it is also possible to perform chroma key processing or the like for image shooting. The pattern memory 205 stores image pattern data such as backgrounds and characters and sound pattern data such as music and character voices to be overlaid with image and voice data in the memory 202. As will be described later, external data can be stored and used as image pattern data and audio pattern data. Of course, the synthesized data itself stored in the memory 202 can be stored as image pattern data and sound pattern data. It is possible.

The image / sound processing unit 206 performs image / sound synthesis processing based on the image / sound data in the memory 202 and the image / sound pattern data in the pattern memory 205. The image / audio output unit 207 outputs data processed by the image / audio processing unit 206. The image / audio output unit 207 is connected to the video printer 217 and the READ / WRITE device 218, and outputs to the video printer 217 and the READ / WRITE device 218 according to a user's instruction or output form. The data storage unit 208 rewrites the contents of the pattern memory 205. The data in the pattern memory 205 is collated with the date of the data written in the pattern memory 205, and if the data stored in the data storage unit 208 is new, the data in the pattern memory 205 is rewritten. As a result, the data stored in the data storage unit 208 can be used as image pattern data and sound pattern data of the background, voice, character, and the like.

A data input unit 209 is connected to the READ / WRITE device 218, and takes in image data and sound data of the portable storage medium 219 as digital information. The data input unit 209 temporarily stores the fetched data in the data storage unit 208. The data storage unit 208 compares the data with the date of the data written in the pattern memory 205, and determines that the data in the pattern memory 205 is newer than the data in the pattern memory 205. rewrite. As a result, the data captured by the data input unit 209 can be used as image pattern data and sound pattern data of a background, voice, character, and the like. Further, the data input unit 209 can store the fetched data in the memory 202 and overwrite the data to synthesize the data.

The I / O control unit 203 is connected to a communication control I / F 210, a digital camera I / F 211, a microphone I / F 212, a sensor 213, a touch panel 214, a coin control unit 215, and a timer 216. Is performed. The communication control I / F 210 is used for connection with an external network. The communication control I / F 210 connects to an external device management server via a dedicated line. The purpose of this device management server (not shown) is to manage the presence or absence of a failure. Further, a new background pattern, a sound pattern, a character, and the like are transmitted from the device management server, and stored in the data storage unit 208 via the I / O control unit 203. The communication control I / F 210 is connected to the optical communication control I / F 223. The optical communication control I / F 223 controls Ir-DA for infrared communication and communication using an optical fiber. By using this interface, binary data such as programs can be exchanged, and it can be directly connected to portable information terminals such as PDAs and notebook PCs. The program and data of the synthesis output device can be imported. Also, data and programs recorded and created by a personal computer can be sent to the image synthesis and output device with voice synthesis output function to change background patterns, sound patterns, and characters as desired.

The sensor 213 detects the presence or absence of a user at the operation site by an infrared sensor, and determines whether the user is at a predetermined position after inserting the coin, and whether there is a single user or a plurality of users. Confirm. The touch panel (corresponding to the monitor and touch panel portion of the touch panel 1 in FIG. 1) 214 displays, for example, an operation menu and accepts input of various selection conditions. In addition, the touch panel 214 detects which resistance value when the displayed operation menu is input by the user through the A / D converter, and calculates the coordinates on the screen. Is determined. The coin control unit 215 detects, by the CPU 201, whether or not a coin has been inserted or an illegal coin has been inserted. The shape and weight of the inserted coin are measured, and for coins that are not genuine coins, the patterns on the front and back of the coins are further determined, and whether the inserted coin is a genuine coin, a fraudulent coin, or a counterfeit coin is determined. Is determined. The shooting fee is accepted by the coin control unit 215, but the fee receiving means is not limited to the coin detector, and a bill reader, a prepaid card reader, a credit card, or the like can be used. The timer 216 is provided in the apparatus main body when there is no environment in which it can be connected to an external management server by a dedicated line, and operates according to an instruction from the CPU 201.

By the way, the camera (corresponding to the camera 6 in FIG. 1) 220 performs shooting of a user when the touch panel 214 receives a shooting instruction to the user after inserting a coin. As the image input device, a MOS, an ordinary video camera, or the like may be used as the camera 220 in addition to the CCD camera. The image data captured by the camera 220 can be stored in the memory 202 after the exposure is adjusted by an AE (auto iris) function built in the camera 220. For example, a digital still camera having an Ir-DA optical communication function may be used as the image input device. Then, with the Ir-DA optical communication function that can receive and transfer the image data captured in advance and the buffer memory that can store multiple image data, the user can select an icon that is a selection condition of the menu image, and JPEG-compressed. A plurality of still images can be easily synthesized.

On the other hand, recording of a voice or a background sound is performed, for example, by selecting a command for recording a voice, a command for recording a background sound, or the like by a user, and receiving the command by the touch panel. In addition to the microphone 221, a recorder or a speaker connected to the external device connection LINEOUT 222 may be used as the audio input device. In terms of output, when the image / audio output unit 207 outputs data to the video printer 217, the video printer 217 prints and outputs a color image on a postcard or a sticker. When the data is output to the READ / WRITE device 218, the READ / WRITE device 218 stores the generated image data and sound data in the portable storage medium 219 as digital information.

In the above description, the image data and the sound data are handled without distinction for convenience, like the image / sound input unit 204 and the image / sound processing unit 205, but actually, the image data and the sound data are handled. They are handled differently, and there is no need to synthesize sound data with image data. Only sound data can be combined with image data and sound data. If sound data is to be combined with image data, it must be converted into image data. The data conversion function at that time may be provided, for example, in the image / sound processing means 205, or may be provided as an independent means.

The control units of the driving devices 5 and 7 in FIG. 1 are not shown in FIG. 2, but are connected to the driving device of FIG. The drive control of 5 and 7 is performed. The start and stop of rotation of the turntable 4 are instructed, for example, by a user operating a foot switch provided on the turntable floor. Similarly, the vertical movement of the camera 6 is also instructed by the user operating an instruction switch provided on the touch panel 1 or a foot switch provided on the turntable floor.

FIG. 3 is a schematic perspective view showing a specific configuration when the image synthesizing output device with a voice synthesizing output function according to the present invention outputs to a portable storage medium. As shown in the figure, an entrance 301 for inserting and removing a storage medium such as an IC card is provided on the operation surface side of the housing 300. This allows the READ / WRITE device 11 shown in FIG. 1 to input and output image data and sound data in the portable storage medium.

FIG. 4 is a diagram showing a structure and an output destination of output data of the image synthesizing output device with the audio synthesizing output function. The output data 400 is roughly divided into two parts, a program part 410 and a data part 420. The program section 410 has an image data display function 411 and an audio data reproduction function 412, and the data section 420 is divided into two parts: image data 421 after synthesis and audio data 422 after synthesis. The output data 400 has the program section 410 because when the output data 400 is read by a portable information terminal, a personal computer, or the like, the display section reproducing program is not installed on the personal computer in advance, and the data section 420 is stored. The image data display function 411 displays and reproduces the synthesized image data 421, and the audio data reproduction function 412 displays and reproduces the synthesized audio data 422.

When the output data 400 is output to the sticker 430, the combined image data 421 is printed out on the sticker 430 by a sticker printing machine. Here, when using the audio data, the audio data needs to be converted into the synthesized image data 421 in advance. That is, since sticker printing can only handle image data, audio data must be converted to image data. Various methods are conceivable as the method. For example, a means for converting sound into a barcode for sound reproduction, which is a known technique, may be provided in the image synthesizing output apparatus with the sound synthesizing output function. When sticker printing is performed, an audio playback barcode is printed together with the image data, so if this barcode is read by a dedicated audio playback barcode reader, the audio is played back. In addition, if the user speaks the voice, the voice recognition processing is performed on the voice to convert the voice into character data, and the character data is further processed into image data as “balloon”. If the created “balloon” is stored as image pattern data and combined with the captured image data, the user's voice can be printed with the image data when printed on a sticker. If the voice pattern data stored in the image synthesis output device with the voice synthesis output function in advance is used, the character data of the voice pattern data is also stored and used as “balloon”. Can be considered.

When the sound is music or background sound, if the sound is MIDI data, the sound can be converted into image data of a staff and output. In addition, the artist name and detailed information of the song may be stored in association with such music, and output as image data when printing. When using voice data in this way, the voice data is converted into character data or image data and then combined with the combined image data 421. Then, the post-combination image data 421 is output and printed by the sticker printing machine 430.

When outputting the output data 400 to a portable storage medium 440 such as an IC card or a smart media, the output data 400 may be stored in the portable storage medium 440 as it is. If the image synthesizing output device with the audio synthesizing output function has two or more types of storage medium output means, the output is performed after the user specifies one or more types of storage medium. Since the output data 400 is stored as digital data in the portable storage medium 440, the user can reproduce the output data 400 anytime and any number of times if there is a display / playback device that can use the portable storage medium. can do. In particular, with the provision of the program section 410, the data section 420 can be displayed and reproduced even if the display reproduction program is not installed in the display reproduction apparatus. Furthermore, if the display / reproduction device is provided with an image printing device, additional printing can be performed any number of times. In addition, in the image synthesis output device with the voice synthesis output function, the output data is further processed / synthesized and output, or a part of the data is used as image pattern data or audio pattern data to be newly used. The user can arbitrarily edit the data, such as creating output data in the database.

When the output data 400 is to be distributed via a network, the user is required to specify a destination mail address, and the output data 400 is distributed to the specified address as it is. The output data 400 is sent to the user-specified mail address in the form of digital data. As described above, the output data 400 can be repeatedly copied or the user can perform arbitrary editing. Also, unlike the case of the portable storage medium, the network distribution is not affected by the medium, so that if the terminal device on the user side has a display / playback program for the output data, or if the environment allows the program unit 410 to operate. The user can display, reproduce, process, edit, etc. the output data 400 at any time on the terminal device. Further, it is possible to transmit image data and audio data from the user terminal side to the image synthesizing output device with the audio synthesizing output function via the network. As a result, the image synthesizing output device with the audio synthesizing output function can output the data on the user side to various media such as a sticker or an IC card, overwrite the data to create new output data, It can be used as image pattern data and audio pattern data used when creating new output data.

Next, a description will be given according to some embodiments. FIG. 5 is a flowchart for explaining a process in a case where the image synthesizing output device with the audio synthesizing output function is applied to “horoscope”. Hereinafter, an example of the process will be described with reference to the drawings. First, the user is photographed by the camera 220, and the photographed image data is used as the photographed image data (step 501). The user and the image synthesizing output device with voice synthesis output function interactively process the captured image data through command input on the touch panel, such as “combining the background” and “changing the color,” so that the captured image data can be processed. The image pattern data is combined with the data to create a photographed image suitable for the user (step 502). Next, the input of the date of birth by the user is received (step 503).

The image synthesizing output device with the voice synthesizing output function executes the horoscope program on the input date of birth, and obtains a word representing “today's fortune” (step 504). Even if the result of the horoscope is bad, the word “today's fortune” is a positive expression. For example, use a plain expression such as "There is no dawn night. Let's do our best a little." Next, the obtained word representing "fortune of today" is combined with balloon image data, and the photographed image created in step 502 and the balloon image data are combined to obtain combined image data (step 505). . Here, the balloon image data is image pattern data in which the word “Today's Fortune” is written in the balloon. Next, the voice pattern data corresponding to the word “Today's fortune” is extracted from the voice data prepared in advance in the image synthesis / output device with the voice synthesis output function, and the speech pattern data corresponding to the word “Today's fortune” is extracted. The audio data is set (step 506). Then, the user is caused to select background sound / background music (step 507). The sound pattern data of the selected background sound / background music is taken out and synthesized with the sound pattern data of the words "Today's Fortune" to obtain synthesized voice data (step 508). Then, the user is made to select whether to output the output data to the sticker (step 509). If the user selects to output, the combined image data is printed on a sticker using a sticker printer (step 510). Next, the user is made to select whether to output the output data to the IC card (step 511). If the user selects to output, the image data after synthesis, the audio data after synthesis, and the display playback program are output to the IC card (step 512). Finally, the user is made to select whether to deliver the output data through a network (step 513). When the distribution is selected by the user, the user specifies the mail address to be distributed (step 514), and the image data after synthesis, the audio data after synthesis, and the display / playback program are stored in the mail address specified by the user. It is distributed (step 515).

FIGS. 6, 7 and 8 are output examples of the embodiment of the application “horoscope” in the image synthesizing output device with the audio synthesizing output function shown in FIG. FIG. 6 is an output example in which output data is printed on a sticker. The seal 600 is created based on the image data after synthesis. The combined image data includes a captured image 601 and a balloon 602. The photographed image 601 is a photographed image obtained by the user interactively processing and synthesizing the photographed image data with the image synthesizing output device with the voice synthesizing output function through a command input operation of the touch panel. The background sun and clouds were also added by the user in the process. The balloon 602 is obtained by combining words representing “fortune of today” obtained by horoscope as balloon image data. FIG. 7 is an output example in which output data is output to an IC card. The IC card 700 stores the synthesized image data 701, the synthesized audio data 702, and the display / reproduction program 703. Here, in the synthesized voice data 702, in addition to the voice data corresponding to the word “today's fortune”, background sound / background music selected by the user himself / herself are also stored. FIG. 8 shows an application example of the above output example, in which a sticker 802 is attached to an IC card 801. This has the effect that the contents of the IC card 801 can be judged instantly by looking at the sticker 802. The sticker 802 may be automatically attached by a machine, or the IC card 801 and the seal 802 may be separately output, and the user may attach the sticker 802 as needed.

FIG. 9 is a flowchart for explaining processing when the present image synthesizing output device with a voice synthesizing output function is applied to “message to lover / friend”. Hereinafter, an example of the process will be described with reference to the drawings. First, the user is photographed by the camera 220, and is used as photographed image data (step 901). Through the user's command input on the touch panel, the image synthesizing output device with the voice synthesizing output function interactively processes the photographed image data to create a photographed image suitable for the user (step 902). Next, the "message to lover / friend" that the user has blown from the microphone is accepted and recorded as sound data (step 903). The recorded voice data is reproduced by the speaker, and the user is inquired of the confirmation of the content if it is OK. If not, the message is reproduced again (step 904). Next, the image synthesizing output device with the audio synthesizing output function performs voice recognition processing of the user's message which is the recorded audio data, converts the message into character data, and synthesizes it as balloon image data (step 905). . Then, the photographed image created in step 902 and the balloon image data are combined, and the combined image data is used as combined image data (step 906).

Next, the user is caused to select a background sound / background music (step 907). The selected background sound / background music and the like are combined with the message, which is the recorded voice data recorded by the user, to obtain synthesized voice data (step 908). Then, the user is made to select whether to output the output data to the sticker printing machine (step 909).

If the user has selected to output, the combined image data is printed on a sticker (step 910). Next, the user is made to select whether to output the output data to the IC card (step 911). If the user selects to output, the image data after synthesis, the audio data after synthesis, and the display / reproduction program are output to the IC card (step 912). Finally, the user is made to select whether to deliver the output data via a network (step 913). If the user selects delivery, the user is allowed to specify the mail address to be delivered (step 914), and the combined image data, combined voice data, and display / playback program are displayed in the user-specified format. Delivery is made to the mail address (step 915).

FIG. 10 is an output example of the embodiment of the “message to lover / friend” in the image synthesizing output device with the voice synthesizing output function shown in FIG. In this output example, the seal 1000 is attached to the IC card 1001. The photographed image 1002 is a photographed image obtained by processing the original photographed image data by the user, and the star in the background of the figure is also added by the user in the process. A balloon 1003 is obtained by converting a message blown by a user for a lover or a friend into character data by voice recognition, and then synthesizing it with balloon image data. The IC card 1001 stores image data after synthesis, audio data after synthesis, and a display / reproduction program. Here, in the synthesized speech data, in addition to the message blown by the user, a background sound / background music selected by the user himself / herself are also stored.

FIG. 11 is a flowchart for explaining processing when the present image synthesis output device with a voice synthesis output function is applied to “shoot with a pet”. Hereinafter, an example of the processing will be described with reference to the drawings. First, a user is photographed by the camera 220, and the photographed image data is used (step 1101). Through the user's touch panel command input, the image synthesis and output device with voice synthesis output function interactively processes the captured image data, creates a captured image appropriate for the user, and sets the captured image as user image data ( Step 1102). Next, the message blown by the user through the microphone is stored as recorded voice data (step 1103), and the background sound / background music selected by the user is extracted from the voice pattern data (step 1104). This message is combined with the background / background music to generate user voice data (step 1105). Next, the IC card inserted by the user is received (step 1106). Then, the synthesized image data and the synthesized audio data in the IC card are taken out to be pet image data and pet audio data, respectively (steps 1107 and 108). This IC card is obtained by photographing a user's own pet with the present image synthesis / output device with voice synthesis output function before shooting. In other words, the image of the pet is stored in the image data after synthesis in the IC card, and the sound of the pet is stored in the audio data after synthesis. Next, the user image data and the pet image data are combined, and the combined image data is used as combined image data (step 1109). Further, the user voice data and the pet voice data are synthesized, and the synthesized voice data is used as the synthesized voice data (step 1110). Then, the user is made to select whether to output the output data to the sticker printing machine (step 1111). When the output is selected by the user, the synthesized image data is output to the sticker printing machine (step 1112). Next, the user is made to select whether to output the output data to the IC card (step 1113). If the user selects to output, the image data after synthesis, the audio data after synthesis, and the display / reproduction program are output to the IC card (step 1114). Finally, the user is made to select whether to deliver the output data through a network (step 1115). When the distribution is selected by the user, the user specifies the mail address to be distributed (step 1116), and the image data after synthesis, the audio data after synthesis, and the display / playback program are stored in the mail address specified by the user. (Step 1117).

FIG. 12 shows an IC card inserted by the user into the image synthesizing output device with the voice synthesizing output function in the embodiment of the application “sharing with pet” shown in FIG. The IC card 1200 stores image data 1201 after synthesis, audio data 1202 after synthesis, and a display / reproduction program 1203. The combined image data 1201 is a photographed image of a pet cat. The synthesized speech data 1202 is a cry of the cat “Miao Miao”.

FIG. 13 is an example of output to an IC card in the embodiment of the application “appearing with a pet” of the image synthesizing and outputting apparatus with a voice synthesizing output function shown in FIG. The data of the pet to be used is taken from the IC card shown in FIG. The IC card 1300 stores post-synthesis image data 1301, post-synthesis audio data 1302, and a display / reproduction program 1303. The combined image data 1301 is obtained by combining a captured image of a cat on an IC card with a captured image of a user. The synthesized voice data 1302 stores the user's message “Please come to play next time” and the cat's cry “Miao Miao” captured from the IC card.

In the embodiments shown in FIG. 11, FIG. 12, and FIG. 13, data for synthesis is taken from the IC card, but it goes without saying that other portable storage media may be used. For example, data taken from a portable storage medium in a digital camera can be read and used as image data for synthesis. Conversely, it is also possible to read image data and audio data in the portable storage medium, and overwrite and synthesize the data.

FIG. 14 is a flowchart for explaining a process when the image synthesizing output device with the audio synthesizing output function is applied to “frame division drama”. In general, karaoke is a music in which the singer's singing part is emptied, and the user supplements that part with his own singing voice so that the amateur can feel somewhat like a singer. On the other hand, the frame split drama described here is a still image, but the drama heroine (or hero) (or hero) is made empty by making the part played by the heroine (or hero) and the user's portrait and voice supplement the part. It can be said that it is something that makes you feel like a hero. At this time, popular actors and anime characters can be considered as the opponents of the user.

Hereinafter, an example of the processing of the flowchart of FIG. 14 will be described with reference to the frame image transition diagram of FIG. First, the user selects a desired frame-divided drama from a plurality of frame-divided dramas prepared in advance and a character to be played among characters appearing in the drama on the touch panel (step 1401). The number of frames in a frame-divided drama may be determined in advance, or may be specified by the user before shooting starts. If the number of frames increases, charging is requested according to the number of frames. Then, the first frame of the drama selected by the user is read (step 1402). Next, before displaying the frame, the character selected by the user from the frame is deleted, and the place where the character was displayed is displayed on the screen in a manner distinguished from the others (step 1403). The user's photographed image is fitted into the place displayed in a distinguished manner. FIG. 15A shows the original frame image, and FIG. 15B shows the processed frame image in step 1403. Reference numeral 1501 in (A) denotes a user-selected character selected by the user, into which a user image is inserted instead of the character image. In the process of step 1403, the user-selected character 1501 is deleted, and the position is shaded 1502 as shown in the drawing, for example, in order to display the character in distinction. The user is fitted into the shaded portion 1502. The user takes a desired pose while looking at the displayed processed frame image (B), and performs photographing with the camera to obtain photographed image data (step 1404). At this time, the user may rotate the turntable or operate the camera up and down so that the user can take a picture at a desired angle. Then, the photographed image data is combined with the processed frame image (B) in FIG. 15 (step 1405). The result is the post-combination frame image shown in FIG. In the hatched portion 1502, a user image 1503 is displayed in place of the user-selected character. Next, the user is instructed to speak the character. First, the dialogue of the character in charge of the user of the frame currently being photographed is displayed (step 1406). In the example of FIG. 15, a phrase “Is it going to be fine tomorrow?” Is displayed on the screen. Then, the user blows a line according to the display and stores the voice data (step 1407). Then, the voice data of each character necessary for the conversation in the frame is read out, and the voice data is stored (step 1408). Incidentally, the voice data of the conversation and dialogue of each character is recorded in advance. For example, the phrase "I think it will be fine" of the opponent character in FIG. 15 is recorded in advance as voice pattern data. Furthermore, the playback order of the dialogue of each character is arranged so that it can be heard as a natural conversation when played back. In other words, the words spoken by the user are stored in place of the voice pattern data of the character selected by the user, so that when the voice is reproduced, it sounds as if the user is talking with another character. The speech data of these conversations is synthesized with BGM and sound effects, and the synthesized frame sound is obtained (step 1409). Finally, the combined frame image 1503 is displayed on the screen, and all the conversations in the frame including the speech spoken by the user are reproduced by voice, and the user is confirmed whether or not this is sufficient (step 1410). If the user does not like it, the process returns to step 1404, and photography and recording are repeated. Now that one frame has been created, it is determined whether there is a next frame (step 1411). If there is a subsequent frame, the next frame is read and the process returns to step 1403 (step 1412). When there are no more frames and all frames have been created, output processing starts. The combined frame image and combined frame sound for all frames are the combined image data and combined voice data, respectively. First, the user is prompted to select whether to print the output data on a sticker (step 1413). If the user has selected to output, the image data after synthesis is printed (step 1414). Next, the user is made to select whether to output the output data to the IC card (step 1415). If the user selects to output, the image data after synthesis, the audio data after synthesis, and the display / reproduction program are output to the IC card (step 1416). Finally, the user is made to select whether to distribute the output data through a network (step 1417). When the distribution is selected by the user, the user specifies the mail address to be distributed (step 1418), and distributes the synthesized image data, the synthesized audio data, and the display / playback program to the user-specified mail address. (Step 1419).

FIG. 16 shows an example of output to an IC card in the embodiment of the application “frame division drama” of the image synthesizing output device with the audio synthesizing output function. The IC card 1600 stores image data after synthesis 1601, audio data after synthesis 1602, and a display / reproduction program 1603. The combined image data 1601 is composed of a plurality of combined frame images, and in this case, is composed of four frames. The female shown in the figure is a user who is fitted in place of the user-selected character. In the synthesized voice data 1602, the conversation of the frame-separated drama is stored as voice. The underlined part is the part that the user was responsible for, that is, the lines that the user uttered from the microphone. Reference numeral 1603 denotes a display / reproduction program. The display / reproduction program in the present embodiment is not limited to simply displaying an image and reproducing a sound, but displaying a composite frame image in frame order and displaying each displayed frame. It is possible to play back the synthesized frame sound corresponding to.

Although it is clear that the present invention can reproduce not only image data but also audio data according to the embodiment of the present invention, the audio reproducing method according to the present invention is not limited to the embodiment of the present invention. . Hereinafter, examples of other possible reproduction methods will be described with reference to the drawings. By the way, in the following output example, since the audio data is reproduced as the audio, "balloon" is not used for the synthesized image data that is printed.

FIG. 17 shows an example in which sound reproduction is performed only by sticker printing. On the sticker 1700, a barcode 1702 for sound reproduction is printed in addition to the print image 1701. This uses a technique of converting sound into a barcode for sound reproduction and printing, which is a known technique. To reproduce the audio, the barcode 1702 for audio reproduction printed on the sticker 1700 may be read by a dedicated barcode reader (not shown).

FIG. 18 shows an example of a reproducing method for reproducing sound only with a portable storage medium. Since the printed sticker 1801 is attached to the IC card 1800, image data can be obtained by viewing the sticker 1801. Audio data can be reproduced by operating the audio reproducing element 1802 in the IC card 1800. In other words, images and sounds can be enjoyed only with the IC card 1800.

FIG. 19 shows an example of a reproducing method for reproducing audio data on a portable terminal. The key holder type IC card READER 1900 is a small portable terminal, and includes an image display means and a sound reproducing means. As a result, the display / reproduction program is started, the combined image data is displayed on the display unit 1901, and the combined sound data is output from the sound output unit 1902.

FIG. 20 shows an example of a reproduction pattern for displaying and reproducing synthesized image data and synthesized audio data on the personal computer 2000. The PC 2000 receives the output data (combined image data + synthesized audio data + display reproduction program) read from the IC card READER 2001 or arrived as an e-mail via the network 2002, and the personal computer 2000 reads and starts the display reproduction program. Then, it is displayed and reproduced on the monitor 2003 and the built-in speaker 2004.

As another reproduction pattern, although not shown, there is a reproduction pattern using the image synthesizing output device with the audio synthesizing output function itself. For this purpose, the image synthesis output device with the audio synthesis output function itself should have a function of reading, displaying, and reproducing output data from an IC card.

[0045]

[Effect of the invention]

 As described above, the present invention adds a function that can handle not only image data but also sound data such as recorded user's voice, natural sound and the like, and background music and the like to the conventional image printing apparatus. In addition, it is possible to provide a user with a more realistic amusement environment in which sound is added to an image. In addition, by adding a display / playback program to the image data and sound data, writing the data to a portable storage medium and distributing it to a designated e-mail address via a network, the user can display the image data and sound data later. , Can be played.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating a hardware configuration of an image synthesis output device with a voice synthesis output function according to the present invention.

FIG. 2 is a block diagram illustrating a main part of a configuration of an embodiment of an image synthesis output device with a voice synthesis output function.

FIG. 3 is a schematic perspective view showing a specific configuration when outputting an information storage medium.

FIG. 4 is a diagram showing the structure and output destination of output data.

FIG. 5 is a flowchart showing a process in a case where the image synthesizing output device with a voice synthesizing output function is applied to “horoscope”;

FIG. 6 is an output example in which output data is printed on a sticker in the embodiment of “horoscope”;

FIG. 7 is an embodiment of “horoscope”, in which output data is IC
It is an example of one output outputted to a card.

FIG. 8 is an output example in which a sticker is attached to an IC card in the embodiment of “horoscope”.

FIG. 9 is a flowchart showing a process when the image synthesis output device with the voice synthesis output function is applied to “message to lover / friend”.

FIG. 10 is an example of output in the embodiment of “message to lover / friend”;

FIG. 11 is a flowchart showing a process in a case where the present image synthesis output device with a voice synthesis output function is applied to “shoot with a pet”.

FIG. 12 is an explanatory diagram showing an IC card inserted by a user into the image synthesizing output device with a voice synthesizing output function in the embodiment of “sharing with a pet”.

FIG. 13 is a diagram illustrating an example of an output in the embodiment of “sharing with a pet”;

FIG. 14 is a flowchart showing a process in a case where the present image synthesizing output device with a voice synthesizing output function is applied to “frame division drama”.

FIG. 15 is a frame image transition diagram in the embodiment of “frame split drama”.

FIG. 16 is a diagram showing an example of output in the embodiment of “frame split drama”.

FIG. 17 is a diagram illustrating an example in which sound reproduction is performed only by sticker printing.

FIG. 18 is an explanatory diagram showing an example in which sound is reproduced only with a portable storage medium.

FIG. 19 is an explanatory diagram illustrating an example in which sound reproduction is performed on a portable terminal.

FIG. 20 is an explanatory diagram showing an example in which sound reproduction is performed by a personal computer.

[Description of sign]

DESCRIPTION OF SYMBOLS 1 ... Monitor and touch panel, 2 ... Microphone, 3 ... Speaker, 4 ... Rotating stand, 5 ... Drive device, 6 ... Camera, 7 ... Drive device, 8 ... Processing device, 9 ... Network, 10 ... Seal printing machine, 11 ... READ / WRI of media such as IC cards
TE device, 400 output data, 410 program part, 411 image data display function, 412 audio data reproduction function, 420 data part, 421 synthesized image data, 422 synthesized audio data, 430 seal, 44
0: portable storage medium such as an IC card; 450: user-specified mail address.

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁶ Identification code FIG10L 5/02 H04N 5/225 Z H04N 5/225 5/781 510F

Claims (4)

[Utility model registration claims] 1. A photographing means for photographing a subject, a recording means for recording a sound generated by the subject, a photographed image data storage means for storing photographed image data photographed by the photographing means, Recorded voice data storage means for storing recorded voice data; Image pattern data storage means for storing a plurality of image pattern data to be synthesized with the photographed image data; and Stored a plurality of sound pattern data to be synthesized with the recorded voice data. Sound pattern data storage means, image pattern data selection means for selecting desired image pattern data among a plurality of image pattern data, and synthesizing the image pattern data selected by the image pattern data selection means with the photographed image data. Image synthesizing output means for outputting image data after synthesizing, and a plurality of sound patterns Sound pattern data selecting means for selecting desired sound pattern data from the sound data, and a sound synthesis output for synthesizing the sound pattern data selected by the sound pattern data selecting means with the recorded sound data and outputting synthesized sound data. Printing means for printing out the combined image data on a sticker, for displaying the combined image data, the combined voice data, and the combined image data, and reproducing the combined voice data. Storage means for storing the display / playback program in a portable storage medium; and a display / playback program for displaying the combined image data, the combined sound data, and the combined image data, and playing back the combined sound data. One or more of delivery means for delivering to a user-specified mail address via a network Image synthesis output device with voice synthesis output function. 2. The apparatus according to claim 1, further comprising a voice data conversion unit for converting the recorded voice data into character data, synthesizing the converted character data with image pattern data, and storing the image data in the image pattern data storage unit. The image synthesizing output device with a voice synthesizing output function according to claim 1. 3. Reading image data and / or sound data stored in advance in the portable storage medium, and reading image data as the photographed image data or image pattern data, and sound data as recorded voice data or sound pattern data. 2. The image synthesizing output device with a voice synthesizing output function according to claim 1, further comprising a portable storage medium reading and inputting means for inputting each of them. 4. Data which receives image data and / or sound data via a network and inputs the received image data as the photographed image data or image pattern data, and the sound data as recorded voice data or sound pattern data. 2. The image synthesizing output device with a voice synthesizing output function according to claim 1, further comprising a receiving input unit.