JP2009271787A - Performance image creation device, performance image creation method, performance image creation program and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a performance image creation device for acquiring an electronic picture book with unique performance effects by setting a performance region to show various performances according to tastes in the arbitrary region of each page of the picture book. <P>SOLUTION: The device stores a plurality of images to be fetched in each page as electronic information and displays the images for each page. The device is provided with: an image storage means 11 for storing each page image; a performance region setting means 12 for setting each page image or a portion of the page image as a performance region; a performance effect selection means 13 for selecting the types of performances corresponding to the performance regions as performance effects; and a performance reproduction means 14 for reproducing performance effects when each page image is selected, or when the performance area is selected. The performance region setting means 12 records the coordinate data of the performance region in setting a portion of the page image as a performance region, and the performance reproducing means 14 reproduces performances by changing a period for reproducing the performance effects of the performance regions based on the coordinate data. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention stores, for example, an image of each page such as a picture book as electronic information, and in an electronic picture book that is displayed for each page on a computer screen, various rendering effects can be freely added to the image of each page. The present invention relates to an effect image creating apparatus and an effect image creating method that can be played back, and further relates to an effect image creating program and a recording medium for causing a computer to create an effect image.

Conventionally, for example, as disclosed in Patent Document 1, a background image and a moving image in a picture book are written on a recording medium, and the background image and the moving image read from the recording medium are combined on the display unit. An electronic picture book display device has been proposed in which an animation function and sound are added to display a picture book in such a manner that an effect that cannot be obtained only by a still picture is given.
JP 5-120400 A

That is, according to the electronic picture book display device, a picture book page is displayed, and an animation operation is performed on animals, landscapes, etc. in a scene while reproducing voice, BGM, and sound for reading a sentence on the page. is there.
There is also an electronic picture book display device in which a secret effect such as a change in the screen or a sound effect is given by designating a specific position of an image in a page with a pointing device or the like.

However, according to the electronic picture book display device described above, in the image shown on the display unit, the location where the screen changes, such as the type of animation operation and the switching timing, and the type of change are fixed. Not only does it not match the taste of the reader (picture book readers), but the phenomenon of being tired of the freshness of changes over time will occur.
In addition, when the secret picture is produced in the electronic picture book display device, when the picture book is viewed for the first time, it is expected that the place causing the change will not be understood. However, if the place is understood, there is a problem that the interest does not continue.

  The present invention has been proposed in view of the above circumstances, and can be set so that various effects can be generated in an arbitrary area of each page of a picture book according to preference, thereby providing an original effect. It is an object of the present invention to provide an effect image creating apparatus, an effect image creating method, an effect image creating program, and a recording medium capable of obtaining an electronic picture book.

  In order to achieve the above object, an effect image creating apparatus according to the present invention is an apparatus for storing a plurality of images captured for each page as electronic information and displaying the images for each page, and storing each page image. Image storage means, effect area setting means for setting each page image or part of the page image as an effect area, effect effect selecting means for selecting the effect type corresponding to the effect area as the effect effect, The first feature is that it includes an effect reproduction means for reproducing the effect when each page image is displayed or when the effect region is selected.

  In the effect image creating apparatus of the present invention, the effect area setting means records the coordinate data of the effect area when setting a part of the page image as the effect area, and generates reproduction time data correspondingly. It has 2 features.

  The effect image creating apparatus according to the present invention is characterized in that the effect reproduction means reproduces the effect at a timing corresponding to the reproduction time data.

  The effect image creating apparatus of the present invention has a fourth feature in that a plurality of effect effects are associated in the effect effect setting means with respect to one effect area set by the effect area setting means.

  In the effect image creating apparatus of the present invention, the effect area setting means sets an attribute of a story effect, a secret effect, or both effects for the effect area, and the effect reproducing means corresponds to each attribute. The fifth feature is that the effect is reproduced in the effect reproduction mode.

  The effect image creating apparatus according to the present invention is characterized in that the reproduction time data for each effect is displayed and editable on the timeline for each type of effect.

  The effect image creating apparatus according to the present invention has a seventh feature of selecting and selecting an effect by the effect effect setting means using a keyword corresponding to the content of the effect type.

  The effect image creating apparatus according to the present invention displays that the effect area set by the effect area setting means is displayed in such a manner that the area can be determined when displaying the page image and setting the effect area. It is a feature.

The production image creation method of the present invention is:
An image reading step of storing a plurality of images captured for each page as electronic information corresponding to each page image;
An effect area setting step for setting each page image or part of the page image as an effect area,
An effect setting step for selecting an effect type corresponding to the effect area as an effect,
An image display step for displaying each page image for each page;
An effect reproduction step of reproducing the effect when the page images are displayed or when the effect area is selected.

  The effect image creation program of the present invention is characterized in that each step shown in the effect image creation method can be executed by a computer.

  The recording medium of the present invention is characterized in that the production image creation program readable by a computer is stored.

  According to the first feature of the effect image creating apparatus of the present invention, a page image such as a picture book is read into a computer, and a free effect such as image change or sound addition is set at an arbitrary position of each page image. be able to.

  According to the second feature of the present invention, when the effect area is set, the coordinate data of the effect area is recorded and the corresponding reproduction time data is generated, so that the reproduction time of the effect effect of the effect area is generated based on the coordinate data. Can be automatically distributed.

  According to the third aspect of the present invention, it is possible to sequentially reproduce the effect at the timing corresponding to the reproduction time data.

  According to the fourth aspect of the present invention, an effect in which video and sound are synchronized by setting a plurality of different types of effects (for example, an animation effect and a corresponding sound effect) for one effect region. The effect can be realized.

  According to the fifth aspect of the present invention, it is possible to exert various effects by reproducing the effects in the effect reproduction mode corresponding to any attribute of the story effect, the secret effect, or both effects. it can.

  According to the sixth feature of the present invention, the reproduction time data for each effect is displayed on the timeline for each type of effect and can be edited, thereby easily adjusting the reproduction time of the effect. can do.

  According to the seventh feature of the present invention, since the selection of the production effect is performed by searching and selecting with a keyword corresponding to the content of the production type, it is possible to easily find a pattern of image change or sound source data to be set as the production effect. Can do.

  According to the eighth aspect of the present invention, the effect area set by the effect area setting means is a mode in which an area can be discriminated, for example, an area boundary line when a page image is displayed and the effect area is set. Therefore, it can be confirmed on the editing screen that the rendering effect has been set in any part of the page image.

  According to the effect image creating method of the present invention, by executing the above steps, a page image such as a picture book is read into a computer, and a free effect such as an image change or sound addition at any position of each page image. The effect can be set.

  According to the effect image creation program and the recording medium of the present invention, each step shown in the effect image creation method can be read into a computer and executed.

Hereinafter, an effect image creating apparatus of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a hardware configuration of an effect image creating apparatus according to an embodiment of the present invention. The effect image creation device stores a plurality of images captured for each page as electronic information, creates an effect image in which various effect effects are set for the stored image, and can reproduce the created effect image for each page. It is a device to do.

  The hardware of the effect image creation device can be realized by a general-purpose information processing device such as a personal computer. The effect image creating apparatus is composed of a CPU 1, a ROM 2, a RAM 3, a sound source device 4 composed of software as a sound source, a DSP for effect addition, a scanner device 5 for reading an image, and a pointing device such as a keyboard and a mouse. Input device 6 and a display device 7 such as a liquid crystal display. As the display device 7, a well-known display means for displaying the processing result of the personal computer, such as a liquid crystal display, can be used. In addition, an external storage device 8 for inputting / outputting data to / from the recording medium is connected to the personal computer, and voice and the like are input and stored via the A / D converter 9. A microphone 10 is connected.

In the ROM 2 of the computer, an effect image creation program for creating an effect image is installed from a recording medium attached to the external storage device 8, or downloaded from a predetermined URL via the Internet.
The CPU 1 executes various processes (each step) in accordance with a predetermined control program (effect image creation program) installed by the above-described procedure, and controls the entire apparatus. The image storage means 11, the effect area setting means 12. By providing the effect effect setting means 13 and the effect reproduction means 14 as the main functions, a plurality of images captured for each page are stored as electronic information, and the stored images can be displayed on the display device 7 for each page. .
The RAM 3 temporarily stores information used for processing in the CPU 1.
A sound system 4 a including a D / A converter, an amplifier, and a speaker is connected to the sound source device 4.

Therefore, the effect image creating apparatus installs or downloads the effect image creating program in the personal computer, thereby reading and storing the page image in the hard disk of the personal computer, and the effect in the read page image. An effect area setting unit 12 that sets an area to be applied, an effect effect setting unit 13 that associates an effect with the set effect area, and an effect reproduction unit 14 that reproduces the page image on which the effect has been applied are read. Switch between the image creation mode, the effect setting mode (editing mode) that gives the desired effect to the captured image, and the effect image playback mode (viewing mode) that reproduces the image with the effect. It is configured to display on the device 7.
That is, in the display device 7, the read image is displayed in the image creation mode (reading mode), and an image creation screen for creating the effect image is displayed in the effect setting mode (editing mode). In (viewing mode), the effect-set image with the effect is reproduced.

  The image storage unit 11 stores an image read from the scanner device 5 as each page image in the image creation mode. The image read from the scanner device 5 is each page of a picture book, a handwritten image, or the like, and an image based on electronic information photographed by a digital camera or the like may be directly taken into the image storage unit 11. Furthermore, each image stored in advance as a picture book image may be read out and loaded from the external storage device 8 or the like into the effect image creation program installed by the recording medium.

The effect area setting means 12 designates each page image or a part of the page image displayed on the display device 7 as an effect area in the effect setting mode, and stores this.
In the pointing device of the input device 6, the amount of movement in the X and Y directions is detected and added to the cursor coordinate data of the cursor point register on the RAM 3, so that the cursor on the display device 7 is based on this coordinate data. Is determined. Then, reproduction time data corresponding to the coordinate data of the position designated as the effect area in each page image displayed on the display device 7 is generated and stored in the effect area setting means 12.

The effect effect setting means 13 selects the effect type corresponding to the effect area as the effect in the effect image creation mode, and stores this. In addition, the attribute of the production to be set in the production area is set to one of the production of “story production” that produces in line with the story, “secret production” that produces an unexpected production, or both productions. It has become.
As the effect, there can be an effect accompanied by an image change such as an image enlargement / deformation process in addition to an effect based on sound source data such as sound, sound (sound effect), and BGM.
Selection of the effect for the effect area is performed for each effect area, but each effect effect in the page image is determined by reproduction time data corresponding to the coordinate data of each effect area stored in the effect area setting means 12. The playback order is assigned. Further, the selection of each production effect is made possible by selecting and searching for a keyword corresponding to the content of the production type, so that the necessary production effect can be easily selected.

The effect reproduction means 14 reproduces the effect at the timing corresponding to the reproduction time data when each page image on which the effect setting is performed is displayed in the effect image creation mode and the effect image reproduction mode. . In other words, when there are a plurality of effect areas in the page image, the reproduction is performed in the order assigned by the reproduction time data based on the coordinate data of the effect area stored in the effect area setting means 12.
In the case of a secret effect described later, when the effect region in the page image is selected by a pointing device such as a mouse constituting the input device 6, the effect specified by the effect effect setting means 13 is reproduced. It is.

Next, the creation and reproduction of a specific effect image using the effect image creation device will be described by taking the creation of an electronic picture book as an example.
Production of production images on each page of the picture book is divided into “story production” that produces the story along the story of the picture book, and “secret production” that causes unexpected image changes and sound generation in any part of the page image. , “Story production” and “Secret production” are concrete effects such as “sound production” that adds sound effects to characters in the page image, “animation production” that gives movement to characters in the page image, page For each page image, a “BGM effect” in which music flows when the image is displayed, a “voice effect” for giving a reading voice of a sentence written in the page image, and the like are performed.
The effects in each page image are set as the above-mentioned effects alone or in combination.

When creating an electronic picture book, an effect image creation program is started on a computer, and an image creation mode is selected in mode selection of an image creation mode, an effect setting mode, and an effect image playback mode (step 101).
Subsequently, a picture book composed of paper is read by the scanner device 5 for each page (step 102). The read image is displayed on the display device 7, and correction processing such as screen rotation, trimming, and tone correction is performed as necessary (step 103), and each page image is stored in the image storage unit 11 as electronic information. Image reading is completed by repeatedly reading each page image (step 104).
Each page image stored in the image storage means 11 is touched by the image reproduction means 14 with the key “→” (when proceeding to the next page) or “←” (when returning to the previous page) on the keyboard of the input device 6. As a result, the display device 7 can be played back by turning pages one by one (displaying the book as if it was read).

Next, an effect setting mode is selected in the mode selection (step 101), and a page image for which an effect image is to be created is displayed on the display device 7 as an effect image setting page 20 (FIG. 3). An effect area setting that specifies an effect area for the page image and an effect effect setting that gives an effect to the effect area are performed (step 105).
The effect setting ends when all the effect settings for each page image are set (step 106).

Next, the effect image reproduction mode is selected in the mode selection (step 101), and the effect image is reproduced on the display device 7 (step 107).
In the effect image playback mode, it is determined whether or not “automatic turning” for automatically turning and sequentially reproducing each page of the picture book is selected (step 108). If “automatic turning” is not selected, The playback ends only with the effect set for the page image, and when “automatic turning” is selected, the effect set for the page image is played back to the last page (step 109). The page is turned and the reproduction is repeated (step 110).
Reproduction of the effect in each page image is performed in the order assigned based on the reproduction time data created based on the coordinate data of the effect area.
In the case of “automatic turning”, the period from the end of playback of the previous page until the page is turned and the next page is displayed is managed as an interval time that is a preset period.

In the effect image setting page 20, as shown in FIG. 3, the picture book pages (left page 21 and right page 22) are displayed in a spread state, and the effect that is set on the left page 21 and the right page 22 in the “story effect”. Is displayed on the upper part of the picture book page. In the operation key window 30, a playback button 31 for playing back and confirming the set effect, a stop button 32 for stopping playback, and a picture book page (left page 21 and right page 22) at the beginning of playback. A return button 33 for returning to the sound volume and a volume button 34 for adjusting the playback sound volume are provided.
Each button of the operation key window 30 is played back by clicking the mouse (input device 6) button (cursor tip displayed by the pointing device) together with the buttons, and the left page 21 and “ The effect set on the right page 22 can be confirmed for each page screen.

  In the effect image setting page 20, the “voice effect” 41, “BGM effect” 42, “animation effect” 43, and “sound effect” 44 are located below the picture book pages (left page 21 and right page 22). A timeline 40 having a rectangular portion corresponding to each is displayed. A time axis 45 is displayed at the lowest position of the timeline 40.

In addition, a switching window 47 for switching between “story attribute” for setting “story effect” and “secret attribute” for setting “secret effect” is displayed on the left side of the timeline 40. ing. Switching between the “story attribute” and the “secret attribute” is performed by clicking the button of the mouse (input device 6) on the switching window 47, and the mode is switched for each click, but for each effect area in the effect setting mode. Can be set to switch.
At the left end of the time axis 45 of the timeline 40, playback time editing buttons 48a and 48b for increasing / decreasing a set value for editing the page playback time are provided.

Next, each effect of “audio production” (story production), “BGM production” (story production), “sound production” (secret production), and “animation production” (story production + secret production) is applied to the page image. The case of giving is described.
First, “voice production” is set for all sentences described in the spread pages (left page 21 and right page 22) of the picture book. The “voice production” is to give a reading sound to the production area. In this case, after launching the effect image creation program, the effect setting mode (editing mode) is selected, and “story attribute” is selected in the switching window 47 of the effect image setting page.
An area where you want to create a sound effect in the page image by clicking the mouse button (the tip displayed on the pointing device) on the sound window 41a of the timeline 40 displayed on the effect image setting page 20 and clicking By dragging with the mouse button, the area of the arbitrary area is displayed as a rectangle.
For example, a region displayed in a rectangle surrounding the sentence portion 54 by dragging with a mouse button is an “audio effect setting region” 57. An area boundary line 57a is displayed around the “audio production setting area” 57 so that its size can be confirmed on the editing screen. In this example, the area boundary line 57a is displayed. However, any form may be used as long as marks can be displayed at the four corners or the area within the area can be color-coded.
Then, by clicking in the “audio effect setting area” 57, an audio effect setting window (dialog box or the like) 200 as shown in FIG. 4 is opened and the contents of the effect are set. That is, by clicking the recording button 201 in the sound effect setting window 200, a sound for reading the sentence portion 54 is input from the microphone 10, and sound effect data having a length corresponding to the reading time through the A / D converter 9. Remember as. In the audio production setting window 200, pan change processing (producing a stereo effect depending on the relationship between the character position and dialogue), volume change processing (producing volume change), echo processing (producing Yamahiko effect), Reverb processing (production of sound in baths, caves, tunnels), pitch shift processing (change of voice pitch), time stretch processing (change of reading speed), mechanic processing (production of robots and alien voices) ) And the like can be added and edited with a variety of sound effects.
Further, it may be stored by selecting from already recorded audio data files.

When the audio effect setting window 200 is closed, time data corresponding to the effect time (time for reading the sentence portion 54) is automatically created, and the effect area (“ A rectangular portion 41b corresponding to the “sound production setting area” 57) is displayed. The length of the rectangular portion 41b in the timeline 40 corresponds to the production time, and the left end position corresponds to the reproduction start time of the audio production. This reproduction start time is determined by the reproduction time data of each effect area (“audio effect setting area” 57) stored in the effect area setting means 12.
That is, the length in the left-right direction in the rectangular portion 41a corresponds to the duration of each audio data, and both end positions indicate the start and end timing of sound generation from the page switching completion time. The sound generation timing can be edited by dragging the both end positions of the rectangular portion 41a. Moreover, you may make it perform a time stretch process by expanding / contracting the length (time area | region) of the left-right direction of the rectangular part 41a.
Similarly, “audio production setting areas” 57 surrounding the sentence portions 55 and 56 are created, the production contents are set in the respective audio production setting windows 200, and then the audio production setting windows 200 are closed, so that each reproduction period is set. The page playback time that is longer than the data and the entire reading time is sequentially updated, and a plurality of rectangular portions 41 b are displayed on the timeline 40. That is, every time a plurality of “sound production setting areas” 57 are created and updated, the page reproduction time is automatically set longer in accordance with the total length of the reading time.

When editing a sound effect in the “sound effect setting area” 57 that has already been set, the sound effect setting window 200 is opened by clicking in the existing “sound effect setting area” 57 and various edits are possible. It becomes. When the audio effect setting window 200 is closed after editing, update time data is created and the display of the timeline is also updated.
Further, when it is desired to change the entire page playback time, it can be lengthened by pressing the playback time editing button 48a for increasing / decreasing the set value of the timeline 40.

  The plurality of rectangular portions 41b for each effect area displayed on the timeline 40 are in the order of reproduction of the sound effects based on the reproduction time data of each effect area (“audio effect setting area” 57) stored in the effect area setting means 12. Is distributed. That is, the playback positions of the audio effects are automatically assigned so that each page corresponds to one time axis 45, and each page has a top priority in the vertical direction and a left priority in the horizontal direction. And the left end of each rectangular part 41b becomes the start of production time, and the right end becomes the end.

By first setting the sound effect for all sentence parts in the page image, the page reproduction time and the reproduction timing of each effect region are determined based on the coordinate data and the reproduction time data of each effect region.
When a page image in which the effect is set is reproduced in the effect image reproduction mode, a screen displayed on the display device 7 is a page image reproduction screen 70 shown in FIG. Each area boundary line 57a displayed on the effect image setting page 20 when performing the effect image setting of the sound effect is not displayed in order not to disturb the original image of the picture book and to keep the secret effect secret. .
When the audio data is reproduced, it is reproduced at the sound generation timing set by the audio unit 41 of the timeline 40 with each page image being displayed. As described above, the reproduction timing of the production effect is distributed according to the reproduction time data of the production area. That is, on the page image playback screen 70, the text portion 55, the text portion 54, and the text portion 56 are played back in order for the sound effect setting areas 57, 57, 57.

In the above example, the audio part 41 of the timeline 40 is displayed on the effect image setting page 20 so that the reproduction time and start time of each effect can be edited. However, a simple specification that does not employ the timeline display may be used. it can.
In that case, when the display switching of the page is completed, the area start point (for example, the upper left position coordinate of the coordinate data when the text is written horizontally. The text is the vertical position when the text is written horizontally). In the case of writing, the upper right position coordinates) are searched, and these area start points are scanned from the page head position toward the page end position, and are reproduced sequentially from the sound data registered in the head sound effect area.
For example, when the text described in the page image is horizontal writing, as shown in FIG. 6A, the region start point is scanned from left to right in the horizontal direction from top to bottom, and the left position is given priority. In the case of vertical writing, as shown in FIG. 6 (b), the area start point is scanned from right to left in the vertical direction from top to bottom, and the audio data is given priority to the right position. Play.

Next, a case where the effect set for the page image is “BGM effect” (story effect) will be described. In this case, after launching the effect image creation program, the effect setting mode (editing mode) is selected, and “story attribute” is selected in the switching window 47 of the effect image setting page 20.
The “BGM effect” corresponds to a scene change in developing a story, and it is considered that the scene change corresponds to the sentence parts 54, 55, 56. Set the BGM effect.
Place the mouse button (the tip displayed on the pointing device) on the BGM window 42a of the timeline 40 displayed on the effect image setting page 20 and click it to set the setting screen. 21) is clicked with a mouse button to set a “BGM effect setting area” 57.
The “BGM effect setting area” 57 is displayed with an area boundary line 57a around it so that it can be confirmed on the editing screen.

When the “BGM effect setting area” 57 is selected by clicking with the mouse button in the area to which the sound effect is given (the area surrounding the text portion 55 on the left page 21), the BGM setting screen 90 (FIG. 7) is displayed. BGM music selection corresponding to the “BGM effect setting area” or the entire page image is performed.
On the BGM setting screen 90, a window of “keyword” 91 indicating a situation to be set by BGM, “type” 92 indicating atmosphere, and “BGM” 93 indicating music is displayed, and a plurality of selection branches are displayed on each window. . In the “keyword” 91 window, words such as seasons, tempos, and feelings related to the situation to be set as options are displayed as keywords. In the “type” 92 window, the words below the phrase selected in “keyword” 91 are displayed. The choices are displayed, and in the “Music” 93 window, the lower-layer choices for the word / phrase selected by “Type” are displayed, so that the type of BGM sound can be easily selected using the keyword.
For example, if you want to express your feelings with BGM, select “feelings” in “keyword” 91, and words such as “happy”, “sad”, “quiet”, etc. will be displayed as options in the “type” 92 window. ”To select one or a plurality of phrases, a BGM corresponding to the atmosphere is searched, and several specific songs“ theme to ”are displayed in the“ BGM ”93 window.

By clicking on an option for which a production effect is desired in each window, the option is highlighted.
On the BGM setting screen 90, a viewing key 95 for viewing each BGM and a volume 96 for volume setting are displayed.

The music data used as the BGM may be recorded with a musical instrument live performance or voice recorded by the microphone 10 and stored. The performance of the MIDI device may be input as MIDI and stored as MIDI data. Alternatively, song data may be created and stored with an instrument performance editing tool on the screen. Music data automatically generated by setting a rhythm pattern, style pattern, chord progression, key, key, tempo, etc. may be stored.
Further, existing music data such as MIDI and Wave files may be selected and stored.

When the BGM setting screen 7 is closed, reproduction time data is created, and a rectangular part 42b having a length corresponding to the production time (BGM performance time) is displayed on the BGM part 42 of the timeline 40. The position of the left end of the rectangular portion 41b in the timeline 40 corresponds to the playback start time of the BGM effect.
The reproduction of the BGM effect data is sequentially reproduced according to the sound generation timing on the timeline 40.

Further, the “production by BGM” may be set so that the same music flows when the picture book page is opened (the entire page image) without being linked to the audio production.
In this case, the length of the rectangular portion 42b is changed by positioning the distal end of the pointing device such as a mouse at the right end or the left end on the rectangular portion 42b and dragging in the left-right direction. This may be dealt with by adjusting and changing the width corresponding to the entire page image, or an arbitrary area in the page may be newly set for BGM production.
When one BGM is selected for the entire page image, the current BGM may be loop-played indefinitely until the new page switching process or the next-played BGM starts, or not looped. You may fade out.

Next, the case where the effect set for the page image is a “sound effect” (secret effect) will be described. In this case, after launching the effect image creation program, the effect setting mode (editing mode) is selected, and “secret attribute” is selected in the switching window 47 of the effect image setting page 20.
Place the mouse button (the tip of the cursor displayed on the pointing device) on the sound window 44a of the timeline 40 displayed at the bottom of the effect image setting page 20 and click it to make the setting screen, and perform the secret effect in the page image By dragging the desired area with the mouse button, the area of the arbitrary area is displayed in a rectangle in the page image.
For example, a rectangular area surrounding the sun picture 50 is referred to as a “secret effect setting area” 51.

  A “secret effect setting area” 51 displayed in a rectangular shape when setting the effect image for the secret effect is displayed when the effect image setting page 20 is displayed on the display device 7 when the effect image is set by displaying the page image. ), An area boundary line 51a is displayed around it so that the effect setting area can be confirmed.

The sound setting screen 60 (FIG. 8) is displayed by clicking the “secret effect setting area” 51 displayed in a rectangular shape with a mouse button, and an effect pattern corresponding to the “secret effect setting area” 51 is set.
On the sound setting screen 60, a keyword 61 indicating a sound type, a sound effect 62, and a pan 63 window are displayed, and a plurality of selections are displayed in each window. In the keyword 61 window, phrases such as nature / motion / footsteps related to the type of sound are displayed as keywords, and in the sound effect 62 and pan 63 windows, lower-layer options for the phrase selected in the keyword 61 are displayed. By displaying, it is easy to select a sound type using a keyword.
For example, if you want to produce a sound related to a natural phenomenon, if you select “Natural” as the keyword 61, sounds such as “Wave”, “River”, “Thunder”, etc. will be displayed as options in the sound effect 62 window. As a method for expressing sound from the left and right speakers, center / left / right / left → right / right → left are displayed as options.

By clicking on an option for which a production effect is desired in each window, the option is highlighted (in this example, “Nature”, “River of the river”, and “Right” are selected).
On the sound setting screen 60, a viewing key 65 for viewing each sound and a volume 66 for volume setting are displayed.
Then, when the sound setting screen 60 is closed in this state, reproduction time data is created, and the rectangular portion 44b having a length corresponding to the effect time is added to the sound part 44 of the timeline 40 of the effect image setting page 20 in which the effect contents are set. Is displayed.

In the case of “secret production”, since the production is irrelevant to the development of the story, the production effect is reproduced when the secret production is selected within the time when the predetermined secret production can be reproduced.
The length in the left-right direction of the rectangular portion 44b in the timeline 40 is displayed with a length corresponding to the reproduction time of data given as sound, but the tip of the pointing device such as a mouse is positioned at the right end or the left end on the rectangular portion 44b. By dragging in the left-right direction after being positioned at, it is possible to change the length of the rectangular portion 44b to adjust and change the length of the production time, and to edit the production timing.

  The sound used as the production effect sound is recorded through the A / D converter 9 as a sound or voice recorded by a microphone 10 such as a wave or river flow in nature. It is also possible to memorize the footsteps “tech-tech” and “dosudos” created by using a rhythm instrument with an instrument editing tool. Alternatively, an elephant call reproduced by a trumpet performance of a MIDI device may be input as MIDI and stored as MIDI data. Further, existing sound data such as a sound effect wave file may be stored.

When the secret effect is set according to the above procedure, when the effect setting mode is selected (effect image setting page 20), when the mouse cursor (tip of the pointing device) is positioned in the “secret effect setting area” 51, A finger-shaped graphic 25 indicating that it can be clicked is displayed.
On the page image playback screen 70 displayed on the display device 7 when the effect image playback mode is selected as shown in FIG. 5, the mouse cursor (tip of the pointing device) is located in an area other than the “secret effect setting area” 51. The arrow graphic 26 is displayed when it is positioned (FIG. 5A), but it can be clicked when the mouse cursor (tip of the pointing device) is positioned in the “secret production setting area” 51. Is displayed (FIG. 5B), it can be recognized that it is a “secret effect setting area” in the effect image playback mode (viewing mode).

In addition, in the page image playback screen 70, the region boundary line 51a displayed when setting the effect image for the secret effect (effect image setting page 20) is not displayed, and the secret effect is applied to any part of the page image. I do n’t know if it ’s been done.
Then, in the page image playback screen 70, when the mouse cursor (tip of the pointing device) is clicked and selected at a position displayed by the finger shape 25 indicating that it can be clicked, the sound setting screen 60 described above is selected. The secret production set in is played.

The secret effect is reproduced when the following operation is performed when the effect image reproduction mode is selected.
That is, when “automatic turning” is selected in the effect image playback mode, the finger shape is within the interval time described above (the period from the end of playback of the previous page until the next page is displayed). The secret effect is reproduced when the secret effect region is selected by clicking in the effect region 50 where the graphic 25 is displayed.
If “automatic turning” is not selected in the effect image playback mode, the secret effect is played when the secret effect area is selected by clicking in the effect area 50 after the page playback ends.

The switching window 47 for switching between “story attribute” and “secret attribute” may be displayed even when the effect image playback mode is selected (when the page image playback screen 70 is displayed). In this case, when “story attribute” is selected in the effect image playback mode switching window 47, the “secret” effect playback is canceled and each page image is displayed mainly based on the story of the picture book. Also, if the secret production area is selected by clicking the finger shape 25 when selecting “story attribute”, playback of the secret production is prohibited, or the story playback is paused and the secret production is played back by interruption. May be.
When “secret attribute” is selected in the switching window 47, the mode is such that only “secret” effect reproduction is performed on each page image.
In addition to the “story attribute” and the “secret attribute”, the mode in the switching window 47 may be set to “story + secret attribute” that can reproduce the secret effect while reproducing the story attribute.

In the example described above, the effect is given to the effect area (secret effect setting area 51) specified in the page image displayed on the effect image setting page 20, but the entire page image is set as the effect area. Also good. When the secret effect is set with the entire page image as the effect region, the mouse cursor (tip of the pointing device) is displayed on the finger shape 25 at any position in the page image and can be clicked.
In the above example, the area designated as the effect area is a rectangle. However, the shape may be arbitrary as long as the figure is a mark such as a circle or a triangle, and the size may be small. .

  In the above example, the sound effect is set as the “secret effect”. However, in the effect image setting page 20, the story attribute is selected in the switching window 47, and the “sound effect” 44 is clicked to set the effect effect in the same procedure. For example, a sound production as a “story production” can be set.

  Next, the case where the effect set for the page image is “animation effect” (story effect) will be described. In this case, after launching the effect image creation program, the effect setting mode (editing mode) is selected, and “story attribute” is selected in the switching window 47 of the effect image setting page 20.

Area where you want to create an animation effect in the page image by clicking the mouse button (the tip displayed on the pointing device) on the animation window 43a of the timeline 40 displayed on the effect image setting page 20 and clicking By dragging with the mouse button, the area of the arbitrary area is displayed as a rectangle.
For example, a rectangular area surrounding the dog picture 52 is referred to as an “animation effect setting area” 53.

  The “animation effect setting area” 53 displayed in a rectangular shape when setting the effect image for the animation effect is displayed when setting the effect area by displaying the page image (when the effect image setting page 20 is displayed). An area boundary line 53a is displayed around the set area so that the set area can be confirmed.

An animation setting screen 80 (FIG. 9) is displayed by clicking in the “animation effect setting area” 53 displayed in a rectangular form, and an effect pattern corresponding to the “animation effect setting area” 53 is set.
On the animation setting screen 80, windows of “style” 81 indicating the type of animation operation, “pattern” 82 indicating the change of animation operation, “magnification of change” 83, and “change time” 84 are displayed. A plurality of selection branches are displayed. In the “style” 81 window, words such as rotation, zoom, and deformation related to the type of animation motion are displayed as keywords as options, and in the “pattern” 82 window, the lower layer for the word selected in “keyword”. By selecting “extends vertically”, “extends horizontally”, “rounds”, and the like, the types of keyword actions can be easily selected. In the “change size” 83 window, a word indicating the degree of change such as small / large is displayed as an option, and in the “change time” 84 window, the length of time such as short / long is displayed as an option. The wording is displayed.
For example, if you want to produce an effect by transforming the animation in the page image, select “Deform” in “Style” 81, and the window of “Pattern” 82 will “extend horizontally”, “extend vertically”, “round”, etc. The type of deformation operation is displayed as an option.

The text or wording is highlighted by clicking on the option for which the effect is desired in each window, and the selection in each window on the animation setting screen 80 is confirmed when the animation setting screen 80 is closed.
When the animation setting screen 80 is closed, playback time data is created, and the animation section 43 of the timeline 40 has a length corresponding to the production time (for example, the time during which the animation operates) corresponding to the production area (“anime production setting area” 53). A rectangular portion 43b is displayed. The position of the left end of the rectangular portion 43b in the timeline 40 corresponds to the reproduction start time of the animation effect, and this reproduction start time corresponds to each effect area (“anime effect setting area” 53 stored in the effect area setting means 12. ) Playback time data.

  The position of the rectangle 43b on the time axis 45 of the timeline 40 is determined based on the reproduction time data created based on the coordinate data of each effect area stored in the effect area setting means 12, and the reproduction position of the effect on the time axis 45. Are automatically sorted. The left end of the rectangular portion 43b is the start of the production time, and the right end is the end. The length of the rectangular portion 43b in the horizontal width direction is displayed in a length corresponding to the time set in advance as the production time, but the tip of the pointing device such as a mouse is positioned at the right end or the left end on the rectangular portion 43b. By dragging in the left-right direction, the length of the rectangular portion 43b is changed, and the effect timing can be edited by changing the start time, the end time, and the effect time length.

If you want to use an animation image that is used as an animation production and that is obtained by extracting the character part excluding the background data from the “animation production setting area” 53, create background removal data when setting the production effect, and use this background removal data. Is used as an animation image, the character drawn in the “animation production setting area” 53 can be given an action according to the “style” 81 and the “pattern” 82 at that location.
When performing an animation effect using an animation image, a cross mark is displayed at the center position where the animation image is displayed, and an effect such as rotation of the animation image with respect to the cross mark is given. The position of the cross mark may be freely set on the screen.
Also, instead of reading from each page of the picture book for anime images, use original character images that you created and stored yourself, or existing anime images that were stored in advance in the production image creation program. There may be.

  As a method of reproducing the animation production, a general animation drawing method is used. For example, the animation image of “dog” extracted from the picture book by removing the background image can be rotated at the position where the dog is depicted on the page, or many rain lines can be depicted on the screen in rainy scenes. In this scene, the entire page is greatly shaken, or a specific face of the group photo is zoomed.

  The animation effect may be associated with the size and position of the effect area. For example, zooming, panning, scrolling, spin processing, mosaic processing, deformation processing, and processing with ripples are performed in correspondence with the effect area.

In addition, in the effect image setting page 20, the page of the picture book is displayed in a spread state, and a timeline 40 corresponding to “audio effect”, “BGM effect”, “animation effect”, and “sound effect” is displayed below the page. By setting “animation production” and “sound production” at the same timing position in the timeline for the same production setting area, two types of production effects are produced for one production area set by the production area setting means. Can be applied.
For example, with respect to the “animation production setting area” 53 as one production area in the “story production”, two types of production of an animation production and a sound production corresponding thereto (for example, “dog rotation in animation production” and By setting “Generate sound of dog barking”) at the same timing in the sound production, it is possible to realize a production effect in which the image and the sound are synchronized.

  In the above example, the animation effect is set as the “story effect”. However, the secret attribute is selected in the switching window 47 on the effect image setting page 20, and the “sound effect” 44 is clicked to set the effect. For example, an animation production as a “secret production” can be set.

  In each of the above-described examples, the display device 7 displays the left and right pages of the picture book page in a spread state, and reproduces the pages so that they are turned one by one. It may be a way of reproduction.

  According to the above-described effect image creation device and effect image creation program, a page image of a picture book that a child wants to show to children, such as a masterpiece picture book or a picture-story show, is read into a computer, and changes in movement to characters appearing with his / her sensitivity You can freely set the animation production that gives the sound, the sound production that generates the sound effect, the BGM production, and the audio production that generates the voice, and the secret production that seems to be surprised or delighted when the child finds himself / herself By setting as, you can change the scenes and pictures of each scene, and you can freely enjoy your own picture book production that cannot be tasted with conventional electronic picture books that have only a fixed mechanism and production.

  When setting audio production for text in a picture book, the voice of the child's parent can be stored as audio data, and even when the parent is not present or busy You can read a picture book with a loving voice.

  In addition, it is possible to set a plurality of effects such as an animation effect and a sound effect corresponding to the animation effect, an animation effect and a sound effect corresponding to the effect effect, and realize an effect effect in which the image and the sound are synchronized. be able to. For example, you can associate text effects such as text, clauses, and words on picture book pages with audio by enclosing text in speech with a frame, zooming, or changing the color of text. It is also possible to make the child aware of the correspondence between the voice and the character, and expect the effects of learning the character and improving the language skills.

  Furthermore, the area to be rendered in the page image, the secret rendering object and type, the type of sound effect and BGM, the type of sound, the timing of the production, etc. can be freely changed at any time. You can enjoy a fresh picture book appreciation.

  In addition, the user can edit an image with a story, a secret effect, sound effects, audio, and BGM while editing the actual picture book page on the computer screen, providing an intuitive and easy-to-understand user interface for everyone. can do.

  By using the effect image creation device of the present invention, various effects such as a secret effect, a sound (sound effect) effect, a sound effect, and a BGM effect can be set in any area of each page of the picture book as desired. By making it possible, it is possible to obtain an electronic picture book or the like having a highly flexible effect.

It is a block diagram which shows the structure of the production image creation apparatus which concerns on one Embodiment of this invention. It is a flowchart figure which shows the operation | movement procedure by the effect image creation program of this invention. It is explanatory drawing which shows the screen of an example of the production image setting page displayed on the display apparatus. It is explanatory drawing which shows the screen of an example of the audio | voice effect setting window displayed on the display apparatus. (A) And (b) is explanatory drawing which shows an example of the page image reproduction | regeneration screen displayed on the display apparatus. (A) And (b) is explanatory drawing which shows a part of effect image setting page displayed on the display apparatus at the time of the setting of "audio | voice effect". It is explanatory drawing which shows the BGM setting screen displayed on the display apparatus at the time of the setting of "BGM production". It is explanatory drawing which shows the sound setting screen displayed on the display apparatus at the time of the setting of the "sound effect" in "secret production". It is explanatory drawing which shows the animation setting screen displayed on the display apparatus at the time of the setting of "animation production".

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... CPU, 2 ... ROM, 3 ... RAM, 4 ... Sound source device, 5 ... Scanner device, 6 ... Input device, 7 ... Display device, 8 ... External recording device, 9 ... A / D converter, 10 ... Microphone, DESCRIPTION OF SYMBOLS 11 ... Image memory | storage means, 12 ... Production area setting means, 13 ... Production effect setting means, 14 ... Production reproduction means, 20 ... Production image setting page, 30 ... Operation key window, 40 ... Time line, 45 ... Time axis, 47 ... Switching window, 51 ... Secret effect setting area, 51a ... Area boundary line, 53 ... Animation effect setting area, 53a ... Area boundary line, 57 ... Audio effect setting area, 57a ... Area boundary line, 60 ... Sound setting screen, 70 ... page image playback screen, 80 ... animation setting screen, 90 ... BGM setting screen.

Claims (11)

A device for storing a plurality of images to be captured for each page as electronic information, and displaying the images for each page,
Image storage means for storing each page image;
Effect area setting means for setting each page image or part of the page image as an effect area;
Production effect setting means for selecting a production type corresponding to the production area as a production effect;
An effect image creating apparatus comprising effect reproduction means for reproducing the effect when each of the page images is displayed or when the effect area is selected.   2. The effect image creating apparatus according to claim 1, wherein the effect region setting means records the coordinate data of the effect region when setting a part of the page image as the effect region, and generates reproduction time data correspondingly.   The effect image creating apparatus according to claim 2, wherein the effect reproduction unit reproduces the effect at a timing corresponding to the reproduction time data.   The effect image creating apparatus according to claim 1, wherein a plurality of effect effects are associated in the effect effect setting unit with respect to one effect region set by the effect region setting unit.   The effect area setting means sets an attribute of any one of a story effect, a secret effect, or both effects for the effect area, and the effect playback means performs an effect in the effect playback mode corresponding to each attribute. The effect image creation device according to claim 1 which performs reproduction.   3. The effect image creation device according to claim 2, wherein the reproduction time data for each effect is displayed and editable on a timeline for each type of effect.   2. The effect image creation apparatus according to claim 1, wherein the effect effect selection unit selects and searches for an effect by a keyword corresponding to the content of the effect type.   The effect image creating apparatus according to claim 1, wherein the effect area set by the effect area setting means is displayed in such a manner that the area can be determined when the page image is displayed and the effect area is set. An image reading step of storing a plurality of images captured for each page as electronic information corresponding to each page image;
An effect area setting step for setting each page image or part of the page image as an effect area,
An effect setting step for selecting an effect type corresponding to the effect area as an effect,
An image display step for displaying each page image for each page;
An effect image creation method comprising: an effect reproduction step of reproducing the effect when each page image is displayed or when the effect area is selected.   An effect image creating program capable of executing each step of the effect image creating method according to claim 9 by a computer.   A computer-readable recording medium in which the effect image creating program according to claim 10 is stored.

Images