JP2010039851A - Apparatus, method and program for reproducing image with effect, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an effect image reproducing apparatus which provides an electronic image book to which a plurality of persons apply different effects by setting various effects to optional areas of respective pages of an image book according to their preference. <P>SOLUTION: The effect image reproducing apparatus stores a plurality of images to be fetched for each page, as electronic information and displays the images by page. The apparatus includes: an image storage means 11 which stores each page image; an effect area setting means 12 which sets each page image or a part of a page image as an effect area; an effect selection means 13 which selects a type of effects corresponding to the effect area as an effect; an effect reproducing means 14 which reproduces the effect when each page image is displayed or the effect area is selected; an effector recording means 15 which records the effects for each effector; and an effector selection means 16 which selects recorded effector during reproduction. The effectors set effects to each page image, and effects set by selected effectors are reproduced. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention stores, for example, an image of each page such as a picture book as electronic information, and in an electronic picture book that is displayed for each page on a computer screen, various rendering effects can be freely added to the image of each page. The present invention relates to an effect image playback device and an effect image playback method that can be played back, and further relates to an effect image playback program and a recording medium for causing a computer to create an effect image.

Conventionally, for example, as disclosed in Patent Document 1, a background image and a moving image in a picture book are written on a recording medium, and the background image and the moving image read from the recording medium are combined on the display unit. An electronic picture book display device has been proposed in which an animation function and sound are added to display a picture book in such a manner that an effect that cannot be obtained only by a still picture is given.
JP 5-120400 A

That is, according to the electronic picture book display device, a picture book page is displayed, and an animation operation is performed on animals, landscapes, etc. in a scene while reproducing voice, BGM, and sound for reading a sentence on the page. is there.
There is also an electronic picture book display device in which a secret effect such as a change in the screen or a sound effect is given by designating a specific position of an image in a page with a pointing device or the like.

However, according to the electronic picture book display device described above, in the image shown on the display unit, the location where the screen changes, such as the type of animation operation and the switching timing, and the type of change are fixed. Not only does it not match the taste of the reader (picture book readers), but the phenomenon of being tired of the freshness of changes over time will occur.
In addition, when the secret picture is produced in the electronic picture book display device, when the picture book is viewed for the first time, it is expected that the place causing the change will not be understood. However, if the place is understood, there is a problem that the interest does not continue.
Further, in the case of a conventional electronic picture book display device, there is a problem that only one kind of effect can be enjoyed for one electronic picture book.

  The present invention has been proposed in view of the above circumstances, and it is possible for a plurality of directors to be set so as to cause various effects according to preferences in an arbitrary area of each page of a picture book. It is an object to provide an effect image playback device, an effect image playback method, an effect image playback program, and a recording medium that can obtain an electronic picture book or the like with different effect effects.

  In order to achieve the above object, an effect image reproduction device according to the present invention is a device for storing a plurality of images captured for each page as electronic information and displaying the images for each page, and storing each page image. Image storage means, effect area setting means for setting each page image or part of the page image as an effect area, effect effect setting means for selecting the effect type corresponding to the effect area as the effect effect, When each page image is displayed, or when the effect area is selected, the effect reproducing means for reproducing the effect, and the effect set by the effect effect setting means for each of a plurality of effectors. And a director recording means for recording separately, and a director selecting means for selecting a director recorded in the director recording means when playing back by the player reproducing means. It is characterized of.

  The effect image reproducing device of the present invention has a second feature that a display window is provided for displaying an image of an effector who has made effect settings when each page image is displayed.

  A third feature of the effect image reproducing device of the present invention is that the effector image displayed in the display window is a moving image.

  The effect image reproducing device according to the present invention is characterized in that a switching unit for effector switching is displayed when each page image is displayed.

The effect image reproduction method of the present invention is:
An image reading step of storing a plurality of images captured for each page as electronic information corresponding to each page image;
A director selection step of selecting a director who gives a presentation effect to each page image or part of the page image from a plurality of directors;
An effect area setting step for setting each page image or part of the page image as an effect area of the performer,
A production effect setting step of selecting a production type corresponding to the production area as a production effect of the director,
An image display step of displaying each page image to which a rendering effect is given by the director for each page;
An effect reproduction step of reproducing the effect when the page images are displayed or when the effect area is selected.

  The effect image reproduction program of the present invention is characterized in that each step shown in the effect image reproduction method can be executed by a computer.

  The recording medium of the present invention stores the effect image reproduction program readable by a computer.

  According to the effect image reproducing device having the first feature of the present invention, the effector recording means for distinguishing and recording the effect effect set by the effect effect setting means for each of the plurality of effectors, and recording in the effector recording means By providing a director selection means for selecting a director who has been performed, when setting a free stage effect such as image change or sound addition at any position of each page image, the stage effect is set for each director. And this can be played back.

  According to the effect image reproducing device having the second feature of the present invention, during the reproduction, the effector who has set the effect is provided by providing a display window for displaying the image of the effector who made the effect setting. It can be recognized from the image of the display window.

  According to the effect image reproducing device having the third feature of the present invention, when the sound of the electronic picture book is reproduced by making the image of the effector displayed on the display window a moving image, the effector speaks. It is possible to exert an effect like that.

  According to the effect image reproducing device having the fourth feature of the present invention, when each page image is displayed, the effector is switched during the reproduction by displaying the switching unit for performing the effector switching. It can be carried out.

  According to the effect image reproduction method of the present invention, by executing the above steps, a page image such as a picture book is read into a computer, and an image change or sound is added to any position of each page image by each effector. Can be played for each director.

  According to the effect image reproduction program and the recording medium of the present invention, each step shown in the effect image reproduction method can be read into a computer and executed.

The effect image playback device of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing a hardware configuration of an effect image playback device according to an embodiment of the present invention. The effect image playback device is an apparatus that creates effect images in which various effect effects are set for images of each page such as a picture book stored as electronic information, and allows the created effect images to be reproduced for each page. is there. Further, for each page image such as a picture book, existing image data stored in advance may be used, or a picture book stored for each page by an image reading means may be used.

  The hardware of the effect image playback device can be realized by a general-purpose information processing device such as a personal computer. The effect image reproducing device is composed of a CPU 1, a ROM 2, a RAM 3, a sound source device 4 composed of software as a sound source, a DSP for effect addition, a scanner device 5 for reading an image, and a pointing device such as a keyboard and a mouse. Input device 6 and a display device 7 such as a liquid crystal display. As the display device 7, a well-known display means for displaying the processing result of the personal computer, such as a liquid crystal display, can be used. In addition, an external storage device 8 for inputting / outputting data to / from the recording medium is connected to the personal computer, and voice and the like are input and stored via the A / D converter 9. A microphone 10 is connected.

In the ROM 2 of the computer, an effect image reproduction program for reproducing the effect image is installed from a recording medium attached to the external storage device 8 or downloaded from a predetermined URL via the Internet.
The CPU 1 executes various processes (each step) in accordance with a predetermined control program (effect image reproduction program) installed by the above-described procedure, and controls the entire apparatus. The image storage means 11, the effect area setting means 12. By providing the effect effect setting means 13 and the effect reproduction means 14 as the main functions, a plurality of images captured for each page are stored as electronic information, and the stored images can be displayed on the display device 7 for each page. .

  Further, the CPU 1 includes the director recording unit 15 and the director selection unit 16 so that the stage effect by the stage effect setting unit 13 is stored for each set stager, and the stage effect reproduction by the stage playback unit 14 is reproduced. By enabling reproduction for each selected director, for example, a plurality of directors can be registered for one picture book data. Then, when reproducing picture book data, a director is selected from the list of directors, and the effects given by the director to each page of the picture book data are sequentially played back, for example, along the story of the picture book.

The RAM 3 temporarily stores information used for processing in the CPU 1.
A sound system 4 a including a D / A converter, an amplifier, and a speaker is connected to the sound source device 4.

Therefore, the effect image playback device installs or downloads the effect image playback program in the personal computer, thereby reading and storing the page image in the hard disk of the personal computer, and the effect in the read page image. An effect area setting unit 12 that sets an area to be applied, an effect effect setting unit 13 that associates an effect with the set effect area, and an effect reproduction unit 14 that reproduces the page image on which the effect has been applied are read. Switch between the image playback mode, the effect setting mode (editing mode) that gives the desired effect to the captured image, and the effect image playback mode (viewing mode) that reproduces the image with the effect. It is configured to display on the device 7.
In other words, the display device 7 displays the read image in the image playback mode (reading mode), displays an image playback screen for performing effect image playback in the effect setting mode (editing mode), and displays the effect image playback mode. In (viewing mode), the effect-set image with the effect is reproduced.

  The image storage unit 11 stores an image read from the scanner device 5 as each page image in the image reproduction mode. The image read from the scanner device 5 is each page of a picture book, a handwritten image, or the like, and an image based on electronic information photographed by a digital camera or the like may be directly taken into the image storage unit 11. Furthermore, each image stored in advance as a picture book image may be read and captured from an external storage device 8 or the like into an effect image reproduction program installed by a recording medium.

The effect area setting means 12 designates each page image or a part of the page image displayed on the display device 7 as an effect area in the effect setting mode, and stores this.
In the pointing device of the input device 6, the amount of movement in the X and Y directions is detected and added to the cursor coordinate data of the cursor point register on the RAM 3, so that the cursor on the display device 7 is based on this coordinate data. Is determined. Then, reproduction time data corresponding to the coordinate data of the position designated as the effect area in each page image displayed on the display device 7 is generated and stored in the effect area setting means 12.

The effect effect setting means 13 selects the effect type corresponding to the effect area as the effect in the effect image playback mode, and stores this. In addition, the attribute of the production to be set in the production area is set to one of the production of “story production” that produces in line with the story, “secret production” that produces an unexpected production, or both productions. It has become.
As the effect, there can be an effect accompanied by an image change such as an image enlargement / deformation process in addition to an effect based on sound source data such as sound, sound (sound effect), BGM or the like.
Selection of the effect for the effect area is performed for each effect area, but each effect effect in the page image is determined by reproduction time data corresponding to the coordinate data of each effect area stored in the effect area setting means 12. The playback order is assigned. Further, the selection of each production effect is made possible by selecting and searching for a keyword corresponding to the content of the production type, so that the necessary production effect can be easily selected.

The effect reproduction means 14 reproduces the effect at the timing corresponding to the reproduction time data when each page image on which the effect setting is performed is displayed in the effect image reproduction mode and the effect image reproduction mode. . In other words, when there are a plurality of effect areas in the page image, the reproduction is performed in the order assigned by the reproduction time data based on the coordinate data of the effect area stored in the effect area setting means 12.
In the case of a secret effect described later, when the effect region in the page image is selected by a pointing device such as a mouse constituting the input device 6, the effect specified by the effect effect setting means 13 is reproduced. It is.

The director recording unit 15 records the stage effect set by the stage effect setting unit 13 separately for each of the plurality of directors. That is, when setting the production effect by the production effect setting means 13, first, the production person is set, and this production person designates each page image or a part of the page image as the production area and each production effect. Is given.
When the effect image reproduction program is launched on the personal computer, an initial screen 300 as shown in FIG. 2 is displayed.
On the initial screen 300, a cover 301 of a picture book image is displayed in the center. The cover 301 corresponds to the picture book cover displayed in the center of the lower list 302. By clicking “←” and “→” displayed on both sides of the cover 301, the list 302 moves in the horizontal direction. The picture book located in the center changes and the picture book can be selected. In addition, an effect setting person window 303 is displayed on the upper part of the cover 301 of the picture book. When reproduction of the picture book is selected in this state, the picture set on the cover 301 is displayed by the effect setting person displayed on the effect setting person window 303. The production effect is played back.
In the lower part of the screen, “environment setting” 310 for setting various environments, on the left side of the screen, “image” 320 for reading a page image, “effect” 321 for giving an effect on the page image, and for the page image on which the effect is given. Each window of “output” 322 for reproduction and “print” 323 for printing the displayed screen is displayed. By selecting “environment setting” 310, “peripheral equipment” “production” connected to the personal computer The setting screen 330 of FIG. 3 for performing various settings regarding “display” is displayed, and by clicking “director setting” 331 of “production”, the director setting screen 340 of FIG. 4 is displayed.

On the director setting screen 340, a registration list 341 of directors who already performed the page image is displayed. By selecting a director in the registration list 341, the director window 342 on the right side displays the registration list 341. The director's image is displayed. In this example, “CMUSIC”, which is an existing effect setting example recorded in advance in the effect image reproduction program, and items set with effect by “Okasan” are registered in the registration list 341, respectively.
Below the registration list 341, windows of “new registration”, “change”, and “delete” are displayed. By appropriately selecting and clicking the “OK” button, the director performs “new registration” “change” “ "Delete" is executed.
For example, when “Otosan” is newly registered and added as a director, new registration is executed to display the director information screen 350 of FIG. 5, “Otosan” is input as the name, and the face image display unit The face image in 351 is selected from the face image selection unit 352. The image selected by the face image display unit 351 is linked to the face image displayed in the effect setting person window 303 and the effector window 342 described above.
As for the face image, general animation images of “Otosan's picture”, “Okasan's picture”, “Grandpa's picture”, and “Grandma's picture” are registered in advance as picture book data directors, and can be selected from them. Yes. In addition, by selecting “Read Image” in the face image selection unit 352 and executing “Read Image” 353 to read a photographic image or the like from the scanner device 5, an actual “Otosan” image is displayed in the director window. It can also be made. By clicking the OK button in the director information window 350, as shown in FIG. 6, “Otosan” is added to the registration list 341, and the director who displays the image of “Otosan's picture” in the director window 342. A setting screen 340 is displayed.

When the effect is set for each page image after setting the director, the effect setting screen 400 shown in FIG. 7 is displayed by clicking “effect” 321 on the initial screen 300. By clicking each icon of the page development unit 401 displayed at the upper center of the screen, the previous page, the rear page, and the first page are displayed, and the effect is set. Further, in the effect setting screen 400, the same director image as the image displayed on the face image display unit 351 of the director information window 350 is displayed on the upper right in order to make it easy to understand which director is set. It is displayed in the effect performer window 410.
The operation key window 402 is provided with a playback button for playing back and confirming the set effect, a stop button for stopping the playback, and a return button for returning to the original playback of the picture book page during playback. Yes.
The effect setting screen 400 of FIG. 7 shows a state where an effect effect for sound is set, and a specific method for setting the effect effect will be described later.

The director selecting unit 16 selects a director to be reproduced from the directors set by the director recording unit 15 when the page reproducing unit 14 reproduces the page image.
After setting (selecting) the director, clicking the “output” 322 on the initial screen 300 displays the effect playback screen 500 shown in FIG. 8, and the selected director is displayed on each page of the picture book. Each effect produced on the image is reproduced in sequence.
In the effect reproduction screen 500 of FIG. 8, the same director image as the image displayed on the face image display unit 351 of the director information window 350 is displayed on the upper right side in order to make it easy to understand which director is playing. Are displayed in the effect performer window (display window) 510.
The director image displayed in the director executor window 510 can be displayed as a moving image by displaying an animated moving image such as a dad's image of moving a mouth stored in advance in addition to a still image.

  Similarly to the effect setting screen 400 of FIG. 7, each page of the previous page, the rear page, and the first page of the picture book is displayed by clicking each icon of the page development unit 501 displayed at the upper center of the screen. In addition, the operation key window 502 is provided with a reproduction button, a stop button for stopping reproduction, and a return button for returning to the original reproduction of the picture book page during reproduction.

  In addition, in the effect reproduction screen 500 in the middle of reproduction on which the page image is displayed, the effector setting shown in FIGS. 4 and 6 can be performed by clicking the effect setting person switching unit 520 displayed as an icon at the top of the screen. The screen 340 can be displayed on the screen, and the director can be switched from the registration list 341. In this case, the director who has switched from the subsequent playback is played back.

Next, creation and reproduction of a specific effect image using the effect image playback device will be described with reference to FIG.
Production of production images on each page of the picture book is divided into “story production” that produces the story along the story of the picture book, and “secret production” that causes unexpected image changes and sound generation in any part of the page image. , “Story production” and “Secret production” are concrete effects such as “sound production” that adds sound effects to characters in the page image, “animation production” that gives movement to characters in the page image, page For each page image, a “BGM effect” in which music flows when the image is displayed, a “voice effect” for giving a reading voice of a sentence written in the page image, and the like are performed.
The effects in each page image are set as the above-mentioned effects alone or in combination.

When creating an electronic picture book, an effect image reproduction program is started on the computer, and it is determined whether or not the director needs to be set (step 100). If the director is not set, the director is selected (step 100a). If the director has already been set, after determining whether or not to end the program, the image creation mode is selected in the mode selection of the image playback mode, the effect setting mode, and the effect image playback mode (step 101). ). Note that at the stage of image creation, it is not necessary to specify which director has created the image, so the setting of the director is not necessary.
Subsequently, a picture book composed of paper is read by the scanner device 5 for each page (step 102). The read image is displayed on the display device 7, and correction processing such as screen rotation, trimming, and tone correction is performed as necessary (step 103), and each page image is stored in the image storage unit 11 as electronic information. Image reading is completed by repeatedly reading each page image (step 104).
Each page image stored in the image storage means 11 is touched by the image reproduction means 14 with the key “→” (when proceeding to the next page) or “←” (when returning to the previous page) on the keyboard of the input device 6. As a result, the display device 7 can be played back by turning pages one by one (displaying the book as if it was read). Moreover, you may make it operate with each icon of the page expansion | deployment part 501 like the effect reproduction | regeneration screen 500 of FIG.
When existing picture book image data is used, the operation of reading an image in the image creation mode can be omitted.

When setting the production effect, it is determined whether or not the director needs to be set (step 100). When the director is not set or when the director is changed, the director is changed. Is selected (step 100a). When the director has already been set, after determining whether or not to end the program, the mode setting mode is selected in the mode selection (step 101), and the page image for which the stage image is to be created is selected as the stage image setting page 20 ( As shown in FIG. 10), on the effect image setting page 20, effect area setting for designating an effect area for each page image and effect effect setting for giving an effect to the effect area are performed (step 105). .
The effect setting ends when all the effect settings for each page image are set (step 106).

Next, when performing the effect reproduction, it is determined whether or not the setting of the director is necessary (step 100). When the director is not set or when the setting of the director is changed, the setting is made. A director is selected from the performed directors (step 100a). If the director has already been set, it is determined whether or not to end the program, and then the effect image playback mode is selected in the mode selection (step 101), and the effect image is played back on the display device 7 (step 107). ).
In the effect image playback mode, it is determined whether or not “automatic turning” for automatically turning and sequentially reproducing each page of the picture book is selected (step 108). If “automatic turning” is not selected, The playback ends only with the effect set for the page image, and when “automatic turning” is selected, the effect set for the page image is played back to the last page (step 109). The page is turned and the reproduction is repeated (step 110).
Although not shown in the flowchart of FIG. 9, when a playback stop operation is performed during page playback, the playback ends and the process returns to the start.
Reproduction of the effect in each page image is performed in the order assigned based on the reproduction time data created based on the coordinate data of the effect area.
In the case of “automatic turning”, the period from the end of playback of the previous page until the page is turned and the next page is displayed is managed as an interval time that is a preset period.

On the effect image setting page 20, as shown in FIG. 10, the picture book pages (left page 21 and right page 22) are displayed in a spread state, and the effect that is set on the left page 21 and the right page 22 in the “story effect”. Is displayed on the upper part of the picture book page. In the operation key window 30, a playback button 31 for playing back and confirming the set effect, a stop button 32 for stopping playback, and a picture book page (left page 21 and right page 22) at the beginning of playback. A return button 33 for returning to the sound volume and a volume button 34 for adjusting the playback sound volume are provided.
Each button of the operation key window 30 is played back by clicking the mouse (input device 6) button (cursor tip displayed by the pointing device) together with the buttons, and the left page 21 and “ The effect set on the right page 22 can be confirmed for each page screen.

  In the effect image setting page 20, the “voice effect” 41, “BGM effect” 42, “animation effect” 43, and “sound effect” 44 are located below the picture book pages (left page 21 and right page 22). A timeline 40 having a rectangular portion corresponding to each is displayed. A time axis 45 is displayed at the lowest position of the timeline 40.

In addition, a switching window 47 for switching between “story attribute” for setting “story effect” and “secret attribute” for setting “secret effect” is displayed on the left side of the timeline 40. ing. Switching between the “story attribute” and the “secret attribute” is performed by clicking the button of the mouse (input device 6) on the switching window 47, and the mode is switched for each click, but for each effect area in the effect setting mode. Can be set to switch.
At the left end of the time axis 45 of the timeline 40, playback time editing buttons 48a and 48b for increasing / decreasing a set value for editing the page playback time are provided.

Next, each effect of “audio production” (story production), “BGM production” (story production), “sound production” (secret production), and “animation production” (story production + secret production) is applied to the page image. The case of giving is described.
First, “voice production” is set for all sentences described in the spread pages (left page 21 and right page 22) of the picture book. The “voice production” is to give a reading sound to the production area. In this case, after launching the effect image playback program, the effect setting mode (editing mode) is selected, and “story attribute” is selected in the switching window 47 of the effect image setting page.
An area where you want to create a sound effect in the page image by clicking the mouse button (the tip displayed on the pointing device) on the sound window 41a of the timeline 40 displayed on the effect image setting page 20 and clicking By dragging with the mouse button, the area of the arbitrary area is displayed as a rectangle.
For example, a region displayed in a rectangle surrounding the sentence portion 54 by dragging with a mouse button is an “audio effect setting region” 57. An area boundary line 57a is displayed around the “audio production setting area” 57 so that its size can be confirmed on the editing screen. In this example, the area boundary line 57a is displayed. However, any form may be used as long as marks can be displayed at the four corners or the area within the area can be color-coded.
Then, by clicking in the “sound effect setting area” 57, a sound effect setting window (dialog box or the like) 200 as shown in FIG. 11 is opened and the contents of the effect are set. That is, by clicking the recording button 201 in the sound effect setting window 200, a sound for reading the sentence portion 54 is input from the microphone 10, and sound effect data having a length corresponding to the reading time through the A / D converter 9. Remember as. In the audio production setting window 200, pan change processing (producing a stereo effect depending on the relationship between the character position and dialogue), volume change processing (producing volume change), echo processing (producing Yamahiko effect), Reverb processing (production of sound in baths, caves, tunnels), pitch shift processing (change of voice pitch), time stretch processing (change of reading speed), mechanic processing (production of robots and alien voices) ) And the like can be added and edited with a variety of sound effects.
Further, it may be stored by selecting from already recorded audio data files.

When the audio effect setting window 200 is closed, time data corresponding to the effect time (time for reading the sentence portion 54) is automatically created, and the effect area (“ A rectangular portion 41b corresponding to the “sound production setting area” 57) is displayed. The length of the rectangular portion 41b in the timeline 40 corresponds to the production time, and the left end position corresponds to the reproduction start time of the audio production. This reproduction start time is determined by the reproduction time data of each effect area (“audio effect setting area” 57) stored in the effect area setting means 12.
That is, the length in the left-right direction in the rectangular portion 41a corresponds to the duration of each audio data, and both end positions indicate the start and end timing of sound generation from the page switching completion time. The sound generation timing can be edited by dragging the both end positions of the rectangular portion 41a. Moreover, you may make it perform a time stretch process by expanding / contracting the length (time area | region) of the left-right direction of the rectangular part 41a.
Similarly, “audio production setting areas” 57 surrounding the sentence portions 55 and 56 are created, the production contents are set in the respective audio production setting windows 200, and then the audio production setting windows 200 are closed, so that each reproduction period is set. The page playback time that is longer than the data and the entire reading time is sequentially updated, and a plurality of rectangular portions 41 b are displayed on the timeline 40. That is, every time a plurality of “sound production setting areas” 57 are created and updated, the page reproduction time is automatically set longer in accordance with the total length of the reading time.

When editing a sound effect in the “sound effect setting area” 57 that has already been set, the sound effect setting window 200 is opened by clicking in the existing “sound effect setting area” 57 and various edits are possible. It becomes. When the audio effect setting window 200 is closed after editing, update time data is created and the display of the timeline is also updated.
Further, when it is desired to change the entire page playback time, it can be lengthened by pressing the playback time editing button 48a for increasing / decreasing the set value of the timeline 40.

  The plurality of rectangular portions 41b for each effect area displayed on the timeline 40 are in the order of reproduction of the sound effects based on the reproduction time data of each effect area (“audio effect setting area” 57) stored in the effect area setting means 12. Is distributed. That is, the playback positions of the audio effects are automatically assigned so that each page corresponds to one time axis 45, and each page has a top priority in the vertical direction and a left priority in the horizontal direction. And the left end of each rectangular part 41b becomes the start of production time, and the right end becomes the end.

By first setting the sound effect for all sentence parts in the page image, the page reproduction time and the reproduction timing of each effect region are determined based on the coordinate data and the reproduction time data of each effect region.
When a page image in which the effect is set is reproduced in the effect image reproduction mode, the screen displayed on the display device 7 is a page image reproduction screen 70 shown in FIG. Each area boundary line 57a displayed on the effect image setting page 20 when performing the effect image setting of the sound effect is not displayed in order not to disturb the original image of the picture book and to keep the secret effect secret. .
When the audio data is reproduced, it is reproduced at the sound generation timing set by the audio unit 41 of the timeline 40 with each page image being displayed. As described above, the reproduction timing of the production effect is distributed according to the reproduction time data of the production area. That is, on the page image playback screen 70, the text portion 55, the text portion 54, and the text portion 56 are played back in order for the sound effect setting areas 57, 57, and 57.

In the above example, the audio part 41 of the timeline 40 is displayed on the effect image setting page 20 so that the reproduction time and start time of each effect can be edited. However, a simple specification that does not employ the timeline display may be used. it can.
In that case, when the display switching of the page is completed, the area start point (for example, the upper left position coordinate of the coordinate data when the text is written horizontally. The text is the vertical position when the text is written horizontally). In the case of writing, the upper right position coordinates) are searched, and these area start points are scanned from the page head position toward the page end position, and are reproduced sequentially from the sound data registered in the head sound effect area.
For example, when the text described in the page image is horizontal writing, as shown in FIG. 13A, the region start point is scanned from left to right in the horizontal direction from top to bottom, and the left position is given priority. In the case of vertical writing, as shown in FIG. 13B, the area start point is scanned from right to left in the vertical direction from top to bottom, and the audio data is given priority to the right position. Play.

Next, a case where the effect set for the page image is “BGM effect” (story effect) will be described. In this case, after launching the effect image playback program, the effect setting mode (editing mode) is selected, and “story attribute” is selected in the switching window 47 of the effect image setting page 20.
The “BGM effect” corresponds to a scene change in developing a story, and it is considered that the scene change corresponds to the sentence parts 54, 55, 56. Set the BGM effect.
Place the mouse button (the tip displayed on the pointing device) on the BGM window 42a of the timeline 40 displayed on the effect image setting page 20 and click it to set the setting screen. 21) is clicked with a mouse button to set a “BGM effect setting area” 57.
The “BGM effect setting area” 57 is displayed with an area boundary line 57a around it so that it can be confirmed on the editing screen.

When the “BGM effect setting area” 57 is selected by clicking with a mouse button in the area to which the sound effect is given (the area surrounding the text portion 55 on the left page 21), the BGM setting screen 90 (FIG. 14) is displayed. BGM music selection corresponding to the “BGM effect setting area” or the entire page image is performed.
On the BGM setting screen 90, a window of “keyword” 91 indicating a situation to be set by BGM, “type” 92 indicating atmosphere, and “BGM” 93 indicating music is displayed, and a plurality of selection branches are displayed on each window. . In the “keyword” 91 window, words such as seasons, tempos, and feelings related to the situation to be set as options are displayed as keywords. In the “type” 92 window, the words below the phrase selected in “keyword” 91 are displayed. The choices are displayed, and in the “Music” 93 window, the lower-layer choices for the word / phrase selected by “Type” are displayed, so that the type of BGM sound can be easily selected using the keyword.
For example, if you want to express your feelings with BGM, select “feelings” in “keyword” 91, and words such as “happy”, “sad”, “quiet”, etc. will be displayed as options in the “type” 92 window. ”To select one or a plurality of phrases, a BGM corresponding to the atmosphere is searched, and several specific songs“ theme to ”are displayed in the“ BGM ”93 window.

By clicking on an option for which a production effect is desired in each window, the option is highlighted.
On the BGM setting screen 90, a viewing key 95 for viewing each BGM and a volume 96 for volume setting are displayed.

The music data used as the BGM may be recorded with a musical instrument live performance or voice recorded by the microphone 10 and stored. The performance of the MIDI device may be input as MIDI and stored as MIDI data. Alternatively, song data may be created and stored with an instrument performance editing tool on the screen. Music data automatically generated by setting a rhythm pattern, style pattern, chord progression, key, key, tempo, etc. may be stored.
Further, existing music data such as MIDI and Wave files may be selected and stored.

When the BGM setting screen 7 is closed, reproduction time data is created, and a rectangular part 42b having a length corresponding to the production time (BGM performance time) is displayed on the BGM part 42 of the timeline 40. The position of the left end of the rectangular portion 41b in the timeline 40 corresponds to the playback start time of the BGM effect.
The reproduction of the BGM effect data is sequentially reproduced according to the sound generation timing on the timeline 40.

Further, the “production by BGM” may be set so that the same music flows when the picture book page is opened (the entire page image) without being linked to the audio production.
In this case, the length of the rectangular portion 42b is changed by positioning the distal end of the pointing device such as a mouse at the right end or the left end on the rectangular portion 42b and dragging in the left-right direction. This may be dealt with by adjusting and changing the width corresponding to the entire page image, or an arbitrary area in the page may be newly set for BGM production.
When one BGM is selected for the entire page image, the current BGM may be loop-played indefinitely until the new page switching process or the next-played BGM starts, or not looped. You may fade out.

Next, the case where the effect set for the page image is a “sound effect” (secret effect) will be described. In this case, after launching the effect image playback program, the effect setting mode (editing mode) is selected, and “secret attribute” is selected in the switching window 47 of the effect image setting page 20.
Place the mouse button (the tip of the cursor displayed on the pointing device) on the sound window 44a of the timeline 40 displayed at the bottom of the effect image setting page 20 and click it to make the setting screen, and perform the secret effect in the page image By dragging the desired area with the mouse button, the area of the arbitrary area is displayed in a rectangle in the page image.
For example, a rectangular area surrounding the sun picture 50 is set as a “secret effect setting area” 51.

  A “secret effect setting area” 51 displayed in a rectangular shape when setting the effect image for the secret effect is displayed when the effect image setting page 20 is displayed on the display device 7 when the effect image is set by displaying the page image. ), An area boundary line 51a is displayed around it so that the effect setting area can be confirmed.

The sound setting screen 60 (FIG. 15) is displayed by clicking the inside of the “secret production setting area” 51 displayed in a rectangle with a mouse button, and the production pattern corresponding to the “secret production setting area” 51 is set.
On the sound setting screen 60, a keyword 61 indicating a sound type, a sound effect 62, and a pan 63 window are displayed, and a plurality of selections are displayed in each window. In the keyword 61 window, phrases such as nature / motion / footsteps related to the type of sound are displayed as keywords, and in the sound effect 62 and pan 63 windows, lower-layer options for the phrase selected in the keyword 61 are displayed. By displaying, it is easy to select a sound type using a keyword.
For example, if you want to produce a sound related to a natural phenomenon, if you select “Natural” as the keyword 61, sounds such as “Wave”, “River”, “Thunder”, etc. will be displayed as options in the sound effect 62 window. As a method for expressing sound from the left and right speakers, center / left / right / left → right / right → left are displayed as options.

By clicking on an option for which a production effect is desired in each window, the option is highlighted (in this example, “Nature”, “River of the river”, and “Right” are selected).
On the sound setting screen 60, a viewing key 65 for viewing each sound and a volume 66 for volume setting are displayed.
Then, when the sound setting screen 60 is closed in this state, reproduction time data is created, and the rectangular portion 44b having a length corresponding to the effect time is added to the sound part 44 of the timeline 40 of the effect image setting page 20 in which the effect contents are set. Is displayed.

In the case of “secret production”, since the production is irrelevant to the development of the story, the production effect is reproduced when the secret production is selected within the time when the predetermined secret production can be reproduced.
The length in the left-right direction of the rectangular portion 44b in the timeline 40 is displayed with a length corresponding to the reproduction time of data given as sound, but the tip of the pointing device such as a mouse is positioned at the right end or the left end on the rectangular portion 44b. By dragging in the left-right direction after being positioned at, it is possible to change the length of the rectangular portion 44b to adjust and change the length of the production time, and to edit the production timing.

  The sound used as the production effect sound is recorded through the A / D converter 9 as a sound or voice recorded by a microphone 10 such as a wave or river flow in nature. It is also possible to memorize the footsteps “tech-tech” and “dosudos” created by using a rhythm instrument with an instrument editing tool. Alternatively, an elephant call reproduced by a trumpet performance of a MIDI device may be input as MIDI and stored as MIDI data. Further, existing sound data such as a sound effect wave file may be stored.

When the secret effect is set according to the above procedure, when the effect setting mode is selected (effect image setting page 20), when the mouse cursor (tip of the pointing device) is positioned in the “secret effect setting area” 51, A finger-shaped graphic 25 indicating that it can be clicked is displayed.
In the page image playback screen 70 displayed on the display device 7 when the effect image playback mode is selected as shown in FIG. 12, the mouse cursor (tip of the pointing device) is located in an area other than the “secret effect setting area” 51. The arrow graphic 26 is displayed when it is positioned (FIG. 12A), but it can be clicked when the mouse cursor (tip of the pointing device) is positioned in the “secret production setting area” 51. Is displayed (FIG. 12B), it can be recognized that it is a “secret effect setting area” in the effect image playback mode (viewing mode).

In addition, in the page image playback screen 70, the region boundary line 51a displayed when setting the effect image for the secret effect (effect image setting page 20) is not displayed, and the secret effect is applied to any part of the page image. I do n’t know if it ’s been done.
Then, in the page image playback screen 70, when the mouse cursor (tip of the pointing device) is clicked and selected at a position displayed by the finger shape 25 indicating that it can be clicked, the sound setting screen 60 described above is selected. The secret production set in is played.

The secret effect is reproduced when the following operation is performed when the effect image reproduction mode is selected.
That is, when “automatic turning” is selected in the effect image playback mode, the finger shape is within the interval time described above (the period from the end of playback of the previous page until the next page is displayed). The secret effect is reproduced when the secret effect region is selected by clicking in the effect region 50 where the graphic 25 is displayed.
If “automatic turning” is not selected in the effect image playback mode, the secret effect is played when the secret effect area is selected by clicking in the effect area 50 after the page playback ends.

The switching window 47 for switching between “story attribute” and “secret attribute” may be displayed even when the effect image playback mode is selected (when the page image playback screen 70 is displayed). In this case, when “story attribute” is selected in the effect image playback mode switching window 47, the “secret” effect playback is canceled and each page image is displayed mainly based on the story of the picture book. Also, if the secret production area is selected by clicking the finger shape 25 when selecting “story attribute”, playback of the secret production is prohibited, or the story playback is paused and the secret production is played back by interruption. May be.
When “secret attribute” is selected in the switching window 47, the mode is such that only “secret” effect reproduction is performed on each page image.
In addition to the “story attribute” and the “secret attribute”, the mode in the switching window 47 may be set to “story + secret attribute” that can reproduce the secret effect while reproducing the story attribute.

In the example described above, the effect is given to the effect area (secret effect setting area 51) specified in the page image displayed on the effect image setting page 20, but the entire page image is set as the effect area. Also good. When the secret effect is set with the entire page image as the effect region, the mouse cursor (tip of the pointing device) is displayed on the finger shape 25 at any position in the page image and can be clicked.
In the above example, the area designated as the effect area is a rectangle, but it may be a circle, a triangle, etc., or a closed figure created with a plurality of arbitrarily designated coordinates, and the size is small. It may be a thing.

  In the above example, the sound effect is set as the “secret effect”. However, in the effect image setting page 20, the story attribute is selected in the switching window 47, and the “sound effect” 44 is clicked to set the effect effect in the same procedure. For example, a sound production as a “story production” can be set.

  Next, the case where the effect set for the page image is “animation effect” (story effect) will be described. In this case, after launching the effect image playback program, the effect setting mode (editing mode) is selected, and “story attribute” is selected in the switching window 47 of the effect image setting page 20.

Area where you want to create an animation effect in the page image by clicking the mouse button (the tip displayed on the pointing device) on the animation window 43a of the timeline 40 displayed on the effect image setting page 20 and clicking By dragging with the mouse button, the area of the arbitrary area is displayed as a rectangle.
For example, a rectangular area surrounding the dog picture 52 is referred to as an “animation effect setting area” 53.

  The “animation effect setting area” 53 displayed in a rectangular shape when setting the effect image for the animation effect is displayed when setting the effect area by displaying the page image (when the effect image setting page 20 is displayed). An area boundary line 53a is displayed around the set area so that the set area can be confirmed.

An animation setting screen 80 (FIG. 16) is displayed by clicking in the “animation effect setting area” 53 displayed in a rectangle, and an effect pattern corresponding to the “animation effect setting area” 53 is set.
On the animation setting screen 80, windows of “style” 81 indicating the type of animation operation, “pattern” 82 indicating the change of animation operation, “magnification of change” 83, and “change time” 84 are displayed. A plurality of selection branches are displayed. In the “style” 81 window, words such as rotation, zoom, and deformation related to the type of animation motion are displayed as keywords as options, and in the “pattern” 82 window, the lower layer for the word selected in “keyword”. By selecting “extends vertically”, “extends horizontally”, “rounds”, and the like, the types of keyword actions can be easily selected. In the “change size” 83 window, a word indicating the degree of change such as small / large is displayed as an option, and in the “change time” 84 window, the length of time such as short / long is displayed as an option. The wording is displayed.
For example, if you want to produce an effect by transforming the animation in the page image, select “Deform” in “Style” 81, and the window of “Pattern” 82 will “extend horizontally”, “extend vertically”, “round”, etc. The type of deformation operation is displayed as an option.

The text or wording is highlighted by clicking on the option for which the effect is desired in each window, and the selection in each window on the animation setting screen 80 is confirmed when the animation setting screen 80 is closed.
When the animation setting screen 80 is closed, playback time data is created, and the animation section 43 of the timeline 40 has a length corresponding to the production time (for example, the time during which the animation operates) corresponding to the production area (“anime production setting area” 53). A rectangular portion 43b is displayed. The position of the left end of the rectangular portion 43b in the timeline 40 corresponds to the reproduction start time of the animation effect, and this reproduction start time corresponds to each effect area (“anime effect setting area” 53 stored in the effect area setting means 12. ) Playback time data.

  The position of the rectangle 43b on the time axis 45 of the timeline 40 is determined based on the reproduction time data created based on the coordinate data of each effect area stored in the effect area setting means 12, and the reproduction position of the effect on the time axis 45. Are automatically sorted. The left end of the rectangular portion 43b is the start of the production time, and the right end is the end. The length of the rectangular portion 43b in the horizontal width direction is displayed in a length corresponding to the time set in advance as the production time, but the tip of the pointing device such as a mouse is positioned at the right end or the left end on the rectangular portion 43b. By dragging in the left-right direction, the length of the rectangular portion 43b is changed, and the effect timing can be edited by changing the start time, the end time, and the effect time length.

If you want to use an animation image that is used as an animation production and that is obtained by extracting the character part excluding the background data from the “animation production setting area” 53, create background removal data when setting the production effect, and use this background removal data. Is used as an animation image, the character drawn in the “animation production setting area” 53 can be given an action according to the “style” 81 and the “pattern” 82 at that location.
When performing an animation effect using an animation image, a cross mark is displayed at the center position where the animation image is displayed, and an effect such as rotation of the animation image with respect to the cross mark is given. The position of the cross mark may be freely set on the screen.
Also, instead of reading from each page of the picture book for anime images, it uses original character images created and stored by itself, or existing anime images stored in advance in the production image playback program. There may be.

  As a method of reproducing the animation production, a general animation drawing method is used. For example, the animation image of “dog” extracted from the picture book by removing the background image can be rotated at the position where the dog is depicted on the page, or many rain lines can be depicted on the screen in rainy scenes. In this scene, the entire page is greatly shaken, or a specific face of the group photo is zoomed.

  The animation effect may be associated with the size and position of the effect area. For example, zoom / panning / scroll / spin processing, mosaic processing / deformation processing / ripple processing is performed in correspondence with the effect area.

In addition, in the effect image setting page 20, the page of the picture book is displayed in a spread state, and a timeline 40 corresponding to “audio effect”, “BGM effect”, “animation effect”, and “sound effect” is displayed below the page. By setting “animation production” and “sound production” at the same timing position in the timeline for the same production setting area, two types of production effects are produced for one production area set by the production area setting means. Can be applied.
For example, with respect to the “animation production setting area” 53 as one production area in the “story production”, two types of production of an animation production and a sound production corresponding thereto (for example, “dog rotation in animation production” and By setting “Generate sound of dog barking”) at the same timing in the sound production, it is possible to realize a production effect in which the image and the sound are synchronized.

  In the above example, the animation effect is set as the “story effect”. However, the secret attribute is selected in the switching window 47 on the effect image setting page 20, and the “sound effect” 44 is clicked to set the effect. For example, an animation production as a “secret production” can be set.

  In each of the above-described examples, the display device 7 displays the left and right pages of the picture book page in a spread state, and reproduces the pages so that they are turned one by one. It may be a way of reproduction.

  According to the above-described effect image playback device and effect image playback program, a page image of a picture book that a child wants to show to children, such as a masterpiece picture book or a picture-story show, is read into a computer, and changes in movement to characters appearing with his / her sensitivity You can freely set the animation production that gives the sound, the sound production that generates the sound effect, the BGM production, and the voice production that generates the sound, and the secret production that seems to be surprised or delighted when the child finds himself / herself By setting as, you can change the scenes and pictures of each scene, and you can freely enjoy your own picture book production that cannot be tasted with conventional electronic picture books that have only a fixed mechanism and production.

  When setting the sound production for the text in the picture book, the voice of the child's parent can be stored as audio data, and even when the parent is not present or busy You can read a picture book with a loving voice.

  In addition, it is possible to set a plurality of effects such as an animation effect and a sound effect corresponding to the animation effect, an animation effect and a sound effect corresponding to the effect effect, and realize an effect effect in which the image and the sound are synchronized. be able to. For example, you can associate text effects such as text, clauses, and words on a picture book page with audio by enclosing the text read aloud with a frame, zooming, or changing the color of text. It is also possible to make the child aware of the correspondence between the voice and the character, and expect the effects of learning the character and improving the language skills.

  Furthermore, the area to be rendered in the page image, the secret rendering object and type, the type of sound effect and BGM, the type of sound, the timing of the production, etc. can be freely changed at any time. You can enjoy a fresh picture book appreciation.

  In addition, the user can edit an image with a story, a secret effect, sound effects, audio, and BGM while editing the actual picture book page on the computer screen, providing an intuitive and easy-to-understand user interface for everyone. can do.

  In addition, since multiple directors can be memorized, for example, in voice production, you can read a picture book with multiple voices familiar to children by blowing in voices such as “Okasan”, “Otosan”, “Grandma”, “Grandpa”, etc. Can. Furthermore, since each director can set a different production, a variety of production effects can be set for one subject.

By using the effect image reproducing device of the present invention, a plurality of effectors can create various secret effects, sound (sound effects) effects, sound effects, and BGM effects in any area of each page of the picture book. By making it possible to make a setting so as to produce a production, it is possible to obtain an electronic picture book or the like on which a production effect having a high degree of freedom is given to each producer.
As a result, based on one picture book, it is possible to give each director a unique performance, and one theme can be used effectively.

It is a block diagram which shows the structure of the effect image reproduction apparatus which concerns on one Embodiment of this invention. It is explanatory drawing of the initial screen displayed on the display apparatus when starting an effect image reproduction program. It is explanatory drawing of the setting screen displayed by selecting "environment setting" in an initial screen. It is explanatory drawing of the director setting screen displayed by selecting "setting of a director" on a setting screen. It is explanatory drawing of the director information screen displayed when selecting "new registration" in a production | presentation setting screen and adding a director. It is explanatory drawing of the director setting screen where the director was added. It is explanatory drawing of the production | presentation setting screen displayed by selecting "production" in the initial screen. It is explanatory drawing of the effect reproduction | regeneration screen displayed by selecting "Output" in the initial screen. It is a flowchart figure which shows the operation | movement procedure by the effect image reproduction program of this invention. It is explanatory drawing which shows the screen of an example of the production image setting page displayed on the display apparatus. It is explanatory drawing which shows the screen of an example of the audio | voice effect setting window displayed on the display apparatus. (A) And (b) is explanatory drawing which shows an example of the page image reproduction | regeneration screen displayed on the display apparatus. (A) And (b) is explanatory drawing which shows a part of effect image setting page displayed on the display apparatus at the time of the setting of "audio | voice effect". It is explanatory drawing which shows the BGM setting screen displayed on the display apparatus at the time of the setting of "BGM production". It is explanatory drawing which shows the sound setting screen displayed on the display apparatus at the time of the setting of the "sound effect" in "secret production". It is explanatory drawing which shows the animation setting screen displayed on the display apparatus at the time of the setting of "animation production".

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... CPU, 2 ... ROM, 3 ... RAM, 4 ... Sound source device, 5 ... Scanner device, 6 ... Input device, 7 ... Display device, 8 ... External recording device, 9 ... A / D converter, 10 ... Microphone, DESCRIPTION OF SYMBOLS 11 ... Image memory | storage means, 12 ... Production area setting means, 13 ... Production effect setting means, 14 ... Production reproduction means, 15 ... Production person recording means, 16 ... Production person selection means, 20 ... Production image setting page, 30 ... Operation Key window, 40 ... Time line, 45 ... Time axis, 47 ... Switching window, 51 ... Secret production setting area, 51a ... Area boundary line, 53 ... Animation production setting area, 53a ... Area boundary line, 57 ... Audio production setting area 57a ... Area boundary line, 60 ... Sound setting screen, 70 ... Page image playback screen, 80 ... Animation setting screen, 90 ... BGM setting screen, 400 ... performance Setup screen, 500 ... directing the playback screen, 510 ... performance performer window (display window), 520 ... rendering setup's switching unit.

Claims (7)

A device for storing a plurality of images to be captured for each page as electronic information, and displaying the images for each page,
Image storage means for storing each page image;
Effect area setting means for setting each page image or part of the page image as an effect area;
Production effect setting means for selecting a production type corresponding to the production area as a production effect;
Effect reproduction means for reproducing the effect when each page image is displayed or when the effect region is selected;
A director recording means for recording and distinguishing a plurality of directors for the stage effects set by the stage effect setting means;
An effect image reproducing device comprising: an effector selecting means for selecting an effector recorded in the effector recording means when the effect reproducing means reproduces.   2. The effect image reproducing device according to claim 1, further comprising a display window for displaying an image of the performer who has made the effect setting when each page image is displayed.   The effect image reproducing device according to claim 2, wherein the image of the effector displayed in the display window is a moving image.   The effect image reproducing device according to claim 1, wherein when each page image is displayed, a switching unit for switching a performer is displayed. An image reading step of storing a plurality of images captured for each page as electronic information corresponding to each page image;
A director selection step of selecting a director who gives a presentation effect to each page image or part of the page image from a plurality of directors;
An effect area setting step for setting each page image or part of the page image as an effect area of the performer,
A production effect setting step of selecting a production type corresponding to the production area as a production effect of the director,
An image display step of displaying each page image to which a rendering effect is given by the director for each page;
An effect image playback method comprising: an effect playback step of playing back the effect when each page image is displayed or when the effect area is selected.   An effect image reproduction program capable of executing each step of the effect image reproduction method according to claim 5 by a computer.   A computer-readable recording medium in which the effect image reproduction program according to claim 6 is stored.

Images