JP2001045262A - Method and device for recording image and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To comfortably and efficiently execute work for printing and recording a voice encoded image. SOLUTION: In the case of printing and recording an optically readably voice encoded image obtained by encoding voice data on a printing medium and determining the position and size of a voice area 49 for printing the voice encoded image on a layout display part, a CPU displays the waveform of a voice corresponding to voice data already linked with one voice area on the layout display part on a waveform display picture 55 in accordance with mouse double click operation corresponding to the voice area.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an optically readable image such as a character, a symbol, a figure, a picture, a photographic image, a computer graphic image, or the like, and an optical system obtained by encoding audio data. IMAGE RECORDING METHOD AND IMAGE RECORDING APPARATUS FOR PRINTING AND RECORDING PERFORMABLELY ENJOYABLE VOICE ENCODED IMAGE ON A PRINTING MEDIUM such as PAPER The present invention relates to a computer-readable recording medium having stored therein.

[0002]

2. Description of the Related Art Conventionally, human-readable images, such as characters, symbols, figures, pictures, pictures, photographic images, and computer graphic images, which can be read directly by human eyes, and one-dimensional images obtained by encoding audio data. Various image recording methods and image recording apparatuses for printing and recording an optically readable audio encoded image including a two-dimensional barcode on a sheet-like print medium such as paper or film have been proposed. I have.

For example, JP-A-60-244146, JP-A-6-231466, and 7-18160
No. 6, No. 10-51645, and the like.

According to the technology disclosed in these publications, a voice is printed and recorded on a sheet of paper, so that the readable image and the voice can be integrated on the sheet of paper. By reading, the user can easily hear the sound on the spot while viewing the readable image.

[0005] Above all, Japanese Patent Application Laid-Open No.
In JP-A-31466, JP-A-7-181606, and JP-A-10-51645, a dot code as a voice-encoded image that allows data such as voice to be easily optically read by manual scanning. And prints this together with a readable image on a sheet-like print medium such as paper.

FIG. 26 shows a physical format configuration of the dot code.

That is, the dot code 1 is constituted by a plurality of blocks 2 arranged two-dimensionally adjacently.
In each of the blocks 2, the value obtained by dividing the data of each block of the audio data to be recorded is “1”.
Alternatively, a data dot pattern portion existing in a predetermined two-dimensional array as a dot image of a black dot or a white dot corresponding to “0” (in practice, white which is the ground color of a print medium is often read as it is). 3 and a marker 5 having a constant number of continuous blacks arranged at four corners of each block used to find a reference point for reading a dot (data dot 4) in the data dot pattern portion 3
And a block address pattern 6 including an error detection or error correction code arranged between markers so that the plurality of different blocks can be identified at the time of reading.

According to the dot code 1, even if the entire size is larger than the imaging field of view 7 of the reading device, in other words, the dot code 1 can be imaged by the reading device in one shot. Even if this is not possible, as long as each address given to each block 2 can be detected in block units together with the data dots 4 included in the block, the entire original data is reconstructed from the data included in each block. It becomes possible.

[0009] Accordingly, since data such as voice on a paper surface can be practically recorded, and the data can be easily read even by manual scanning, expectations for the future are increasing.

When actually recording such a voice-coded image such as a dot code on paper or the like,
The audio data is encoded on the computer to create the target audio encoded image, the layout and editing of the audio encoded image are performed on the computer screen, and then printed using a general printer. It is possible to record.

[0011]

However, it has been found that there is a new problem as described below when actually printing and recording the voice-encoded image such as the dot code described above using the printer.

That is, when a computer screen is used as a layout screen and the position and size of the print recording area of the audio encoded image are determined on the layout screen, the operator can efficiently edit the audio. In order to proceed, it is preferable that the relationship between the size of the print recording area and the content and time of the voice actually recorded or to be recorded can be grasped as necessary, and a new device for that purpose is required. Was.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned circumstances, and an image recording method and an image recording apparatus capable of performing a print recording operation of a voice-encoded image comfortably and efficiently. It is an object of the present invention to provide a computer-readable recording medium storing a program including an instruction for causing a computer to execute an operation of an image recording apparatus.

[0014]

In order to achieve the above object, a first aspect of an image recording method according to the present invention is to provide an optically readable audio encoding obtained by encoding audio data. When printing and recording an image on a predetermined print medium, a layout screen for determining a print recording area of the voice-encoded image on the print medium is displayed and print-recording of the voice-encoded image is performed. The audio data has already been linked to one print recording area on the layout screen, based on a predetermined operation on the one print recording area, The audio waveform corresponding to the data is displayed.

That is, according to the first aspect of the image recording method of the present invention, the audio data linked to the print recording area of the audio encoded image can be directly visually confirmed, and the editing operation can be performed immediately without complicated operation. Can be done.

In order to achieve the above-mentioned object, a second aspect of the image recording method according to the present invention provides a method for encoding an optically readable audio encoded image obtained by encoding audio data. An image recording method for displaying a layout screen for determining a print recording area of the voice-encoded image on the print medium when printing and recording on the print medium, and performing print-recording of the voice-encoded image The audio data is linked to one print recording area on the layout screen, and the audio time corresponding to the linked audio data is the audio time printable and recordable in the one print recording area. When the value exceeds, the sound from the head of the sound corresponding to the linked sound data to the time corresponding to the printable time in the one print recording area can be recorded. It is characterized in.

That is, according to the second aspect of the image recording method of the present invention, when the audio data is linked to the print recording area of the audio encoded image, the continuous partial audio for the recording time from the head of the audio data is obtained. By setting the section as a recordable section, the operator does not recognize that the linked voice data itself is defective data, but recognizes that the data has been cut off halfway due to a short recording time. It is not necessary to make the person carelessly careless.

In order to achieve the above object, a third aspect of the image recording method according to the present invention provides a method for encoding an optically readable audio encoded image obtained by encoding audio data. An image recording method for displaying a layout screen for determining a print recording area of the voice-encoded image on the print medium when printing and recording on the print medium, and performing print-recording of the voice-encoded image The audio data is linked to one print recording area on the layout screen, and the audio time corresponding to the linked audio data is the audio time printable and recordable in the one print recording area. If it exceeds, the reproduction output of the sound corresponding to all the linked sound data, and the one mark of the sound corresponding to the linked sound data Characterized in that any one of the reproduction output of the printing on the recording area recordable time of the audio and selectable.

That is, according to the third aspect of the image recording method of the present invention, it is possible to audibly determine where the partial audio data for printing and recording the audio encoded image is located with respect to the entire audio data. Since identification is possible, it is possible to confirm whether unnecessary audio data is recorded, or conversely, whether necessary audio data is recorded. Further, the voice section to be printed and recorded can be determined in voice editing, and the editing target becomes clear.

Further, in order to achieve the above object, a first aspect of the image recording apparatus according to the present invention provides an optically readable audio-encoded image obtained by encoding audio data. An image recording apparatus configured to display a layout screen for determining a print recording area of the voice-encoded image on the print medium when performing print-recording on a print medium and print-record the voice-encoded image; An audio data linking means for linking audio data with respect to one print recording area on the layout screen; and a sound linked by the audio data linking means based on a predetermined operation on the one print recording area. Display means for displaying a sound waveform corresponding to the data.

That is, according to the first aspect of the image recording apparatus of the present invention, the audio data linked to the print recording area of the audio encoded image can be directly visually confirmed, and the editing operation can be performed immediately without complicated operation. Can be done.

In order to achieve the above object, a second aspect of the image recording apparatus according to the present invention provides an optically readable audio encoded image obtained by encoding audio data. An image recording apparatus configured to display a layout screen for determining a print recording area of the voice-encoded image on the print medium when performing print-recording on a print medium and print-record the voice-encoded image; Audio data linking means for linking audio data with respect to one print recording area on the layout screen; audio time corresponding to the audio data linked by the audio data linking means; Comparing means for comparing the time of the sound that can be printed and recorded in the area, and sound linked by the sound data link means by the comparing means When it is determined that the time of the sound corresponding to the data exceeds the time of the sound that can be print-recorded in the one print recording area, the one print recording area starts from the head of the sound corresponding to the linked sound data. Control means for recording sound up to the time that can be printed on the
It is characterized by having.

That is, according to the second aspect of the image recording apparatus of the present invention, at the time when the audio data is linked to the print recording area of the audio coded image, the continuous partial audio for the recording time from the head of the audio data. By setting the section as a recordable section, the operator does not recognize that the linked voice data itself is defective data, but recognizes that the data has been cut off halfway due to a short recording time. It is not necessary to make the person carelessly careless.

[0024] In order to achieve the above object, a third aspect of the image recording apparatus according to the present invention provides an optically readable audio-encoded image obtained by encoding audio data. An image recording apparatus configured to display a layout screen for determining a print recording area of the voice-encoded image on the print medium when performing print-recording on a print medium and print-record the voice-encoded image; Audio data linking means for linking audio data with respect to one print recording area on the layout screen; audio time corresponding to the audio data linked by the audio data linking means; Comparing means for comparing the time of the sound that can be printed and recorded in the area, and sound linked by the sound data link means by the comparing means When it is determined that the time of the sound corresponding to the data exceeds the time of the sound that can be printed and recorded in the one print recording area, the reproduction and output of the sound corresponding to all of the linked sound data, and And control means for selecting any one of the audio output corresponding to the time which can be printed and recorded in the one print recording area among the audio corresponding to the audio data. .

That is, according to the third aspect of the image recording apparatus of the present invention, it is audible to determine where the partial audio data for printing and recording the audio encoded image is located with respect to the entire audio data. Since identification is possible, it is possible to confirm whether unnecessary audio data is recorded, or conversely, whether necessary audio data is recorded. Further, the voice section to be printed and recorded can be determined in voice editing, and the editing target becomes clear.

In order to achieve the above object, a first computer-readable recording medium according to the present invention is provided.
In printing the optically readable audio encoded image obtained by encoding the audio data on a predetermined print medium, a print recording area of the audio encoded image on the print medium is provided. When displaying a layout screen for determining and printing and recording the audio encoded image, when audio data is already linked to one print recording area on the layout screen, the one print recording A program is stored that includes an instruction to cause a computer to execute a process of displaying a sound waveform corresponding to the already linked sound data based on a predetermined operation on the region.

That is, according to the first aspect of the recording medium of the present invention, the audio data linked to the print recording area of the audio encoded image can be directly visually confirmed, and the editing operation can be performed immediately without complicated operation. Can do it.

In order to achieve the above-mentioned object, the present invention provides a computer-readable recording medium according to the present invention.
In printing the optically readable audio encoded image obtained by encoding the audio data on a predetermined print medium, a print recording area of the audio encoded image on the print medium is provided. When displaying a layout screen for determining and printing and recording the audio encoded image, audio data is linked to one print recording area on the layout screen, and the audio data corresponding to the linked audio data is linked. When the time of the sound exceeds the time of the sound that can be printed and recorded in the one print recording area, from the beginning of the sound corresponding to the linked sound data to the time that can be printed and recorded in the one print recording area. A program including an instruction for causing a computer to execute a process of enabling recording of a voice is stored.

That is, according to the second aspect of the recording medium of the present invention, at the time when the audio data is linked to the print recording area of the audio encoded image, a continuous partial audio section for the recording time from the beginning of the audio data. By making it a recordable section,
Since the operator does not recognize the linked audio data itself as defective data, but recognizes that the recording time is short due to a short recording time, there is no need to make the operator needlessly care. .

Further, in order to achieve the above object, a third computer-readable recording medium according to the present invention is provided.
In printing the optically readable audio encoded image obtained by encoding the audio data on a predetermined print medium, a print recording area of the audio encoded image on the print medium is provided. When displaying a layout screen for determining and printing and recording the audio encoded image, audio data is linked to one print recording area on the layout screen, and the audio data corresponding to the linked audio data is linked. When the time of the sound exceeds the time of the sound that can be printed and recorded in the one print recording area, the reproduction output of the sound corresponding to all the linked sound data, and the reproduction of the sound corresponding to the linked sound data The computer executes a process for enabling selection of any one of the audio reproduction outputs for the time that can be printed and recorded in the one print recording area. Storing a program including instructions for causing.

In other words, according to the third aspect of the recording medium of the present invention, it is possible to audibly identify where the partial audio data to be printed and recorded of the audio encoded image is located with respect to the entire audio data. Therefore, it is possible to confirm whether unnecessary voice data is not recorded, or conversely, whether necessary voice data is recorded. Further, the voice section to be printed and recorded can be determined in voice editing, and the editing target becomes clear.

[0032]

DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention will be described below with reference to the drawings.

FIG. 2 is a diagram showing a configuration when the present embodiment is applied to a personal computer.

That is, the personal computer (PC) 1
Reference numeral 0 denotes a CPU 11 that controls the entire system, a RAM 12 that is used when the CPU 11 executes a program, and an auxiliary storage unit 13 such as a hard disk that stores an OS, various programs, and data files. Further, the PC 10 is connected to a data input unit 14 as an interface for connection to data input devices such as a digital camera 21, a microphone 22, and a video camera 23, and to data output devices such as a printer 31, a speaker 32, and a monitor 33. And a pointing device 16 such as a mouse for a user to specify a position on the monitor 33.

The auxiliary storage unit 13 previously stores an operation program for causing the PC 10 to function as an image recording apparatus according to an embodiment of the present invention, and printer information 13A supplied together with the operation program. ing. Note that the new printer information 13 is stored via a network (public line) or a recording medium such as a CD-ROM.
B is supplied, and the CPU 11
The printer information 13A stored in the auxiliary storage unit 13 can be updated with the new printer information 13B via the.

Next, the operation in such a configuration will be described.

FIG. 1 is a diagram showing a main flowchart of an operation program for causing the PC 10 stored in the auxiliary storage section 13 to function as the image recording apparatus according to the present embodiment.

That is, when the program is started, first, the user specifies on a selection screen (not shown) whether to create a new layout or open an already laid-out file. It is determined whether the designation is a new creation (step S1).

Here, when it is determined that the new creation is selected, the printer information 13A stored in the auxiliary storage unit 13 is automatically taken in, and the user is requested to specify an output printer (step S2). . That is, an output printer selection dialog box 41 as shown in FIG. 3 is displayed based on the acquired printer information 13A. In the output printer selection dialog box 41, a list of printer names is displayed as hierarchical information corresponding to each printer manufacturer and its model, and the user can use a pointing device (hereinafter, described as a mouse).
The pointer 42 is moved to a desired printer name and selected by performing a mouse click operation, and then an “OK” button 43 is similarly subjected to a mouse click operation to determine an output printer.

When the user does not select an output printer on the output printer selection dialog box 41, that is, when the user clicks the mouse on the "cancel" button 44, for example, the printer is set to "normally used printer". The default printer specified by the user in advance is selected as the output printer.

Thereafter, it is determined whether the selected output printer is a printer capable of code printing (step S3). Here, the code printable printer is a printer having a print resolution capable of printing a dot code which is an audio encoded image. That is, in the current dot code, the data dot, which is the minimum recording unit of the dot code, needs to have a size of about 60 μm to 80 μm, and in this case, the minimum resolution of the printer is 300 dpi or more. The minimum dot size that can be printed by this 300 dpi printer is 85 μm.

If it is determined that the selected printer is a code printable printer, the layout mount template 45 as shown in FIG. 4A is designated (step S4). If it is determined that the printer is not a code-printable printer, (B) of FIG.
(Step S5).

Here, the layout mount template 45
4 is a mount template including three areas of an image area 47, a text area 48, and an audio area 49, as shown in FIG. In step S4, the user selects and specifies a desired one from a large number of layout mount templates 45 in which one or a plurality of these areas are laid out in advance.

Also, the limited layout mount template 4
Reference numeral 6 denotes a mount template having only two regions, an image region 47 and a text region 48, and having no audio region 49, as shown in FIG. In step S5, the user selects and specifies a desired one from a large number of limited layout mount templates 46 in which one or more of these areas are laid out in advance. Here, in these mount templates, the image area 47, the text area 4
8 and the audio area 49 are displayed in different colors, and area names such as “image area” and “text area” indicating which area the area is in are displayed. If the area can be identified,
It is not limited to this.

It should be noted that step S4 or step S4
In the designation of the mount template in 5, it is possible to select not only a template in which each area is actually laid out in advance, but also a mount template in which nothing is laid out. In this case, the user can arbitrarily create each area by operating the mouse. However, if a printer capable of code printing is selected, the audio area 49 can be created. However, if a printer that is not capable of code printing is selected, the audio area 49 cannot be created. Has become.

When the (limited) layout mount template is selected in this way, a main screen 50 as shown in FIG. 5 is displayed, and the layout mount is edited (step S6). This is a process of changing the size and position of the image area 47, the text area 48, and the audio area 49, and adding a picture such as wallpaper to the background.

Here, the main screen 50 is a layout display section 51 on which the selected layout board is displayed.
And a file display unit 52 for displaying thumbnails of each object as will be described in detail later. Editing of the layout mount is performed by the layout display unit 51.
This is performed on the layout card displayed above.

In the layout sheet displayed on the layout display section 51, the image area 47, the text area 48, and the audio area 49 are displayed in different colors, and the image area 47 and the text area 48 are displayed in different colors. The area name is displayed, and for the audio area 49,
Instead of the area name, the recordable time of the audio recorded as the audio coded image is displayed there.

In the layout board displayed on the layout display section 51, the image area 47 and the text area 48 can be continuously enlarged / reduced or moved by a known mouse operation. But,
Regarding the audio area 49, the unit of enlargement / reduction is limited by the feature of the audio encoded image recorded therein,
It is done step by step.

For example, when the audio area 49 is to be enlarged in the horizontal direction, as shown in FIG. 6A, by dragging the right end boundary of the audio area 49 to the right with a mouse, as is known. In this case, the step of expanding is as shown in FIG. 6B.
It is enlarged by the size of the minimum reading unit (one block unit surrounded by four corners by markers) constituting a dot code which is an audio encoded image actually recorded. Then, in accordance with this enlargement operation, the available audio recording time as the audio encoded image displayed in the audio area 49 changes from 5 seconds to 6 seconds as shown in FIG. In this case, the recordable time actually displayed in the audio area 49 can be displayed not in units of seconds but in units of comma seconds. Display may be performed, or fractions may be rounded down and displayed in units of seconds. The display of the recordable time is not limited to the display in the audio area 49, and may be displayed at a position in the vicinity of the audio area 49. It can also be displayed at any position. In that case, audio area 4
As shown in FIG. 6 (B), the display in 9 may schematically display blocks surrounded by markers.

The same applies to the area reduction performed by dragging the right end boundary of the audio area 49 leftward with the mouse.

On the other hand, when the audio area 49 is enlarged in the vertical direction, as shown in FIG. 6C, the audio area 49 is enlarged by dragging the upper edge of the audio area 49 upward with a mouse. However, the enlargement unit at this time is an audio area unit such that a recordable time of 6 seconds is 12 seconds.

The dot code as the audio encoded image is
The sound is reproduced by scanning one continuous area with the reading device, and the one where one dot code is divided into a plurality of parts and the sound is reproduced by reading them continuously with the reading device. The two types of configurations are possible.

Thus, by expanding in the vertical direction in this manner, a plurality of one continuous voice-encoded image can be laid out. In this case, the latter plurality of continuous voice-encoded images are As a result, it is possible to generate a code that reproduces a sound by reading by the reading device. In (C) of FIG. 6, a circle mark newly automatically displayed on the left side in the audio area when the image is enlarged,
This is to indicate that such divided audio encoded images are one group.

As shown in FIG. 6D, it is also possible to simultaneously enlarge / reduce the horizontal and vertical directions.
This is performed by dragging the upper right corner of the audio area 49 with the mouse in the upper right / lower left direction.

In the vertical direction, FIG.
Of course, as shown in FIG.

If a high compression ratio having a high compression ratio can be selected in addition to the standard compression as a compression method when creating the audio coded image, the compression ratio is set in the layout board editing subroutine. May be selected, and identification display such as changing the display color of the audio area 49 may be performed according to the selection result, as shown in FIG. 7A.

As described above, after the user performs the editing processing of the desired layout board, the user specifies the pasted object (step S7). This is a process of pasting one object (photograph or sound as an image) to each area on the layout board displayed on the layout display unit 51, as shown in FIG. The user pastes a desired object by dragging the mouse from a plurality of objects displayed on the file display unit 52 displayed on the right side of the layout display unit 51 on the main screen 50. The object is pasted to the area by a so-called drag and drop (D & D) operation of bringing the object to the area and dropping it there.

The file display section 52 displays objects stored in one folder (directory) of the auxiliary storage section 13. For an image and a sound linked to each other, the image side identifies the object. Is displayed. Of course, the voice side may be identified and displayed, or both may be identified and displayed. Further, for example, when a plurality of link objects exist in one object such as “photograph 9” linked to “audio 9a”, “audio 9b”, and “audio 9c”, one link object It is preferable to further display the identification so that it can be distinguished from those which only exist. Note that in the present embodiment, the color of the outer frame is changed as the identification display, but any type of mark such as a picture of a speaker may be used.

Here, the link between the image and the sound is performed as follows. For example, the image file format standard "Exif (Exchangeab) which is a JEIDA (Japan Electronic Industry Development Association) standard and is also certified as an ISO standard.
le Image File Format) defines a format for embedding link information in a JPEG file which is a general image file and a WAVE file which is a general audio file. Therefore, by describing the file name of the audio file or image file to be linked as this link information, the image file and the audio file can be linked.

As described above, the user-desired image (photograph) can be pasted on the image area 47 by D & D operation, and similarly, the user-desired voice can be pasted on the audio area by D & D operation. Although the image and the sound can be pasted by the D & D operation as described above, by using the above-mentioned link information, when one of them is pasted, the other linked thereto is automatically placed in the corresponding area. It is also possible to paste it on.

The details of such pasting object designation processing will be described later.

Then, when the object (image, sound, text) is pasted, the pasted object is edited (step S).
8). By double-clicking the mouse on the area where the object to be edited is pasted, a corresponding editing screen is displayed and the object can be edited. The details of the pasting object editing process will be described later.

Next, the layout between the pasted objects is edited (step S9). That is, the above step S8
As a result of editing individual objects in the above, there is a case where the layout needs to be changed, and such a change is possible here. Details of the layout editing process between the pasted objects will also be described later.

Thereafter, the output printer is changed (step SA). That is, the output printer specified in step S2 can be changed again after the layout. Details of the output printer changing process will be described later.

Then, by the selected printer 31,
A print output process is performed (step SB). The details of this print output process will be described later.

When the output is completed in this way, the layout board currently laid out and pasted with the objects displayed on the layout display section 51 is stored in the auxiliary storage section 13 as a file (step SC).

Thereafter, it is determined whether or not the user has performed an end operation of the program (step SD). If the end operation has not been performed, the process returns to step S1. Terminates the program.

If it is determined in step S1 that the file is not newly created, that is, that the file is to be opened, the process immediately proceeds to step S6 without specifying a layout board, and edits the layout board.

Next, a subroutine for designating a pasted object called in step S7 will be described with reference to FIG.
This will be described with reference to the flowchart of FIG.

First, a mount-paste object is selected (step S701). This is, for example, a process of attaching “Photo 7”, which is an image object, from the file display unit 52 on the right side in FIG. 5 to the image area 47 by D & D.

Next, a corresponding object linked to the selected object is searched, and the link information is stored in the RAM.
12 is stored in the temporary area (step S7).
02). For example, a search is made for “sound 7”, which is a corresponding object linked to “photo 7”. This is "Photo 7"
Then, the audio file name described as the link information in the file is read, and it is searched whether the audio file of the file name exists in the same directory. If there is, the file name and the like are stored in a temporary file.

Then, it is determined whether there is a link object (step S703). If there is no link object, the subroutine is terminated, and the process returns to the main routine with only the image attached. There are a case where a file name is not originally described as link information in a file of a pasted object and a case where a link object is not found as a result of the search.

On the other hand, if there is a link object, a paste confirmation display of the link object and an object selection are performed (step S704). This displays a confirmation message on the screen, "Are you sure you want to paste the linked sound?"

As shown in “Photo 9” in FIG.
There are cases where a plurality of link objects such as "speech 9a", "speech 9b", and "speech 9c" are present. In such a case, a selection is made as to which of the plurality of link objects is to be pasted. For example, as shown in FIG. 8A, a dialog box 53 including a message “Please select one from three linked audio files.” And a list of link objects to be selected is displayed. And the user can select a desired sound from the three sounds. In the same figure, the state where the mouse pointer 42 is moved to “audio 9a.wav” and clicked, the audio file is specified, and the identification is displayed (for example, highlighted) in accordance with it. At this time, the link information stored in the temporary area of the RAM 12 is updated to indicate the selected link object.

Then, after selecting one of the plurality of link objects on the link object pasting confirmation display screen or not, it is determined whether or not an instruction of pasting OK has been made by a mouse click operation of the "OK" button 54. (Step S705). Here, when the pasting is not OK, that is, when the pasting is canceled, the subroutine ends and the process returns to the main routine.

On the other hand, if it is determined that the pasting is OK,
An attachment position is selected (step S706). This is performed only when there are a plurality of pasting positions, and when there is only one pasting position, this step is skipped.

That is, as shown in FIG. 9A, when the mount template has a plurality of image areas 47A and 47B and a plurality of sound areas 49A and 49B, for example, the lower image area 47B When "Photo 7" is pasted by mouse D & D operation, the audio regions to which "Audio 7" linked to "Photo 7" should be pasted include audio regions 49A and 49B. Therefore, in such a case,
The two audio regions 49A and 49B are identified (for example, blinking or changing colors) to notify the user that there are two audio regions. Then, as shown in FIG. 9B, the user performs a mouse click operation on a desired audio area (the audio area 49B in the figure) to select and specify the paste position.

When the link object to be pasted and the pasting position are determined in this way, the object is read out from the auxiliary storage unit 13 based on the link information stored in the temporary area of the RAM 12, and is read from the layout board. (Step S707). Then, the subroutine ends, and the process returns to the main routine.

In the description of this subroutine,
Although the description has been made on the assumption that the photograph as the image object is pasted on the image area 47, on the contrary, by pasting the sound object on the sound area 49, the photograph linked thereto is pasted on the image area 47. It is also possible.

When “photograph 9” to which a plurality of audio files are linked is pasted in one image area 47B, the audio file selected in step S704 is pasted in the audio area selected in step S706. In this case, when one audio region is selected in step S706, one of the remaining two audio files not selected is further added to the other audio region. It is also possible to make a selection such as pasting. Furthermore, in a state where the user selects a mount template whose area to paste each object is not particularly defined on the layout screen and does not explicitly create an object paste area, the image, sound, and text are placed on the mount. When the D & D is performed on the object, the object itself may be pasted together with a pasting area of a predetermined size for each object. In this case, the position of the paste of the link object to the mount based on the link information is selected. Is a mouse click at an arbitrary position on the mount. In this case, it can be considered that there are countless pasting areas.

However, there is an exception in the case where a voice object is pasted, and it is important to secure the pasted area so as not to overlap the voice area to which the voice object has already been pasted. If this is not ensured, a message indicating that pasting is not possible is displayed as a warning dialog to the user to call attention.

The audio pasting area of the predetermined size is an area of the minimum size in which the entire capacity of the audio object can be recorded, and operates so as to automatically generate this area.
If the size exceeds a certain upper limit, an audio area of the upper limit size is generated.

This process can be similarly performed on an image object. That is, a pasting area in which the entire image object fits is automatically generated. At this time, if the size is equal to or larger than a certain upper limit size, an image area of the upper limit size is generated. Of course, the same applies to text objects.

Next, the editing subroutine of the pasted object called in step S8 will be described with reference to the flowchart of FIG.

First, object editing is selected (step S801). This is a process in which the user selects the audio area 49 or the image area 47 on the layout display unit 51 that has already been pasted, and is selected by, for example, double-clicking the area to be edited with the mouse.

Then, the selected area is the audio area 4
9 is determined (step S802), and if it is a voice area, a waveform display screen 55 as shown in FIG. 8B is displayed (step S803).

On the waveform display screen 55, audio waveform data 56 corresponding to the audio file attached to the audio area 49 is displayed. In this case,
For example, the part that enters the recordable time in the audio area 49 and the part that does not enter the audio area 49 are identified and displayed by, for example, color-coding. At this time, the part that enters the recordable time is allocated from the head of the audio corresponding to the audio file, and the waveform data 56
Below, a voice recording period bar 57 corresponding to the portion that enters the recordable time is displayed. The recordable time is displayed in the sound recording period bar 57, and the total recording time (link sound time) of the sound corresponding to the sound file is displayed above the waveform data 56. . In this example, the recordable time is 8 seconds, and the total record time is 9.8 seconds. Accordingly, it is shown that, of the 9.8 seconds of audio, 8 seconds from the beginning can be recorded, and the remaining 1.8 seconds are not recorded. Note that triangular play buttons 58 and 59 are displayed near the total recording time and near the recordable time in the audio recording period bar 57, respectively. .8 seconds worth of audio is played, play button 5
By operating the mouse 9 with a mouse, only the recordable audio portion of 8 seconds is reproduced.

A check column 60 is provided below the voice recording period bar 57 together with a description of “enlarge / reduce the audio area”. Each time the mouse is clicked on the check column 60, a check is made. None is toggled. Here, when the check box 60 is checked, the audio area 49 on the layout screen is enlarged / reduced in conjunction with a mouse drag operation of expanding the audio recording period bar 57 to the right or reducing it to the left. Become like If you uncheck this check box 60,
The voice recording period bar 57 cannot be enlarged, and only the reduction operation can be performed. That is, when the size of the audio area 49 on the layout screen is not changed, but the data to be entered is to be recorded only for 6 seconds out of 8 seconds, the mouse drag operation is performed in a direction to reduce the audio recording period bar 57. By doing so, only the audio data of 6 seconds is recorded in the audio area 49.

Note that “0 seconds” and “10 seconds” displayed at the lower ends of the audio recording period bar 57 indicate the scale of the time displayed on the waveform display screen 55.

Thus, on such a waveform display screen 55, the user corrects and fixes an area for a printable time (step S804). That is, the above 8
By moving the audio recording period bar 57 for seconds or performing an enlargement / reduction operation, it is possible to record the audio desired by the user.

Here, the moving operation of the voice recording period bar 57 is performed by dragging the mouse on the voice recording period bar 57 and moving it left and right as shown in FIG.
This operation is to move the voice recording period bar 57 in the horizontal direction. By performing such a moving operation,
The user can select which 8 seconds of the 9.8 seconds of audio to take.

As described above, when the check box 60 is checked for the enlargement / reduction operation,
In the state where the sound object is pasted on the sound area 49 as shown in FIG. 12A, a mouse drag operation is performed to enlarge the sound recording period bar 57 to the right as shown in FIG. 12B. Accordingly, the audio area 49 on the layout screen can be enlarged in conjunction with the above.
In this case, the display of the recordable time in the audio area 49 is also updated. Similarly, it can be reduced. The display of the recordable time in the audio area 49 is not limited to the update to the new recordable time as described above. For example, the original recordable time is displayed in the denominator such as “10/8 seconds”. It is also possible to display the original recordable time, such as a fractional display of the recordable time updated to the time and numerator.

When the user corrects and confirms the area for the printable time, it is next determined whether or not the correction and confirmation operation is accompanied by a change in the size of the voice area 49. A determination is made (step S805). If not, the process proceeds to step S807 to be described later. If the operation involves a size change as shown in FIG.
Is corrected (step S806).

Thereafter, a voice editing process is further performed (step S807). This is a process of performing a known audio editing process such as equalizing and changing the pitch on the displayed audio waveform data 56. Alternatively, another audio data may be added by a cut (copy) and paste operation, or unnecessary portions may be deleted.

Then, the user performs an end operation, that is, "O
It is determined whether the “K” button 61 or the “Cancel” button 62 has been operated (step S808). If the end operation has not been performed, the process returns to step S804. On the other hand, when the end operation is performed, the subroutine ends and the process returns to the main routine.

On the other hand, if it is determined in step S802 that the selected area is not the audio area 49, other objects corresponding to the selected area, that is, the image area 47 or the text area 48 are edited. From (step S809), the process returns to the main routine. The details of other object editing are omitted because they are known, and examples thereof include color change for images and text, and filter processing such as sharpening processing and blurring processing for images.

Next, a layout editing subroutine between the pasted objects called in step S9 is described.
This will be described with reference to the flowchart of FIG.

First, it is determined whether or not a new voice area 49 has been created by a user operation (step S90).
1). If it is determined that the voice area 49 has been newly added, the coordinates of the newly created voice area 49 are calculated and stored in the temporary area provided in the RAM 12 (step S902).

On the other hand, if it is determined that the voice area 49 is not newly created, it is determined whether or not a user editing operation has been performed on the existing voice area 49 (step S9).
03). Here, when it is determined that the existing audio area 49 has been actually edited, it is further determined whether or not there has been any change due to the editing operation, that is, whether or not the position or the size has been changed (step S1). S904). If it is determined that there has been a change, the above step S
Proceeding to 902, the coordinates of the changed audio area 49 are calculated and stored in a temporary file.

After the calculation and storage of the coordinates of the sound area 49 are completed, next, the overlap of the periphery of the sound area 49 into the regulation area is calculated (step S905).

Here, the audio area 49 is an area where a dot code as an audio encoded image is actually printed.
As shown in FIG. 14, a margin area 63 exists around the audio area 49. This blank area 63 is an area where all other objects must not enter. Further, outside the margin area 63, there is a restriction area 64, which is an area in which only the dot code as the audio coded image must not enter.

The dot code as the audio coded image is
As described above, the reading device uses a specific regular pattern to read. If this regular pattern is close to the audio area 49, it will adversely affect the reader. That is, if there are a plurality of regular patterns of the voice-encoded image other than the voice-encoded image to be read in the imaging field of view of the reading device, the dot code positioning process using the regular pattern is successful. Without functioning, the reading device malfunctions and a reading error occurs. Therefore, it is necessary to prevent a regular pattern of another voice-encoded image from being included in one field of view of the reading device. The restriction area 64 is provided for opening between the coded images.

Therefore, when an operation for overlapping another audio area is performed within the restricted area 64, for example, as shown in FIG. If it is attempted to move the 6-second audio area by mouse drag operation, it is necessary to perform a process of preventing further movement at the time of moving to the restriction area 64.

On the other hand, in a normal readable image, it is very rare to see a regular pattern as in a voice-encoded image. Accordingly, even if the distance between the voice-encoded image and the ordinary readable image is made closer, the reading device does not affect the reading because a periodic pattern is not generated in the reading device. Therefore, as a margin between the audio encoded image and the ordinary readable image, it is sufficient to provide only the margin area 63.

Thus, as a result of the overlap calculation in step S905, it is determined whether or not the newly created or edited audio area overlaps with the restriction area 64 around another audio area (step S906). . Then, when it is determined that they overlap, the state may be set such that they do not overlap as shown in FIG. 14, but in the present embodiment, after the warning is displayed (Step S
907), the coordinates of the newly created or edited audio area are returned to the values immediately before the overlap (step S908). Then, the process returns to the step S901.

That is, as shown in FIG. 15A, the sound area of the recordable time of 6 seconds is moved to the recordable time of 5 seconds by the mouse drag operation. A warning dialog box 65 is displayed. Then, after the warning dialog box 65 is displayed, as shown in FIG. 15B, the display of the audio area of the recordable time of 6 seconds is returned to a position immediately before overlapping with the audio area of the recordable time of 5 seconds. It is.

On the other hand, if it is determined in step S906 that the newly created or edited audio area does not overlap the restriction area 64 around another audio area, it is determined whether or not the overlap inhibition object area check has been completed. A determination is made (step S909). That is, it is determined whether the check has been completed for all the audio regions 49 on the layout board. If all the sound areas 49 have not been checked, the process returns to step S905.

On the other hand, if it is determined that the check has been completed for all the audio regions 49, or if it is determined in step S904 that one or the size of the audio regions 49 has not changed, Then, an overlapping process between different types of objects, which will be described in detail later, is performed (step S910). Thereafter, the subroutine ends, and the process returns to the main routine.

When it is determined in step S903 that the audio area 49 has not been edited,
Next, image or text area editing of another object is performed (step S911). Then, the process proceeds to step S910, where an overlapping process between different types of objects is performed.

Before describing the details of the subroutine of the overlap processing between different kinds of objects called in step 910, display when the areas 47 and 48 of readable image objects such as images and texts and the sound area 49 overlap. (And printing) will be described from an example. At this time, the display and printing are different depending on whether the overlapping of the readable image object areas 47 and 48 and the audio area 49 is permitted or not.

That is, as shown in FIG. 16A, the sound area 49 is moved to the text area 48 having a green background and displaying the text "1999/7/7" in black. Readable image object area 47,
In the case where the overlap between the audio region 48 and the audio region 49 is not permitted,
As shown in FIG. 16B, the readable image of the overlapping portion is not displayed. Also, when actually printing by the printer 31, such an image is output.

On the other hand, the readable image object areas 47 and 4
In the case where the overlapping of the audio area 8 and the audio area 49 is permitted, FIG.
As shown in (A) of FIG. 7, after displaying a warning dialog box 66 such as "The voice area and the text area overlap. The text color will be changed to the specified color." Alternatively, the display on the readable image object area side is changed as shown in FIG. That is, as shown in FIG. 17B, the background color of the text area 48 is changed to transparent, and all of the characters “1999/7/7” are displayed in red (in FIG. 17, indicated by white characters). I do. Alternatively, as shown in FIG. 17C, the overlapping area (in this case, “9 /
7/7 "), the character is changed to red (indicated by white characters in the figure), and the background of that portion is made transparent. Further, the background is fixed to be transparent, but may be another specified color (for example, yellow) different from the above-mentioned character color.

Here, the readable image object area 4
A description will be given of the distinction between the case where the overlap of the sound area 49 and the audio region 49 is not permitted and the case where the overlap is permitted, and the reason for performing the color change.

When the ground color of the recording paper (printing medium) of the printer 31 is white, the reflected light from the printing medium changes from blue (B) at the light wavelength as shown in FIG. It has almost the same reflection intensity over red (R). Here, a reading device that reads a dot code as an audio encoded image recorded in the audio area 49 has a built-in light source, illuminates the dot code with light from the light source,
It is configured to capture the reflected light from the paper surface of the print medium. When a light source having a wavelength of R as shown by a bright line spectrum 67 in the figure is used as the light source, the bright line spectrum 6
Those having a reflection intensity at 7 are determined to be "white". On the other hand, ink having no reflection intensity is determined to be “black”. In this way, the reading device reads in a binarized state.

Therefore, the red ink has a reflection intensity at the illumination wavelength (bright line spectrum 67) of the reading device as shown in FIG.
It is determined to be "white". Also, as shown in FIG. 18C, in the case of the yellow ink, although the emission line spectrum 67 of the reader is slightly deviated, it still has a considerable reflection intensity with respect to the illumination wavelength. The reading device determines that the color is “white”. On the other hand, as shown in (D) and (E) of FIG. 18, in the case of black ink or cyan ink, the reading device does not have a reflection intensity at the illumination wavelength portion of the reading device. Is determined.

Therefore, if the ink color of the image or text to be superimposed on the voice-encoded image is overwritten with ink having a reflection intensity, for example, red or yellow, at the position of the emission line spectrum 67 of the illumination light source of the reading device, Since it does not affect the reading by the device, the color is changed to such a color.

Whether the overlap is permitted or not is different for each printer. For example, when the color of a character is actually specified to be red on the application software and output to a printer, the color may not be printed in red but may be mixed with a cyan component and printed. As described above, whether to print in red or to include a cyan component differs depending on the printer.
In a printer that prints including a cyan component, the printing is determined to be “black” by the cyan component, even though the reading device specifies printing in red so as to be determined to be “white” as described above. Will be. Therefore, when a printer that prints red containing such a cyan component is selected as an output printer, overlapping is prohibited and a printer that prints red without a cyan component is used. If the printer is selected as an output printer, overlapping is permitted.

Next, the subroutine of the overlap processing between different kinds of objects called in step 910 will be described with reference to the flowchart of FIG.

That is, first, it is determined whether or not any one of the image area 47, the text area 48, and the audio area 49 has been edited (step S9101).
If none of the regions has been edited, the overlap processing subroutine between different types of objects is terminated, and the process returns to the higher-level routine.

On the other hand, if it is determined that any one of the object areas has been edited, it is further determined whether or not the position or size of the edited area has changed (step S9102). If there is no area change, the overlap processing subroutine between different types of objects is terminated, and the process returns to the higher-level routine.

On the other hand, if it is determined that the area has changed, the coordinates of the object area are calculated, and the data is stored in a temporary file provided in the RAM 12 (step S9103).

Thereafter, the overlap is calculated (step S91).
04), it is determined whether or not they overlap (step S910)
5). In this case, the overlap between the audio area 49 and the surrounding margin area 63 and other object areas is determined.

Here, if it is determined that they overlap, it is determined whether or not the overlap is permitted (step S9).
106). As described above, depending on the printer, as shown in FIG. 17B or 17C, when the text area 48 and the audio area 49 overlap, the character color is changed to overlap the audio area 49, as shown in FIG. There is a printer that permits the above, and a printer in which the audio area 49 is located at the highest position, as shown in FIG. 16B, and other objects can only be hidden by the audio area 49. Therefore, for each printer, information indicating whether overlap is permitted or not is stored in the auxiliary storage unit 13 as the printer information 13A. In step S9106, this information is used to select the current output printer. It is determined whether or not the specified printer prohibits the overlapping of the audio area 49 and other objects.

If it is determined that the printer permits the overlap, a warning is displayed by a warning dialog box 66 as shown in FIG. 17A (step S9107). Then, the display form of the overlapped object is changed, and the change information is stored in the temporary file of the RAM 12 (step S9108). That is, the display mode is changed as shown in FIG. 17B or FIG. 17C, and the change information is stored. When printing is actually performed by the printer 31, printing is performed in the color indicated by the stored change information.

If it is determined in step S9106 that a printer for which overlapping is not permitted is selected, as shown in FIG. Are not displayed, and the information is stored in a temporary file in the RAM 12 (step S9109). Here, the voice area 4
In the case of overlapping between regions other than 9, only information on which is located higher is provided.
The data at the top of the overlap is valid.

When the display mode has been changed and stored in step S9108 or step S9109, it is determined whether or not the check has been completed for all object areas (step S910).
A) If not, the process returns to step S9104. Then, when it is determined that the check has been completed for all object areas, the overlapping processing subroutine between different kinds of objects is terminated, and the routine returns to the higher-level routine.

Although not particularly described in the flowchart of FIG. 19, before performing the warning display in step S9107, the color of the object in the portion overlapping the sound area 49 is determined, and the If the color is a color that is allowed to overlap, such as yellow or yellow, step S91
07 and step S9108 may be skipped and the process may proceed to step S910A.

Also, two types of display modes changed in step S9108 as shown in FIGS. 17B and 17C have been described, but only one of them is predetermined. May be used, or may be arbitrarily selected by the user. Further, after the warning dialog box 66 for warning the overlap is displayed, FIG.
(D) may be displayed to allow the user to make a selection. In this case, of course, in the color selection dialog box 68, only the colors which do not cause a problem even if they overlap as described above are displayed as selection candidates. In addition, when the output paper size is changed after the layout editing and the automatic layout change is performed, it goes without saying that the processing for the overlap between the pasted objects is performed. In particular, since the layout of the audio area is automatically changed so as to fit within the sheet size, the dot code cut off in the middle is not printed out, so that the reading device can surely read and reproduce it.

Next, the output printer change subroutine called in step SA will be described with reference to the flowchart of FIG.

First, it is determined whether or not an output printer change operation is to be performed (step SA01). If no output printer change operation is to be performed, this output printer change subroutine is terminated, and the process returns to the main routine. Return.

On the other hand, when the output printer is changed, the user selects the output printer again (step SA02), and determines whether or not the reselected output printer is a code printable printer. Is determined (step SA03).

Here, when a printer capable of code printing is selected again, it is determined whether or not the resolution after the change is different from the previously selected resolution (step S).
A04). If the resolutions are the same, the output printer change subroutine ends, and the process returns to the main routine.

On the other hand, if the resolutions are different, a user warning is issued (step SA05). In this case, there are the following two types of user warnings.

In the first pattern, as shown in FIG. 21A, the layout of the audio area 49 is changed without changing the recording time of the audio area 49.
That is, as shown on the left side of the figure, a warning dialog box 69 is displayed, stating that "the layout of the audio area will be changed because the print resolution is different." A mouse click operation (press operation) is performed. Then, when the user enters "O
When the “K” button 70 is clicked, an audio region 49 having a size corresponding to the recording time of 6 seconds at the original resolution is obtained.
As shown on the right side of the figure, the size is changed (enlarged in this case) according to the changed resolution without changing the 6-second audio recording time. When the “Cancel” button 71 is clicked, the change of the output printer is canceled, and the output printer remains unchanged.

In the second pattern, as shown in FIG. 21B, without changing the layout of the audio area 49,
That is, the recording time of the audio area 49 is changed.
That is, as shown on the left side of the figure, a warning dialog box 72 is displayed indicating that "the recording resolution is changed to 5 seconds because the printing resolution is different," and the user clicks the "OK" button 73. If the recording is performed, an audio area 49 having a size corresponding to a recording time of 6 seconds at the original resolution is recorded in accordance with the changed resolution without changing its size, as shown on the right side of FIG. Change to time (in this case shorter)
I do. That is, for example, when the printing resolution is changed from a 720 dpi printer to a 600 dpi printer, the recording time is reduced if the size of the audio area is the same, so that the recording time of 6 seconds is reduced to 5 seconds as in this example. Be changed. In other words, what is recorded is 5 seconds from the beginning of the original 6-second sound, and the remaining 1 second is deleted. Therefore, in this case, as described above, the user double-clicks the changed audio area 49 to open the waveform display screen 55 and edit the audio data so as to fit in the area reduced to 5 seconds. It is necessary. If the user clicks on the "cancel" button 74, the change of the output printer is canceled and the output printer remains unchanged.

The user warning at step SA05 is
In the present embodiment, the above warning dialog boxes 69 and 72 are alternatively displayed. Alternatively, for example, a selection such as "Do you want to modify the layout or change the recording time?" May be displayed to allow the user to make a selection. Of course, one of the warning dialog boxes 69 and 72 may be displayed as a default or by a user's selection in advance.

Then, it is determined whether or not the user has been confirmed (step SA06). If the “cancel” button is clicked with a mouse, the process returns to step SA01.

On the other hand, if the "OK" button is clicked with the mouse after making a selection by mouse operation, it is determined whether or not the selected item is a layout change (step SA07). If the layout is changed, the layout is corrected (step SA0).
8) If the layout is not changed, the recording amount is corrected (step SA09). When the layout is corrected or the recording amount is corrected in this way, an overlapping process between the pasted objects is performed (step SA13).
This output printer change subroutine ends, and the process returns to the main routine.

The overlapping process between the pasted objects is the same as the process shown in the layout editing between the pasted objects.

On the other hand, if it is determined in step SA03 that a printer capable of printing codes has not been selected, a user warning such as "The voice area is not printed." Is displayed (step SA1).
0). At this time, the display of the audio area on the layout sheet may be erased at the same time.

Then, it is determined whether or not the user has performed a confirmation operation (for example, an "OK" button mouse click operation) in response to the user warning (step SA11).
If the user confirmation operation has not been performed, that is, if the mouse click operation of the “cancel” button has been performed, the process returns to step SA01. When a user confirmation operation is performed, an internal flag indicating a display of a predetermined area (audio area) and a print disabled state is set, and a message "printing of audio area is not performed" is displayed. After that (step SA12), the output printer change subroutine ends, and the process returns to the main routine.

Next, the print output processing subroutine called in step SB will be described with reference to the flowchart in FIG.

First, a search is made as to whether or not there is an audio area 49 on the laid back board (step SB01), and it is determined whether or not the audio area 49 is present as a result of the search (step SB02). Here, if there is an audio area 49, it is further determined whether or not the currently selected output printer is a printer capable of code printing (step SB03). Displays a dialog box 75 indicating that printing is performed twice, as shown in the upper part of FIG. 23 (step SB).
04). Then, in response to the display of this dialog box 75, whether or not the user has given an instruction for the first printing,
That is, it is determined whether the “OK” button 76 has been clicked with the mouse (step SB05).

When the mouse click operation of the "OK" button 76 is performed, generation of a voice-encoded image for the voice region and display of the progress of the processing are performed (step SB0).
6). In other words, since a certain amount of processing time is required to generate the audio encoded image, the progress of the processing is displayed. Then, the generated audio encoded image (if there are a plurality of them, all of them) is output to the printer 31 according to the layout (step SB07). This starts printing, and FIG.
As shown in a), only the audio encoded image 78 is printed on the printing paper (print medium) 77.

Thereafter, as shown by b) in FIG.
A confirmation dialog box 79 such as "Print the second time. Please set paper again without mistake in the direction" is displayed (step SB0).
8). Here, before the user clicks the “OK” button 80 with the mouse, the user puts the printing paper 77 on which only the voice-encoded image 78 is printed in the first printing, into the printer 31
Must be set again. Some printers have a function to automatically return the printing paper 77 once printed to the home position. In such a printer, the printing paper 77 can be returned to the home position and printed. Is displayed, the confirmation dialog box 79 is displayed. Therefore, there is no problem even if the "OK" button 80 is immediately clicked with the mouse. Of course, in such an automatic return to the home position, the confirmation display itself can be skipped.

When the mouse click operation of the "OK" button 80 is performed, all objects (images, texts, etc.) other than the laid-out audio area are operated.
Is output to the printer (step SB09). That is, in the second printing, the printing as shown by b) in FIG. 23 is performed, but since the voice coded image 78 is already printed on the printing paper 77 as in a), the result is as follows. Specifically, a print result as shown in the upper part of FIG. 23 is obtained. When the printing is completed in this way, the print output processing subroutine ends, and the process returns to the main routine. In this way, when the voice-encoded image is printed first, and thereafter the readable image is printed, even if the readable image “1999.7.8 photographed” is superimposed on the voice-encoded image 78 and printed. The audio encoded image 78 does not easily peel off, and does not hinder later reading. At this time, the ink colors of the readable image take into account the relationship described with reference to FIG.

If it is determined in step SB03 that the printer is not a code printable printer,
After a warning that the audio area cannot be printed is displayed (step SB10), the flow advances to step SB09 to print an object other than the audio area, that is, perform only the second printing.

If it is determined in step SB02 that there is no audio area, the process proceeds to step SB02.
In step 09, only the object other than the audio area is printed.

Although the present invention has been described based on the embodiments, the present invention is not limited to the above-described embodiments, and various modifications and applications are possible within the scope of the present invention. .

For example, in the pasting object editing subroutine called in step S8, the waveform display screen 55 is displayed and the sound to be recorded in the sound area 49 is edited as in the first embodiment. Besides, it can be edited by various methods.

That is, in the pasting object editing subroutine, the editing of the audio area 49 shown in FIGS. 6A to 6E shown in FIG. You can edit attached objects.

Also, as shown in FIG. 24A, a sound object, here a 3-second sound file, is pasted from the file display section 52 to a sound area 49 having a recordable time of 6 seconds by D & D operation. In this case, as shown in (B) of FIG. 24, the display unit identifies and identifies how much of the recordable time is consumed by the attached sound object. Of course, in this case, 3 seconds actually correspond to the sound area 49.
It may be displayed inside. Then, in the editing of the pasted object, as shown in FIG. 24C, the sound is dragged leftward with the mouse at the right end boundary of the sound area 49 (actually, the margin area 63). Area 4
9 can be reduced. In this case, as shown in FIG. 24 (D), if the audio object has already been pasted for 3 seconds, it cannot be reduced further, that is, it does not move. I do.

When the user clicks on the audio area 49 as shown in FIG. 25A with a mouse, the audio area 49 is enlarged / reduced as shown in FIG. 25B. At this time, a guide point 81 indicating a position where the mouse pointer 42 is set is displayed, and the sound area 49 is displayed.
A play button 82, a stop button 83, and a record button 84 may be displayed adjacent to the lower side. When the play button 82 is clicked with a mouse, the sound file attached to the sound area 49 is reproduced. In this case, the sound compression is performed so that the actually recorded sound can be confirmed. Processing is performed, and data for confirming recorded voice is created by expanding the compressed voice, and the data is reproduced. Accordingly, in this case, since it takes a very long time to compress / decompress the audio, a progress display dialog box 85 indicating that the recording audio confirmation data is being created is displayed as shown in FIG. . Note that the recorded voice confirmation data created in this way is stored in a temporary file in the RAM 12, so that it can be reproduced and output immediately without displaying such a progress display dialog box 85 during the second and subsequent reproductions. Of course, every time the attached sound is edited, such as when the sound area 49 is enlarged / reduced or when the sound of the recording button 84 is clicked with a mouse click, the recorded sound confirmation data is created.

The summary of the present invention is as follows.

(1) When printing an optically readable audio encoded image obtained by encoding audio data on a predetermined print medium, printing the audio encoded image on the print medium An image recording method in which a layout screen for determining a recording area is displayed and print recording of the audio encoded image is performed, wherein audio data is already linked for one print recording area on the layout screen. And displaying a sound waveform corresponding to the already linked sound data based on a predetermined operation on the one print recording area.

That is, by displaying a waveform display screen 55 as shown in FIG. 8B, for example, audio data linked to the print recording area (audio area 49) of the audio encoded image can be directly confirmed visually. In addition, the editing operation can be performed immediately without any complicated operation.

(2) In displaying the audio waveform, the audio waveform corresponding to the audio data of the portion that is determined to be printed and recorded as the audio encoded image in the one print recording area is further expressed as The image recording method according to (1), wherein the image is displayed so as to be distinguishable from a sound waveform corresponding to already linked sound data.

That is, since it is possible to identify where the partial audio data to be printed and recorded of the audio encoded image is located with respect to the entire audio data, whether unnecessary audio data is recorded or not. On the other hand, the user can visually check whether necessary audio data is recorded.

(3) The image recording method according to (2), wherein the recording time of the audio that can be printed and recorded as the audio encoded image is further displayed in the one print recording area.

That is, the voice section to be printed and recorded in voice editing can be determined, and the editing target becomes clear.

(4) The recording time of the sound corresponding to the sound data of the portion determined to be printed and recorded as the sound-encoded image in the one print recording area is further displayed (2). The image recording method described in 1.

That is, the audio section to be printed and recorded in the audio editing can be determined, and the editing target becomes clear.

(5) When printing an optically readable audio encoded image obtained by encoding audio data on a predetermined print medium, printing the audio encoded image on the print medium An image recording method for displaying a layout screen for determining a recording area and performing print recording of the audio coded image, wherein audio data is linked to one print recording area on the layout screen, When the time of the sound corresponding to the linked sound data exceeds the time of the sound that can be print-recorded in the one print recording area, the one print record starts from the head of the sound corresponding to the linked sound data. An image recording method, characterized in that sound can be recorded up to a time that can be printed in an area.

That is, for example, as shown in FIG.
When the audio data is linked to the print recording area (audio area 49) of the audio coded image, the continuous audio section for the recording time from the beginning of the audio data is set as a recordable section, so that the operator is linked. Since the voice data itself is not recognized as defective data, but is recognized as having been cut off halfway due to a short recording time, it is not necessary for the operator to take unnecessary care.

(6) When printing an optically readable audio-encoded image obtained by encoding audio data on a predetermined print medium, printing the audio-encoded image on the print medium An image recording method for displaying a layout screen for determining a recording area and performing print recording of the audio coded image, wherein audio data is linked to one print recording area on the layout screen, When the time of the sound corresponding to the linked sound data exceeds the time of the sound that can be printed and recorded in the one print recording area, the reproduction and output of the sound corresponding to all of the linked sound data; and Selected from among the sounds corresponding to the reproduced sound data, one of the sound reproduction outputs for the time that can be printed and recorded in the one print recording area. An image recording method characterized by being selectable.

That is, for example, by operating the play buttons 58 and 59 as shown in FIG. 8B, the partial audio data for printing and recording the audio encoded image is located in any part of the entire audio data. Since it is possible to discriminate whether or not unnecessary voice data is recorded, it is possible to confirm whether unnecessary voice data is recorded or not. In addition, the voice section to be printed and recorded in voice editing can be determined,
Editing goals are clear.

(7) When the audio time corresponding to the audio data linked to the one print recording area exceeds the audio time that can be print-recorded in the one print recording area, The image recording method according to (5) or (6), wherein any one of an operation for enlarging a recording area and an operation for editing the linked audio data can be selected.

That is, by providing the check box 60 as shown in FIG. 8B, for example, the print recording area of the audio encoded image on the layout is changed or the audio encoded image is recorded as the audio encoded image. It is possible to select whether to edit audio data to be processed, and the degree of freedom of the operator is increased.

(8) When printing an optically readable audio encoded image obtained by encoding audio data on a predetermined print medium, printing the audio encoded image on the print medium What is claimed is: 1. An image recording apparatus which displays a layout screen for determining a recording area and prints and records the voice-encoded image, wherein a voice linking voice data is provided for one print recording area on the layout screen. Data link means, and display means for displaying a waveform of a sound corresponding to the sound data linked by the sound data link means based on a predetermined operation on the one print recording area. Image recording device.

That is, by displaying the waveform display screen 55 as shown in FIG. 8B, for example, the audio data linked to the print recording area (audio area 49) of the audio encoded image can be directly visually confirmed. In addition, the editing operation can be performed immediately without any complicated operation.

(9) When printing an optically readable audio encoded image obtained by encoding audio data on a predetermined print medium, printing the audio encoded image on the print medium What is claimed is: 1. An image recording apparatus which displays a layout screen for determining a recording area and prints and records the voice-encoded image, wherein a voice linking voice data is provided for one print recording area on the layout screen. A data link unit, a comparison unit that compares the audio time corresponding to the audio data linked by the audio data link unit with the audio time that can be printed and recorded in the one print recording area, The time of the sound corresponding to the sound data linked by the sound data link means is a sound that can be printed and recorded in the one print recording area. When it is determined that the time exceeds the time of the voice, control means that enables recording of the voice from the head of the voice corresponding to the linked voice data to the time that can be printed and recorded in the one print recording area, An image recording apparatus, comprising:

That is, for example, as shown in FIG.
When the audio data is linked to the print recording area (audio area 49) of the audio coded image, the continuous audio section for the recording time from the beginning of the audio data is set as a recordable section, so that the operator is linked. Since the voice data itself is not recognized as defective data, but is recognized as having been cut off halfway due to a short recording time, it is not necessary for the operator to take unnecessary care.

(10) When printing an optically readable audio encoded image obtained by encoding audio data on a predetermined print medium, printing the audio encoded image on the print medium What is claimed is: 1. An image recording apparatus which displays a layout screen for determining a recording area and prints and records the voice-encoded image, wherein a voice linking voice data is provided for one print recording area on the layout screen. A data link unit, a comparison unit that compares the audio time corresponding to the audio data linked by the audio data link unit with the audio time that can be printed and recorded in the one print recording area, The time of the voice corresponding to the voice data linked by the voice data link means can be printed and recorded in the one print recording area. When it is determined that the time exceeds the time of the sound, the reproduction output of the sound corresponding to all the linked sound data, and the print recording can be performed in the one print recording area among the sounds corresponding to the linked sound data. An image recording apparatus comprising: a control unit configured to select any one of audio reproduction outputs for a time.

That is, by operating the play buttons 58 and 59 as shown in FIG. 8B, for example, the partial audio data for printing and recording the audio encoded image is located in any part of the entire audio data. Since it is possible to discriminate whether or not unnecessary voice data is recorded, it is possible to confirm whether unnecessary voice data is recorded or not. In addition, the voice section to be printed and recorded in voice editing can be determined,
Editing goals are clear.

(11) When printing an optically readable audio encoded image obtained by encoding audio data on a predetermined print medium, printing the audio encoded image on the print medium When a layout screen for determining a recording area is displayed and print recording of the audio encoded image is performed, when audio data is already linked to one print recording area on the layout screen, the one A computer-readable recording medium storing a program including an instruction for causing a computer to execute a process of displaying a waveform of an audio corresponding to the already linked audio data based on a predetermined operation on a print recording area. .

That is, by displaying the waveform display screen 55 as shown in FIG. 8B, for example, the audio data linked to the print recording area (audio area 49) of the audio encoded image can be directly visually confirmed. In addition, the editing operation can be performed immediately without any complicated operation.

(12) In printing an optically readable audio encoded image obtained by encoding audio data on a predetermined print medium, printing the audio encoded image on the print medium When displaying a layout screen for determining a recording area and performing print recording of the audio-encoded image, audio data is linked to one print recording area on the layout screen, and the linked audio data is linked to the linked audio data. When the time of the corresponding sound exceeds the time of the sound that can be printed and recorded in the one print recording area, the time that can be printed and recorded in the one print recording area from the beginning of the sound corresponding to the linked sound data. A computer readable program that contains instructions that cause a computer to perform up to a minute of audio recording Recording medium.

That is, for example, as shown in FIG.
When the audio data is linked to the print recording area (audio area 49) of the audio coded image, the continuous audio section for the recording time from the beginning of the audio data is set as a recordable section, so that the operator is linked. Since the voice data itself is not recognized as defective data, but is recognized as having been cut off halfway due to a short recording time, it is not necessary for the operator to take unnecessary care.

(13) When printing an optically readable audio encoded image obtained by encoding audio data on a predetermined print medium, printing the audio encoded image on the print medium When displaying a layout screen for determining a recording area and performing print recording of the audio-encoded image, audio data is linked to one print recording area on the layout screen, and the linked audio data is linked to the linked audio data. When the time of the corresponding sound exceeds the time of the sound that can be printed and recorded in the one print recording area, the reproduction output of the sound corresponding to all of the linked sound data and the sound output corresponding to the linked sound data A process for enabling selection of any one of the audio reproduction outputs for the time that can be printed and recorded in the one print recording area out of the audio, A computer-readable recording medium that stores a program including instructions to be executed by a computer.

That is, by operating the reproduction buttons 58 and 59 as shown in FIG. 8B, for example, where the partial audio data for printing and recording the audio encoded image is located with respect to the entire audio data. Since it is possible to discriminate whether or not unnecessary voice data is recorded, it is possible to confirm whether unnecessary voice data is recorded or not. In addition, the voice section to be printed and recorded in voice editing can be determined,
Editing goals are clear.

[0182]

As described in detail above, according to the present invention,
For audio data that is printed and recorded as an audio-encoded image in one print recording area, the corresponding waveform can be displayed as necessary or edited as necessary, enabling audio encoding. IMAGE RECORDING METHOD AND IMAGE RECORDING APPARATUS WHICH PERFORMS WORK IN PRINTING AND RECORDING OF GENERATED IMAGES EASYLY AND EFFICIENTLY A possible recording medium can be provided.

[Brief description of the drawings]

FIG. 1 is a diagram showing a main flowchart of an operation program for causing a personal computer to function as an image recording device according to an embodiment of the present invention.

FIG. 2 is a diagram showing a configuration when an embodiment of the present invention is applied to a personal computer.

FIG. 3 is a diagram illustrating an output printer selection dialog box.

FIGS. 4A and 4B are diagrams for explaining a layout mount template and a limited layout mount template, respectively.

FIG. 5 is a diagram for explaining a main screen.

FIGS. 6A and 6B are diagrams for explaining enlargement editing in a horizontal direction of an audio region, respectively, and FIGS. 6C and 7D are diagrams for explaining enlargement editing in a vertical direction; FIGS. (E) is a diagram for explaining simultaneous enlargement editing in the horizontal and vertical directions, respectively.

7A is a diagram for explaining a display mode of a sound area according to a compression ratio, and FIG. 7B is a flowchart of a pasting object designation subroutine in FIG. 1;

FIG. 8A is a diagram for explaining a dialog box for selecting a plurality of audio objects linked to one image object, and FIG. 8B is a diagram for explaining a waveform display screen; .

FIG. 9A is a diagram for explaining identification display of a sound area when a pasting operation is performed on one image area when a plurality of image areas and a sound area are present on the layout mount; FIG. 7B is a diagram for explaining an operation of designating one voice region.

FIG. 10 is a flowchart of a pasting object editing subroutine in FIG. 1;

FIG. 11 is a diagram for explaining a moving operation of a voice recording period bar.

12A is a diagram illustrating a display state of a sound area to which a sound object is pasted, and FIG. 12B is a diagram illustrating expansion of a sound area in conjunction with an operation of expanding a sound recording period bar; It is.

FIG. 13 is a flowchart of a layout editing subroutine between pasted objects in FIG. 1;

FIG. 14 is a diagram for explaining the relationship between a sound area, a margin area, and a restriction area.

FIG. 15A is a diagram for explaining a warning dialog box when a moving operation in which voice regions overlap with each other is performed, and FIG. 15B illustrates a state after the voice region is moved at that time; FIG.

16A is a diagram for explaining an operation of moving a sound area onto a readable image object area, and FIG. 16B is a view showing a display result when overlapping of the readable image object area and the sound area is not permitted; FIG.

17A is a diagram for explaining a warning dialog box displayed when the overlap between the readable image object region and the audio region is permitted, and FIGS. 17B and 17C are display results in that case, respectively. FIG.
(D) is a diagram for explaining a color selection dialog box.

FIGS. 18A to 18E show a case where overlapping of a readable image object area and an audio area is not permitted, and FIGS.
FIG. 9 is a diagram showing a wavelength distribution of reflection intensity in each color, which is used for explaining the case of performing the color change and the reason for performing the color change.

FIG. 19 is a flowchart of an overlap processing subroutine between different types of objects in FIG. 13;

FIG. 20 is a flowchart of an output printer change subroutine in FIG. 1;

21A is a diagram for explaining a transition of display when changing the layout of the audio area without changing the recording time of the audio area, and FIG. 21B is a diagram for changing the layout of the audio area. FIG. 9 is a diagram for explaining a transition of display when changing the recording time of the audio area without changing the recording time.

FIG. 22 is a flowchart of a print output processing subroutine in FIG. 1;

FIG. 23 is a diagram for explaining twice printing.

FIG. 24A is a diagram for explaining an operation of attaching a 3-second audio object to an audio area having a recordable time of 6 seconds, and FIG. 24B shows a display state after the application. FIGS. 8C and 8D are diagrams for explaining the reduction operation.

FIG. 25A is a diagram showing another display example of a sound area to which a sound object is pasted, and FIG. 25B is a view for explaining a display state when the user clicks the sound area of FIG. (C) is a diagram for explaining a progress display dialog box.

FIG. 26 is a diagram illustrating a physical format configuration of a dot code as an audio encoded image.

[Explanation of symbols]

1 dot code 10 personal computer (PC) 11 CPU 12 RAM 13 auxiliary storage unit 13A printer information 13B new printer information 14 data input unit 15 output unit 16 pointing device 21 digital camera 22 microphone 23 video camera 31 printer 32 speaker 33 monitor 41 output Printer selection dialog box 42 Mouse pointer 43, 54, 61, 70, 73, 76, 80
"K" button 44, 62, 71, 74 "Cancel" button 45 Layout mount template 46 Limited layout mount template 47, 47A, 47B Image area 48 Text area 49, 49A, 49B Audio area 50 Main screen 51 Layout display section 52 File display Part 53, 75 Dialog box 55 Waveform display screen 56 Audio waveform data 57 Audio recording period bar 58, 59, 82 Play button 60 Check column 63 Margin area 64 Restricted area 65, 66, 69, 72 Warning dialog box 67 Bright line spectrum 68 Color Selection dialog box 77 Printing paper (printing medium) 78 Voice coded image 79 Confirmation dialog box 81 Guide point 83 Stop button 84 Record button 85 Progress display dialog box

Claims (13)

[Claims] When recording an optically readable audio encoded image obtained by encoding audio data on a predetermined print medium, the audio encoded image is printed and recorded on the print medium. An image recording method in which a layout screen for determining an area is displayed and print recording of the audio encoded image is performed, wherein audio data is already linked for one print recording area on the layout screen. And displaying a sound waveform corresponding to the already linked sound data based on a predetermined operation on the one print recording area. 2. When displaying the audio waveform, the audio waveform corresponding to the audio data of a portion that is determined to be printed and recorded as the audio encoded image in the one print recording area is also displayed. 2. The image recording method according to claim 1, wherein the image is displayed so as to be distinguishable from a sound waveform corresponding to linked sound data. 3. The image recording method according to claim 2, further comprising displaying a recording time of an audio printable as the audio encoded image in the one print recording area. 4. The method according to claim 2, further comprising displaying a recording time of audio corresponding to audio data of a portion determined to be printed and recorded as the audio encoded image in the one print recording area. The image recording method described in the above. 5. When printing an optically readable audio encoded image obtained by encoding audio data on a predetermined print medium, printing the audio encoded image on the print medium. An image recording method in which a layout screen for determining an area is displayed and print recording of the audio encoded image is performed, wherein audio data is linked to one print recording area on the layout screen. When the time of the sound corresponding to the linked sound data exceeds the time of the sound that can be print-recorded in the one print recording area, the one print recording area from the head of the sound corresponding to the linked sound data An image recording method characterized in that audio can be recorded up to a time that can be printed and recorded in a computer. 6. A method for printing and recording an optically readable audio encoded image obtained by encoding audio data on a predetermined print medium, wherein the audio encoded image is printed on the print medium. An image recording method in which a layout screen for determining an area is displayed and print recording of the audio encoded image is performed, wherein audio data is linked to one print recording area on the layout screen. When the time of the sound corresponding to the linked sound data exceeds the time of the sound that can be printed and recorded in the one print recording area, the reproduction and output of the sound corresponding to all of the linked sound data; and One of the audio output corresponding to the time that can be printed and recorded in the one print recording area can be selected from the audio corresponding to the reproduced audio data. Image recording method is characterized in that the. 7. When the time of audio corresponding to audio data linked to the one print recording area exceeds the time of audio that can be print-recorded in the one print recording area, further comprising: 7. An image processing apparatus according to claim 5, wherein one of an operation for enlarging an area and an operation for editing the linked audio data is selectable.
The image recording method described in 1. 8. When printing an optically readable audio encoded image obtained by encoding audio data on a predetermined print medium, print recording the audio encoded image on the print medium. What is claimed is: 1. An image recording apparatus which displays a layout screen for determining an area and prints and records said audio coded image, wherein audio data is linked to audio data for one print recording area on said layout screen. Link means; and display means for displaying a waveform of a sound corresponding to the sound data linked by the sound data link means based on a predetermined operation on the one print recording area. Image recording device. 9. When printing an optically readable audio encoded image obtained by encoding audio data on a predetermined print medium, print recording the audio encoded image on the print medium. What is claimed is: 1. An image recording apparatus which displays a layout screen for determining an area and prints and records said voice-encoded image, wherein voice data for linking voice data for one print recording area on said layout screen is provided. Link means, comparing means for comparing the time of the sound corresponding to the sound data linked by the sound data linking means, and the time of the sound which can be printed and recorded in the one print recording area, and the comparing means The time of the sound corresponding to the sound data linked by the sound data link means is the time of the sound that can be printed and recorded in the one print recording area. And control means for enabling recording of the sound from the head of the sound corresponding to the linked sound data to the time corresponding to the printable time in the one print recording area when it is determined that the time exceeds the time. An image recording apparatus, comprising: 10. When printing an optically readable audio encoded image obtained by encoding audio data on a predetermined print medium, print recording the audio encoded image on the print medium. What is claimed is: 1. An image recording apparatus which displays a layout screen for determining an area and prints and records said audio coded image, wherein audio data is linked to audio data for one print recording area on said layout screen. Link means, comparing means for comparing the time of the sound corresponding to the sound data linked by the sound data linking means, and the time of the sound that can be printed and recorded in the one print recording area, and the comparing means The time of the sound corresponding to the sound data linked by the sound data link means is the sound that can be printed and recorded in the one print recording area. When it is determined that the time exceeds the time, the reproduction output of the sound corresponding to all of the linked sound data, and the time in which the sound corresponding to the linked sound data can be printed and recorded in the one print recording area. And control means for selecting any one of the reproduction outputs of the minute voice. 11. When printing an optically readable audio encoded image obtained by encoding audio data on a predetermined print medium, print recording the audio encoded image on the print medium. When a layout screen for determining an area is displayed and print recording of the audio encoded image is performed, when audio data is already linked to one print recording area on the layout screen, the one print is performed. A computer-readable recording medium storing a program including an instruction for causing a computer to execute a process of displaying a sound waveform corresponding to the already linked sound data based on a predetermined operation on a recording area. 12. When printing an optically readable audio encoded image obtained by encoding audio data on a predetermined print medium, print recording the audio encoded image on the print medium. When a layout screen for determining an area is displayed and print recording of the audio coded image is performed, audio data is linked to one print recording area on the layout screen, and corresponding to the linked audio data. When the time of the sound to be performed exceeds the time of the sound that can be printed and recorded in the one print recording area, the time that can be printed and recorded in the one print recording area from the beginning of the sound corresponding to the linked sound data Computer-readable recording that stores a program that includes instructions for causing a computer to execute the process of enabling the recording of audio up to Media. 13. Printing and recording an optically readable audio encoded image obtained by encoding audio data on a predetermined print medium, wherein the audio encoded image is printed and recorded on the print medium. When a layout screen for determining an area is displayed and print recording of the audio coded image is performed, audio data is linked to one print recording area on the layout screen, and corresponding to the linked audio data. When the time of the sound to be performed exceeds the time of the sound that can be printed and recorded in the one print recording area, the reproduction output of the sound corresponding to all the linked sound data, and the sound corresponding to the linked sound data Processing for enabling selection of any one of audio playback outputs for a time during which print recording is possible in the one print recording area. Storing a program comprising instructions to be executed by the data, the computer readable recording medium.