JP2001216063A - Method for starting data reproduction by computer and method for printing output screen and recording medium and computer system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a method for starting data reproduction by a computer and a method for printing an output screen and a recording medium and a computer system for improving operability or convenience. SOLUTION: This method for starting data reproduction by a computer comprises a step for displaying picture elements related with voice data or animation data to which access can be performed by a computer at a prescribed position on a screen to be outputted by the computer, a step for detecting the position of a mobile pointer index in the screen, a step for judging whether or not the voice data or the animation data should be reproduced by using only the positional relation of the picture elements and the pointer index, and a step for performing access to the voice data or the animation data based on the judgment, and for starting the data reproduction.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for interfacing a computer screen with a user, and more particularly, to a technique for instructing reproduction of audio or moving image data on a computer screen and a technique for printing out information on the computer screen. The present invention relates to a method for starting data reproduction by a computer, a method for printing an output screen, a recording medium, and a computer system.

[0002]

2. Description of the Related Art Conventionally, with respect to a computer screen and user interface technology, an image element such as a button displaying various functions is arranged on a computer screen, and a pointer index operated by a mouse or the like is moved onto the image element. It is widely practiced to activate a function associated with the image element by clicking a mouse or the like.

[0003] When the pointer index is moved over an image element, a balloon mark displaying a text describing the image element is often displayed adjacent to the image element.

[0004] Printing computer screens, such as hard copies of computer screens, is also widely practiced.

On the other hand, a technique for converting audio data handled by a computer into a dot code which is an optically readable pattern is disclosed in Japanese Patent Application Laid-Open No. Hei 6-231466.

The technique of converting the audio data into a dot code, which is an optically readable pattern, is employed in ScanTalk (registered trademark) sold by Olympus Optical Industries, Ltd.

[0007]

However, in the conventional operation using the pointer index on the computer screen as described above, an operation such as a mouse click is required at the time of activation of the function, and the operability is not good. was there.

[0008] The click operation includes a single click, a double click, and the like, and these operations require a certain amount of learning.

In particular, it is difficult for a child or the like to perform a click operation, and a click is required to reproduce a sound or a moving image.

Further, audio data is often processed by a computer, but the audio data cannot be easily printed and saved as a screen like image data.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned problems, and is directed to a technique for instructing reproduction of audio or moving image data on a computer screen and a technique for printing and outputting information on a computer screen. It is an object of the present invention to provide a method of starting data reproduction by a computer capable of realizing a man-machine interface with good operability, a recording medium used therefor, and a computer system.

Further, the present invention has been made in view of the above-mentioned problems, and is directed to a technique for instructing reproduction of audio or moving image data on a computer screen and a technique for printing and outputting information on a computer screen. Another object of the present invention is to provide a method of printing an output screen by a computer, a recording medium used for the method, and a computer system for improving the convenience of the computer.

[0013]

According to the present invention, in order to solve the above problems, (1) a predetermined position on a screen output by a computer is associated with audio data or moving image data accessible by the computer. Displaying an image element; detecting a position of a movable pointer index in the screen; and determining whether to reproduce the audio data or the moving image data using only the positional relationship between the image element and the pointer index. And starting the playback by accessing the audio data or the moving image data based on the determination.

According to the present invention, in order to solve the above problems, (2) displaying an image element associated with audio data or moving image data accessible by the computer at a predetermined position on a screen output by the computer. Causing the position of the movable pointer index on the screen to be detected, and determining whether to reproduce the audio data or the moving image data using only the positional relationship between the image element and the pointer index. And a step of starting the reproduction by accessing the audio data or the moving image data based on the determination. A computer-readable recording medium storing a program for causing a computer to execute the steps is provided.

According to the present invention, in order to solve the above-mentioned problems, (3) an access means for accessing audio data or moving image data by a computer, and the audio data or moving image at a predetermined position on an output screen of the computer. Display means for displaying an image element associated with data;
Moving means for moving the pointer index to a desired position on the output screen of the computer; position detecting means for detecting the position of the pointer index; and the audio using only the positional relationship between the image element and the pointer index. A computer system is provided, comprising: a determination unit that determines whether to reproduce data or moving image data; and a reproduction unit that reproduces the audio data or moving image data based on the determination.

According to the present invention, in order to solve the above-mentioned problems, (4) a step of detecting a print instruction of an output screen of a computer, and a step of detecting audio data associated with an image element displayed in the output screen Accessing the image data, generating the optically readable pattern image by converting the audio data, and printing the output screen by superimposing or adding the pattern image. An output screen printing method by a computer is provided.

According to the present invention, in order to solve the above-mentioned problems, (5) a step of detecting a print instruction of an output screen of a computer, and a step of detecting audio data associated with an image element displayed in the output screen Accessing the computer, converting the audio data to generate an optically readable pattern image, and printing the output screen by superimposing or adding the pattern image. A computer-readable recording medium that records a program for causing a computer to print a screen is provided.

Further, according to the present invention, in order to solve the above-mentioned problems, (6) detecting means for detecting a print instruction of an output screen of a computer, and a sound associated with an image element displayed in the output screen Access means for accessing data, generating means for converting the audio data to generate an optically readable pattern image,
And a printing means for printing the output screen by superimposing or adding the pattern image.

Here, it is determined whether or not the audio data or the moving image data is reproduced by using only the positional relationship between the screen element and the pointer index in the above (1), (2), and (3). "Includes the time when the positional relationship is maintained as a factor of the judgment.

The image elements “associated with image elements” in the above (1) to (6) include not only buttons, icons, characters, etc., which are visually distinct from the surroundings, but also It also includes elements that cannot be visually distinguished from the surroundings, such as a specific range in the area.

[0021]

Embodiments of the present invention will be described below with reference to the drawings.

(Embodiment 1) The point of Embodiment 1 is only that an image element associated with audio data or moving image data is displayed on an output screen of a computer, and a movable pointer is positioned on the image element. , The reproduction of audio data or moving image data associated with the pixel is started.

The present embodiment is an example in which the computer system according to the present invention is applied to control on a homepage accessed by the Internet.

FIG. 1 is a block diagram showing a schematic configuration of a computer system according to Embodiment 1 of the present invention.

That is, this computer system
As shown in FIG. 1, a personal computer (hereinafter, PC) main body 2 having a display 1, a keyboard 3, and a mouse 4 attached thereto, and being connected to the PC main body 2 via a communication line 6, It comprises a homepage server 7 accessed by the Internet and a disk mechanism 8 attached to the server 7 as an external recording device.

The PC body 2 has a built-in disk drive mechanism 5 for driving a disk as a recording medium.

FIG. 2 shows a homepage screen accessible via the Internet by the computer system shown in FIG.

In this site, the user registers image data or audio data created by the user and uses this data to process data, print data, browse (gallery), contest (comparison with other users) ) And other services.

That is, as shown in FIG. 2, at the top of this screen, there is an area where the title 11 is displayed.

On the left side of the screen, there is an area where a plurality of buttons 12 as image elements to which various functions are added are displayed.

From the center to the right side of the screen, there is an area where a plurality of icons 13 as image elements indicating still image data, moving image data, and audio data registered by the user are displayed.

Among them, on the icon 13 of the still image,
A reduced image of the still image is displayed.

On the moving image icon 13, a reduced image of the initial screen of the moving image is displayed.

On the voice icon 13, “voice” is displayed.
Is displayed.

The user moves the pointer index 14 on the screen arbitrarily using a pointing device such as the mouse 4.

Then, in this computer system,
The programming is performed so that the movement of the pointer index 14 and the positioning of the pointer index on the audio icon 13 only starts the reproduction of the audio data associated with the icon 13.

Further, in this computer system, the pointer index 14 is moved to be positioned on the moving picture icon 13 without any special operation such as mouse click. Programming is performed so that the playback of the moving image is started.

Further, in this computer system, the programming is performed so that the reproduction of the voice message described by the button 12 is started only by moving the pointer index 14 and positioning it on the button 12. .

As described above, in this computer system, when the index 14 controlled by the pointing device such as the mouse 4 is at a predetermined position on the screen, a predetermined operation such as mouse click is not required. Programming is performed so that reproduction of audio data and moving image data is started.

Here, the time when the index 14 is at a predetermined position on the screen is measured, and this time is measured for a predetermined time (for example, 1).
(Seconds) or more, it is also possible to control to start reproduction of predetermined audio data or moving image data.

In this way, it is possible to prevent a harmful effect that unintended data is frequently reproduced due to the movement of the index 14, and the present invention encompasses such control.

Of course, the moving picture data may be animation moving picture data instead of live-action moving picture data.

In this computer system, in addition to the above, particularly preferred examples include the following.

1. Programming is performed so that an operation image element operated by the user, such as the button 12 or the switch, is associated with a voice message describing a function that operates by operating the image element.

2. Programming is performed such that image elements corresponding to various facilities on the map are displayed on an image such as a map, and a voice message explaining the facility is associated with the image elements.

3. Programming is performed so as to associate a voice message of the character and a moving image of the motion of the character with an image element of the character.

4. A part of the image is an image element associated with audio data or moving image data, and the position of the image element is presented to the user so as not to be visually recognized on the screen, and the user searches for the image element by moving the point indicator 14. By doing so, programming is performed so as to provide game characteristics.

5. In the computer system of the present invention,
Programming is performed so that an easy-to-read screen with few texts can be created by using the homepage that can be browsed on the Internet.

FIG. 3 is a flowchart for explaining functions of the computer system according to the first embodiment.

First, at a predetermined position on the screen of the display 1 output by the computer (PC main body 2), a button 12, a mark, an icon 13, an image such as a figure associated with audio data or moving image data accessible by the computer. The element is displayed (Step S1).

When the user operates the pointing device such as the mouse 4 or the like, the position of the pointer index 14 movable on the screen on the image is detected (step S2).

The pointer index 14 is placed on the image element.
Is determined (step S3).

The pointer index 14 is placed on the image element.
Is located, it is determined that the audio data or the moving image data associated with the image element is reproduced (step S
4) Otherwise, it is determined not to reproduce (step S)
5).

If it is determined in step S4 that the audio data or the moving image data is to be reproduced, the reproduction is started (step S6).

Then, the position of the pointer index 14 is continuously checked (step S7), and when the pointer index 14 deviates from the predetermined position, the reproduction of the audio data or the moving image data is stopped (step S8).

Here, the time when the index 14 is at a predetermined position on the screen is measured, and this time is measured for a predetermined time (for example, 1).
(Seconds) or more, when controlling to start reproduction of predetermined audio data or moving image data, the time between the step S3 and the step S4 where the pointer index is located on the pixel element It may be added a step of determining whether is longer than one second.

As described above, in the computer system according to the first embodiment of the present invention, the reproduction of the audio data or the moving image data is started only by positioning the pointer index 14 at the predetermined position on the screen.

Thus, according to the computer system according to the first embodiment of the present invention, for example, most of the information displayed as text on the screen can be reproduced only by moving the pointer 14 so that the sound is reproduced. It is possible to provide a user-friendly screen that is easy to handle and replaces data or moving image data.

That is, in the computer system according to the first embodiment of the present invention, the user who has become familiar with the operation on the screen can proceed to the next operation without listening to the voice, so that the operability is improved and the user is familiar with the service. For those who do not, it is possible to provide an intimate interface with voice messages.

In the computer system according to the first embodiment of the present invention, the reproduction of the audio data or the moving image data can be started only by the positional relationship of the pointer index 14, so that, for example, the pointer index is displayed on the character on the screen. If the character 14 is moved, it is possible to control the character to move and speak, etc., and it is possible to provide an interface that is easy to handle especially for infants and the like.

As described above, in the computer system according to the first embodiment of the present invention, it is possible to provide a more operable man-machine interface.

(Second Embodiment) The point of the second embodiment is that, in addition to the first embodiment, when an instruction to print a screen displaying an image element associated with audio data is issued, the audio data is optically converted. A computer system is characterized by being converted into a readable pattern and printed.

In the present embodiment, the same functions as those of the home page provided in the first embodiment are recorded on a recording medium such as a CD-ROM, and operate independently on the PC main body 2.

Therefore, the screens and functions described in the first embodiment also apply to this embodiment as they are.

In the present embodiment, when the user instructs to print a screen displaying image elements associated with audio data, the audio data is converted into an optically readable pattern and printed. It is characterized in that it is added to the first embodiment.

FIG. 4 is a block diagram showing a schematic configuration of a computer system according to Embodiment 2 of the present invention.

That is, this computer system
As shown in FIG. 4, a computer (hereinafter referred to as a PC) main body 2 having a display 1, a keyboard 3, and a mouse 4 attached thereto, and a recording medium such as the above-described CD-ROM attached to the PC main body 2. A disk drive mechanism 9 for driving a disk as a printer and a printer 10.

The PC main body 2 has a built-in disk drive mechanism 5 for driving a disk as a recording medium.

FIG. 5 shows a home page screen by the computer system shown in FIG.

In this homepage, the user registers image data or audio data created by the user, and uses this data to process data, print data, view (gallery), contest (comparison with other users). ) And other services.

That is, as shown in FIG. 5, at the top of this screen, there is an area where the title 11 is displayed.

On the left side of the screen, there is an area in which a plurality of buttons 12 as image elements to which various functions are added are displayed.

Further, from the center to the right side of the screen, there is an area in which a plurality of icons 13 as image elements indicating still image data, moving image data, and audio data registered by the user are displayed.

Further, a button 15 for hard copy for instructing a hard copy of the screen is provided at the lower right side of the screen.
There is an area where is displayed.

Among them, on the icon 13 of the still image,
A reduced image of the still image is displayed.

On the moving picture icon 13, a reduced image of the initial screen of the moving picture is displayed.

Further, “voice” is displayed on the voice icon 13.
Is displayed.

The user moves the pointer index 14 on the screen arbitrarily using a pointing device such as the mouse 4.

Then, in this computer system,
The programming is performed so that the movement of the pointer index 14 and the positioning of the pointer index on the audio icon 13 only starts the reproduction of the audio data associated with the icon 13.

Further, in this computer system, the pointer index 14 is moved to be positioned on the moving picture icon 13 without any special operation such as mouse click. Programming is performed so that the playback of the moving image is started.

Further, in this computer system, by moving the pointer index 14 and positioning it on the button 15 for hard copy, an instruction to print a screen on which image elements associated with audio data are displayed is given. Programming is performed so that the voice data is converted into an optically readable pattern and printed.

Further, in this computer system, the programming is performed such that the reproduction of the voice message described by the button 12 is started only by moving the pointer index 14 and positioning it on the button 12. .

As described above, in this computer system, when the index 14 controlled by the pointing device such as the mouse 4 is at a predetermined position on the screen, a predetermined operation such as a mouse click is not required. The programming is performed so that the reproduction of the audio data and the moving image data is started, and the printing of the screen on which the image element associated with the audio data is displayed is instructed, and the pattern in which the audio data can be optically read. Is programmed so as to be converted to a print.

Here, the function of starting the reproduction of the former predetermined audio data or moving image data is the same as in the first embodiment.

Therefore, the function of converting the latter voice data into an optically readable pattern and printing the latter will be described below.

First, when the pointer index 14 is moved onto the hard copy button 15, the screen shown in FIG.
The printout is performed by the printer 10 attached to the C body 2.

At this time, if there is an area associated with the audio data on the screen, the audio data is converted into a dot code which is an optically readable pattern, and this dot code is also printed.

FIG. 6 is a diagram illustrating a print output by the hard copy function of the computer system according to the second embodiment of the present invention.

In FIG. 6, a dot code 16 which is an optically readable pattern obtained by converting the audio data is displayed in an area associated with the audio data.

Here, a technique for converting audio data handled by a computer into a dot code which is an optically readable pattern is employed in ScanTalk (registered trademark) sold by Olympus Optical Industries, Ltd. And Japanese Patent Laid-Open No. 6-231466.

FIG. 7 is a flowchart for explaining the hard copy function of the computer system according to the second embodiment.

First, at a predetermined position on the screen of the display 1 which is output by the computer (PC main body 2), buttons 12, marks, icons 13, images such as figures associated with audio data or moving image data accessible by the computer. The element is displayed (Step S11).

In this state, it is detected that the user operates the pointing device such as the mouse 4 to select the hard copy button 15 at the position on the image of the pointer index 14 which can be moved on the screen. (Step S12).

Then, the screen image at this time is stored in the memory of the computer (step S1).
3).

Next, it is determined whether or not there is an area associated with the audio data on the screen (step S14).

If there is an area associated with the audio data, access is made to the associated audio data (step S15).

The voice data is converted to create a dot code which is an optically readable pattern image (step S16).

This pattern image is superimposed or added to the screen image stored in the memory of the computer (step S17).

The image of the screen stored in the memory in the computer and the audio data superimposed or added thereto are converted and the dot code which is an optically readable pattern image is converted into the printer 1.
0 is printed out (step S17).

In this case, when the audio data is short in time, the dot code, which is a pattern image which can be converted and optically read, is associated with the audio data as shown in FIG. It may be printed out as a dot code 16 in the designated area.

However, when the audio data is not short in time, the dot code which is a pattern image that can be converted and optically read is associated with the audio data as shown in FIG. Instead of printing out the dot code 16 in the area, the printout may be performed on the margin of the print paper or another print paper.

If it is determined in step S14 that there is no area associated with the audio data in the screen, the image on the screen at that time is printed out as it is.

As described above, in the computer system according to the second embodiment of the present invention, when an instruction is issued to print a screen on which image elements associated with audio data are displayed, the audio data is converted into an optically readable pattern. Since it has a function of being converted and printed, when a screen having an area associated with audio data is printed, the audio data is fixed during printing without loss.

Thus, according to the computer system according to Embodiment 2 of the present invention, by printing the screen, the voice data on the screen can be printed out, so that the convenience is improved.

[0105]

Therefore, as described above, claim 1 is as follows.
According to the third to third aspects of the present invention, it is possible to provide a method of starting data reproduction by a computer having a more operable man-machine interface, a computer-readable recording medium, and a computer system.

As described above, according to the fourth to sixth aspects of the present invention, voice data on the screen can be printed out by printing the screen.
An output screen printing method by a computer, a computer-readable recording medium, and a computer system with improved convenience can be provided.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a schematic configuration of a computer system according to a first embodiment of the present invention.

FIG. 2 is a view showing a homepage screen accessible via the Internet by the computer system according to the first embodiment of the present invention.

FIG. 3 is a flowchart for explaining functions of the computer system according to the first embodiment of the present invention;

FIG. 4 is a block diagram illustrating a schematic configuration of a computer system according to a second embodiment of the present invention.

FIG. 5 is a view showing a screen of a homepage by a computer system according to Embodiment 2 of the present invention.

FIG. 6 is a diagram exemplifying a print output by a hard copy function of a computer system according to a second embodiment of the present invention.

FIG. 7 is a flowchart illustrating a hard copy function of a computer system according to a second embodiment of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 ... Display, 3 ... Keyboard, 4 ... Mouse, 2 ... Computer (PC) main body, 6 ... Communication line, 7 ... Server, 8 ... Disk mechanism, 5 ... Disk drive mechanism, 9 ... Disk drive mechanism, 10 ... Printer, 12 ... button, 13 ... icon, 14 ... pointer index, 15 ... button for hard copy, 16 ... dot code.

 ──────────────────────────────────────────────────続 き Continued on the front page (72) Inventor Yoshie Kosaka 3-4, Kanda Surugadai, Chiyoda-ku, Tokyo Olympus Sales Co., Ltd. (72) Masaya Honma 3--4, Kanda Surugadai, Chiyoda-ku, Tokyo Olympus Sales Co., Ltd. (72) Inventor Tsuneyuki Kubo 2-43-2 Hatagaya, Shibuya-ku, Tokyo Olympus Optical Industrial Co., Ltd. F-term (reference) 5E501 AA01 AB13 AC16 BA05 CA02 CB09 EA11 FA02 FA04 FA05 FA32

Claims (6)

[Claims] Displaying an image element associated with audio data or moving image data accessible by the computer at a predetermined position on a screen output by the computer; and detecting a position of a movable pointer index on the screen. Determining whether to reproduce the audio data or the moving image data using only the positional relationship between the image element and the pointer index, and accessing the audio data or the moving image data based on the determination. Starting data reproduction by a computer. A method for starting data reproduction by a computer, comprising: Displaying an image element associated with audio data or moving image data accessible by the computer at a predetermined position on a screen output by the computer; and detecting a position of a movable pointer index on the screen. And determining whether to reproduce the audio data or the video data using only the positional relationship between the image element and the pointer index, and accessing the audio data or the video data based on the determination. And a computer-readable recording medium on which a program for causing a computer to execute the reproduction is recorded. 3. Access means for accessing audio data or video data by a computer; display means for displaying an image element associated with the audio data or video data at a predetermined position on an output screen of the computer; Moving means for moving the pointer index to a desired position on the output screen; position detecting means for detecting the position of the pointer index; and using only the positional relationship between the image element and the pointer index, the audio data or the moving image. A computer system comprising: a determination unit that determines whether to reproduce data; and a reproduction unit that reproduces the audio data or the moving image data based on the determination. 4. A step of detecting a print instruction on an output screen of a computer, a step of accessing audio data associated with an image element displayed in the output screen, and a step of converting the audio data and optically converting the audio data. A method of printing an output screen by a computer, comprising: generating a readable pattern image; and printing the output screen by superimposing or adding the pattern image. 5. A step of detecting a print instruction of an output screen of a computer, a step of accessing audio data associated with an image element displayed in the output screen, and a step of converting the audio data and optically converting the audio data. A step of generating a readable pattern image; and a step of printing the output screen by superimposing or adding the pattern image. Recording medium. 6. A detection means for detecting a print instruction of an output screen of a computer, an access means for accessing audio data associated with an image element displayed in the output screen, and an optical element for converting the audio data to optical data. A computer system comprising: generating means for generating a pattern image that can be read; and printing means for printing the output screen by superimposing or adding the pattern image.