WO2000003540A1

WO2000003540A1 - Information processing device, information processing method, and recording medium

Info

Publication number: WO2000003540A1
Application number: PCT/JP1999/001271
Authority: WO
Inventors: Satoshi Miyagawa; Yasuhiro Kawakatsu
Original assignee: Fujitsu Limited
Priority date: 1998-07-10
Filing date: 1999-03-16
Publication date: 2000-01-20
Also published as: JP2000029596A

Abstract

An information processing device for reproducing an image and sound and a storage medium stored with a program for allowing an information processing device to execute processings relating to the invention are provided. Video information and audio information are controlled by the user. Control information supplied together with input data is detected, and the parameters are altered by the operation of the user to alter the video information and audio information.

Description

Technical Field Information processing apparatus, information processing method, and recording medium

The present invention relates to an information processing apparatus, an information processing method, and a recording medium of the present invention, and more particularly, to an information processing apparatus, an information processing method, and a recording medium for reproducing images, sounds, and the like.

'' Jing Technology

When playing back images and sounds on a personal computer or the like, the images and sounds are played back by processing video and audio information recorded in a recording medium such as a hard disk or CD-ROM in MPEG format.

At this time, the video information and audio information to be reproduced are single and fixed ones created by the creator, and the provided video information and audio information are reproduced. However, in the conventional information processing apparatus, the video information and the audio information are fixed at the time of reproduction, and there is a problem that the display color and the like cannot be controlled by the operator. Disclosure of the invention

The present invention has been made in view of the above points, and has as its object to provide an information processing apparatus, an information processing method, and a recording medium that allow an operator to control video information and audio information.

The present invention controls the output of input data by detecting control information supplied together with the supplied input data and changing the setting of the detected control information. Further, according to the present invention, it is possible to change a set value for determining the processing content of the control means among the control commands by the instruction means.

Further, according to the present invention, unnecessary images and the like can be hidden by stopping the output of the input data in accordance with the control information.

According to the present invention, the color of an image given as input data is changed. Further, according to the present invention, the volume of the audio output given as input data can be controlled according to the control information.

Further, according to the present invention, the data to be controlled can be controlled by controlling the input data with control information to which an identification number corresponding to the identification number given to the input data is assigned.

Further, according to the present invention, by outputting a plurality of input data on the same screen, different input data can be superimposed and displayed on the same screen.

According to the present invention, it is possible to easily perform a preset control of the input data based on the control information. For this reason, for example, it is possible to control the display and non-display of a given image, the conversion of the color of the image, the volume of voice, and the like.

Further, according to the present invention, by stopping the output in accordance with the control information, the image can be hidden when, for example, the image is not desired to be displayed.

Further, according to the present invention, the color of the display image can be easily changed by converting the color information of the input data into a predetermined color according to the control information.

Further, according to the present invention, by controlling the output level of the input data according to the control information, for example, the volume of the output sound can be easily controlled. BRIEF DESCRIPTION OF THE FIGURES

FIG. 1 is a block diagram of an embodiment of the present invention.

FIG. 2 is a functional block diagram of the execution control processing program according to one embodiment of the present invention. FIG. 3 is a data configuration diagram of data supplied from the data supply unit according to one embodiment of the present invention.

FIG. 4 is a data configuration diagram of control information according to one embodiment of the present invention.

FIG. 5 is a processing flowchart of the control information processing unit according to one embodiment of the present invention. FIG. 6 is a diagram for explaining a control operation based on video control information according to one embodiment of the present invention.

FIG. 7 is a diagram for explaining another control operation based on the video control information according to one embodiment of the present invention.

FIG. 8 is a view for explaining another control operation based on the video control information according to the embodiment of the present invention. FIG.

FIG. 9 is a diagram for explaining a control operation based on voice control information according to one embodiment of the present invention. BEST MODE FOR CARRYING OUT THE INVENTION

FIG. 1 shows a block diagram of an embodiment of the present invention.

The information processing apparatus 1 of the present embodiment mainly includes a CPU 2, a ROM 3, a RAM 4, a hard disk drive 5, a floppy disk drive 6, a CD-ROM drive 7, a display 8, a display controller 9, an input device 10, It consists of a communication controller 11 and a bus 12.

The CPU 2 performs desired data processing according to the program being executed. The startup program and the initial values are stored in the ROM3, and the startup program and the initial values are read when the device is started. The RAM 4 stores application program data and the like of the application software from the hard disk drive 6 and stores it, and is used as a work area of the CPU 2.

The hard disk drive 5 stores OS, the execution control processing program of this embodiment, image data, and the like. The OS programs and data stored in the hard disk drive 5 are expanded in the RAM 4 and processed by the CPU 2.

The floppy disk drive 6, on which the floppy disk 13 is mounted, stores programs and data on the floppy disk 13 and reads out program data stored in advance on the floppy disk 13.

The CD-ROM drive 7 is loaded with the CD-ROM 14 and reads out the program data recorded on the CD-ROM 14.

The display 8 displays a screen corresponding to the display data. The display controller 9 is connected between the display 8 and the bus 12, and converts display data into an image signal for displaying a screen on the display 8.

The input device 10 is composed of a keyboard and a mouse, and inputs an instruction data. The communication controller 11 is connected to the communication line 15 and communicates programs and data via the communication line 15. Bus 12 is for CPU2, ROM3, RAM4, Connected between the hard disk drive 5, floppy disk drive 6, CD-ROM drive 7, display 8, display controller 9, input device 10 and communication controller 11 to exchange commands and data.

The hard disk drive 5 has installed therein an execution control processing program for performing control processing for controlling image display and audio output according to the present embodiment. The execution control processing program is provided from, for example, the floppy disk 13 and the CD-ROM 14. In addition, it may be provided via the communication line 15.

Next, a functional configuration of the execution control processing program according to the present embodiment will be described. FIG. 2 is a functional block diagram of the execution control processing program according to one embodiment of the present invention. The execution control processing program 21 converts the information processing device (computer) 1 into a data supply unit 22, a demultiplexer 23, a decoder 24, a filter 25, and a data output unit.

26, function as control information processing section 27.

The data supply unit 22 outputs moving image data including control information and stream data such as audio data and supplies them to the demultiplexer 23.

Here, the data structure of the data supplied from the data supply unit 22 will be described.

The data supplied from the data supply unit 22 is information encoded by the MPEG method.

FIG. 3 shows a data structure diagram of data supplied from a data supply unit according to an embodiment of the present invention. Fig. 3 (A) shows data containing audio control information, Fig. 3 (B) shows data containing audio control information and video control information, and Fig. 3 (C) shows data containing audio control information and video control information. Figure 3 (D) shows the data structure of each data. Data 31 including audio control information is composed of audio data 32, video data 33, and audio control information 34, as shown in FIG. The audio data 32 is converted into an output audio signal by a predetermined decoding process. The video data 33 is converted into an output video signal by a predetermined decoding process. The voice control information 34 is information for controlling the output of the voice data 32.

As shown in Fig. 3 (D), audio data 32 and video data 33 are

35, Data identification part 36, Time data part 37, Data size part 38, Data part It consists of 3 9—1 to 3 9—n.

In the ID section 35, a stream ID is set. The stream ID indicates an identification number for identifying a series of data. By setting the stream ID set in the ID section 35 as a different ID as shown in FIG. 3 (C) and setting different data, different video and audio can be output on the same screen.

In the data type part 36, information indicating the type of data stored in the data parts 39-1 to 39-n is set. Dummy data when the data set in the data type section 36 is “0”, dummy data when the data is “1”, video data when the data is “2”, and video data when the data is “2”. When one night is "3", it indicates audio control information, and when one night is "4", it indicates video control information.

Time data is set in the time data section 37.

The data size section 38 stores the data size of the data section 39-1-39-n.

In the data section 39-1 to 39-n, data corresponding to the data set in the data classification section 36 is set. For example, if the data set in the data type part 36 is “0”, it is set as dummy data. If the data set in the data type part 36 is “1”, it is set as audio data and the data type part 36 is set. If the data set is “2”, the video data is set. If the data set in the data classification section 36 is “3”, the audio control information is set. If the data set in the data classification section 36 is “4”, the data is set to “4”. If there is, video control information is set. Next, the data configuration of the data sections 39-1 to 39-n of the voice control information will be described. FIG. 4 shows a data configuration diagram of control information according to one embodiment of the present invention. Fig. 4 (A) shows a data array of control information, Fig. 4 (B) shows a list of control commands, and Fig. 4 (C) shows an example of a set value record.

The audio control information and the video control information are composed of an ID section 43, a command number section 44, a parameter length section 45, and a parameter section 46.

In the ID section 43, a stream ID is set. The stream ID indicates an identification number for identifying a series of data.

In the command number section 44, a control command number to be applied is set. In the parameter length section 45, parameter lengths of the parameter sections 46-1 to 46-n are set. Parame evening In the part 4 6—1 4 6—n, parameters according to the control command are set.

For example, “1” and “3” are set as the applied control command numbers. The control command number “1” is a display setting function as shown in Fig. 4 (B), and the parameter length is “1”. ° Luminous part 4 The parameter set to 6-1 is not displayed when “0” is set, and display control is performed when set to “1”.

The control command number “2” is a color change function as shown in Fig. 4 (B), and the parameter length is “2”. The RGB value of the color before the change is set in parameter section 46-1, and the RGB value of the color after the change is set in parameter section 46-2. In the control command number “2”, the color before the change set in the parameter part 46-1 in the supplied video is converted into the color after the change set in the parameter part 46-2.

The control command number “3” is a volume setting function as shown in FIG. 4 (B), and the parameter length is “1”. The value set in parameter section 46-1 indicates the volume range of the output sound, and the output sound is controlled according to the value set in parameter section 46-1. Control command number “3” controls the volume of the output voice.

As shown in FIG. 4 (C), a hexadecimal number “0 0 0 0 0 0 0 1 j”, that is, a control command number “1” is set in the control command number section 44, and the parameter length section 4 5 1 hexadecimal number “0 0 0 0 0 0 0 1”, that is, the parameter length “1” is set, and furthermore, the hexadecimal number “0 0 0 0 0 0 0 0” is set in the parameter part 46-1. In other words, if "1 J is set, display is controlled.

Also, as shown in FIG. 4 (D), a hexadecimal number “0 0 0 0 0 0 0 2”, that is, a control command number “2” is set in the control command number section 44. The hexadecimal number “0 0 0 0 0 0 0 2”, that is, the parameter length “2” is set in the lane setting part 4 5. 1-6 hexadecimal number “0 0 FF 0 0 0 0”, ie, the RGB value of red, ⁰ , 1 hexadecimal number “0 0 0 0 0 FF”, That is, if a blue RGB value is set, the red part of the image will be converted to blue. Further, as shown in FIG. 4 (E), a hexadecimal number “0 0 0 0 0 0 0 3”, that is, a control command number “3” is set in the control command number section 4 4, and the parameter length section 4 5 is set to 1 hexadecimal "0 0 0 0 0 0 0 1", that is, parameter length "1" is set. And further, no. When the hexadecimal number "0 0 0 0 0 0 1 F", that is, the volume setting value "3 1" is set, the volume of the output sound is set to "3 1". .

The data 40 including the audio control information and the video control information includes the video control information 41 in the audio data 32, the video data 33, and the audio control information 3 as shown in FIG. 3 (B). It has a data structure. The audio data 32 and the video data 33 have the same data configuration as in FIG. 3 (D). Further, the audio control information 34 and the video control information 41 have a data configuration as shown in FIG.

Furthermore, a data configuration in which a plurality of continuous data strings including audio control information and video control information are multiplexed is configured as shown in Fig. 3 (C).

As shown in Fig. 3 (C), the data configuration of data obtained by multiplexing a plurality of continuous data streams including audio control information and video control information corresponds to ID 1 as shown in Fig. 3 (C). , Video data 3 3-1, audio control information 3 4, and video control information 4 1-1 are set in this order. Corresponding to ID 2, audio data 3 2-2, video data 3 3-2, Audio control information 34-2 and video control information 41-2 are set.

Here, returning to FIG. 2 again, the description will be continued.

The demultiplexer 23 transmits the data supplied from the data supply unit 22 to the decoder 24 and the control information processing unit in accordance with the contents of the data identification unit 36 and the control command number unit 44 shown in FIG. Distribute to parts 27.

The decoder 24 decodes the data encoded by the MPEG system in the original data. The data decoded by the decoder 24 is supplied to a filter 25.

The filter 25 performs a process on the information supplied from the decoder 24 according to the control information set by the control information processing unit 27.

The data processed by the filter 25 is output from the data output unit 26.

The control information processing unit 27 includes a switching switch unit 28 and a control information holding unit 29. The control information processing unit 27 holds the control information distributed by the demultiplexer 23.

Here, the processing of the control information processing section 27 will be described. FIG. 5 shows a processing flowchart of the control information processing unit according to one embodiment of the present invention.

The operation of the control information processing unit 27 is controlled by a setting application 30 specified in advance.

First, the control parameters are supplied from the demultiplexer 23 (step S1-1). It is determined whether or not the operator has selected the control parameters supplied in step S1-1 by switching the switch 28 (step S1-2).

In step S12, if none of the control parameters is selected by the operator, the data supplied from the decoder 24 to the filter 25 is sent to the control information holding unit 29 as it is. A control signal for controlling the filter 25 so as to be output to the filter 26 is supplied to the filter 25 (step S1-3).

When a desired control parameter is selected by the operator in step S1-2, the control information selected by the switching switch unit 28 is set in the control information holding unit 29.

The control information set in the control information holding unit 29 is extracted (step S1-4), and the type of control information is identified (step S1-5).

In step S1-5, if the type of the control information is the voice control information, the voice signal to be output is controlled according to the voice control information set for the voice processing of the filter 25 (step S1-6, S 1—8).

If the type of control information is video control information in step S1-5, the video signal to be output is controlled according to the video control information set for the video processing of the filter 25 (steps S1-7, S 1-8).

As described above, video and audio are controlled according to the control information selected by the operator.o

Next, a specific video control operation will be described.

First, control of the color of the display image will be described.

FIG. 6 is a diagram for explaining a control operation based on video control information according to one embodiment of the present invention. FIG. 6 (A) shows a screen before selection of control information by an operator, and FIG. 6 (B) shows a screen after selection of control information by an operation. When the image of car 51 is displayed as shown in Fig. 6 (A), unless the operator selects the video control information, the video data passes through filter 25 as it is, and The image is displayed. At this time, the displayed image is an image corresponding to image data recorded on a recording medium such as a CD-ROM14. In addition, when there is video control information, a control information display area 52 is displayed as shown in FIG. Here, the control command number “2” shown in FIG. 4 (B) is set as the control command of the control information, and the color information “red” from the color information “red” and the color information “red” from the color information Assuming that the color information “blue” is set, “red”, “blue”, and “green” are displayed as selectable colors in the control information display area 52 as shown in FIG. 6 (A).

The operator operates the mouse to move the pointer to desired color information among the red, blue, and green color information displayed in the control information display area 52 and clicks a mouse button. . When the desired color information is selected in the control information display area 52 by the operation of the operator, the control information of the color information selected by the pointer is set in the control information holding unit 29.

Here, for example, when the process of converting the color information “red” into the color information “green” is set, the red color in the image shown by the diagonal lines in FIG. 6 (A) is shown by the matte pattern in FIG. 6 (B). Converted to green.

As described above, the color of the display image can be changed to the color set in advance as the control information. Next, control of video display and non-display will be described.

FIG. 7 is a diagram for explaining a control operation based on video control information according to one embodiment of the present invention. FIG. 7 (A) shows a screen before selection of control information by the operator, and FIG. 7 (B) shows a screen after non-display control information is selected by the operator.

When the image of car 51 is displayed as shown in Fig. 7 (A), unless the operator selects the video control information, the video data passes through filter 25 as it is, The image is displayed. At this time, the displayed image is an image corresponding to the image data recorded on a recording medium such as a CD-ROM14. In addition, when there is video control information, a control information display area 53 for selecting whether or not to display is displayed as shown in FIG. Here, if the control command number Γ1 ”shown in Fig. 4 (B) is set as the control command of the control information, and the parameter is displayed as" 1 "with display and" 2 "without display as the parameter, Fig. 7 ( As shown in A), the display of "with car" and "without car" for selecting the presence or absence of display in the control information display area 53 is performed.

By operating the mouse, the operator positions the pointer on a desired display area of the “vehicle present” and “no car” displayed in the control information display area 53 and clicks the mouse button. When "vehicle present" is selected in the control information display area 53 by the operator's operation, control information for displaying the vehicle 51 in the control information holding unit 29, that is, the parameter value "1" is set. When "no car" is selected, control information for hiding car 51 in control information holding unit 29, that is, parameter value "0" is set.

When the control information for displaying the car 51 in the control information holding unit 29, that is, the parameter value “1” is set, the car 51 is displayed as shown in FIG. 7 (A). When control information indicating that the car 51 is to be hidden in the control information holding unit 29, that is, when the parameter value “0” is set, the car 51 is hidden as shown in FIG. 7 (B). Becomes As described above, an image that does not need to be displayed can be hidden.

Also, in the display control of FIG. 7, the display control is performed by setting the presence or absence of display for a single object, but the display control is performed by setting the display control of each of a plurality of display targets. Can also be performed.

FIG. 8 is a diagram for explaining a control operation based on video control information according to one embodiment of the present invention. FIG. 8 (A) shows a screen before selection of control information by the operator, and FIG. 8 (B) shows a screen after non-display control information is selected by the operator.

In the image shown in FIG. 8, the characters 61 to 63 are displayed, the conversation of the characters 62 and 63 is output as speech, and the speech is displayed by balloons 64 and 65. At this time, different IDs are set for the balloons 64 and 65, and video and audio data, and control information for controlling the display and non-display of the balloons 64 and 65 are set. At this time, the control information is set to the control command number “1” shown in FIG. 4B, that is, information for controlling the display and non-display of the video data.

If the operator does not select the video control information, the target person is displayed as shown in Fig. 8 (A). The image data of the objects 61 to 63 and the balloons 64 and 65 pass through the filter 25, and both the balloons 64 and 65 are displayed. At this time, a control information display area 66 for selecting the presence or absence of display is displayed as shown in FIG. 8 (A).

Here, in the control information display area 66, as shown in FIG. 8A, whether or not to display balloons 64, 65 in the control information display area 66 is selected. Is displayed.

When hiding the female speech bubble, the operator operates the mouse to display the "male speech balloon" or "female speech balloon" display displayed in the control information display area 66. Position the pointer on the display with "Women's balloon" and click the mouse button. When “Blade of female” is selected in the blue report display area 6 6 by the operation of the operator, control information indicating that the balloon 65 is not displayed in the control information holding unit 29, that is, the parameter value “ 0 ”is set and the female balloon 65 is hidden as shown in FIG. 8 (A).

As described above, display and non-display of images displayed on the same screen can be controlled separately.

Next, a control operation based on the voice control information will be described.

FIG. 9 is a diagram for explaining a control operation based on voice control information according to one embodiment of the present invention. FIG. 9 (A) shows a screen before selection of control information by the operator, and FIG. 9 (B) shows a screen after non-display control information is selected by the operator.

In the image shown in FIG. 9, the characters 61 to 63 are displayed, and the conversation of the characters 62 and 63 is output as speech, and is displayed by speech balloons 64 and 65. At this time, different IDs are set for the output audio, and the video and audio data of the speech balloon and control information for controlling the volume of the audio data are set. At this time, the control information is a control command number “3” shown in FIG. 4B, ie, a command for controlling the volume setting.

If the operator does not select the voice control information, the voice data of the target persons 61 to 63 and the balloons 64 and 65 pass through the filter 25 as it is, as shown in Fig. 9 (A). For example, sound is output at volume “5”. At this time, a control information display area 67 for controlling the volume is displayed as shown in FIG. 9 (A). Is done.

Here, in the control information display area 67, as shown in FIG. 9 (A), the volume of the balloons 64, 65 is set as "male volume 5", "△", "V", and " Women's volume 5 ”,“ 「”, and “V” are displayed.

To reduce the volume of female voice output, the operator clicks “▽” of “Female Volume 5”. By clicking “▽”, the value of the control information parameter shown in 46-1 in Fig. 4 (E) decreases, and the volume of women decreases.

As described above, the audio volume can be controlled.

As described above, according to the present invention, control in which input data is set in advance by control information can be easily performed. For this reason, it has features such as control of display and non-display of a given image, conversion of the color of the image, control of the volume of audio, and the like.

Further, according to the present invention, by stopping the output according to the control information, for example, there is a feature that the image can be hidden when the image is not desired to be displayed. Further, according to the present invention, the color information of the input image is converted into a predetermined color according to the control information, so that the color of the display image can be easily changed. Further, according to the present invention, by controlling the output level of the input data according to the control information, for example, the volume of the output sound can be easily controlled.

Claims

The scope of the claims

1. Control information detection means for detecting control information supplied together with the input data, instruction means for changing the control information detected by the control information detection means, and according to the control information changed by the instruction means Control means for controlling an output of the input data.

2. The control information includes a control command for setting a process in the control unit, and a set value for determining a process content of the control unit according to the control command, wherein the instruction unit changes the set value. 2. The information according to claim 1, wherein

3. The information processing apparatus according to claim 1, wherein the control unit stops outputting the input data according to the control information.

4. The input data includes color information,

2. The information processing apparatus according to claim 1, wherein the control unit changes color information of the human power day to a predetermined color according to the control information.

5. The information processing apparatus according to claim 1, wherein the control means controls an output level of the input data according to the control information.

6. The information according to claim 1, wherein the control means controls the input data by control information to which an identification number corresponding to the identification number assigned to the input data is assigned.

7. The information processing apparatus according to claim 1, wherein the control means outputs a plurality of input data on the same screen.

8. An information processing method comprising: a control information detection procedure for detecting control information given to input data; and a control procedure for controlling output of the input data in accordance with the control information.

9. The information processing method according to claim 8, wherein in the control procedure, the output of the input data is stopped according to the control information.

10. The information processing method according to claim 8, wherein the control procedure changes the color information of the input data to a predetermined color according to the control information.

1 1. The control procedure includes an output level of the input data according to the control information. 9. The information processing method according to claim 8, wherein the information processing is controlled.

12. The information processing method according to claim 8, wherein the control procedure outputs a plurality of input data on the same screen.

13. The information processing method, wherein the control information includes input data including identification information and identification information corresponding to the input data for performing processing control.

14. The control information comprises a control instruction for setting information to be processed with respect to the input data, and a set value for determining processing content executed by the control command. Item 13. The information processing method according to Item 13.

1 5.

A control information detection procedure for detecting control information given to the input data,

And a control procedure for controlling the output of the input data in accordance with the control information.

16. The recording medium storing a program according to claim 15, wherein in the control procedure, the output of the input data is stopped according to the control information.

17. The recording medium according to claim 15, wherein the control procedure changes the color information of the input data to a predetermined color according to the control information.

18. The recording medium according to claim 15, wherein the control procedure controls an output level of the input data according to the control information.

19. The recording medium according to claim 15, wherein the control step outputs a plurality of input data on the same screen.

20. A computer-readable recording medium in which input data including identification information and control information including identification information corresponding to the input data for performing processing control are recorded.

21. The control information, wherein the control information includes a control instruction for setting information to be processed with respect to the input data, and a setting value for determining processing content executed by the control instruction. 20. The recording medium according to 20.