JP2003174598A - Information processor, information processing method, recording medium and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To automatically decide a viewing form of input sources matching the preference of a user on the basis of history information in simultaneously outputting the video images and sound of the input sources provided from a plurality of media by storing viewing patterns of the user in the past as the history information. <P>SOLUTION: A source ID selected as input is identified in a step S401, and whether the input source (or the combination thereof) is viewed in the past, that is, whether it is present in a viewing pattern history data base, is checked on the basis of the attribute data of the selected input source in the next step S402. In the case that it is present in the history data base, display is performed by the screen layout and sound mode of the highest frequency from the viewing patterns in the past (S403). <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention stores an information processing apparatus and method for outputting information such as image data and audio data to a display device or an audio output device, and a program for executing the information processing method. Regarding storage media.

[0002]

2. Description of the Related Art At present, information is distributed to various households from various media. For example, as broadcast waves, terrestrial waves, satellites, TV and radio from CATV (cable TV), and data broadcasting are provided, while on the other hand, images of the Internet, electronic mail, etc., through communication lines,
Voice and information services are provided.

In addition, in recent years, CS (communication satellite) broadcasting and CA
In TVs (cable TVs) and the like, so-called digital broadcasting systems for digitizing and transmitting television signals have become widespread, and in these systems,
With the adoption of digital compression and transmission technology, it is possible to secure up to hundreds of channels, making it possible to receive an extremely large number of TV / radio (music) programs more than ever before. . (Also, the digitization of AV equipment is progressing, DVD (digital video disc),
Many video and audio sources as package media for DV (digital video), digital cameras, etc. have come to exist in the home. )

As described above, in order to enjoy a wide variety of TV programs, videos and information services provided from various media, recently, a plurality of windows are simultaneously opened on a large display, and different input sources are provided for each of them. A multi-window function for allocating is being realized.

[0005]

Due to the digitization of broadcasting in the future and the development of communication infrastructure, the input route and amount of video and information to the home are increasing, and the amount of information to be displayed has never been increased. It is not difficult to imagine that it will increase even more. Due to the Internet connection function of the TV receiver, it is expected that cases such as going to obtain information related to a program via the Internet while watching, or receiving an e-mail while watching a certain image will be common. In addition, there may be a case in which a display event occurs in an interrupt type due to a schedule management function as an auxiliary function of the TV or a fixed time reception by a timer or the like.

In such a situation, the multi-window function capable of simultaneously displaying a plurality of images and information is one solution, but in the conventional multi-window control system, the screen layout and input source switching are performed. It is necessary for the user to change each time, and it takes a lot of time and effort to realize the screen layout that the user likes, which is suitable for the combination of the input sources. For example, in the case of a two-screen display on a TV receiver, the user first selects the two-screen display, and when switching to the two-screen display, selects and sets the desired input source so that each screen displays the desired input source. Was needed.

Therefore, in order to truly enjoy images and information supplied from various media,
The user has to bother with the multi-window screen layout when viewing multiple input sources at the same time, the selection of audio at that time, and the transition to the multi-window when an interrupt-type display request event occurs. It becomes important to do it without doing anything.

Therefore, according to the present invention, the past viewing pattern of the user is stored as history information, and when the video and audio of the input source provided from a plurality of media are simultaneously output, the history information is automatically output based on the history information. An object of the present invention is to provide an information processing device and method, a recording medium, and a program capable of determining a viewing mode of an input source that suits a user's taste.

[0009]

In order to achieve the above object, an information processing apparatus according to a first aspect of the present invention provides an input means for inputting data and a predetermined image related to the input data input by the input means. Display control means for controlling the display means to display in a display form, and storage means for storing attribute information of the input data and display form information related to the display form in association with each other as a viewing pattern, The storage means is characterized by storing a plurality of pieces of information related to the viewing patterns.

According to another aspect of the information processing apparatus of the present invention, input means for inputting data including image data and audio data, and display means for displaying an image related to the image data input by the input means in a predetermined display form. Display control means for controlling to display on the voice output means, and voice output control means for controlling the voice output means to output the voice related to the voice data input by the input means in a predetermined voice output form,
It is characterized by further comprising storage means for associating the attribute information of the input data, the display form information relating to the display form, and the audio output form information relating to the audio output form as a viewing pattern.

The information processing method according to claim 20,
Data is input, control is performed so that an image related to the input data that has been input is displayed on a display unit in a predetermined display form, and attribute information of the input data and display form information related to the display form are associated with each other. It is characterized in that it is stored in the storage means as a viewing pattern, and information regarding a plurality of the viewing patterns is stored.

The information processing method according to claim 21 is
Data including image data and audio data is input, control is performed so that an image related to the input image data is displayed on a display unit in a predetermined display form, and audio related to the input audio data is controlled to a predetermined audio. The audio output means is controlled to output in the output form, and the attribute information of the input data, the display form information related to the display form, and the audio output form information related to the audio output form are associated with each other and stored as a viewing pattern. It is characterized by storing in.

A storage medium according to a thirty-ninth aspect is characterized in that a program for causing a computer to execute the processing steps of the information processing method according to any one of the twenty-third aspects is recorded.

Further, a program according to claim 40 is characterized by causing a computer to execute the processing steps of the information processing method according to any one of claims 20 to 38.

[0015]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

<First Embodiment> FIG. 1 shows a first embodiment of the present invention.
3 is a diagram showing main blocks of an integrated reception system to which the information processing apparatus according to the embodiment is applied. In FIG. 1, reference numeral 1A denotes a digital broadcast receiving unit, which is a tuner 10
1 selects and receives a radio wave of a predetermined frequency from digital TV broadcast waves transmitted via a TV antenna or a cable. The broadcast wave selectively received by the tuner 101 is sent to the digital data demodulation circuit 102,
Demodulation, A / D conversion, and error correction processing are performed. After that, the transport descrambler 103 descrambles the data for conditional access to generate a data stream called a transport stream (TS).
At this time, the conditional access management data (EMM, ECM) superimposed and transmitted on the broadcast wave is extracted and sent to the IC card interface 121, and the program that matches the contract conditions read from the IC card owned by the user ( If it is a program, it is processed so that the video, audio, and data can be decoded in the subsequent stages.

The MPEG2 transport demultiplexer 104 divides the input transport stream into a video stream, an audio stream, and a stream related to data broadcasting, and reconstructs each stream. Usually one transport
A plurality of programs are multiplexed in the stream, and further, a plurality of transport streams are transmitted from one transponder of the satellite, for example. Therefore, in order to select one channel, information (PID, PAT, NIT) regarding a desired channel is selected from PSI (Program Specific Information) separated by the MPEG2 transport demultiplexer 104.
Etc.) is extracted and a tuning operation is performed.

Video Decoder 106 and Audi
The o decoder 105 is provided for each M of Video and Audio.
Each PEG2 stream is decoded. The decoded Audio signal is sent to the audio control unit 108, and the Video signal is transmitted to the next-stage Video.
Sent to the interface 110a. Data decoder 1
07 decodes a stream related to data broadcasting transmitted by BS digital broadcasting. More specifically, DSM
-After CC decoding, store a series of XML-related files in a pre-allocated area of RAM 122.

1B and 1C are video / video signals for the information processing apparatus.
It is another external AV device connected via an audio signal. The audio control unit 108 determines an output destination of each audio signal of a plurality of input sources displayed in a multi-window. Generally, there are many cases in which what is being viewed on the maximum screen is reproduced by the main speaker 109a and the sound of the sub window is used as the headphones 109b.
In the present embodiment, the CPU 123 controls and determines based on the past viewing history data. Of course, the user can directly specify by using the remote controller 125 or the like.

Video interfaces 110a-11
Reference numeral 0c is an input unit for receiving Video signals output from 1A, 1B, and 1C. In this embodiment, an analog Video signal is input to the input section 110b from the external AV apparatus 1B, and a digital Video signal input specification is set to the input section 110c from the external AV apparatus 1C. Analog video interface 110
b is composed of an A / D converter, a PLL circuit for generating a sampling clock, and the like, and may further include a color space conversion circuit, an interlace-progressive conversion circuit, and the like, if necessary.

Digital Video Interface 110
c is, for example, LVDS (Low Voltage Differential S
If the signal is a differentially multiplexed signal such as ignaling), it is composed of a decoding circuit, a voltage level conversion circuit, and the like. Here, in addition to the input from the Digital TV receiver 1A, there is one external AV input port each for analog and digital. In addition, there are the following as sources input from other routes.

IEEE 1394 interface 117
Reference numerals a and 117b are interfaces for digitally connecting the information processing apparatus to external AV equipment, computer peripheral equipment, and the like, and are D-VHS and DV for recording and the like.
A D player or the like is connected. The modem 118 sends information regarding a user's viewing record such as use of pay broadcasting to a management center on the broadcaster side through a telephone line, and is also an interface for connecting to the Internet and browsing various homepages and exchanging electronic mail. Function. The PCMCIA interface 119 is an interface for capturing various images taken by a digital camera or the like, and is a CF (Compact Flash) card used as a recording medium for the digital camera or the like.
Connect smart media etc. through an adapter.

Here, once arranged, there are the following input sources to the information processing apparatus. -Video, audio from the DigitalTV receiver (1A), data-Video / audio from the external AV equipment (1B, 1C) input in the form of video / audio signals, audio-D-Connected via the IEEE1394 interface
Video data such as VD and D-VHS, audio / Internet information connected via a modem, e-mail information, and image data from a digital camera connected via a PCMCIA interface

The resolution converters 111a to 111c each have at least one screen of video memory therein (not shown), and after temporarily storing video data from the video interfaces 110a to 110c that are asynchronously input, Predetermined screen format (size and number of colors) according to instructions from the CPU 123 and the multi-screen composition control unit 112.
Convert to.

Incidentally, the IEEE 1394 interface 1
The resolution conversion processing of video and image data from 17a and 117b, the modem 118, and the PCMCIA interface 119 is realized by a part of the graphics accelerator 115 and the graphics memory 116.

The graphics accelerator 115 is
It creates the frame layout and background image of each window in the multi-window screen, the application screen of the home page browser and mail, the graphical user interface screen such as operation menus, icons and buttons.

The graphics memory 116 has a structure composed of a plurality of planes such as a moving picture plane, a still picture plane, a character / graphic plane, and an overlay / switch control plane.
It is used to combine video and image data from each input source.

The multi-screen composition control unit 112 is composed of the CPU 1
By linking with 23, video, images from each input source,
After reading the data such as character information from each video memory address, make sure that the screen layout (position, size, overlay effect, number of colors, etc.) is the same.
The data is expanded on the graphics memory 116 to generate a final multi-screen. In the present embodiment, this screen layout is controlled to the presentation form according to the past viewing history of the user. Regarding this point,
I will explain later.

The output control unit 113 controls the drive timing and converts the display format according to the characteristics of the display 114 in order to output the final multi-screen to the display 114. As the display 114, it is preferable to select a large-screen, high-definition, high-definition, high-definition plasma display or projection type monitor for the purpose of utilizing the effect of multi-window.
The output control unit 113 outputs display data in a timing and display format corresponding to these displays.

The printer interface 120 is literally a port for connecting a printer, and edits / prints an image input from a digital camera while confirming it on the screen of the information processing apparatus, or in a broadcasting system (including data broadcasting). It is used to deliver program-related information (travel guides, recipes for cooking, applications for prizes, various coupons, etc.), and print homepage information.

The CPU 123 is for centrally controlling these components. That is, the CPU 123 identifies, determines, and processes (tuner selection, EPG-related information extraction, and processing) various tables related to PSI in the digital broadcasting system, and XML transmitted as data broadcasting.
In addition to processing related files, the resolution conversion unit 111
And display-related control such as the multi-screen composition control unit 112,
The voice control unit 108 performs voice-related control, external interface control such as the modem 118 and the IEEE 1394 interface 117, and the user interface 124 including the remote controller 125. Also, CP
U123 has an attribute detection unit 130 for detecting the attribute of the input source, a display / audio parameter detection unit 131,
In addition, the processing program for creating and updating the history database is executed.

The RAM 122 operates as an external memory of the CPU 123, and a part thereof functions as a means 132 for storing a user history database. The user interface 124 is for selecting and operating an input medium, a TV channel, an external device, etc. in cooperation with an appropriate operation screen, and is basically a remote controller 125.
Controlled by.

FIG. 2 shows a configuration example of the remote controller 125 for operating each device of the integrated reception system. Hereinafter, functions of main buttons related to the present embodiment will be described by taking an operation procedure of a multi-screen as an example.

First, when a video, image, or information source to be viewed by the user is selected by the menu button 211, channel button 201, input source selection button 202, etc., the screen layout preset in the receiver is displayed. , Single or multi-screen display. After that, the user selects a desired screen layout from several preset screen layout patterns by using the left / right direction (next / return) of the direction selection key 209, and presses the enter key 210 (the central portion of the direction selection key). ) To select it.

If the user wants to perform a layout freely, he or she first presses the custom key 206 and then sets the position and size of each window using the direction selection key 209. A series of operations is performed according to the operation guide displayed on the screen, and finally, the enter key 210 is pressed to register the user's customized screen.
The operation related to changing the screen and voice will be touched later.

Next, in the present embodiment, a flow of operation of the CPU 123 when generating the viewing pattern history database will be described. FIG. 3 detects attributes of information from the input source when viewing information such as video, audio, characters, etc. from a certain input source (TV, external DVD, Internet, etc.) incorporated in the CPU 123. Detecting what form (screen layout and audio mode) the input source is being viewed, and creating a history database 132 that associates them,
It shows a basic operation flow up to storing in the history database storage unit 132 in the AM122.

In step S301 of FIG. 3, the recognition of viewing is performed. Here, when the information from a certain input source (channel in case of TV) is viewed for a certain time or longer, it is recognized that the information from the input source is viewed.
Regarding the screen layout, if the layout is fixed to the same layout for a certain period of time or longer, it is recognized that the screen layout is viewed. The same applies to audio output. These are for preventing a desired channel to be searched for when selecting a TV channel or the like, so-called zapping, so as to prevent a viewing pattern during operation from being stored as history data.

Next, in step S302, the attribute of the input source is detected for the object recognized as being viewed in step S301. FIG. 5 shows a configuration example of the attribute data of the input source. As shown in the figure, first, after determining the input source ID as the management number, as attribute data for each input source, the media type, in the case of broadcasting system, the genre of the program or channel, the title, the channel The number, the entire program time, the viewing start time, the type of application (TV, homepage browsing, e-mail, scheduler, etc.) are detected and managed as one data structure.

In FIG. 5, parameters such as title, genre, channel, and total program time are extracted only if they exist depending on the type of media, and are blank if they do not exist as data. The viewing start time is for recognizing the viewing start time of the input source, and is used as data for screen layout control when an interrupt type input event described later occurs.

FIG. 6 shows an example of classification of media types in the attribute data. The types of media include four types of input from the broadcasting system, the Internet (modem input), external AV input, input from the IEEE 1394 or PCMCIA interface, a clock (timer) installed as an internal function, and a scheduler. Input from 1
Classified as one media.

FIG. 7 shows an example of genre classification when the type of media in the attribute data is a TV broadcasting system and a data reproducing system from an externally connected device. Here, it is classified into seven genres: news, sports, movies, drama, variety, documentary, and liberal arts. Of course, there are many other things besides this, but we have dealt with them here. Of the attribute data of the input source, the genre often has a close relationship with the screen layout, the audio mode, etc., such as displaying a large window for sports or movies.

FIG. 8 shows an example of application classification in the attribute data. In this information processing device,
In addition to the TV broadcast viewing function, it has an Internet browser, e-mail, and applications such as a clock and a scheduler as built-in functions. The types of these applications are the application information in the attribute data shown in FIG. Remembered.

In the digital TV broadcasting system, attribute data relating to the input source such as the type of the media and the genre are service supplementary information relating to channels called SDT (Service Description Table) and EIT (Event Information Table). And as supplementary information about the program, it is transmitted after being multiplexed with the broadcast wave. Therefore, after the table data is filtered by the digital broadcast receiving unit 1A, the CPU 12
By performing processing in 3, it is possible to extract the attribute data shown in FIG. Regarding external input sources other than broadcasting, the CPU 123 cooperates with each interface input unit to detect each parameter. When the genre information is input together with the content data in the reproduction system from the externally connected device, the CPU 123 detects the genre information and stores it as attribute data.

Subsequently, in step S303 of FIG. 3, the display parameters of the video displayed in each window are extracted. FIG. 9 shows a configuration example of the display parameters in this embodiment. The CPU 123 allocates the input source to each window, which window shows each input source. In the display parameter data of each window, first, there is an input source ID indicating the input source of the video displayed in that window. Since the attribute data of the input source can be known from the input source ID (FIG. 5), each window is associated with the attribute of the input source corresponding to that window. Here, a window number may be assigned to each window for management.

Of the display parameters shown in FIG. 9,
Each data from the window start address to the layer is a parameter regarding the display of each window. These parameters are extracted by the CPU 123 by referring to the values of the registers related to the display control in the graphics accelerator 115. As parameters relating to the position and size of each window, the start address (usually the upper left address is shown), the X (horizontal) direction size (dot number), the Y (vertical) direction size (dot number), and , The layer position of the window, the display effect (transparency), etc. are extracted as parameters indicating the relationship with the background screen. In addition, the number of display colors in each window is also managed as display parameter data as needed.

Next, in step S304, voice parameters are extracted. FIG. 10 shows a configuration example of voice parameter data in this embodiment. Like the display parameter, the audio parameter data includes an input source I indicating the input source of the audio output from the output channel.
There is D. As a result, it is associated with which output channel and in what mode an input source having what attribute is viewed. FIG. 11 shows an example of classification of output channels. In the present embodiment, it is classified into any one of the main speaker, headphones, external outputs 1 and 2, and no audio output.

FIG. 12 shows an example of classification of voice modes. Multi-channel stereo is, for example, Dolby 5.1ch and DTS (Dolb
y Theater Surround) refers to modes such as. The CPU 123 cooperates with the audio decoder 105 and the audio control unit 108 (register setting, mode identification) to extract data of these audio-related parameters.

In the next step S305, the relationship between the attribute data of the input source detected in step S302 and the parameter data of the display and voice detected in steps S303 and S304 is organized, and various input sources are identified. Create a database of what you were watching with the screen layout (display parameters) and voice mode. That is, in step S305, the input source I
For each D, what kind of display and audio parameter is used for viewing is stored as a viewing pattern, and the frequency thereof is also stored. Further, even when a plurality of input sources are simultaneously viewed, the display and voice parameters for each combination pattern of the input source IDs are stored, and the frequency thereof is also stored.

As the history database, some viewing pattern data remains as a history even when the same input source ID is viewed, but the display and voice parameters in each case are stored and sorted in descending order of frequency. And remember. Also, among the display parameters, the window start address, the size in the X direction, and the size in the Y direction can take arbitrary values on the screen. Therefore, although not shown in particular, if the addresses and sizes are close, the data is rounded. Is performed, and data in a certain range is stored as the same data (value). In this way
The viewing pattern and the frequency of what kind of screens and audios the various input sources were watching are stored as a history database.

FIG. 4 is a basic operation flow until the screen layout and the audio mode are decided when the user tries to view a certain input source. In FIG. 4, step S4
At 01, the input source ID such as video and audio that the user is going to view is identified. In this case, 1
There may be cases where only one input source is selected, and there are cases where multiple input sources are selected from the beginning.

In step S401, the input source ID selected as the input is identified, and the next step S402.
Then, based on the attribute data of the selected input source, it is checked whether the input source (or a combination thereof) has been viewed in the past, that is, whether the viewing pattern exists in the history database.

If it exists in the history database, it is first displayed in the most frequently used screen layout and voice mode from the past viewing patterns (S403). For the user, it is determined whether or not the presented screen layout and voice mode are OK (S404). FIG. 13 is an example of an inquiry screen (OSD display) for the user. In FIG. 13, an example of presentation is shown in which a part of the left corner of the screen being viewed is occupied, but the selection confirmation screen (screen mode, audio mode) is displayed while adjusting the OSD transparency and showing the background screen. It is also possible to display). Furthermore, by presetting some patterns and providing a graphical design display as shown in FIG. 14, for example, it is possible to present in a form that is familiar to users of a wider age group.

When the user selects "OK" for both the screen and voice by operating the remote controller, the user watches the screen as it is, and when a certain time or more has passed, the result is fed back to the attribute database (S420) ( The frequency of the most frequent viewing pattern will be added once again). If you select NG,
The presentation is performed twice more, that is, in the viewing pattern that has the second and third largest history data.

If there is no desired presentation form in the viewing patterns presented three times, in step S405, the mode is changed to a mode in which the user can freely select and set by remote control. Specifically, by pressing the custom key 206 of the remote controller, a screen or voice change menu is called up. For example, when changing the screen, the position and size of each window are set using the direction selection keys 209. 15 and 16 show examples of the operation guide display when changing the screen and voice, respectively.

After setting by the user, if OK, viewing is performed in that pattern, and feedback to the history database is performed as described above. In the case of NG, the retry is performed by the user's change (S405) up to two times, and when the NG continues for three times or more, the display is performed in the preset (preset) screen layout and voice mode.

Although not shown in the operation flow of FIG. 4, several types of screens and voice patterns are preset in the information processing apparatus according to the present embodiment. As described above, the user selects the direction of the remote controller. By using the left / right direction of the key 209 (next / return), selecting a desired screen layout from preset several types of screens and voice patterns, and pressing the decision key 210 (center part of the direction selection key) It is possible to select it. Also when the viewing in the preset pattern is selected, the history database is updated in the same manner.

On the other hand, in step S402 of FIG.
If the input source of the video or audio to be viewed or the combination thereof is not in the history database, step S4
At 08, a preset screen and a voice pattern are displayed. In this case as well, the user selects from a plurality of preset patterns in the same manner as described above.

At step S409, the presentation form is confirmed. If it is OK, it is viewed as it is and the history database is updated. If the result is NG, the screen and voice pattern are changed by the user in step S410. The processing here is the same as the processing in step S405 described above. On the other hand, in the case of OK, the user views and listens to the pattern and updates the history database. When NG continues for three times or more, in step S412, the display is forcibly displayed with a preset pattern.

In this way, the final screen and the viewing pattern in the voice pattern are selected and determined. In any case, after confirming that the pattern has been viewed for a certain time or longer, the history database is confirmed. Update.

The above description is a case of determining the screen and the voice pattern when one or a plurality of input sources are selected from the beginning. However, while watching an existing input source, an electronic mail is sent. There may be a case where an interrupt type display request (event) is generated from a scheduler or a timer (timer). In addition, a display request for information from a new input source may be generated by a user operation. Even in that case, when an interrupt type display event occurs, the process returns to step S401 and the same processing is performed.

That is, in the first step S401, regarding the relationship between the input source of the video, audio, etc. that is already being viewed and the input source of the display event that has occurred in an interrupted manner, it is confirmed whether it is in the history database as described above. Then, the same process will be performed thereafter. still,
When an interrupt type event occurs, as a parameter of the history database for determining the viewing pattern,
A viewing elapsed time may be newly added, which will be described later.

FIG. 17 shows an example of a history database showing the attributes of the input source and the screen layout and the audio mode in which the information from the input source was viewed by a certain user. Here, with respect to the eight viewing patterns A to H, the screen layouts and audio modes that have been viewed most frequently in the past are picked up and tabulated.

Here, if the attribute data of the input source includes genre information as in the case of a TV broadcasting system or a data reproducing system from an external medium, the combination of the medium and the genre is used as the attribute of the input source to create the attribute database. As a parameter, in the case of the Internet, the combination of media and application is used as the attribute of the input source and is the parameter of the database. In other words, by combining not only the media as the attributes of the input source but also more detailed attributes, the content of information from the input source is reflected, and the history of viewing patterns is managed more accurately.

In order to create this database, the past viewing history for each user is converted into a histogram, and the screen (window) size and the like are subjected to rounding processing (treated as the same history) for data that is close to a certain extent. The task of extracting the most frequently used combination of the screen and voice is the CPU 12
3 is always performed as background processing.

Next, regarding some viewing patterns,
How to process based on the past viewing history will be described according to some examples. FIG. 18 is a screen layout in the case of the viewing pattern A in FIG. In this case, there is one "digital TV broadcast" as the input source and the genre is "sports". According to the history database of FIG. 17, in the case of this input source, this user is
Since the information is most often viewed in the stereo mode from the main speaker, the information processing apparatus preferentially presents in that pattern when the user selects the input source (digital TV broadcasting → sports). To control. (Step S403 in FIG. 4)

FIG. 19 shows the viewing pattern B shown in FIG.
It is a screen layout in the case of. This is an example when there are two "digital TV broadcasts" as input sources, one of which is a drama and the other of which is sports. In the past, when watching simultaneous drama and sports programs, this user had the most viewing patterns, such as displaying the drama on a full screen and opening a child screen at the bottom right of the screen to check the progress of sports. Specifically, the presentation is performed in the screen layout as shown in FIG.

FIG. 20 shows the viewing pattern C in FIG.
It is a screen layout in the case of. This is a scene in which, while watching a documentary program on a TV broadcast, a browser is activated to check program-related data, and homepage information related to the program is checked. In such a situation, in the past, this user often viewed the TV screen on the left ⅔ and the home page (browser) display on the right ⅓, so that it is shown in FIG. The screen layout is as shown.

Next, the operation of the information processing apparatus when a display request (event) for information from another input source occurs while watching a certain input source will be described. Figure 2
1 and FIG. 22 each show a presentation example when an electronic mail arrives while viewing information from an input source. (Viewing patterns D and E in FIG. 17)

FIG. 21 shows the information processing apparatus in IEEE
9 is a display example of a screen when an incoming electronic mail occurs while watching a movie from a DVD device connected by a 1394 interface on a full screen. In this case, the user does not want to disturb the viewing in the movie scenario,
As shown in the history database in FIG. 17, the icon display (see FIG. 21) in the lower right part of the screen is selected as the screen layout when an email is received. Therefore, the information processing apparatus selects the display mode as shown in FIG. 21 in the history database as the first presentation mode and automatically controls the presentation. If there is no combination of input source attributes “media = 1394 connected device, genre = movie” in the history database, the preset layout is presented as described above.

Similar to FIG. 21, FIG. 22 shows the case of receiving an electronic mail while watching a certain input source. Here, a case is shown in which the attributes of the input sources that were viewed before the event occurred are different, and in FIG. 22, a mail incoming while viewing the drama on a full screen is shown. in this case,
FIG. 22 (b), instead of the icon display as when watching a movie
As shown in, a notification window indicating the arrival of an e-mail is displayed in the uppermost layer in the center of the screen.
After a second, as shown in FIG. 22C, the mail application is automatically started, and a window is controlled to open on the right side of the screen with a size of 1/3.

This is a result based on the history of the user's forgiving response to the interrupt type display event in the drama as compared with the movie. The size and position of the window of this mail application, the transition timing from the display of the incoming notification window of the electronic mail to the start of the mail application, etc. are determined by the past history pattern of the user. Of course, even if it is an interrupt type display event as in the operation flow of FIG.
If necessary, the user can manually set the settings and store the settings to obtain the desired settings.

Regarding such an interrupt type display event, not only the static relationship between the input source that was viewed before the event occurred and the input source that was requested to be displayed, but a combination of the same input source was used. However, depending on the elapsed viewing time of the information from the input source that was viewed before the event occurred, the selection of the display form to be presented, such as displaying an icon or popping up a window, may be different.

For example, when the viewing time has passed considerably and the climax scene of a movie or the end of a sports game is approached, it can be generally expected that automatic pop-up of windows tends to be shunned. In the present embodiment, the attribute of the input source is a combination of media and genre or media and application as a parameter of the history database, but it may be a single parameter including the elapsed viewing time. in this case,
The screen layout can be presented based on the elapsed viewing time when an interrupt type display event occurs. That is,
Even with the same combination of input sources, different viewing patterns are selected depending on the timing at which the interrupt type display event occurs.

Incidentally, a clock function such as a counter provided in the information processing apparatus may be used to measure the elapsed viewing time, or, in the case of a TV program or the like, information on the program superimposed on the broadcast wave. Alternatively, it can be calculated by detecting information about a program obtained from the Internet or a CD-ROM, detecting the start or end time of the viewed program from the data, and comparing with the current time.

FIG. 23 shows an example of a morning viewing pattern of a certain user, and is a diagram showing changes in the presentation form from the single-screen viewing to the viewing patterns F, G, H in FIG. In FIG. 23A, the news program TV1
When the user instructs the remote control to display the headline news DATA1 and the clock display T1 by the data broadcast in the multi-window display while watching the full-screen, the presentation mode of FIG. 23 (b) is automatically displayed. It changes (viewing pattern F).

Of course, this is the same as in the case described so far, when the information processing apparatus determines the combination of input sources and detects that the user has previously viewed with this screen layout. , The layout is automatically managed and presented.

Further, when the user additionally requests the display of the weather forecast DATA2 of the data broadcast, FIG.
The screen layout is changed to that shown in (c) (viewing pattern G). In this case, the display area of the headline news DATA1 by data broadcasting is reduced (L10 → L1
2), below that, open a new weather forecast window (L
14).

Further, the clock display T1 displayed on the lower right of the conventional screen has been changed to a presentation in the form of being superimposed on the headline news window (L11 → L1).
3). Finally, when the user selects and decides the weather mark with the remote controller in order to know more detailed information of the weather forecast, the screen layout changes to that shown in FIG. 23D.
In FIG. 23D, a more detailed information sub-window regarding the weather forecast DATA2 is opened at the bottom of the window of the news TV 1.

In FIG. 23, the description has been given in such a manner that the input sources to be displayed are sequentially increased. However, when the user selects a plurality of input sources from the beginning, all of the steps shown in FIG.
It is of course possible to shift to the viewing pattern of (d).

The information processing apparatus for controlling the screen layout and the audio mode based on the viewing history of the user has been described above centering on the history database of FIG. 17, the operation flow of FIG. 4, and the screen examples of FIGS. 18 to 23. did. In addition, in the present embodiment (FIG. 1), the information processing apparatus according to the present invention has a configuration that does not include a display unit and a broadcast receiving unit. However, from the essence of the present invention, it is not limited to the configuration of the present embodiment. IRD (Integrated Receiver Decoder) that has a broadcast receiving unit and no display unit,
It is obvious that the same effect can be obtained even when applied to a television broadcast receiving device having a broadcast receiving unit and a display unit.

<Second Embodiment> Next, the operation of the integrated receiving system to which the information processing apparatus according to the second embodiment of the present invention is applied will be described. One feature of the present embodiment is that the history of viewing patterns is managed for each viewing time zone.

FIG. 24 is a flow chart showing the flow of the operation of creating the viewing pattern history database according to this embodiment. Steps S2401 to S2404
Is the same processing as steps S301 to S304 in FIG. Step S2405
Then, the attribute data of the input source detected in step S302 of FIG. 3 and steps S301 and S304.
Organize the display and audio parameter data detected in, and create a database of information from which input source, what screen layout, and audio mode you were viewing for each viewing time zone (date, day of the week). create.

As the history database, some viewing pattern data remains as a history for each same time zone, but the input source, display, and audio parameter in each case are detected, sorted and stored in descending order of frequency. .

Basically, the clock function provided in the information processing apparatus is used to measure the viewing time, but the time (date) information superimposed on the broadcast wave is detected and the time is calibrated step by step. .

Of the display parameters, the window start address, the size in the X direction, and the size in the Y direction can take arbitrary values on the screen. Therefore, although not particularly shown, in the case of a close address and a size, The specifications are such that data is rounded and data in a certain range is stored as the same data (value).

Thus, for each time zone, date, day of the week, what input source, what screen,
A viewing pattern and history database indicating whether or not the user is watching by voice are stored.

FIG. 25 is a basic operation flow up to input source, screen layout, and audio mode determination when the user tries to view something at a certain time. Figure 2
5, in step S2501, first, the current time (date / day of the week) is identified. Next step S2
At 502, based on the identified time information, it is checked whether the past viewing history in the time zone exists in the history database.

If it exists in the history database, the input source (combination) that has the highest frequency among the past viewing patterns, the screen layout, and the voice mode are displayed first (S2503) and presented to the user. Whether or not the selected input source, screen layout, and audio mode are OK is determined (S2504). As already mentioned,
An example of this inquiry screen is shown in FIG.

When the user selects "OK" for all of the input source, screen layout, and audio mode by remote control operation, the user watches the same viewing pattern, and when a certain time or more elapses, the result is stored in the viewing pattern database. Feedback is given (S2520) (one frequency of the most frequent viewing pattern is added). If you make a selection of NG, two more times,
That is, the presentation is performed in the combination (viewing pattern) that is the second and third most common as the history data.

If the desired presentation mode is not present in the viewing patterns presented three times, in step S2505 the mode is changed to a mode in which the user can freely select and set by remote control. Specifically, by pressing the custom key 206 of the remote controller, the input source, screen layout, or audio mode change menu is called, and after first selecting a window (Fig. 26 shows an example of a selection guide by moving focus / cursor is shown. For example, if the screen layout is changed, the position and size of each window are set using the direction selection key 209. 27 and the above-mentioned FIG. 15 and FIG. 16 show examples of the operation guide display at the time of changing the input source (application), the screen layout and the voice mode, respectively.

After setting by the user, if OK, viewing is performed with that pattern, and feedback to the viewing pattern database is performed as described above. 2 for NG
When the user changes the number of times (S2505) and retries three or more times, if the input source is preset (preset) for each time period,
Display in screen layout and voice mode.

Although not shown in the operation flow of FIG. 25, the information processing apparatus according to the present embodiment has several types of input sources, screen layouts, and audio mode viewing patterns, as in the first embodiment. Is preset, and the user selects the direction selection key 2 on the remote controller as described above.
Using the 09 left / right direction (next / return), a favorite pattern is selected from preset preset viewing patterns, and the decision key 210 (center of the direction selection key) is pressed to select it. It is possible. Even if the viewing in the presented pattern is selected,
Similarly, the viewing pattern database is updated.

On the other hand, in step S2502 of FIG. 25, if the viewing history in the time zone to be viewed is not in the database, in step S2508 the preset input source, screen layout, and voice mode pattern are displayed. . Again, as before,
The user selects from a plurality of preset patterns.

In step S2509, the presentation form is confirmed. If it is OK, it is viewed as it is and the history data is updated. In the case of NG, in step S2510, the user selects the input source, the screen layout,
The voice mode pattern is set. The process here is the same as the process in step S2505 described above.
As a result, in the case of OK, the pattern is viewed and the history data is updated.

Here, if NG continues for three times or more, in the step S2512, the presentation is performed in the pattern that was viewed in the same time zone last time. If the viewing history data in the same time zone does not exist, the presentation is performed in the mode (the channel, such as TV, etc.) when the power was turned off last time.

In this way, the viewing pattern in the combination of the input source, the screen layout, and the audio mode is finally selected and determined. In any case, the viewing pattern must be viewed for a certain time or longer. After checking, the viewing pattern history database is updated.

FIG. 28 is an example of a history database showing which input source, what screen layout, and audio mode the user is viewing for each time zone (time, day of the week, date) for a certain user. Here, to make the explanation easier to understand, specific numbers, days of the week, months, etc. are used for the time zone data.
Actually, each data is assigned as a code. Of course, in order to create this database, the past viewing history data for each user is histogrammed and sorted by time, day of the week, and date, and in each case, the most frequent input source / screen / audio combination is selected. The work of extracting is always performed as a background process of the CPU 123.

Rounding processing is performed for screen (window) sizes that can take arbitrary values, and data that is close to a certain extent is treated as the same data so that the number of combinations does not increase more than necessary. There is. It is also possible to limit the range (window size, position) that the user can select to some extent by setting on the device side.

Next, how to process based on the past viewing history will be described with some examples.
FIG. 29 is a screen layout in the case of the viewing pattern A in FIG. The viewing pattern A indicates a combination (input source / screen layout / speech mode) that is most viewed between 6 am and 7 am on a certain user's weekday (weekday). The month / day column is blank, which means that this combination is the most common throughout the year regardless of the month (season) or date.

In FIG. 29, the presentation form is such that a lot of information is obtained by reflecting the time zone of weekday morning. Ch for TV broadcasting on the largest screen L1
While watching the 8th morning program, the contents of news (DATA1) and weather forecast (DATA2) by data broadcasting are opened in two child screens on the right side of the screen. Here, these three windows are arranged without overlapping, and this layout information is naturally also recorded in the history database. Further, a clock, which is one of the internal functions (applications) of the information processing apparatus, is displayed in the upper right corner so as to overlap with the news window. The audio output destination is the TV broadcast (TV1) audio output to the main speaker, and the data broadcast news (DATA1) audio information is output to the headphones.

At the same time (day of the week), this user
Since most of the four types of input sources are being watched at the same time in the screen layout and the audio mode shown in FIG. 13, the information processing device immediately
Alternatively, if the receiver is powered on, the time information is checked one by one, and if there is viewing history data at that time (time zone), the input source, screen layout, and audio mode combination pattern is given priority first. Make a presentation.

FIG. 30 is a screen layout of a viewing pattern (viewing pattern B) when the state of FIG. 29 on weekdays becomes 7:00 am. At the same time, the user routinely switches the TV broadcast channel to Ch1 and further switches the window displaying the weather forecast at 6 am to traffic information (DATA3). It was For this reason, when the information processing apparatus detects that it is the same time, it automatically switches to the viewing pattern shown in FIG. 30 based on the past viewing history data, without bothering the user. To do.
Note that warning may be displayed for a certain period of time before the switching control is automatically performed, and it may be possible to support the change of the viewing pattern during the warning display.

FIG. 31 shows the viewing pattern C shown in FIG.
Is an example of a screen of. This is at noon on Sunday (12-
Variety program (TV which we always watch at 12:30)
3) It is an example of presentation when there is. Again, TV
For broadcasting, channel switching, screen (L5), audio mode (M1) settings, etc. are automatically controlled based on past history data.

FIG. 32 shows the viewing pattern E in FIG.
Is an example of a screen of. This is a particularly popular viewing pattern between April and September, which is Wednesday from 8 pm to 9 pm
While watching the variety program (TV3) that I always watch, PinP (picture-in-picture) shows the game situation of the professional baseball night game broadcast on the sports channel.
This is the case when viewing on the screen. In this case,
In addition to the parameters of "time" and "day of the week" described above (Figs. 29 to 31), "date" is determined. If the date is out of the range, control by history is not performed. In FIG. 28,
An example of historical data when it differs on a monthly basis is shown, but of course,
It can also be managed on a daily basis.

Next, the operation when a display request (event) for another input source occurs while viewing a certain input source will be described. FIG. 33 shows screens of viewing patterns F and G in FIG. Here, Tuesday afternoon 9
This time period (October to 12
In the case where an interrupted e-mail is received while watching a movie program (TV5) that is broadcast only for a month on a wide full screen (L5) and multi-channel stereo (M2) from the main speaker. is there.

Since this user is in this time zone and is watching the movie (I do not want to be disturbed from watching the movie), as shown in FIG. In the past, I often selected the presentation mode to display icons at the bottom. Therefore, the information processing apparatus selects such a display mode as the first presentation mode and automatically controls the presentation as shown in FIG. 33.

FIG. 34 shows an example of presentation when an incoming of an e-mail occurs in another time situation, that is, in the situation of FIG. 29 (viewing pattern A) described above. The viewing pattern A is a presentation form in the morning on weekdays, and may be an important mail for the user. Therefore, a presentation form that prompts stronger confirmation is selected.

As described above, the present information processing apparatus is characterized in that the input source, the screen layout, and the voice mode are first presented in the pattern that has been viewed the most in the past, according to the time (day of the week, date). However, if the user does not accept the presentation, as described above, it is possible to perform the customization processing by the user by operating the remote controller.

As described above, regarding the information processing apparatus for controlling the screen layout and the audio mode based on the viewing history of the user, the history database of FIG. 28, the operation flow of FIG. 25,
Also, the screen examples of FIGS. 29 to 34 have been mainly described. It should be noted that, like the first embodiment, the present embodiment has a configuration that does not include a display unit and a broadcast receiving unit as an information processing apparatus according to the present invention, but from the essence of the present invention, the present embodiment The configuration is not limited to that of IRD (Integrated Receiver Decoder) that has a broadcast receiving unit and no display unit.
It is clear that the same effect can be obtained when applied to a coder), a television broadcast receiving device having a broadcast receiving unit and a display unit, and the like.

Software for realizing the functions of the above-described embodiments is provided to a computer in an apparatus or system connected to the various devices so as to operate the various devices so as to realize the functions of the above-described embodiments. What was implemented by supplying the program code and operating the above various devices according to the program stored in the computer (CPU or MPU) of the system or apparatus is also included in the scope of the present invention.

In this case, the program code itself of the software realizes the function of the above-described embodiment, and the program code itself and means for supplying the program code to the computer,
For example, a recording medium storing such program code constitutes the present invention. As a recording medium for storing the program code, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-RO.
M, a magnetic tape, a non-volatile memory card, a ROM, or the like can be used.

Further, by executing the supplied program code by the computer, not only the functions of the above-described embodiment are realized, but also the OS (operating system) or other OS in which the program code is operating in the computer. Needless to say, the program code is also included in the embodiments of the present invention when the functions of the above-described embodiments are realized in cooperation with application software or the like.

Further, after the supplied program code is stored in the memory provided in the function expansion board of the computer or the function expansion unit connected to the computer, the function expansion board or function expansion unit is instructed based on the instruction of the program code. It goes without saying that the present invention also includes a case where the CPU or the like included in the above performs a part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

[0114]

As is apparent from the above description, according to the present invention, the past viewing pattern of the user is stored as history information, and the video and audio of the input source provided from a plurality of media are simultaneously output. At this time, it is possible to automatically determine the viewing mode of the input source that matches the taste of the user based on the history information.

[Brief description of drawings]

FIG. 1 is a block diagram showing a main part of an integrated reception system including an information processing device according to a first embodiment of the present invention.

FIG. 2 is a diagram showing a configuration example of a remote controller for operating an integrated reception system including an information processing device applied in the first embodiment of the present invention.

FIG. 3 is a flowchart showing an operation flow of an integrated reception system including an information processing device to which the information processing device according to the first embodiment of the present invention is applied.

FIG. 4 is a flowchart showing a flow of basic operations up to screen layout and audio mode determination in the first embodiment of the present invention.

FIG. 5 is a diagram showing a configuration example of attribute data of an input source.

FIG. 6 is a diagram showing an example of classification of media types in attribute data.

FIG. 7 is a diagram showing an example of genre classification when the media type in the attribute data is TV broadcasting system.

FIG. 8 is a diagram showing an example of classification of applications in attribute data.

FIG. 9 is a diagram showing a configuration example of display parameters according to the first embodiment of the present invention.

FIG. 10 is a diagram showing a configuration example of audio parameter data.

FIG. 11 is a diagram showing an example of classification of output channels.

FIG. 12 is a diagram showing an example of classification of voice modes.

FIG. 13 is a diagram showing an example of an inquiry screen for a user.

FIG. 14 is a diagram showing another example of an inquiry screen for the user.

FIG. 15 is a diagram showing an example of an operation guide display when changing a screen and voice.

FIG. 16 is a diagram showing another example of the operation guide display when changing the screen and voice.

FIG. 17 is a diagram showing an example of a history database.

FIG. 18 is a diagram showing a screen layout example in one viewing pattern.

FIG. 19 is a diagram showing a screen layout example in another viewing pattern.

FIG. 20 is a diagram showing a screen layout example in another viewing pattern.

FIG. 21 is a diagram showing an example of a screen layout of a case where an incoming of an email occurs while watching a movie on a full screen.

FIG. 22 is a diagram showing an example of a screen layout in the case where an incoming email is generated while viewing another input source.

FIG. 23 is a diagram showing an example of a morning viewing pattern of a certain user.

FIG. 24 is a flowchart showing a flow of operations for creating a viewing pattern history database according to the second embodiment of the present invention.

FIG. 25 is an input source when the user tries to view something at a certain time. It is the flowchart which showed the flow of the basic operation until the screen layout and the sound mode determination.

FIG. 26 is a diagram showing an example of a selection guide by moving a focus / cursor.

FIG. 27 is a diagram showing an example of an operation guide display when changing an input source, a screen, and a voice.

FIG. 28 is a diagram showing a configuration example of a history database.

FIG. 29 is a diagram showing an example of a screen layout in one viewing pattern.

FIG. 30 is a diagram showing an example of a screen layout in a viewing pattern which has shifted from the viewing pattern over time.

FIG. 31 is a diagram showing an example of a screen layout in another viewing pattern.

FIG. 32 is a diagram showing an example of a screen layout in another viewing pattern.

FIG. 33 is a diagram showing an example of a screen layout when an electronic mail is received.

FIG. 34 is a diagram showing another example of a screen layout when an electronic mail is received.

[Explanation of symbols] 101 tuner 102 demodulation circuit 103 descrambler 104 MPEG2 Demultiplexer 105 Audio Decoder 106 Video Decoder 107 data decoder 108 voice control unit 109 speaker 110a-c Video interface 111a-c resolution converter 112 Multi-screen composition controller 113 Output control unit 114 display 115 Graphic accelerator 116 graphics memory 117 IEEE 1394 interface 118 modem 119 PCMCIA interface 120 printer interface 121 IC card interface 122 RAM 123 CPU 124 User Interface 125 remote control 126 DAC 130 Attribute detection unit 131 Display / Voice Parameter Detection Unit 132 History database storage unit

   ─────────────────────────────────────────────────── ─── Continued front page    F-term (reference) 5C025 AA30 BA14 BA22 BA25 BA28                       CA02 CA09 CA10 CA11 CA19                       CA20 CB02 CB03 CB05 CB06                       CB07 CB08 CB09 CB10 DA01                       DA05                 5C063 AA01 AB03 AB07 AB09 AB10                       AC01 AC06 AC10 CA20 CA23                       CA29 CA36 CA40 DA02 DA03                       DA05 DA07 DA13 DB10 EA01                       EB33 EB38 EB40 EB42 EB46                 5C064 BA01 BA07 BB07 BB10 BC23                       BC25 BC27 BD03 BD09 BD16

Claims (40)

[Claims] 1. Input means for inputting data, display control means for controlling to display on the display means an image relating to the input data input by the input means in a predetermined display form, and an attribute of the input data. Information processing characterized by having a storage unit that stores information as a viewing pattern in association with information and display form information related to the display form, wherein the storage unit stores a plurality of information related to the viewing patterns. apparatus. 2. Input means for inputting data including image data and audio data, and display control means for controlling to display an image related to the image data input by the input means on the display means in a predetermined display form. A voice output control means for controlling the voice output means to output a voice related to the voice data input by the input means in a predetermined voice output form; attribute information of the input data and a display according to the display form. An information processing apparatus, comprising: storage means for storing the form information and the sound output form information relating to the sound output form in association with each other as a viewing pattern. 3. The input means can input a plurality of data strings from a plurality of input sources, and the display means can simultaneously display images corresponding to the plurality of data strings. The information processing device according to claim 1 or 2. 4. The input source is a digital TV broadcast,
At least one of an analog TV broadcast, a digital data broadcast, an analog data broadcast, the Internet, an externally connected device including a VTR and a DVD, and a recording medium capable of reproducing recorded data by the information processing device is included. The information processing apparatus according to claim 1 or 2. 5. The attribute information is input source information of the input data, channel information, genre information, program title information, program broadcast time information, viewing start time information,
The information processing apparatus according to claim 1 or 2, further comprising at least one of application information for executing the input operation and the display operation of the input data. 6. The display form information includes a screen size for displaying the image, a screen display position, hierarchical display information between a plurality of screens, display effect information including screen transparency, and screen color number information. The information processing apparatus according to claim 1, comprising at least one of the above. 7. The display control means selects a viewing pattern corresponding to the attribute information of the input data input by the input means from the viewing patterns stored in the storage means, and displays an image related to the input data. The information processing apparatus according to claim 1, wherein the information processing apparatus is controlled so as to be displayed in a display form according to the selected viewing pattern. 8. The storage unit stores the number of times of viewing an image in a display form according to the viewing pattern and the viewing pattern in association with each other, and the display control unit stores the attribute information of the input data. The information processing apparatus according to claim 7, wherein a viewing pattern having the largest number of times of viewing is selected from the corresponding viewing patterns. 9. The display device includes an instruction unit for instructing the input of the input data by the input unit, and the display control unit displays an image of an image related to the input data instructed by the instruction unit in response to an instruction by the instruction unit. The information processing apparatus according to claim 7, wherein a display form is determined. 10. The instructing means selects a channel for receiving a broadcast wave, reproduces data from an externally connected device, activates an internet browser, and records data from a recording medium capable of reproducing recorded data by the information processing apparatus. 10. The information processing apparatus according to claim 9, wherein the information processing apparatus instructs at least one operation of the reproduction. 11. An application execution means for executing an application is provided, wherein the display control means further displays on the display means an image relating to display data generated by the execution of the application by the application execution means. The information processing according to claim 1 or 2, wherein the storage unit further stores the attribute information of the display data and the display form in association with each other as a viewing pattern. apparatus. 12. The display control means selects a viewing pattern according to attribute information of display data generated by execution of the application from among the viewing patterns stored in the storage means, and relates to the display data. The information processing apparatus according to claim 11, wherein the image processing apparatus controls to display an image in a display form according to the selected viewing pattern. 13. The information processing apparatus according to claim 12, wherein the application executing unit executes at least one of applications for displaying a clock, notifying a scheduler, and receiving an electronic mail. . 14. The display control means, when the display data is generated during execution of the application by the application executing means, determines a display form of the display data according to the generation of the display data. The information processing apparatus according to claim 12, wherein 15. The application executing means executes an application for receiving and displaying an electronic mail, and the display control means determines a display form of content data of the electronic mail in response to the reception of the electronic mail. The information processing apparatus according to claim 14, wherein the information processing apparatus comprises: 16. The storage means stores the time information related to the time when the image display or the sound output of the input data is performed and the viewing pattern in association with each other. Alternatively, the information processing apparatus according to claim 2. 17. The method according to claim 16, wherein the number of times of viewing of the viewing pattern and the viewing pattern are stored in association with each other for each predetermined time period in accordance with the time information stored in the storage means. Information processing equipment. 18. The display control means displays an image or outputs a sound in accordance with a viewing pattern in which the number of times of viewing is large in the predetermined time period including the predetermined time when the predetermined time is reached. The information processing apparatus according to claim 17, wherein the information processing apparatus is controlled so as to perform. 19. The information processing apparatus according to claim 2, wherein the audio output state includes at least one of monaural, stereo, multi-channel stereo, and bilingual audio output modes. . 20. Inputting data, controlling to display an image relating to the inputted input data on a display means in a predetermined display form, attribute information of the input data and display form information relating to the display form. And an information processing method for storing a plurality of pieces of information related to the viewing patterns by storing them in a storage unit as a viewing pattern. 21. Inputting data including image data and audio data, controlling to display an image related to the input image data on a display means in a predetermined display form, The voice is controlled to be output to the voice output means in a predetermined voice output form, and the attribute information of the input data, the display form information related to the display form, and the voice output form information related to the voice output form are associated with each other. An information processing method characterized by storing as a viewing pattern in a storage means. 22. A plurality of data strings can be input from a plurality of input sources, and images corresponding to the plurality of data strings can be simultaneously displayed.
0 or the information processing method according to claim 21. 23. The input source is a digital TV broadcast, an analog TV broadcast, a digital data broadcast, an analog data broadcast, the Internet, an externally connected device including a VTR and a DVD, and a recording medium capable of reproducing recorded data by the information processing device. 23. The information processing method according to claim 22, comprising at least one of the above. 24. The attribute information is input source information of the input data, channel information, genre information, program title information, program broadcast time information, viewing start time information, input data input and display operation. 22. The information processing method according to claim 20, further comprising at least one of application information to be executed. 25. The display form information is a screen size for displaying the image, a screen display position, hierarchical display information between a plurality of screens, display effect information including screen transparency, and the number of screen colors. 22. The information processing method according to claim 20, further comprising at least one of the information. 26. A viewing pattern according to the attribute information of the input data to be input is selected from the viewing patterns stored in the storage means, and the image related to the input data is according to the selected viewing pattern. 22. The information processing method according to claim 20, wherein the information processing method is controlled to display in a display form. 27. The storage means stores the number of times of viewing an image in a display form according to the viewing pattern and the viewing pattern in association with each other, and the information processing method uses the attribute information of the input data. 27. The information processing method according to claim 26, wherein the viewing pattern having the largest number of times of viewing is selected from the corresponding viewing patterns. 28. The information processing method according to claim 20, further comprising: instructing the input of the input data, and determining a display form of an image related to the instructed input data in response to the instruction. 29. The instructions include channel selection in reception of broadcast waves, reproduction of data from an externally connected device, activation of an internet browser, and data reproduction from a recording medium capable of reproducing recorded data by the information processing device. 29. The information processing method according to claim 28, which is an instruction for at least one operation of reproduction. 30. An application is executed, control is performed so that an image related to display data generated by the execution of the application is displayed on a display unit in a certain display form, and the storage unit further includes an attribute of the display data. The information processing method according to claim 20, wherein the information and the display form are associated with each other and stored as a viewing pattern. 31. A viewing pattern corresponding to attribute information of display data generated by execution of the application is selected from the viewing patterns stored in the storage means,
31. The information processing method according to claim 30, wherein the image related to the display data is controlled to be displayed in a display form according to the selected viewing pattern. 32. The application is a clock display,
The information processing method according to claim 31, wherein at least one of an application for receiving a scheduler notification and an electronic mail is executed. 33. The display mode of the display data is determined according to the generation of the display data when the display data is generated during execution of the application. Information processing method. 34. The application is an application for receiving and displaying an electronic mail, and a display form of content data of the electronic mail is determined according to the reception of the electronic mail. 33
Information processing method described in. 35. The storage means stores the time information related to the time when the image display or the audio output related to the input data is executed and the viewing pattern in association with each other. Alternatively, the information processing method according to claim 21. 36. The number of times of viewing of the viewing pattern and the viewing pattern are stored in association with each other for each predetermined time period in accordance with the time information stored in the storage means. Information processing method. 37. When the predetermined time has come, control is performed so as to display an image or output a sound according to a viewing pattern in which the number of times of viewing is large in the predetermined time period including the predetermined time. The information processing method according to claim 36, wherein: 38. The information processing method according to claim 21, wherein the audio output state includes at least one of monaural, stereo, multi-channel stereo, and bilingual audio output modes. . 39. A computer-readable recording medium on which a program for causing a computer to execute the processing steps of the information processing method according to claim 20 is recorded. 40. A program for causing a computer to execute the processing steps of the information processing method according to claim 20.