JP5472960B2 - Terminal device and program - Google Patents

Description

The present invention relates to a terminal device and a program having a search function for performing a data search based on a search character string input in a search input area.

Generally, in a terminal device such as a mobile phone device or a personal computer, a search input area called a search window is displayed on the display screen when connected to the Internet, and an arbitrary search character string is input by a user operation in the search window. Then, the Web browser is activated and a search for a Web page corresponding to the search character string is requested.
By the way, as a technique for reducing the input operation when inputting a search character string in the search window, conventionally, when an arbitrary character string in a Web page is selected, this character string is input into the search window. The technique made to do is disclosed (refer patent document 1).
JP 2004-259216 A

  However, in the above-described prior art, although it is possible to reduce the labor of inputting a search character string, a desired character string is selected by a user operation when selecting an arbitrary character string from a Web page. It was necessary to specify a range. Such range designation puts a burden on the user, and if the range designation is wrong, an erroneous search is performed. In addition, when searching for a desired character string from the Web page, it is often confusing what character string to select, and as a result, it takes time to search.

An object of the present invention is to efficiently perform from the input to the start of the search when performing a data search based on the search character string input in the search input area.

In order to solve the above-described problem, the invention described in claim 1 is a terminal device having a search function for performing a data search based on a search character string input in a search input area, and is output by the terminal device. And a character string candidate extraction method for extracting the search character string candidate from the content being output by the terminal device based on the content type determined by the determination means. The character data included in the content being output by the terminal device or the information added to the content is analyzed using the specifying means for specifying the character string and the character string candidate extraction method specified by the specifying means. and extracting means for extracting a candidate of the search string, top priority selected in accordance with a predetermined priority from among the search string candidates extracted by the extracting means The character string candidate is characterized by comprising a an input control means for inputting the search input area.

The invention subordinate to claim 1 further comprises a television broadcast receiving means for receiving a digital television broadcast, and the character data included in the content being output is added to the television broadcast received by the television broadcast receiving means. The invention according to claim 2, wherein the character data is a character data.

The invention dependent on claim 1 further comprises a television broadcast receiving means for receiving a digital television broadcast, and a voice recognition means for recognizing character data from the voice, wherein the character data contained in the content being output is 4. The invention according to claim 3, wherein the character data is recognized by the voice recognition means from the sound of the television broadcast received by the television broadcast receiving means.

According to a third aspect of the present invention, the extracting means recognizes the voice from character data added to the television broadcast received by the television broadcast receiving means and audio of the television broadcast received by the television broadcast receiving means. The invention according to claim 4, wherein the search character string candidates are extracted by analyzing the character data recognized by the means.

According to a first aspect of the present invention, the apparatus further comprises a calling means for performing a voice call and a voice recognition means for recognizing character data from the voice. The character data included in the content being output is the calling means. 6. The invention according to claim 5, wherein the character data is recognized by the voice recognition means from the voice of the call received by.

As an invention dependent on claim 1, it further comprises an e-mail means for sending and receiving e-mails, and the character data included in the content being output is included in the e-mail transmitted or received by the e-mail means. The invention according to claim 6 may be character data.

As an invention dependent on claim 1, it further comprises an access means for accessing an information page published on a network, and character data contained in the content being output is stored in the information page accessed by the access means. The invention according to claim 7 may be included character data.

According to a first aspect of the present invention, there is further provided a reproducing means for reproducing music data or moving picture data, wherein the extracting means is selected from the character data added to the music data or moving picture data reproduced by the reproducing means. extracting a character string related to the music or video as a candidate of the search string may be an invention of claim 8, wherein the this.

As an invention dependent on claim 8 , a storage means for storing access information for accessing a specific information page published on the network, and a reproduction of music data or moving picture data by the reproduction means when performing data retrieval based on the retrieval character string input in the search input area, characterized that you further comprising a search request means for performing a search request for the particular information page reads the access information The invention according to claim 9 may be used.

The invention according to claim 1 further comprises rank determining means for determining the priority of each search character string candidate extracted by the extracting means, wherein the input control means includes the priority determined by the rank determining means. 11. The invention according to claim 10 , wherein a candidate with the highest priority is input to the search input area as the highest priority character string candidate .

The invention according to claim 1 further includes list display means for displaying a list of search character string candidates extracted by the extraction means, wherein the input control means replaces the top priority character string candidate with the list display. The invention according to claim 11, wherein a candidate arbitrarily selected from the search character string candidates displayed in a list by the means is input to the search input area.

The invention according to claim 11 further includes rank determining means for determining a priority when displaying each list of search character string candidates extracted by the extracting means, wherein the list display means includes the rank determining means. Each search character string candidate is displayed in a list such that the priority order determined by the display order is the display order, and the input control means is a search character arbitrarily selected from the list display. to input a string candidate in the search input area may be an invention of claim 12, wherein the this.

As an invention dependent on claim 12, wherein the input control means to input the highest priority of the candidate of the priority determined by the order determination means to the search input area, claims, characterized and this The invention described in Item 13 may be used.

As an invention dependent on claim 10, 12, wherein the rank determining means determines the priority order based on the appearance frequency of each search data candidates extracted by the extracting means, claim 14, wherein It may be the invention of this.

As an invention dependent on claim 10, 12, wherein the rank determining means determines the priority order based on the appearance time of each search data candidates extracted by the extracting means, claim it characterized and this 15 The described invention may be used.

Claims as an invention dependent on claim 11, wherein the list display means, for erasing under certain conditions from the list the lower candidate based on the priority determined by the order determination means, characterized by the this Item 16 may be the invention.

As an invention dependent on claim 11 , in a state where the search character string input in the data search input area is stored as a search history, the list display means is a search character string candidate extracted by the extraction means list displayed with the search history may be an invention of claim 17, wherein the this.

As an invention dependent on claim 1, when performing data retrieval based on the search character string input to the search input area, instructs the search to the information published on the network page, and this The invention according to claim 18 may be provided.

According to a nineteenth aspect of the present invention, in order to solve the above-described problem, a computer performs a data search based on a search character string input to a search input area, and a content being output. A step of determining a type, a step of specifying a character string candidate extraction method when extracting the search character string candidate from the content being output based on the determined content type, and the specified character Analyzing the character data included in the content being output or information added to the content using a column candidate extraction method, and extracting the search character string candidates; and inputting the priority string candidates selected according to a predetermined priority from among the search character string candidates to the search input area, programming for implementing And wherein the beam.

According to this invention, when performing a data search based on a search character string input to the search input area, it is possible to efficiently perform from the input to the start of the search without imposing a burden on the user. It will be very useful for character string input support.

Hereinafter, embodiments of the present invention will be described with reference to FIGS.
This embodiment exemplifies a case where the present invention is applied to a mobile phone device as a terminal device, and FIG. 1 is a block diagram showing basic components of the mobile phone device.
This cellular phone device is, for example, a foldable device in which two casings (an operation unit casing and a display unit casing) are attached so as to be openable and closable. A voice call function, an e-mail function, an Internet connection function (Web access) Function), TV broadcast reception function for receiving TV broadcasts, content playback function for playing music / video content, etc., and data search based on the search string entered in the search input area (search window) Various functions such as a data search function to be performed are provided. Although not shown in the figure, this cellular phone device is connected to the Internet via a wireless communication network (public mobile communication network), and can send and receive electronic mail to and from this wireless communication network and a mail server on the Internet side. In addition, it is possible to access any Web page via the Internet.

The control unit 1 operates by supplying power from a power supply unit 2 including a secondary battery, and controls the overall operation of the mobile phone device according to various programs in the storage unit 3. Is provided with a CPU (Central Processing Unit), a memory and the like. The storage unit 3 is an internal memory and has a program area and a data area. In this program area, a program for realizing the present embodiment is stored in accordance with operation procedures shown in FIGS. Has been. The storage unit 3 may include a removable portable memory (recording medium) such as an SD card or an IC card.

The display unit 4 is a high-definition display device using liquid crystal, organic EL, etc., and can display numerical values, characters, standby images, TV images, etc., and a time display is displayed in the picto area of the standby screen. , Reception sensitivity, etc. are displayed. The operation unit 5 performs dial input, character input, command input, and the like. The control unit 1 executes various processes such as a transmission process as a process according to an operation signal from the operation unit 5. The communication unit 6 includes a radio unit, a baseband unit, a demultiplexing unit, and the like, for example, for transmitting and receiving data to and from the nearest base station during the operation of the call function, the e-mail function, and the Internet connection function. During operation of the call function, a signal is acquired from the receiving side of the baseband unit and demodulated into a received baseband signal, and then the sound is output from the speaker SP for calling via the telephone unit 7, and the input sound from the calling microphone MC is also output. Data is fetched from the telephone unit 7 and encoded into a transmission baseband signal, which is then given to the transmission side of the baseband unit and transmitted from the antenna.

The TV broadcast receiver 8 receives terrestrial digital TV broadcasts for portable receivers such as mobile phones, and can receive electronic program guides (EPG) in addition to TV video and audio information. The TV broadcast receiving unit 8 is connected to the TV antenna and extracts a broadcast signal (analog circuit unit). The received broadcast signal is demodulated by OFDM (Orthogonal Frequency Division Multiplexing) or multiplexed. It has a digital circuit unit that separates video data, audio data, and character data (for example, caption data) from a signal, decodes them, and decompresses compressed data.

The content reproduction unit 9 reproduces music content, video content, and the like, and the reproduction operation is controlled according to the reproduction start operation / end operation. Note that the music content and the video content are not only broadcast content received from the TV broadcast receiving unit 8, but also downloaded via the Internet or acquired via an external memory. The voice recognition unit 10 recognizes voice data as character data, and voice data at the time of a call and voice of a television broadcast are recognized by the voice recognition unit 10 and converted into character data.

FIG. 2A shows a television broadcast reception screen.
On the upper side of the television broadcast reception screen, a horizontal band-like search input area (search window) SW for inputting a search character string is displayed. The search window SW is used to input a search character string when searching for a Web page (information page) on the Internet, and is displayed on the upper side of the television broadcast reception screen. The search button SB provided in the vicinity of the search window SW is a button for instructing that a corresponding Web page on the Internet should be searched based on the contents of the search window SW. FIG. 2B is a diagram showing a state in which the contents of the search character string list RT are displayed as a pull-down menu when the search window SW is selected by a user operation so that the search window SW can be used. is there.

This search character string list RT is created in correspondence with a running application (in this case, a television broadcast reception function) and displayed as a pull-down menu, and is directly input to the search window SW by a user operation. In addition to displaying the search character string as a search history, a character string extracted by analyzing a television broadcast (for example, caption data, audio data) as the content being output is displayed as a search character string candidate. Each search character string candidate in the list RT is displayed according to a predetermined arrangement order.

When an arbitrary search character string candidate is selected and designated from the search character string list RT by a user operation, the selected search character string candidate is input to the search window SW and displayed. FIG. 2C is a diagram illustrating a case where a corresponding Web page on the Internet is searched and displayed in response to an operation of the search button SB. In the illustrated example, the search character string is “Dribble”, and the Web page screen related to “Dribble” is switched and displayed instead of the television broadcast reception screen.

FIG. 3 is a diagram for explaining a process from extracting a search character string candidate from a television broadcast (caption data, audio data) to displaying the search character string candidate in the search character string list RT.
When the control unit 1 receives a television broadcast via the television broadcast receiving unit 8, the control unit 1 performs morphological analysis on the caption data (see FIG. 3A) of the television broadcast, and divides it into elements (FIG. 3 ( 1B), a character string that satisfies a predetermined character string extraction condition (noun, adjective, adjective verb) is extracted as a search character string candidate (see FIG. 3 (1C)).

In addition, the voice recognition unit 10 converts the voice data of the television broadcast into character data, and the voice recognition character data (see FIG. 3 (2A)) is subjected to morphological analysis in the same manner as described above, and each element. Then, a character string satisfying a predetermined character string extraction condition is extracted as a search character string candidate (see FIG. 3 (2C)). The search character string candidate extracted based on the caption data and the search character string candidate extracted based on the speech data are merged (integrated), and then given priority according to the appearance frequency within a predetermined range (for example, time or data amount). The order (display order) is determined, and each search character string candidate is added to the search character string list RT according to the order of the priorities. Then, the contents of the search character string list RT are displayed as a pull-down menu (see FIG. 3D). When determining the priority order based on the appearance frequency, for example, the priority order is determined based on the appearance frequency within a predetermined range such as one minute, one screen, and one page (hereinafter the same).

Next, the operation concept of the mobile phone device in this embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. In addition, the operation according to the above-described program code transmitted via the transmission medium can be sequentially executed. In other words, operations specific to this embodiment can be executed by using programs / data supplied externally via a transmission medium.

4 to 6 are flowcharts showing the entire operation of the mobile phone device that is started to be executed when the power is turned on.
First, after initial setting such as clearing a predetermined memory (step A1 in FIG. 4), the control unit 1 enters a standby state while reading and displaying a predetermined standby image (step A2). In this standby state, the presence or absence of an incoming call from the communication unit 6 is checked (step A3). When an incoming call is detected, in response to an off-hook operation for connecting a line (YES in step A4), a call process for making a call ready state Is started (step A5). Here, the voice data of the other party is given to the voice recognition unit 10 to perform voice recognition corresponding to an unspecified speaker and converted into character data (step A6). In this case, after acquiring the voice data of the other party in real time from the start of the call, it is converted into character data, and then a search character string extraction process is performed based on this character data (step A7).

FIG. 7 is a flowchart for explaining the search character string extraction processing (step A7 in FIG. 4 and the like) in detail.
First, the control unit 1 performs morphological element analysis on character data (step B1), and extracts search character string candidates (step B2). FIG. 9 is a diagram for explaining a process from extracting a search character string candidate from character data obtained by character recognition of a voice call to displaying a search character string list RT.
The control unit 1 performs a morphological analysis on character data obtained by character recognition of a voice call (see FIG. 9A) and divides the data into elements (see FIG. 9B), and is determined in advance. A character string satisfying the character string extraction condition (noun, adjective, adjective verb) is extracted as a search character string candidate (see FIG. 9C).

Then, the priority (display order) is determined based on the appearance frequency of the extracted search character string candidates (see FIG. 9D), and each search character string rearranged according to this priority order is added to the search character string list RT. (Step B3). As a result, a search character string list RT corresponding to the application (voice call function) currently being executed is generated. Then, the uppermost (most prioritized) character string candidate in the search character string list RT is input and displayed in the search window SW (step B4). FIG. 10A illustrates a display screen during a voice call. In the search window SW displayed on the upper side of the display screen, the highest priority character string candidate determined by the current voice call is displayed. "Summer vacation" is entered as

When such a search character string extraction process (step A7 in FIG. 4) is completed, a process of deleting unnecessary search character string candidates from the list RT for organizing the contents of the search character string list RT is performed (FIG. 4). Step A8). This deletion process is executed under the condition that a predetermined time has elapsed since the search character string extraction process (step A7) is performed. The lower character string candidate (for example, the lowest candidate) is selected as the search character. Delete from the column list RT. Note that the lowermost character string candidate is not deleted after the elapse of a predetermined time. For example, whether or not the deletion process is performed is determined or deleted depending on the number of candidates stored in the search character string list RT. The number of candidates may be determined. That is, if the number of candidates is small, the deletion process is temporarily suspended, and if the number of candidates is large, a plurality of candidates such as the third character string candidates counted from the lowest may be deleted at once. .

Then, the search window SW in the voice call screen is selected and it is checked whether or not a selection operation for making it active has been performed (YES in step A9). If the selection operation is not performed, an on-hook operation for blocking the line is performed. (Step A11), the above-described operation is repeated while performing the above-described speech recognition processing (step A6) and search character string extraction processing (step A7). If an operation for selecting the search window SW is performed during a call (YES in step A9), the Internet is accessed based on the contents of the search window SW, and the corresponding Web page is received and displayed. The process proceeds to search processing (step A10).

FIG. 8 is a flowchart for explaining the search process (step A10 in FIG. 4 and the like) in detail.
First, the control unit 1 displays a search character string list RT for an application being executed (step C1). FIG. 10B shows a state where the search character string list RT is pulled down from the search window SW on the voice call screen, and the contents shown in FIG. 9D are displayed as the search character string list RT. The When an operation for selecting a search character string candidate desired by the user from the search character string list RT is performed (YES in step C2), the selection candidate is input to the search window SW and displayed (step C3). When an operation for directly inputting an arbitrary search character string is performed without selecting a candidate from the search character string list RT (YES in step C4), the directly input character string is input to the search window SW. Are displayed (step C5).

In this state, when the search button SB attached to the search window SW is operated (YES in Step C6), after starting the Web browser (Step C7), it is checked whether music content or moving image content is being played back (Step C7). Step C8) Since a voice call is currently being made (NO in Step C8), it connects to the Internet, requests a search for a Web page corresponding to the search character string in the search window SW (Step C12), and responds to it. The received web page is displayed (step C11).

FIG. 10C is a diagram illustrating a case where a corresponding Web page on the Internet is searched and displayed in response to an operation of the search button SB. In the illustrated example, when the search character string is “travel”, the Web page screen related to “travel” is switched and displayed instead of the call screen. When such a search process is completed (step A10 in FIG. 4), the process returns to the above-described step A6, and the same operation is repeated thereafter. When an on-hook operation is performed during a call (YES in step A11), the line is blocked (step A12), and the search character string list RT created in the current call is cleared (step A13), and then waiting is performed. Return to the state (step A2).

When an operation for instructing the start of television broadcast reception is performed in the standby state (YES in step A14 in FIG. 5), the television broadcast receiver 8 is activated to start reception of television broadcast (step A15). Here, when subtitle data is acquired from a television broadcast, the subtitle data acquired this time is compared with the subtitle data acquired last time to check whether or not the subtitle data is updated (step A16). If not, the process moves to step A19, but when the caption data is updated, the search character string extraction process of FIG. 7 is executed (step A17). Now, when subtitle data is acquired at the start of television broadcast reception, it is determined that the subtitle data has been updated, and therefore a search character string extraction process is performed. As a result, a search character string list RT corresponding to the currently executed application (television broadcast reception function) is generated, and the highest priority character string candidate in this search character string list RT is input to the search window SW. For example, as shown in FIG. 2A, “pass” is input to the search window SW as the highest priority candidate determined by the current television broadcast reception.

Then, after executing deletion processing for deleting unnecessary search character string candidates from the search character string list RT (step A18), the current acquired voice data is compared with the previously acquired voice data to determine whether or not the voice data is updated. In step A19, if the audio data has not been updated, the process proceeds to step A23. Now, when the voice data is acquired at the start of the reception of the television broadcast, it is determined that the voice data has been updated. Therefore, the process proceeds to step A20, where the voice data is given to the voice recognition unit 10 and the voice corresponding to the unspecified speaker. Recognize and convert to character data. In this case, the voice data is converted into character data while being acquired in real time, and then the search character string extraction process of FIG. 7 is executed (step A21), but extracted from the search character string candidates extracted from the caption data and the voice data. The search character string candidates are merged, and the priority order is determined based on the appearance frequency based on the result.

Then, after executing deletion processing for deleting unnecessary search character string candidates from the search character string list RT (step A22), in response to the selection operation of the search window SW (YES in step A23), the search processing of FIG. Is executed (step A24). As a result, the search character string list RT corresponding to the TV broadcast reception function is displayed as a pull-down menu as shown in FIG. 2B, and in response to the operation of the search button SB as shown in FIG. The corresponding Web page on the Internet is searched and displayed. Thereafter, the process returns to the above-described step A16, and the above-described operation is repeated thereafter.

If the search window SW selection operation is not performed (NO in step A23), it is checked whether an end operation for instructing the end of reception of the television broadcast has been performed (step A25). Returning to step A16, the above-described operation is repeated. If the end operation is performed (YES in step A25), the television broadcast receiving unit 8 is stopped to end the broadcast reception (step A26), and the search character string list RT created by the current television broadcast reception is cleared. After that (step A27), it returns to the standby state (step A2 in FIG. 4).

If an operation for instructing the start of music / video playback is performed in the standby state (YES in step A28 in FIG. 5), the playback unit 9 is activated to start playback of music / video content (step A29). ). Then, a character string related to the content is extracted from the character data added to the music / video content as a search character string candidate (step A30). For example, character strings such as “artist name”, “song name”, “title”, “performer”, “producer”, “genre”, etc. included in the header of the content are extracted as search character string candidates. After that, this search character string candidate is added to the search character string list RT (step A31). As a result, a search character string list RT corresponding to the currently executed application (content reproduction function) is generated.

Then, a predetermined character string candidate predetermined from the search character string list RT, for example, “artist name” for music and “title” for video are input to the search window SW and displayed. (Step A32). FIG. 11A shows an example of a display screen during music playback. At the start of music playback, “artist name” is displayed in the search window SW. In this state, when a search window SW selection operation is performed (YES in step A33), the search process of FIG. 8 is executed (step A34).

As a result, the search character string list RT corresponding to the content reproduction function is displayed as a pull-down menu as shown in FIG. 11B, and in response to the operation of the search button SB as shown in FIG. The corresponding Web page on the Internet is searched and displayed. Thereafter, the process returns to step A33 in FIG. 5, and the search process is executed each time the search window SW is selected.

In this case, in step C8 of the search process in FIG. 8, it is determined that music / video content is being played back, so a specific URL (Uniform Resource Locator) stored in advance is read out (step C9) and connected to the Internet. Then, a search for a Web page corresponding to the search character string in the search window SW is requested (Step C10), and the received Web page is displayed in response thereto (Step C11). This specific URL accesses a promotion site for music / video sales promotion, and a web page for sales promotion is displayed during reproduction of the music / video.

When an end operation for instructing the end of music / video playback is performed (YES in step A35), the playback unit 9 is stopped to stop playback of music / video content (step A36), and the current music / video playback is stopped. After clearing the search character string list RT created by moving image reproduction (step A27), the process returns to the standby state (step A2 in FIG. 4).

If an operation for instructing the start of Web browser use is performed in the standby state (YES in Step A37 in FIG. 6), the Web browser is activated (Step A38). In this state, when an operation for instructing the update of the Web page being displayed is performed (YES in step A39), the process proceeds to the execution of the search character string extraction process of FIG. 7 (step A40). As a result, morphological analysis is performed on the text (character data) in the Web browser, and a search character string list RT corresponding to the currently executing application (Web access function) is generated. The highest priority character string candidate is input to the search window SW. FIG. 12A illustrates an example of a display screen when using a Web browser / displaying an e-mail. In the search window SW, “path” is displayed as the highest priority character string candidate. In this state, when a search window SW selection operation is performed (YES in step A41), the search process of FIG. 8 is executed (step A42).

As a result, the search character string list RT corresponding to the Web access function is displayed as a pull-down menu as shown in FIG. 12B, and in response to the operation of the search button SB as shown in FIG. The corresponding Web page on the Internet is searched and displayed. Then, returning to the above-described step A39, the search character string extraction process of FIG. 7 is executed every time the page update operation is performed, and the search process of FIG. 8 is performed every time the search window SW selection operation is performed. Run. If an operation for instructing the end of the use of the Web browser is performed (YES in Step A43), the Web browser is ended (Step A44), and the search character string list RT created by using the current Web browser is cleared. (Step A45) returns to the standby state (Step A2 in FIG. 4).

If an operation for instructing the start of e-mail use is performed in the standby state (YES in step A46 in FIG. 6), the e-mail function is activated (step A47). When an operation for opening a mail is performed in this state (step A48), the process proceeds to execution of the search character string extraction process of FIG. 7 (step A49). As a result, a morphological analysis is performed on the e-mail body (character data) to generate a search character string list RT corresponding to the currently executing application (e-mail function), and the highest priority in the search character string list RT. A character string candidate is input to the search window SW.

In step B3 of this search character string extraction process, when determining the priority order, the priority order is determined according to the appearance time (mail reception time), not the appearance frequency. In this case, the order of early reception time of mail may be set as the priority order, and conversely, the order of reception time may be set as the priority order. FIG. 12A shows an example of a display screen when an e-mail is opened. In the search window SW, “path” is displayed as the highest priority character string candidate. In this state, when a search window SW selection operation is performed (YES in step A50), the search process of FIG. 8 is executed (step A51).

As a result, a search character string list RT corresponding to the e-mail function is displayed as a pull-down menu as shown in FIG. 12B, and in response to the operation of the search button SB as shown in FIG. The corresponding Web page on the Internet is searched and displayed. Thereafter, the process returns to step A48 described above, and thereafter, every time an operation for opening an e-mail is performed, the search character string extraction process of FIG. 7 is executed, and each time the search window SW is selected, the search of FIG. Execute the process. Here, when an operation for instructing the end of the use of e-mail is performed (YES in step A52), the e-mail function is ended (step A53), and after the search character string list RT created by using this e-mail is cleared. (Step A45) returns to the standby state (Step A2 in FIG. 4).

If any other operation is performed (YES in step A54 in FIG. 6), for example, a transmission process, an e-mail creation process, and the like are executed as a process corresponding to the operation (step A55).

As described above, in this embodiment, the control unit 1 analyzes the character data included in the content being output, extracts search character string candidates, and lists the search character string candidates from the display unit 4. Since the candidates selected from the search character string candidates displayed in the list are input to the search window SW, the data search is performed based on the search character string input to the search window SW. In doing so, it is possible to efficiently perform from the input to the start of the search without imposing a burden on the user, which is highly practical as a search character string input support.

Since the character data included in the content being output is character data added to the television broadcast, search character string candidates suitable for the program can be input to the search window SW during the reception of the television broadcast.

Since the character data included in the content being output is character data obtained by recognizing the audio data added to the television broadcast, search character string candidates suitable for the program are input to the search window SW during the television broadcast reception. can do.

Since the character data (for example, caption data) added to the television broadcast and the character data that recognizes the voice data added to the television broadcast are analyzed to extract search character string candidates, the caption data It is possible to merge (integrate) the search character string candidates extracted based on the search character strings and the search character string candidates extracted based on the speech data.

Since the character data included in the content being output is character data that has been voice-recognized from the call voice, search character string candidates suitable for conversation during a voice call can be input to the search window SW.

Since the character data included in the content being output is character data included in the received e-mail, it is possible to input search character string candidates suitable for browsing the e-mail to the search window SW. it can.

Since the character data included in the content being output is character data included in a Web page published on the Internet, search character string candidates suitable for browsing the Web page are displayed in the search window SW. Can be entered.

A character string related to the content is extracted from the character data attached to the content being output as a search character string candidate and displayed as a list, and selected from the search character string candidates displayed in the list. Since the candidates are input to the search window SW, when performing a data search based on the search character string input to the search window SW, the process from the input to the start of search can be efficiently performed without imposing a burden on the user. It can be performed, and it becomes rich in practicality as a search character string input support. In this case, search character string candidates can be extracted without analyzing character data added to the content being output.

Since a character string related to the music / video is extracted as a search character string candidate from the character data added to the music data / video data, search character string candidates suitable for music / video playback are selected. The search window SW can be input.

When a data search is performed based on a search character string input to the search window SW during reproduction of music / video data, the URL of a specific site (for example, a music / video sales promotion site) is read and the Web page Therefore, the user can purchase the content while reproducing the music / video and search for a web page suitable for reproducing the music / video.

Since the priority order of each extracted search character string candidate is determined and the candidate with the highest priority among the priority order is input to the search window SW, automatic input to the search window SW is possible, and user operation is possible. It becomes unnecessary.

The extracted search character string candidates are displayed in a list, and candidates selected by the user operation from among the search character string candidates displayed in the list are input to the search window SW. However, it is only necessary to select the search character string from the candidate list without directly inputting the search character string or selecting the range by specifying the range, and the burden on the user can be greatly reduced.

Since the priority order (display order) for displaying each search character string candidate as a list is determined, the user can select a desired candidate according to the order in which the candidates are arranged. Candidates can be easily selected.

When the priority for displaying each search character string candidate in a list is determined, the candidate with the highest priority is input to the search window SW. Therefore, candidates that are highly likely to be used for the search are displayed in the search window SW. Since it is entered, the search can be started immediately.

When the priority order of each search character string candidate is determined, the priority order is determined based on the appearance order, so that frequently appearing character strings can be input as search candidates to the search window SW.

When determining the priority of each search character string candidate, the priority is determined based on the appearance time, so that the mail with the earliest or latest mail reception time is input to the search window SW. Can do.

Since the lower candidates are deleted from the list display under certain conditions based on the priority order, unnecessary candidates that are unlikely to be used for the search can be deleted, and the number of candidates can be narrowed down.

In the search character string list RT, a search character string directly input to the search window SW by a user operation is displayed as a search history, and a character string extracted by analyzing the content being output is a search character string. Since the list RT is displayed as a candidate, the content of the list RT is in accordance with the actual situation, and a candidate that is highly likely to be used for the search can be displayed.

When performing a data search based on a search character string input to the search window SW, a search for a web page on the Internet is instructed, so that it is possible to search for desired information from a vast amount of information. it can.

In the above-described embodiment, the search character string candidate is extracted from the character data included in the received e-mail, but the search character string candidate is extracted from the character data included in the e-mail to be transmitted. May be extracted. This makes it possible to input search character string candidates suitable for creation of an e-mail to the search window SW.

Further, in the above-described embodiment, the search character string directly input to the search window SW by the user operation is displayed as the search history in the search character string list RT, and is extracted by analyzing the content being output. Although the character string is displayed as the search character string candidate, the search character string candidate extracted by the content analysis may be displayed separately from the search history. The search character string list RT is not limited to being displayed as a pull-down menu from the search window SW, but may be displayed in a separate window.

In the above-described embodiment, when performing a data search based on a search character string input to the search window SW, a search for a web page on the Internet is instructed. The electronic dictionary or various externally connected electronic dictionaries may be searched based on the search character string input to the search window SW. Furthermore, not only the electronic dictionary but various tables, files, and folders may be searched.
In addition, the present invention is not limited to a mobile phone device, and can be similarly applied to, for example, a mobile terminal device such as a PDA, a digital camera, and a music player, a PC (personal computer), and the like.

The block diagram which showed the basic component of the mobile telephone apparatus applied as a terminal device. (A) is a television broadcast reception screen, (B) is a state in which a search character string list RT is displayed in response to selection of the search window SW, and (C) is a search display of a Web page by operating the search button SB. The figure which showed the state made to do. The figure for demonstrating the process from extracting a search character string candidate from television broadcasting (subtitle data, audio | speech data), and displaying a search character string candidate on the search character string list RT. The flowchart which showed the whole operation | movement of the mobile telephone apparatus started execution with power activation. The flowchart following the operation | movement of FIG. 6 is a flowchart following the operation of FIG. 5 is a flowchart for explaining in detail search character string extraction processing (step A7 in FIG. 4 and the like). 5 is a flowchart for explaining search processing (step A10 in FIG. 4 and the like) in detail. The figure for demonstrating the process until a search character string candidate is extracted from a voice call and a search character string candidate is displayed on search character string list RT. (A) is a screen during a voice call, (B) is a state in which a search character string list RT is displayed in response to selection of the search window SW, and (C) is a search for a Web page by operating the search button SB. The figure which showed the state displayed. (A) is a music / video playback screen, (B) is a state in which a search character string list RT is displayed in response to selection of the search window SW, and (C) is a Web page displayed by operating the search button SB. The figure which showed the state made to search and display. (A) is a display screen when using a web browser / mail display, (B) is a state in which a search character string list RT is displayed according to selection of the search window SW, and (C) is a state of the search button SB. The figure which showed the state which searched and displayed the web page by operation.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Control part 2 Power supply part 3 Memory | storage part 4 Display part 5 Operation part 6 Communication part 7 Telephone part 8 Television broadcast receiving part 9 Playback part 10 Voice recognition part SW Search window RT Search character string list SB Search button

Claims (19)

A terminal device having a search function for performing a data search based on a search character string input in a search input area,
A discriminating means for discriminating the type of content being output by the terminal device;
A specifying means for specifying a character string candidate extraction method for extracting the search character string candidates from the content being output by the terminal device based on the content type determined by the determination means;
Using the character string candidate extraction method specified by the specifying means, the character data included in the content being output by the terminal device or the information added to the content is analyzed, and the search character string Extraction means for extracting candidates;
Input control means for inputting the highest priority character string candidate selected according to a predetermined priority from the search character string candidates extracted by the extraction means to the search input area;
A terminal device comprising: TV broadcast receiving means for receiving digital TV broadcast is further provided,
The character data included in the content being output is character data added to the television broadcast received by the television broadcast receiving means.
The terminal device according to claim 1. TV broadcast receiving means for receiving digital TV broadcast;
Speech recognition means for recognizing character data from speech;
The character data included in the content being output is character data recognized by the voice recognition unit from the voice of the television broadcast received by the television broadcast reception unit.
The terminal device according to claim 1. The extraction means includes character data added to the television broadcast received by the television broadcast reception means and character data recognized by the voice recognition means from the sound of the television broadcast received by the television broadcast reception means. Analyzing and extracting candidates for the search string;
The terminal device according to claim 3, which is configured as described above. Call means for making voice calls;
Speech recognition means for recognizing character data from speech;
Further comprising
The character data included in the content being output is character data recognized by the voice recognition unit from a call voice received by the calling unit.
The terminal device according to claim 1. Further comprising an e-mail means for sending and receiving e-mail;
The character data included in the content being output is character data included in an email transmitted or received by the email means.
The terminal device according to claim 1. An access means for accessing an information page published on the network;
The character data included in the content being output is character data included in the information page accessed by the access means.
The terminal device according to claim 1. It further comprises a playback means for playing back music data or video data,
The extraction unit extracts a character string related to the music or moving image as a candidate for the search character string from the character data added to the music data or moving image data reproduced by the reproducing unit.
The terminal device according to claim 1. Storage means for storing access information for accessing a specific information page published on the network;
When performing a data search based on a search character string input to the search input area during playback of music data or video data being played back by the playback means, the access information is read and the specific information page Search request means for making a search request for,
The terminal device according to claim 8, further comprising: Rank determining means for determining the priority of each search character string candidate extracted by the extracting means;
The input control means causes the highest priority candidate among the priority orders determined by the rank determination means to be input as the highest priority character string candidate to the search input area.
The terminal device according to claim 1. A list display means for displaying a list of search character string candidates extracted by the extraction means;
The input control means, in place of the top-priority character string candidate, causes a candidate arbitrarily selected from the search character string candidates listed by the list display means to be input to the search input area.
The terminal device according to claim 1. A rank determining means for determining a priority when displaying the list of search character string candidates extracted by the extracting means;
The list display means displays a list of search character string candidates so that the priority order determined by the order determination means is the display order and the order of arrangement according to the order.
The input control means causes a search character string candidate arbitrarily selected from the list display to be input to the search input area.
The terminal device according to claim 11. The input control means causes a candidate of the highest priority among the priorities determined by the order determination means to be input to the search input area.
The terminal device according to claim 12, which is configured as described above. The rank determining means determines the priority based on the appearance frequency of each search data candidate extracted within a predetermined range by the extracting means;
13. The terminal device according to claim 10 or claim 12, characterized by the above. The rank determining means determines the priority based on the appearance time of each search data candidate extracted by the extracting means;
The terminal device according to claim 10 or 12, characterized in that The list display means erases the lower candidates from the list display under a certain condition based on the priority order determined by the order determination means.
The terminal device according to claim 11. In a state where the search character string input to the data search input area is stored as a search history, the list display means displays a list of search character string candidates extracted by the extraction means together with the search history.
The terminal device according to claim 11. Instructing a search to an information page published on the network when performing a data search based on a search character string input in the search input area,
The terminal device according to claim 1. Against the computer,
Performing a data search based on the search string entered in the search input area;
Determining the type of content being output;
Identifying a character string candidate extraction method for extracting the search character string candidates from the content being output based on the determined content type;
Using the specified character string candidate extraction method, analyzing character data included in the content being output or information added to the content and extracting the search character string candidates; ,
Inputting the highest priority character string candidate selected according to a predetermined priority from the extracted search character string candidates into the search input area;
A program to realize

Images