JP5522728B2 - Terminal device and program - Google Patents

Description

  The present invention relates to a terminal device and a program for controlling a display unit.

  In general, in a terminal device such as a mobile phone, various conversion functions for converting a character string include, for example, a function for converting a character string of one character type into a character string of another character type (for example, a kana for converting hiragana to kanji) There are kanji conversion functions, alphanumeric conversion functions that convert input character strings into English letters and numbers, and translation functions that convert character strings in one language into character strings in another language. In these conversion functions, various methods have been proposed as display methods for displaying a character string and a converted character string. For example, when a character string is converted while a certain character string is displayed, a method of displaying the converted character string instead of a certain character string, or when a certain character string is displayed For example, when a character string is converted, a certain character string and the converted character string are displayed at the same time by dividing the display area. As the latter method, a technique is disclosed in which a machine translation apparatus displays an original sentence, a primary translation sentence, and a secondary translation sentence at the same time with a display area being separated (see Patent Document 1).

JP 2004-220616 A

  However, in the former method described above, since the character string before conversion is not displayed, it cannot be confirmed. In the latter method, the display area of each character string is narrowed, and particularly in a mobile terminal device such as a mobile phone, the display area is limited, which is particularly remarkable. Thus, conventionally, when a certain character string is converted into another character string and displayed on the display unit, it cannot be said that the display can be appropriately controlled.

  An object of the present invention is to make it possible to appropriately control display of a character string when it is converted into another character string and displayed on a display unit without impairing user convenience.

In order to solve the above-described problem, the invention described in claim 1
A terminal device for controlling the display unit,
An instruction means for instructing conversion of the first character string based on a user operation on the first character string;
In response to a conversion instruction by the instruction means, an acquisition means for acquiring a conversion result obtained by converting the first character string into a second character string;
First display control for controlling the display unit so that the second character string is visually recognized from both a first viewing angle direction with respect to the display unit and a second viewing angle direction different from the first viewing angle direction. When, wherein the first viewing angle direction together with the first character string is viewed, before Symbol second display control for controlling the display unit so that the second string is viewed from the second viewing angle direction Display control means for controlling switching based on a series or integral operation by a user accompanying a user operation instructing conversion of the first character string ;
It is characterized by providing.

As an invention dependent on claim 1,
The instruction means is means for instructing translation of the first character string into a different language,
The acquisition means acquires a translation result obtained by translating the first character string into the second character string described in a language different from the language of the first character string.
The invention according to claim 2, which is configured as described above.

As an invention dependent on claim 1,
The instruction means is means for instructing conversion of the first character string into a different character type,
The acquisition means acquires a conversion result obtained by converting the first character string into the second character string described in a character type different from the character type of the first character string.
The invention according to claim 3, which is configured as described above.

As an invention dependent on claim 1,
Further comprising designation means for designating a positional relationship between the first viewing angle direction and the second viewing angle direction;
Before Symbol Table示制control means is in said second display control, on the basis of the specified positional relationship by the specified means, together with the first character string from said first viewing angle direction is viewed, the second Controlling the display unit so that the second character string is visually recognized from a viewing angle direction;
The invention according to claim 4, which is configured as described above.

As an invention dependent on claim 4,
Imaging means for imaging a user looking at the display unit;
Detecting means for detecting the position of the user based on the user imaged by the imaging means;
Further comprising
The designation means designates a positional relationship between the first viewing angle direction and the second viewing angle direction based on the position of the user detected by the detection means;
The invention according to claim 5, which is configured as described above.

As an invention dependent on claim 4,
The designation means designates a positional relationship between the first viewing angle direction and the second viewing angle direction based on a user operation on the first character string ;
The invention according to claim 6 is characterized in that it is configured as described above.

As an invention dependent on claim 6,
The instructing unit instructs the conversion of the first character string based on a user operation for instructing the conversion of the first character string,
The designation means designates a positional relationship between the first viewing angle direction and the second viewing angle direction based on a series or integral operation by a user accompanying a user operation instructing conversion of the first character string .
The invention according to claim 7, characterized in that it is configured as described above.

As an invention dependent on claim 1,
Voice output means for outputting the second character string acquired as a conversion result by the acquisition means by voice;
The invention according to claim 8, which is configured as described above.

In order to solve the above-described problem, the invention according to claim 9 is
A terminal device for controlling the display unit,
Instruction means for instructing the translation of the first character string based on a user operation on the first character string described in the first language;
An obtaining means for obtaining a translation result obtained by translating the first character string into a second character string described in a second language different from the first language in response to a translation instruction by the instruction means;
First display control for controlling the display unit so that the second character string is visually recognized from both a first viewing angle direction with respect to the display unit and a second viewing angle direction different from the first viewing angle direction. If, with the previous SL the first character string from the first viewing angle direction is viewed, and a second display control to control so that the second character string from the second viewing angle direction is viewed, Display control means for controlling switching based on a series or integral operation by a user accompanying a user operation instructing translation of the first character string ;
It is characterized by providing.

In order to solve the above-mentioned problem, the invention according to claim 10
Against the computer,
A function for instructing conversion of the first character string based on a user operation on the first character string;
In response to the conversion instruction, a function of acquiring a conversion result obtained by converting the first character string into a second character string;
First display control for controlling the display unit so that the second character string is visually recognized from both a first viewing angle direction with respect to the display unit and a second viewing angle direction different from the first viewing angle direction. When, wherein the first viewing angle direction together with the first character string is viewed, before Symbol second display control for controlling the display unit so that the second string is viewed from the second viewing angle direction And a function of controlling the switching so as to be switchable based on a series or integral operation by a user accompanying a user operation instructing conversion of the first character string ;
It is a program for realizing.

In order to solve the above-described problem, the invention according to claim 11
Against the computer,
A function for instructing translation of the first character string based on a user operation on the first character string described in the first language;
In response to the translation instruction, a function of acquiring a translation result obtained by translating the first character string into a second character string described in a second language different from the first language;
First display control for controlling the display unit so that the second character string is visually recognized from both a first viewing angle direction with respect to the display unit and a second viewing angle direction different from the first viewing angle direction. When, wherein the first viewing angle direction together with the first character string is viewed, before Symbol second display control for controlling the display unit so that the second string is viewed from the second viewing angle direction And a function for controlling the switching based on a series or integral operation by a user accompanying a user operation for instructing translation of the first character string ;
A program to realize

  According to the present invention, when a certain character string is converted into another character string and displayed on the display unit, the display can be appropriately controlled without impairing the convenience for the user, which is highly practical. It will be.

The block diagram which showed the communication network system which can use the mobile telephone applied as a terminal device. FIG. 2 is a block diagram showing basic components of the mobile phone 1. The main flowchart which showed the outline | summary of the whole operation | movement by the side of the mobile telephone 1 by which execution is started with power activation. The flowchart for explaining in detail the translation application process (step A6 of FIG. 3) started to be executed in response to the conversion application activation operation. 6 is a flowchart for explaining in detail translation processing A (step B5 in FIG. 4) that is started in response to a translation instruction operation. 6 is a flowchart for explaining in detail a translation process B (step B6 in FIG. 4) that is started in response to a translation instruction + direction instruction operation. The flowchart for explaining in detail the conversion application process (step A8 of FIG. 3) started to be executed in response to the conversion application activation operation. (1), (2) is a figure for demonstrating concretely the translation process B (step B6 of FIG. 4). (1), (2) is a figure for demonstrating concretely a conversion application process (step A8 of FIG. 3). It is a figure for demonstrating the modification of embodiment, and the translation process B (step B6 of FIG. 4) in case the user who sees the original sentence and the user who sees a translation face each other and sees the display part 16 is explained in full detail. Flowchart for FIGS. 10A and 10B are diagrams for specifically explaining a modified example of the embodiment shown in FIG. 10. FIGS. 10A and 10B are diagrams in which a user who sees an original text and a user who sees a translated text face each other and view the display unit 16. The figure which showed the state displayed on the display part 16 by making the display direction of an original sentence into a forward direction, and making the display direction of a translation sentence into a reverse direction when there is. It is a figure for demonstrating the other modification of embodiment, and details the translation process B in the case of determining a viewing angle direction by analyzing the image which image | photographed the user with the imaging part 21 (step B6 of FIG. 4). The flowchart for doing.

Hereinafter, embodiments of the present invention will be described with reference to FIGS.
This embodiment exemplifies a case where the present invention is applied to a mobile phone as a terminal device, and FIG. 1 is a block diagram showing a communication network system in which the mobile phone can be used.
The mobile phone 1 is, for example, a straight type mobile phone having a single casing, and has a call function, an e-mail function, an Internet connection function (Web access function), a camera function, and the like. The mobile phone 1 has a display surface DP that covers almost the entire surface of the housing, and an imaging lens FR that constitutes a camera function is attached to the central portion of the housing. This camera function can be used as an in-camera that captures the display screen DP side (user side) by a predetermined camera switching operation, or can be used as an out-camera that captures the opposite side of the display screen DP Thus, when used as an in-camera, it is possible to simultaneously image a plurality of people viewing the display surface DP by wide-angle imaging.

  When the cellular phone 1 is connected to the wireless communication network (mobile communication network) 2 from the nearest base station 2A and exchange 2B, the cellular phone 1 is connected to other cellular phones (not shown) via the wireless communication network 2. The phone is ready to talk. In addition, when the mobile phone 1 is connected to the Internet 3 via the wireless communication network 2, the mobile phone 1 can be accessed by browsing a Web site, or the Internet 3 and the wireless communication network with the translation device / conversion device 4. The character string can be transmitted / received via 2. The translation device / conversion device 4 is a server device on the supplier side that provides a translation / conversion service. The translation device / conversion device 4 includes a translation dictionary database and a conversion dictionary database, and receives a translation or conversion request from the mobile phone 1 on the member user side. Translation processing and conversion processing are executed in response to the request, and the processing result is transmitted to the requesting mobile phone 1.

FIG. 2 is a block diagram showing basic components of the mobile phone 1.
The central control unit 11 operates by supplying power from the battery unit 12 including a secondary battery, and controls the overall operation of the mobile phone 1 according to various programs in the storage unit 13 and a memory. (Not shown). The storage unit 13 includes a program storage unit M1, various information temporary storage units M2, a source text storage unit M3, a translation dictionary database storage unit M4, a conversion dictionary database storage unit M5, and the like. Note that the storage unit 13 may be configured to include a removable portable memory (external recording medium) such as an SD card or an IC card, or may be on a predetermined external server (not shown).

  The program storage unit M1 stores a program and various applications for realizing the present embodiment according to the operation procedure shown in FIGS. 3 to 7, and stores various information necessary for the program. ing. The various information temporary storage unit M2 is a work area for temporarily storing various information necessary for the mobile phone 1 to operate, such as flag information and screen information. The source text storage unit M3 stores various source text data to be translated. The central control unit 11 displays the contents of the source text storage unit M3 as a list from the source text list by a user operation. When an arbitrary original sentence (character string) is selected, the selected original sentence (character string) is read out as a translation target.

  The translation dictionary database storage unit M4 stores a translation dictionary database for converting a character string in one language (for example, Japanese) into a character string in another language (for example, English) (for example, Japanese-English translation). The control unit 11 executes translation for the original text (character string) arbitrarily input in response to the original text data read from the original text storage unit M3 or a user operation by referring to the translation dictionary database storage unit M4. Or a translation request is transmitted to the translation apparatus / conversion apparatus 4 described above. The conversion dictionary database storage unit M5 has a function (kana-kanji conversion function) for converting a character string of a certain character type (for example, hiragana) into a character string of another character type (for example, kanji), and an input character string The central control unit 11 stores an alphanumeric conversion dictionary database to be converted into numbers. The central control unit 11 converts the input character string by referring to the conversion dictionary database storage unit M5, A request for a conversion request is transmitted to the conversion device 4.

  The radio communication unit 14 includes a radio unit, a baseband unit, a demultiplexing unit, and the like. For example, during operation of a call function, an e-mail function, an internet connection function, etc., data is transmitted to and received from the nearest base station 2A. When the call function is in operation, when the signal is received from the receiving side of the baseband unit, demodulated into a received baseband signal and output to the central control unit 11, the central control unit 11 causes the audio signal processing unit 15 to Via the voice speaker SP, and the voice data input from the voice microphone MC is fetched from the voice signal processing unit 15, encoded into a transmission baseband signal, and then sent to the transmission side of the baseband unit. Output from the antenna AN.

  The display unit 16 constitutes the above-described display surface DP, and uses high-definition liquid crystal to display, for example, character information, a standby image, a still image, a moving image, and the like. A touch screen is configured by laminating and disposing contact operation units (transparent touch panels) for detecting contact of a finger corresponding to the surface of the display unit 16. The central control unit 11 executes processing in accordance with an input operation signal from a contact operation unit constituting the display unit (touch screen) 16. The touch panel may be a capacitance type or a resistance film type, or may be a piezoelectric type that can detect the pressing (pressing) of an operating instrument or a finger in addition to the contact. Although not shown, a liquid crystal layer for generating a parallax barrier having fine translucent slits is provided on the surface of the display unit (touch screen) 16, and a viewing angle is generated by generating the parallax barrier. Different table contents can be visually recognized depending on the direction.

  When a plurality of different display contents are displayed on the display unit 16 at the same time, the parallax barrier control unit 17 recognizes one display content from one viewing angle direction and another display content from another viewing angle direction. The parallax barrier is generated on the surface of the display unit 16 so that the parallax barrier is generated on the surface of the display unit 16 under the control of the central control unit 11, or the parallax barrier is deleted from the surface of the display unit 16. To do. Here, the central control unit 11 responds to an operation instructing conversion (for example, Japanese-English translation, kanji conversion) of the first character string (for example, Japanese for translation, hiragana for kanji conversion). When a conversion result obtained by converting one character string into a second character string (for example, English, kanji) is obtained, and when the first character string and the second character string are displayed on the display unit 16 at the same time, The display unit 16 is controlled such that the first character string is visually recognized from the first viewing angle direction and the second character string is visually recognized from a second viewing angle direction different from the first viewing angle direction. I have to.

  The operation unit 18 includes a push button type key such as a side key disposed on the side surface of the housing, and the central control unit 11 executes processing according to an input operation signal from the operation unit 18. . For example, the power on / off process is executed in response to the power on / off operation, or the application process is executed in response to the application (application) activation operation. The RTC (real time clock module) 19 constitutes a clock unit, and the central control unit 11 acquires the current date and time from the RTC 19. The notification unit 20 includes a sound speaker 20A, an LED (light emitting diode) 20B, and a vibration motor 20C. The notification unit 20 is driven at the time of an incoming call to notify an incoming call, and is also driven at the time of an alarm notification. The imaging unit 21 is a component that constitutes the above-described camera function, has an imaging element (for example, CCD or CMOS), and can capture moving images in addition to still image imaging. The imaging unit 17 includes a distance measuring sensor, a light amount sensor, an analog processing circuit, a signal processing circuit, a compression / decompression circuit, and the like in addition to the above-described imaging device and imaging lens FR, and controls and controls the optical zoom. Control drive control, shutter drive control, exposure, white balance, etc.

  Next, the operation concept of the mobile phone 1 in this embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. Further, it is possible to sequentially execute the operation according to the above-described program code transmitted via a transmission medium such as a network. In other words, in addition to the recording medium, an operation unique to the present embodiment can be executed using a program / data supplied externally via a transmission medium.

FIG. 3 is a main flowchart showing an outline of the overall operation on the mobile phone 1 side which starts to be executed when the power is turned on.
First, when a power-on operation for turning on the power is performed (YES in Step A1), the central control unit 11 starts power supply and executes a power-on process for initializing a predetermined memory and the like, A standby process is performed in which a standby image is read and displayed, or a location registration is performed by communicating with the base station 2A (step A2). In this state, it is checked whether a setting operation has been performed (step A3), whether a translation application activation operation has been performed (step A5), whether a conversion application activation operation has been performed (step A8), It is checked whether an incoming call has been detected (step A9), whether a power-off operation has been performed (step A11), and whether other operations have been performed (step A13).

  If a setting operation is performed to set arbitrary information (YES in step A3), a setting process corresponding to the operation is performed (step A4), and the process returns to step A3 described above. When a translation application activation operation is performed (YES in step A5), the process proceeds to execution of a translation application process described later (step A6), and when a conversion application activation operation is performed (YES in step A7), it will be described later. The conversion application process is executed (step A8). On the other hand, when an incoming call is detected (YES in step A9), call processing is performed in accordance with the response operation (step A10), and the process returns to step A3 described above. When a power-off operation is detected (YES in step A11), after the power-off process is performed (step A12), this flow ends. However, when other operations such as a calling operation are performed (step A12) After a transmission process is performed as a process corresponding to the operation (step A14), the process returns to the above-described step A3.

FIG. 4 is a flowchart for explaining in detail the translation application process (step A6 in FIG. 3) started to be executed in response to the conversion application activation operation.
First, after starting the translation application (step B1), the central control unit 11 accepts designation of the original text (character string) to be translated (step B2). In this case, for example, an original text (character string) arbitrarily selected from the original text list by the user operation in a state where the contents of the original text storage section M3 are displayed as a list on the display section 16 is read as a translation target, The original text (character string) arbitrarily input as the translation target is fetched from the section 18 or the display section (touch screen) 16, and the original text (character string) to be translated is displayed on the display section (touch screen) 16. Let

  In this state, it is checked whether a translation instruction operation has been performed (step B3) or a translation instruction + direction instruction operation has been performed (step B4). Here, the translation instruction operation is, for example, an operation of touching the original text (character string) to be translated displayed on the display unit (touch screen) 16 and releasing the touch at that position. The translation instruction + direction instruction operation is, for example, in a state where the original text (character string) to be translated is touched, from the first character to the last character, or from the last character to the first character. This is an operation to release the touch after sliding. The sliding direction is not limited to this and is arbitrary. When a translation instruction operation is performed (YES in step B3), the process proceeds to execution of translation process A (step B5). When a translation instruction + direction instruction operation is performed (YES in step B4), translation process B is performed. (Step B6).

FIG. 5 is a flowchart for explaining in detail the translation process A (step B5 in FIG. 4) started in response to the translation instruction operation.
First, the central control unit 11 refers to the translation dictionary database storage unit M4, executes translation processing on the original text (first character string) to be translated (step C1), and translates the second translation result (second character). Column) is generated (step C2). In this case, translation processing or translation sentence generation may be requested to the translation apparatus / conversion apparatus 4 side, and the translation sentence generated on the translation apparatus / conversion apparatus 4 side may be received. Then, the translated sentence is displayed on the display unit 16 without generating a parallax barrier (step C3), converted into audio data (step C4), and output from the sound speaker 20A (step C5).

FIG. 6 is a flowchart for explaining in detail the translation process B (step B6 in FIG. 4) that is started in response to the translation instruction + direction instruction operation.
First, when the positional relationship between the first viewing angle direction and the second viewing angle direction is designated by a user operation, the central control unit 11 performs the first viewing angle direction and the second viewing angle direction based on the user operation. Is determined (step D1). That is, the first viewing angle direction and the second viewing angle direction are determined based on a direction instruction operation (slide operation) that is a series or integral operation by the user. For example, if the source of the slide is the first viewing angle direction and the tip of the slide is the second viewing angle direction, when sliding from the first character of the original text (character string) to the last character direction, The first viewing angle direction is determined, and the end character side is determined as the second viewing angle direction. Conversely, when the end character is slid in the direction of the first character, the end character side is set as the first viewing angle direction. The first character side is determined as the second viewing angle direction.

  FIG. 8 is a diagram for specifically explaining the translation process B. In (1), “How are you?” Is displayed on the display unit (touch screen) 16 as the original text (character string) to be translated. In the state where the main user of the mobile phone 1 is from the position on the left side in the figure, and another user (a user who wants to show the translation) side by side on the main user side is from the position on the right side in the figure The case where the display content of 16 is seen is shown. In this case, when sliding in the direction from the first character to the last character of the character string (left to right in the figure), the first character side is determined as the first viewing angle direction, and the last character side is the second viewing angle direction. As determined.

  Based on the first viewing angle direction and the second viewing angle direction determined as described above, the display direction of the original sentence and the display direction of the translated sentence are determined (step D2). For example, if the first viewing angle direction and the second viewing angle direction are in a left-right relationship, it is determined that the user viewing the original sentence and the user viewing the translated sentence are viewing the display unit 16 side by side. Thus, the display direction of the original text and the display direction of the translation text are determined to be the same forward direction (the top of the character is up and the ground is down). If the first viewing angle direction is below and the second viewing angle direction is above, it is determined that the user who sees the original sentence and the user who sees the translated sentence face each other and look at the display unit 16. Thus, the display direction of the original sentence is determined to be the forward direction, and the display direction of the translated sentence is determined to be the reverse direction (the top of the character is down and the ground is up).

  After determining the first and second viewing angle directions in this way and determining the display direction of the original text and the translated text, the translation dictionary database storage unit M4 is referred to in the same manner as described above, and A translation process is performed on the original sentence (first character string) (step D3), and a translation sentence (second character string) as a result of the translation is generated (step D4). Also in this case, translation processing and translation sentence generation may be requested to the translation apparatus / conversion apparatus 4 side, and the translation sentence generated on the translation apparatus / conversion apparatus 4 side may be received. Then, after the above-described parallax barrier is generated on the surface of the display unit 16 (step D5), the original sentence and the translated sentence are simultaneously displayed on the display unit 16 (step D6). At that time, due to the effect of the parallax barrier, the original text and the translated text are displayed in the determined display directions so that the original text is visually recognized from the first viewing angle direction and the translated text is visually recognized from the second viewing angle direction. 16 are displayed simultaneously. Then, the translated sentence is converted into voice data (step D7), and the voice is output from the sound speaker 20A (step D8).

  FIG. 8B shows a state in which the original sentence is visually recognized from the first viewing angle direction and the translation unit is simultaneously displayed on the display unit 16 so that the translated sentence is visually recognized from the second viewing angle direction. In this case, the first viewing angle direction and the second viewing angle direction have a left-right relationship, and the main user who sees the original text “How are you” and the user who sees the translated text “How are you?” Therefore, the display direction of the original sentence and the display direction of the translated sentence are the same forward direction.

  When such translation processing A (step B5 in FIG. 4) or translation processing B (step B6 in FIG. 4) is completed, it is checked whether or not an original text redesignation operation for designating another source text to be translated has been performed (step B7), it is checked whether the termination of the translation application is instructed in response to a user operation or a certain time (step B8). Here, when the original text redesignation operation is performed (YES in step B7), the process returns to the above-described step B2, and the above-described operation is repeated (steps B2 to B7), but when the termination of the translation application is instructed. (YES in step B8), after terminating the translation application (step B9), the process returns to step A3 in FIG.

FIG. 7 is a flowchart for explaining in detail the conversion application process (step A8 in FIG. 3) started to be executed in response to the conversion application activation operation.
First, the central control unit 11 activates a conversion application such as kana-kanji conversion or alphanumeric conversion (step E1), and then receives designation of a pre-conversion character string (unconverted character string) by a user operation or the like and displays the display unit. (Touch screen) 16 is displayed (step E2). Then, a conversion instruction operation wait state is entered (step E3), but now a conversion instruction operation is performed by a touch operation on a pre-conversion character string (for example, hiragana) displayed on the display unit (touch screen) 16. (YES in step E3) Based on the position of the user looking at the display unit 16, a process of determining the first viewing angle direction and the second viewing angle direction is performed (steps E4 to E7). That is, the camera function is activated to capture a captured image from the imaging unit 21 (step E4), and the number P of users who are viewing the display unit 16 is counted by analyzing how many people are captured while analyzing the captured image. Detect (step E5).

  FIG. 9 is a diagram for specifically explaining the conversion application process. In (1), “Gashinshotan” is displayed on the display unit (touch screen) 16 as a pre-conversion character string (unconverted character string). In the state where the main user of the mobile phone 1 is located in the horizontal line on the main user side from the position on the left side in the figure, the other users (two persons who want to see the converted character string) in the figure In this case, the display contents of the display unit 16 are viewed from the center position and the right position, respectively. In this case, three other users are detected as the number of users P because the other two users are lined up side by side on the main user side.

  Then, by dividing the entire viewing angle of the display unit 16 based on the number of users P, the first viewing angle direction, the second viewing angle direction, and the P (P = 3) viewing angle in order from the left side of FIG. A direction is determined (step E6). In this case, the viewing angle direction of the main user may be increased without being limited to the equal division, and the viewing angle direction may be determined according to the position of the user's face. In the example of FIG. 9A, the first viewing angle direction, the second viewing angle direction, and the third viewing angle direction are determined from the left side (main user side) in the drawing. Then, the display directions of the pre-conversion character string and the post-conversion character string are determined (step E7). In this case as well, the display direction is determined in the same manner as described above. However, in the example of FIG. 9 (1), the first viewing angle direction to the Pth viewing angle direction have a left-right relationship. The display direction of the character string and the converted character string is determined to be the same forward direction (the top of the character is up and the ground is down).

  After determining the first viewing angle direction to the Pth viewing angle direction and determining the display direction of the pre-conversion character string and the post-conversion character string in this way, the character string is referred to the conversion dictionary database storage unit M5. Conversion processing is executed (step E8), and a converted character string is generated (step E9). In this case, for example, a hiragana character string is converted into a kanji character string, or converted into an alphabetic or numeric character string. In the example of FIG. 9, the pre-conversion character string is converted to a “Chile” kanji character string. A parallax barrier is generated on the surface of the display unit 16 so that different character strings can be visually recognized from the first viewing angle direction and the other viewing angle directions (step E10), and the pre-conversion character string and the post-conversion character string The character strings are simultaneously displayed on the display unit 16 (step E11). In this case, as shown in FIG. 9 (2), the pre-conversion character string is visually recognized from the first viewing angle direction, and the post-conversion character string is visually recognized from the other second and third viewing angle directions. The character string and the converted character string are simultaneously displayed on the display unit 16. Here, since the first to third viewing angle directions have a left-right relationship, the display direction of the pre-conversion character string and the post-conversion character string is the same forward direction.

  Thereafter, it is checked whether or not a re-designating operation for re-designating the pre-conversion character string has been performed (step E12), or whether or not the conversion application is instructed in response to a user operation or when a certain time has elapsed (step E12). E13). Here, when the re-designation operation is performed (YES in step E12), the process returns to the above-described step E2, and thereafter the above-described operation is repeated (steps E2 to E12), but when the conversion application is instructed ( After the conversion application is terminated (step E14), the process returns to step A3 in FIG.

  As described above, in the present embodiment, the central control unit 11 determines the first character string from the first viewing angle direction with respect to the display unit 16 when the first character string is converted into the second character string in accordance with the conversion instruction. Since the first character string and the second character string are simultaneously displayed on the display unit 16 so that the second character string can be visually recognized from the second viewing angle direction, When the character string is converted and displayed on the display unit 16, the display can be appropriately controlled without impairing the convenience for the user, which is practical. That is, for example, Mr. A can visually recognize a certain character string from a certain viewing angle direction, and at the same time, Mr. B can visually recognize the converted character string from another viewing angle direction, and only changes the position where the user sees. (By simply changing the viewing angle direction), it is possible to visually recognize a certain character string and the converted character string, and further, it does not reduce the display area of each character string. The display can be appropriately controlled without any loss, and is highly practical.

  When the translation of the first character string into a different language is instructed, the second character string translated into a language different from the language of the first character string is acquired. The original text) and the translated character string (translated text) can be viewed from different viewing angle directions without narrowing the display area.

  When the conversion of the first character string to a different character type is instructed, the second character string converted to a character type different from the character type of the first character string is acquired. Character strings converted into different character types can be viewed from different viewing angle directions without narrowing the display area.

  When the positional relationship between the first viewing angle direction and the second viewing angle direction is specified, the first character string and the second character string are displayed so as to be viewed from different viewing angle directions based on the positional relationship. Since the images are simultaneously displayed on the unit 16, it is possible to specify a positional relationship in different viewing angle directions, which is highly flexible.

  Since a user is looking at the display unit 16 and the positional relationship between the first viewing angle direction and the second viewing angle direction is specified based on the position of the user, a certain character string is visually recognized. The direction in which the converted character string is visually recognized can be appropriately specified according to the position of the user who is viewing the display unit 16.

  Since the positional relationship between the first viewing angle direction and the second viewing angle direction is designated based on the user operation (slide operation for instructing the direction), the direction in which a certain character string is visually recognized, The direction in which the character string is visually recognized can be appropriately designated in the direction desired by the user.

  Based on a series or integrated operation (sliding operation for instructing the direction) by the user, the conversion of the first character string is instructed and the positional relationship between the first viewing angle direction and the second viewing angle direction is designated. Therefore, the user can easily perform both the conversion instruction and the viewing angle direction designation.

  Since the second character string is output by voice, the user can listen to the converted character string by voice in addition to the confirmation on the display unit 16.

  When the first character string is translated into the second character string in accordance with the translation instruction, the first character string is visually recognized from the first viewing angle direction with respect to the display unit 16 and the second character from the second viewing angle direction. Since the first character string and the second character string are displayed on the display unit 16 at the same time so that the column is visually recognized, for example, when Mr. A visually recognizes a certain character string from a certain viewing angle direction, Mr. B can visually recognize the subsequent character string from a different viewing angle direction, and the user can change the viewing position (just change the viewing angle direction), The character strings can be visually recognized, and furthermore, the display can be appropriately controlled without impairing the convenience of the user, such as without reducing the display area of each character string. It will be rich.

  In the translation process B shown in the above-described embodiment, the first viewing angle direction and the second viewing angle direction are determined based on the user operation (direction instruction operation), and the character string is based on the viewing angle direction. However, the viewing angle direction is fixed to a predetermined direction (vertical direction of the display unit 16), and the display direction of the character string is fixed to a predetermined direction (forward direction or reverse direction). It may be.

FIG. 10 is a diagram for explaining a modification of the embodiment.
That is, when the user who sees the original sentence and the user who sees the translated sentence are facing each other and looking at the display unit 16, the translation process B in the case where the viewing angle direction and the display direction of the character string are fixed in a predetermined direction (FIG. 4). It is a flowchart for explaining step B6) in detail.
First, the central control unit 11 determines the first viewing angle direction as the direction below the display unit 16 and the second viewing angle direction as the direction above the display unit 16 (step F1). Then, the display direction of the original text is determined to be the forward direction (character top is up, the ground is down), and the display direction of the translation is reverse (character top is down, the ground is up) (step F2). Then, the translation dictionary database storage unit M4 is referred to, a translation process is performed on the original sentence (first character string) to be translated (step F3), and a translation sentence (second character string) as a translation result is generated (step F4). ).

  Then, after the above-described parallax barrier is generated on the surface of the display unit 16 (step F5), the original sentence and the translated sentence are simultaneously displayed on the display unit 16 (step F6). At that time, due to the effect of the parallax barrier, the original text and the translated text are displayed in the determined display directions so that the original text is visually recognized from the first viewing angle direction and the translated text is visually recognized from the second viewing angle direction. 16 are displayed simultaneously. Then, the translated sentence is converted into voice data (step F7), and the voice is output from the sound speaker 20A (step F8).

FIG. 11 is a diagram for specifically explaining a modification of the above-described embodiment.
FIG. 11 (1) shows that the user viewing the original text is on the lower side (front side) in the state where “How are you?” Is displayed on the display unit (touch screen) 16 as the original text (character string) to be translated. ) From the position (first viewing angle direction), the other user (the partner user who wants to see the translation) sees the display content of the display unit 16 from the upper (back side) position (second viewing angle direction) in the figure. Shows the case. FIG. 11 (2) shows that when the user who sees the original sentence and the user who sees the translated sentence face each other and looks at the display unit 16 as described above, the display direction of the original sentence is set as the forward direction. This is a case where the display unit 16 simultaneously displays the reverse direction. As described above, in the translation process B, even if the viewing angle direction and the display direction of the character string are fixed in a predetermined direction, the same effect as that of the above-described embodiment is obtained.

  Further, in the translation process B shown in the above-described embodiment, the first viewing angle direction and the second viewing angle direction are determined based on the user operation (direction instruction operation). The viewing angle direction may be determined by analyzing the captured image. In this case, the number of users may be three or more.

FIG. 12 is a diagram for explaining another modified example of the embodiment. Translation processing B in the case where the viewing angle direction is determined by analyzing the image captured by the imaging unit 21 (step B6 in FIG. 4). Is a flowchart for explaining in detail.
First, the central control unit 11 activates the image capturing unit 21 to capture a captured image from the image capturing unit 21 (step G1), and counts how many persons are captured while analyzing the captured image to display the display unit 16. The number of viewing users P is detected (step G2). Then, the entire viewing angle of the display unit 16 is divided based on the number of users P, and the first viewing angle direction, the second viewing angle direction, and the P (P = 3) viewing angle direction are sequentially displayed from the left side of FIG. Determine (step G3). In this case, the viewing angle direction of the main user may be increased without being limited to the equal division, and the viewing angle direction may be determined according to the position of the user's face.

  Based on the first viewing angle direction to the Pth viewing angle direction thus determined, the display direction of the original sentence and the display direction of the translated sentence are determined (step G4). That is, as described above, when the first viewing angle direction and the second viewing angle direction are in a left-right relationship, the user who sees the original sentence and the user who sees the translated sentence look at the display unit 16 in a horizontal row. The original text display direction and the translation text display direction are determined to be the same forward direction (the top of the character is up and the ground is down), but the first viewing angle direction is down and the second viewing angle direction is Is the above relationship, it is determined that the user who sees the original sentence and the user who sees the translated sentence face each other and looks at the display unit 16, and the display direction of the original sentence is the forward direction, the display direction of the translated sentence Is determined as the reverse direction (the celestial character is down and the ground is up).

  Then, the translation dictionary database storage unit M4 is referred to, a translation process is performed on the original sentence to be translated (step G5), and a translation sentence of the translation result is generated (step G6). Also in this case, translation processing and translation sentence generation may be requested to the translation apparatus / conversion apparatus 4 side, and the translation sentence generated on the translation apparatus / conversion apparatus 4 side may be received. Then, after the above-described parallax barrier is generated on the surface of the display unit 16 (step G7), the original sentence and the translated sentence are simultaneously displayed on the display unit 16 (step G8). At that time, due to the effect of the parallax barrier, the original text and the translated text are displayed in the determined display directions so that the original text is visually recognized from the first viewing angle direction and the translated text is visually recognized from the second viewing angle direction. 16 are displayed simultaneously. Then, the translated sentence is converted into voice data (step G9), and the voice is output from the sound speaker 20A (step G10).

  As described above, in the translation processing B, even if the viewing angle direction is determined by analyzing the image captured by the imaging unit 21, the same effect as that of the above-described embodiment is obtained.

  In the above-described embodiment, when the second character string as the conversion result is displayed on the display unit 16, the second character string is viewed from the second viewing angle direction. However, the first viewing angle direction and the second viewing angle are displayed. You may make it control the display part 16 so that a 2nd character string is visually recognized from both corner directions. For example, in the example of FIG. 8, the case where the main user views the original sentence and the case where another user views the translated sentence is shown, but the translated sentence may be visually recognized on the main user side. In this case, the translated sentence may be visually recognized together with the original sentence by the main user, but the translated sentence may be visually recognized instead of the original sentence. This is the same even in the case of the conversion shown in FIG.

  In this way, if the display unit 16 is controlled so that the second character string is visually recognized from both the first viewing angle direction and the second viewing angle direction, the user is converted from different viewing angle directions. Can be visually recognized.

  In the above-described embodiment, when the conversion instruction operation and the direction specifying operation are performed, the display unit (touch screen) 16 is slid. However, the conversion instruction operation and the direction specifying operation are the slide operations. Not limited to, for example, an operation that uses a key, a touch operation of another aspect such as a double touch operation, and the operation that designates conversion and an operation that specifies a direction are integrated or a series of operations. Also good.

  In the embodiment described above, the case of Japanese to English has been exemplified as the translation. However, the present invention is not limited to this, and any translation from one arbitrary language to another arbitrary language may be used. In the above-described embodiment, the case where kana characters are converted to kanji is exemplified as the conversion. However, the present invention is not limited to this, and any conversion from any arbitrary character type to any other character type may be used.

  In the above-described embodiment, the display unit 16 is a display unit provided in the terminal device, but may be any external display device such as an external monitor. In addition, the terminal device is not limited to a mobile phone, and may be any terminal device such as a personal computer, a PDA, a digital camera, or a music player. Furthermore, it is not limited to a straight type terminal device, but may be an arbitrary housing structure such as a folding type, a slide type, or a spin top type.

  Further, the “device” and “machine” shown in the above-described embodiments may be separated into a plurality of cases according to function, and are not limited to a single case. In addition, each step described in the above-described flowchart is not limited to time-series processing, and a plurality of steps may be processed in parallel or separately.

DESCRIPTION OF SYMBOLS 1 Cellular phone 2 Wireless communication network 3 Internet 4 Translation device / conversion device 11 Central control unit 13 Storage unit 16 Display unit (touch screen)
17 Parallax Barrier Control Unit 18 Operation Unit 21 Imaging Unit M1 Program Storage Unit M2 Various Information Temporary Storage Unit M3 Original Text Storage Unit M4 Translation Dictionary Database Storage Unit M5 Conversion Dictionary Database Storage Unit

Claims (11)

A terminal device for controlling the display unit,
An instruction means for instructing conversion of the first character string based on a user operation on the first character string;
In response to a conversion instruction by the instruction means, an acquisition means for acquiring a conversion result obtained by converting the first character string into a second character string;
First display control for controlling the display unit so that the second character string is visually recognized from both a first viewing angle direction with respect to the display unit and a second viewing angle direction different from the first viewing angle direction. When, wherein the first viewing angle direction together with the first character string is viewed, before Symbol second display control for controlling the display unit so that the second string is viewed from the second viewing angle direction Display control means for controlling switching based on a series or integral operation by a user accompanying a user operation instructing conversion of the first character string ;
A terminal device comprising: The instruction means is means for instructing translation of the first character string into a different language,
The acquisition means acquires a translation result obtained by translating the first character string into the second character string described in a language different from the language of the first character string.
The terminal device according to claim 1, which is configured as described above. The instruction means is means for instructing conversion of the first character string into a different character type,
The acquisition means acquires a conversion result obtained by converting the first character string into the second character string described in a character type different from the character type of the first character string.
The terminal device according to claim 1, which is configured as described above. Further comprising designation means for designating a positional relationship between the first viewing angle direction and the second viewing angle direction;
Before Symbol Table示制control means is in said second display control, on the basis of the specified positional relationship by the specified means, together with the first character string from said first viewing angle direction is viewed, the second Controlling the display unit so that the second character string is visually recognized from a viewing angle direction;
The terminal device according to claim 1, which is configured as described above. Imaging means for imaging a user looking at the display unit;
Detecting means for detecting the position of the user based on the user imaged by the imaging means;
Further comprising
The designation means designates a positional relationship between the first viewing angle direction and the second viewing angle direction based on the position of the user detected by the detection means;
The terminal device according to claim 4, which is configured as described above. The designation means designates a positional relationship between the first viewing angle direction and the second viewing angle direction based on a user operation on the first character string ;
The terminal device according to claim 4, which is configured as described above. The instructing unit instructs the conversion of the first character string based on a user operation for instructing the conversion of the first character string,
The designation means designates a positional relationship between the first viewing angle direction and the second viewing angle direction based on a series or integral operation by a user accompanying a user operation instructing conversion of the first character string .
The terminal device according to claim 6, which is configured as described above. Voice output means for outputting the second character string acquired as a conversion result by the acquisition means by voice;
The terminal device according to claim 1, which is configured as described above. A terminal device for controlling the display unit,
Instruction means for instructing the translation of the first character string based on a user operation on the first character string described in the first language;
An obtaining means for obtaining a translation result obtained by translating the first character string into a second character string described in a second language different from the first language in response to a translation instruction by the instruction means;
First display control for controlling the display unit so that the second character string is visually recognized from both a first viewing angle direction with respect to the display unit and a second viewing angle direction different from the first viewing angle direction. If, with the previous SL the first character string from the first viewing angle direction is viewed, and a second display control to control so that the second character string from the second viewing angle direction is viewed, Display control means for controlling switching based on a series or integral operation by a user accompanying a user operation instructing translation of the first character string ;
A terminal device comprising: Against the computer,
A function for instructing conversion of the first character string based on a user operation on the first character string;
In response to the conversion instruction, a function of acquiring a conversion result obtained by converting the first character string into a second character string;
First display control for controlling the display unit so that the second character string is visually recognized from both a first viewing angle direction with respect to the display unit and a second viewing angle direction different from the first viewing angle direction. When, wherein the first viewing angle direction together with the first character string is viewed, before Symbol second display control for controlling the display unit so that the second string is viewed from the second viewing angle direction And a function of controlling the switching so as to be switchable based on a series or integral operation by a user accompanying a user operation instructing conversion of the first character string ;
A program to realize Against the computer,
A function for instructing translation of the first character string based on a user operation on the first character string described in the first language;
In response to the translation instruction, a function of acquiring a translation result obtained by translating the first character string into a second character string described in a second language different from the first language;
First display control for controlling the display unit so that the second character string is visually recognized from both a first viewing angle direction with respect to the display unit and a second viewing angle direction different from the first viewing angle direction. When, wherein the first viewing angle direction together with the first character string is viewed, before Symbol second display control for controlling the display unit so that the second string is viewed from the second viewing angle direction And a function for controlling the switching based on a series or integral operation by a user accompanying a user operation for instructing translation of the first character string ;
A program to realize

Images