WO2015045679A1

WO2015045679A1 - Information device and control program

Info

Publication number: WO2015045679A1
Application number: PCT/JP2014/071715
Authority: WO
Inventors: 健文大塚
Original assignee: シャープ株式会社
Priority date: 2013-09-25
Filing date: 2014-08-20
Publication date: 2015-04-02
Also published as: JP2015064781A

Abstract

This smartphone (1) is provided with the following: an angle correction unit (23) that generates a second target image by rotating, in accordance with an input operation performed by a user, a first target image that contains text to be translated; an OCR unit (24) that recognizes the text in the second target image; and a translation unit (25) that generates a translation result from the text that was successfully recognized by the OCR unit (24) and generates a display image comprising said translation result superimposed onto the part of the second target image that was translated.

Description

Information equipment and control program

The present invention relates to information equipment.

Currently, OCR (Optical Character Recognition) technology is applied to various information devices such as image scanners, PCs (Personal Computers), and smartphones.

In particular, in recent years, OCR processing technology has been applied to an application for a smartphone called Word Lens of Quest Visual. Word Lens says that the result of translating characters obtained by OCR processing is displayed in the preview image of the camera application by performing OCR processing on the image generated by the camera of the smartphone shooting the subject. It has a function.

By the way, when the image to be subjected to the OCR process is tilted (that is, when the image is not upright), the accuracy of the OCR process is reduced, and the characters included in the image are not recognized correctly. There is a problem. Patent Document 1 discloses a method for improving the accuracy of OCR processing by automatically correcting the rotation angle (tilt angle) of an image.

Japanese Patent Publication “JP 2005-196563 A (published July 21, 2005)”

In the method of Patent Document 1, a rectangle including characters in an image is automatically extracted prior to calculation of the rotation angle of the image. Therefore, when the rotation angle of the image is a certain value or more, the rectangle is not properly extracted, and the correction of the rotation angle of the image for improving the accuracy of the OCR processing cannot be automatically performed. There was a problem.

Also, the above-mentioned Word Lens does not have a function for correcting the rotation angle of the image taken by the camera. Therefore, it is difficult for the user to shoot an upright image when there is no horizontally stable scaffold during shooting, or when the position where the subject can be shot is limited. There was a problem that OCR processing and translation processing by Word Lens were not performed properly.

The present invention has been made to solve the above problems, and an object thereof is to provide an information device capable of improving the accuracy of OCR processing and translation processing.

In order to solve the above-described problem, an information device according to an aspect of the present invention is an information device that acquires a first target image including a character to be translated and translates a character included in the first target image. An image rotating means for generating a second target image obtained by rotating the first target image in accordance with a user input operation, and the second target image as a target for character recognition processing. A character recognition unit for recognizing the included character, a translation result for the character that has been successfully recognized by the character recognition unit, as a translation target, and a display result in which the translation result is superimposed on the translation target in the second target image Translation processing means for generating an image.

According to the information device according to one aspect of the present invention, it is possible to provide an information device that can improve the accuracy of the OCR process and the translation process.

It is a block diagram which shows the structure of the smart phone which concerns on Embodiment 1 of this invention. It is a figure which shows the flow of the translation process of the smart phone which concerns on Embodiment 1 of this invention. (A)-(d) is a figure which illustrates the case where the OCR process and translation are performed with respect to the character contained in the image in the smart phone which concerns on Embodiment 1 of this invention. It is a block diagram which shows the structure of the smart phone which concerns on Embodiment 2 of this invention. It is a figure which shows the flow of the translation process of the smart phone which concerns on Embodiment 2 of this invention. It is a figure which shows another example of the flow of the translation process of the smart phone which concerns on Embodiment 2 of this invention. (A)-(b) is a figure which illustrates the case where the OCR process and translation are performed with respect to the character contained in an image in the smart phone which concerns on Embodiment 2 of this invention.

Embodiment 1
Embodiment 1 of the present invention will be described with reference to FIGS. 1 to 3 as follows.

(Configuration of smartphone 1)
FIG. 1 is a functional block diagram schematically showing the configuration of the smartphone 1 (information device) of the present embodiment. The smartphone 1 includes a touch panel 10, a main control unit 20, a photographing unit 30, and a storage unit 40.

The touch panel 10 is, for example, a capacitive touch panel, and includes a display unit 11 and an input unit 12 (input surface). The display unit 11 is, for example, a liquid crystal display. The input unit 12 is a user interface that accepts an input operation by the user, and is arranged at a position overlapping the display screen of the display unit 11. Therefore, the input unit 12 can detect an input operation on the display screen of the display unit 11.

The input unit 12 mainly receives an input signal (for example, a signal indicating a change in capacitance and a change in capacitance) indicating that a touch input by a finger (or a touch pen or the like) has been performed. This is given to the input position detection unit 22 provided in the control unit 20.

The photographing unit 30 is, for example, a main camera provided on the surface opposite to the surface on which the display unit 11 is disposed (that is, the back surface of the smartphone 1). The photographing unit 30 gives an image generated by photographing a subject to the image acquisition unit 21 included in the main control unit 20. The storage unit 40 is a storage device that stores various data used in the smartphone 1.

The main control unit 20 comprehensively controls operations of various hardware (for example, the touch panel 10 and the photographing unit 30) included in the smartphone 1 and functions of the smartphone 1. The main control unit 20 includes an image acquisition unit 21, an input position detection unit 22, an angle correction unit 23 (image rotation unit and rotation button display unit), an OCR processing unit 24 (character recognition unit), and a translation process described below. It functions as a section 25 (translation processing means).

The image acquisition unit 21 displays the image from the photographing unit 30 on the display unit 11. Note that the image acquisition unit 21 can also cause the display unit 11 to display an image currently captured by the imaging unit 30 as a preview image of the camera application (see FIG. 3A described later).

The input position detection unit 22 detects an input position that is a position where an input from the user to the input unit 12 is given based on an input signal from the input unit 12. Various buttons (or icons) are displayed on the display unit 11 as an input operation target by the user, and the user responds to the button via the input position detection unit 22 by tapping each button. The attached operation can be performed by the smartphone 1. Further, the user can cause the smartphone 1 to perform various predetermined operations via the input position detection unit 22 not only by tapping a button but also by a drag operation or the like on the input unit 12.

The angle correction unit 23 (image rotation means) has a function of rotating (rotating) the image displayed on the display unit 11 and adjusting (correcting) the rotation angle of the image. The angle correction unit 23 (rotation button display means) causes the display unit 11 to display a “left rotation” or “right rotation” button (rotation button). When the user taps the rotation button displayed on the display unit 11, processing in the angle correction unit 23 is performed.

In the present embodiment, the angle correction unit 23 is illustrated as having a function as a rotation button display unit in addition to a function as an image rotation unit. The rotation button display means may be provided separately. For example, the angle correction unit 23 may be provided with only a function as an image rotation unit, and a functional block having a function as a rotation button display unit may be separately provided in the main control unit 20.

Each time the user taps the “rotate left” button once, the angle correction unit 23 rotates the image counterclockwise by 1 °. Further, each time the user taps the “rotate right” button once, the angle correction unit 23 rotates the image by 1 ° in the clockwise direction (see FIG. 3C described later).

In addition, the rotation angle of the image every time the rotation button is tapped is not limited to 1 °, and may be another appropriate value (for example, 5 °) according to the specification of the smartphone 1. Further, the rotation center position (rotation center position) of the image is, for example, the center position of the display unit 11. It should be noted that the center position of the image rotation may be a predetermined position other than the center position of the display unit 11, and the coordinates indicating the center position of the image rotation may be given to the angle correction unit 23 in advance. .

Then, the angle correction unit 23 causes the display unit 11 to display the rotated image. The angle correction unit 23 gives the rotated image to the OCR processing unit 24. When the angle correction unit 23 does not rotate the image, the image acquired by the image acquisition unit 21 from the photographing unit 30 is directly supplied from the angle correction unit 23 to the OCR processing unit 24.

The OCR processing unit 24 performs OCR processing (character recognition processing) on the image displayed on the display unit 11. That is, the OCR processing unit 24 converts characters included in the image into character codes that can be processed by a computer. Then, the OCR processing unit 24 gives the character code obtained as a result of the OCR process and the coordinates of the character in the image corresponding to the character code to the translation processing unit 25.

Note that, in the OCR processing unit 24, the image to be subjected to the OCR processing may be an image after the rotation in the angle correction unit 23 (second target image) or in the angle correction unit 23. It may be an image before the rotation (first target image).

The translation processing unit 25 has a function of translating a character code of a source language (for example, English) into a predetermined target language (for example, Japanese). The translation processing unit 25 performs the above-described translation by referring to dictionary data (bilingual dictionary data in which the meaning of each word in the source language is indicated by the target language) recorded in the storage unit 40 in advance. .

The translation processing unit 25 translates the character code given from the OCR processing unit 24 and generates a translation result. Then, the translation processing unit 25 refers to the character coordinates in the image corresponding to the translated character code, generates a display image in which the translation result is superimposed on the character to be translated in the image, and A display image is displayed on the display unit 11. The target image on which the translation result is superimposed may be either the first target image or the second target image described above (see (b) and (d) of FIG. 3 described later).

(Flow of translation processing on smartphone 1)
FIG. 2 is a flowchart illustrating the flow of translation processing in the smartphone 1. The user activates the photographing unit 30 by performing an input operation on the smartphone 1, and starts photographing the subject by the photographing unit 30 (S1). The image acquisition unit 21 acquires an image generated by the shooting unit 30 shooting a subject (S2), and causes the display unit 11 to display the image.

The OCR processing unit 24 performs an OCR process on the image displayed on the display unit 11 (S3), and converts characters included in the image into a character code that can be processed by a computer. The translation processing unit 25 translates the character code and generates a translation result (S4).

Then, the translation processing unit 25 causes the display unit 11 to display the translation result on the character to be translated in the image. That is, the translation processing unit 25 displays the generated display image on the display unit 11 (S5). The angle correction unit 23 checks whether or not the user has tapped the rotation button (“left rotation” or “right rotation” button) displayed on the display unit 11 (process S6).

When the user taps the rotation button displayed on the display unit 11 (YES in S6), the angle correction unit 23 moves in the direction of the rotation button (the “left rotation” or “right rotation” button) tapped by the user. Accordingly, each time the user taps the rotation button once, the image is rotated by a predetermined angle (for example, 1 °) in a predetermined direction (counterclockwise or clockwise) (S7). Then, the process returns to the process S3, and the processes S3 to S6 are repeated.

On the other hand, when the user does not tap the rotation button displayed on the display unit 11 (NO in S6), the image is not rotated, and the translation result displayed in the process S5 is continuously displayed on the display unit 11. Is displayed.

(Effect of smartphone 1)
The effect of the smartphone 1 will be described with reference to FIG. FIGS. 3A to 3D show that the smartphone 1 performs OCR processing and translation on the English character “Chapter 1 This is a pen. How are you?” Included in the image of the subject. It is a figure which illustrates the case where it was performed. FIG. 3A is a diagram illustrating a point in time when the image of the subject currently captured by the image capturing unit 30 is displayed on the display unit 11 as a preview image of the camera application.

FIG. 3B is a diagram illustrating a case where OCR processing and translation are performed on an image generated when the photographing unit 30 photographs a subject. In FIG. 6B, since the image to be subjected to the OCR process is tilted, the accuracy of the OCR process in the OCR processing unit 24 is reduced, and all the characters included in the image are correctly recognized. Not.

In the case of FIG. 6B, the OCR processing unit 24 succeeds only in the OCR processing of “is” which is a part of English characters. For this reason, the translation processing unit 25 performs the translation process only on the English character “is” that has been successfully subjected to the OCR processing in the OCR processing unit 24, and generates the Japanese character “is” as the translation result. The Japanese character “Is” as a result of translation by the translation processing unit 25 is superimposed on the English character “is” and displayed on the display unit 11.

FIG. 3C is a diagram illustrating a point in time when the user adjusts the rotation angle of the image by tapping the “right rotation” button displayed on the display unit 11. Each time the user taps the “rotate right” button once, the image rotates 1 ° clockwise. When the user performs an operation of rotating the image an appropriate number of times, the user can manually adjust the rotation angle of the image so that the image is generally upright.

(D) of FIG. 3 is a figure which illustrates the case where an OCR process and translation are performed to the image in which the rotation angle was adjusted. In FIG. 3D, since the image to be subjected to the OCR processing is generally upright, the accuracy of the OCR processing does not decrease, and all characters included in the image are correctly recognized. Yes. For this reason, all of the above-mentioned English characters are subjected to OCR processing, and the Japanese character “Chapter 1 This is a pen?” Is superimposed on the above-mentioned English characters as a translation result and displayed on the display unit 11. It is displayed.

Therefore, even when the user cannot take an upright image, he / she taps the rotation button until an appropriate translation result is obtained while confirming the translation result displayed on the display unit 11. The rotation angle of the image can be adjusted by an angle (for example, 1 °). Therefore, according to the smartphone 1, the convenience of the operation by the user for adjusting the rotation angle of the image is improved.

[Embodiment 2]
The following will describe another embodiment of the present invention with reference to FIGS. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted.

(Configuration of smartphone 2)
FIG. 4 is a functional block diagram schematically showing the configuration of the smartphone 2 (information device) of the present embodiment. The smartphone 2 is obtained by replacing the main control unit 20 included in the smartphone 1 of the first embodiment with the main control unit 26. The main control unit 26 of the present embodiment is the same as the main control unit 20 of the first embodiment except that (i) a rotation center setting unit 27 (rotation center calculation means) is further added, and (ii) the angle correction unit 23 is It is replaced by the angle correction unit 28 (image rotation means).

The rotation center setting unit 27 has a function of setting a rotation center position prior to image rotation processing in an angle correction unit 28 described later. The rotation center setting unit 27 acquires two input positions from the input position detection unit 22 and detects that the user is placing two fingers on the input unit 12.

The rotation center setting unit 27 sets the midpoints of the two input positions corresponding to the positions of the two fingers at the time when the user places the two fingers on the input unit 12 as the rotation center position ( (Rotation center position). Also. The rotation center setting unit 27 sets a predetermined position such as the center position of the display unit 11 (that is, the image rotation center position similar to the angle correction unit 23 of the first embodiment) as the image rotation center position. May be.

The rotation center setting unit 27 gives coordinates indicating the rotation center position of the image to the angle correction unit 28. Prior to the processing of the rotation center setting unit 27, the rotation center setting unit 27 determines which of the midpoints of the two input positions or the center position of the display unit 11 is set as the rotation center position of the image. The user can arbitrarily set.

The angle correction unit 28 of the present embodiment has a function of rotating the image displayed on the display unit 11 and adjusting the rotation angle of the image, like the angle correction unit 23 of the first embodiment. However, the angle correction unit 28 of the present embodiment is different from the angle correction unit 23 of the first embodiment in the interface for accepting the user's input operation. In the present embodiment, after the user puts two fingers on the input unit 12, the angle correction unit 28 performs processing by rotating the two fingers on the input unit 12.

The angle correction unit 28 refers to the temporal change in the two input positions acquired from the input position detection unit 22 and detects that the two input positions are rotating, so that the user holds two fingers. Recognize that an operation of rotating counterclockwise or clockwise is performed.

When the user rotates the two fingers counterclockwise, the angle correction unit 28 rotates the image counterclockwise. When the user rotates two fingers in the clockwise direction, the angle correction unit 28 rotates the image in the clockwise direction (see FIG. 7A described later).

Here, the rotation center position of the image is a position set in the rotation center setting unit 27. Note that the rotation angle of the image in the angle correction unit 28 is determined as an amount proportional to the angle at which the user has rotated the two fingers (that is, the rotation angle of the two input positions). For example, when the user rotates two fingers by 60 °, the angle correction unit 28 rotates the image by 30 °. The proportionality constant between the rotation angle of the two fingers of the user and the rotation angle of the image in the angle correction unit 28 may be set as appropriate according to the specifications of the smartphone 2.

Then, the angle correction unit 28 displays the rotated image on the display unit 11 and gives it to the OCR processing unit 24 as with the angle correction unit 23 of the first embodiment. Note that a rotation button of “left rotation” or “right rotation” may be displayed on the display unit 11, and the angle correction unit 28 of the present embodiment may be further provided with the same function as the angle correction unit 23 of the first embodiment. Good.

Further, when the smartphone 2 is configured to set a predetermined position such as the center position of the display unit 11 as the center position of image rotation, the rotation center setting unit 27 is excluded and the angle correction unit 28 receives the image. The coordinates of the center position of the rotation may be given in advance.

(Flow of translation processing on smartphone 2: Part 1)
FIG. 5 is a flowchart illustrating the flow of translation processing in the smartphone 2. Processes S11 to S18 in FIG. 5 exemplify the process flow when the center position of the display unit 11 is set as the center position of image rotation. Note that the processes S11 to S15 in FIG. 5 are the same as the processes S1 to S5 in FIG. Therefore, only the processes S16 to S18 in FIG. 5 and the processes before and after that will be described.

After the process S15, the rotation center setting unit 27 acquires the input position from the input position detection unit 22, and determines whether or not the two input positions are on the input unit 12 (process S16). When the rotation center setting unit 27 determines that the two input positions are on the input unit 12 (YES in S16), the rotation center setting unit 27 further refers to temporal changes in the two input positions. Then, it is determined whether or not the two input positions are rotating (processing S17).

When it is determined that the two input positions are rotating (YES in S17), the rotation center setting unit 27 sets the center position of the display unit 11 as the rotation center position of the image. Then, the angle correction unit 28 rotates the image by an angle proportional to the rotation angle of the two input positions according to the rotation direction of the two input positions, with the center position of the display unit 11 as the center position of the image rotation. (Process S18). Then, the process returns to the process S13, and the processes S13 to S16 are repeated.

On the other hand, when rotation center setting unit 27 determines that the two input positions are not on input unit 12 (NO in S16), rotation center setting unit 27 determines that the two input positions are not rotating. If it has been (NO in S17), the image is not rotated, and the translation result displayed in the process S15 is continuously displayed on the display unit 11.

(Flow of translation processing on smartphone 2: Part 2)
FIG. 6 is a flowchart illustrating the flow of translation processing in the smartphone 2. Processes S21 to S28 in FIG. 6 exemplify a process flow in the case where the midpoint between the two input positions is set as the rotation center position of the image. Note that the processes S21 to S27 in FIG. 6 are the same as the processes S11 to S17 in FIG. Therefore, only the process S28 in FIG. 6 and the processes before and after that will be described.

When it is determined that the two input positions are rotating (YES in S27), the rotation center setting unit 27 sets the middle point of the two input positions as the rotation center position of the image. Then, the angle correction unit 28 rotates the image by an angle proportional to the rotation angle of the two input positions according to the rotation direction of the two input positions, with the middle point of the two input positions as the center position of the rotation of the images. (Step S28). Then, the process returns to the process S23, and the processes S23 to S26 are repeated.

(Effect of smartphone 2)
The effect of the smartphone 2 will be described with reference to FIG. FIGS. 7A and 7B show a case where the OCR process and the translation are performed on the English characters included in the image in which the subject is photographed in the smartphone 2 as in FIG. 3 described above. It is a figure illustrated.

FIG. 7A is a diagram corresponding to FIG. 3C, and the user performs an operation of rotating two fingers clockwise on the input unit 12 to change the rotation angle of the image. It is a figure which illustrates the time of adjusting. The clockwise rotation angle of the image is determined in proportion to the angle at which the user has rotated two fingers in the clockwise direction. When the user performs an operation of rotating two fingers in an appropriate direction and by an appropriate angle, the user can manually adjust the rotation angle of the image so that the image is almost upright.

(B) in FIG. 7 is a diagram similar to (d) in FIG. 3, and is a diagram illustrating a case where OCR processing and translation are performed on an image whose rotation angle has been adjusted. FIG. 7B illustrates a case where the center position of the display unit 11 is set as the center position of image rotation, as in the first embodiment. Also in FIG. 7B, as in FIG. 3D, all the English characters included in the image are subjected to OCR processing, and the translation result is superimposed on the English characters. 11 is displayed.

Therefore, even when the user cannot take an upright image, the user can adjust the rotation angle of the image manually while checking the translation result displayed on the display unit 11 to obtain an appropriate translation result. Can be obtained. In the smartphone 2, since the user can easily adjust the rotation angle of the image per operation, the convenience of the user's operation is improved.

Further, when the center position of the display unit 11 is set as the center position of the image rotation, no matter which position of the input unit 12 the user rotates two fingers, Since the translation result can be displayed at the position, the visibility of the translation result is improved.

Further, when the midpoint between the two input positions is set as the center position of the image rotation, the user can display the translation result at a desired position on the display unit 11. The degree of freedom of screen layout is improved.

In the first and second embodiments described above, the

smartphones

1 and 2 including the touch panel 10 are illustrated as an example of the information device, but the present invention is another information device that operates using the touch panel 10 as an input device ( For example, it can also be applied to a PC). Therefore, the touch panel 10 may be an external input device externally attached to the information device. The imaging unit 30 does not need to be built in the information device, and may be externally attached to the information device.

[Embodiment 3]
The control blocks (especially the main control units 20 and 26) of the

smartphones

1 and 2 may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or a CPU (Central Processing Unit) And may be realized by software.

In the latter case, the

smartphones

1 and 2 include a CPU that executes instructions of a program that is software that realizes each function, and a ROM (Read Only Memory) in which the program and various data are recorded so as to be readable by the computer (or CPU). Alternatively, a storage device (these are referred to as “recording media”), a RAM (Random Access Memory) for expanding the program, and the like are provided. And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it. As the recording medium, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

[Summary]
An information device (smart phone 1) according to aspect 1 of the present invention is an information device that acquires a first target image including characters to be translated and translates characters included in the first target image. Image rotating means (angle correction unit 23) for generating a second target image obtained by rotating the first target image in response to an input operation, and the second target image as a target for character recognition processing. A character recognition unit (OCR processing unit 24) for recognizing a character included in the character, and a translation result is generated with the character recognized by the character recognition unit as a translation target, and the translation result is translated into the second target image. Translation processing means (translation processing unit 25) for generating a display image superimposed on the object.

According to the above-described configuration, the user does not perform high-accuracy character recognition processing (i.e., an image that is not upright and inclined) due to reasons such as limited shooting conditions of the subject. Even when obtained as the first target image, the second target image (ie, the character recognition process and the subsequent translation process are appropriately performed by manually adjusting the rotation angle of the target image by its own input operation (that is, A generally upright image) can be obtained.

Therefore, the user can perform the above-described adjustment operation while confirming the display image generated in the translation processing means with a display device (for example, a touch panel of a smartphone), which is suitable for character recognition processing and subsequent translation processing. A second target image can be obtained.

Moreover, the information apparatus which concerns on aspect 2 of this invention is the rotation which is the object which performs the input operation for the touch panel (10) which receives a user's input operation in the said aspect 1, and a user to rotate the said 1st target image. Rotation button display means (angle correction unit 23) for displaying buttons on the touch panel, and the image rotation means rotates a predetermined position on the touch panel every time the user taps the rotation button once. As the position, the second target image may be generated by rotating the first target image in a predetermined direction by a predetermined angle.

According to the above configuration, the user can tap the rotation button displayed on the touch panel and obtain the second target image while rotating the first target image by a predetermined angle (for example, 1 °). The convenience of the operation by the user for adjusting the rotation angle can be improved.

The information device according to aspect 3 of the present invention is the information apparatus according to aspect 2, in which the image rotation unit is configured to perform a predetermined operation on the touch panel when the user rotates two fingers on the touch panel in a predetermined direction. The second target image may be generated by rotating the first target image in a predetermined direction by an angle proportional to the rotation angle of the two fingers with the position as the rotation center position.

According to the above configuration, since the user can easily adjust the rotation angle of the image per operation, the convenience of operation by the user can be improved. In addition, even if the user rotates two fingers at any position on the touch panel, a display image including the translation result can be displayed at a predetermined position on the touch panel (for example, a position near the center). The visibility of the translation result can be improved.

The information device according to aspect 4 of the present invention is the information apparatus according to aspect 2, in which the two input positions respectively corresponding to the positions of the two fingers at the time when the user places the two fingers on the touch panel. Rotation center calculation means (rotation center setting unit 27) for calculating a midpoint is further provided, and the image rotation means is configured such that when the user rotates the two fingers in a predetermined direction on the touch panel, The second target image may be generated by rotating the first target image in a predetermined direction by an angle proportional to the rotation angle of the two fingers with the point as the rotation center position.

According to the above configuration, similarly to the above-described aspect 3, since the user can easily adjust the rotation angle of the image per operation, the convenience of the operation by the user can be improved. Further, by setting the middle point of the two input positions as the center position of the rotation of the image, the user can display a display image including the translation result at a desired position of the display unit 11. The degree of freedom of the screen layout can be improved.

In addition, the information device according to each aspect of the present invention may be realized by a computer, and in this case, information for realizing the information device by the computer by causing the computer to operate as each unit included in the information device. An apparatus control program and a computer-readable recording medium on which the apparatus control program is recorded also fall within the scope of the present invention.

The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and can be obtained by appropriately combining technical means disclosed in different embodiments. Embodiments are also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

The present invention can be used for information equipment.

1, 2 Smartphone (information device), 10 Touch panel 23 Angle correction unit (image rotation means, rotation button display means)
24 OCR processing part (character recognition means)
25 translation processing unit (translation processing unit), 27 rotation center setting unit (rotation center calculation unit)
28 Angle correction unit (image rotation means)

Claims

An information device that acquires a first target image including characters to be translated and translates characters included in the first target image,
Image rotating means for generating a second target image obtained by rotating the first target image according to a user input operation;
Character recognition means for recognizing characters included in the second target image, with the second target image as a target of character recognition processing;
A translation processing unit that generates a translation result for a character that has been successfully recognized by the character recognition unit, and that generates a display image in which the translation result is superimposed on the translation target on the second target image. Information equipment characterized by
A touch panel that accepts user input operations;
Rotation button display means for displaying on the touch panel a rotation button that is a target for the user to perform an input operation for rotating the first target image,
The image rotation means rotates the first target image in a predetermined direction by a predetermined angle with a predetermined position of the touch panel as a rotation center position every time the user taps the rotation button once. The information device according to claim 1, wherein a second target image is generated.
The image rotation means is proportional to the rotation angle of the two fingers with the predetermined position of the touch panel as a rotation center position when the user rotates two fingers on the touch panel in a predetermined direction. The information device according to claim 2, wherein the second target image is generated by rotating the first target image in a predetermined direction by an angle.
A rotation center calculating means for calculating a midpoint between the two input positions respectively corresponding to the positions of the two fingers when the user places the two fingers on the touch panel;
When the user rotates the two fingers in a predetermined direction on the touch panel, the image rotation means has an angle proportional to the rotation angle of the two fingers with the center point as the rotation center position. The information device according to claim 2, wherein the second target image is generated by rotating the first target image in a predetermined direction.
A control program for causing a computer to function as the information device according to any one of claims 1 to 4, wherein the control program causes the computer to function as each of the above means.