JP4809462B2 - Mobile terminal device - Google Patents

Description

  The present invention relates to a mobile terminal device having a plurality of functions including an imaging function.

  Conventionally, there has been a mobile terminal device having a plurality of functions including an imaging function (see, for example, Patent Document 1).

Japanese Patent Laid-Open No. 2003-21867

  However, in such a portable terminal device, further enhancement of the photographing function has been desired.

In order to solve the above problems, the present invention has an imaging unit and a control unit that executes a shooting function for performing shooting by the imaging unit, and when the control unit executes the shooting function, Based on the image data recognized by the image processing of the image pickup unit, shooting is automatically performed when it is detected that the frame surrounding the character information attached to the shooting target is within the shooting range. It is what.

The frame surrounding the character information attached to the subject to be photographed may be a rectangular frame.
The control unit may automatically take a picture according to a camera shake state when the shooting function is executed.

  According to the mobile terminal device of the present invention, it is possible to further enhance the photographing function.

It is a figure which shows the paper instruction manual 4 which concerns on one embodiment of this invention, Comprising: It is the fragmentary top view which shows the state which opened the one page. It is an enlarged plan view which shows one of the description parts 6 for screen displays in FIG. It is a block diagram which shows the circuit structure of the mobile telephone 2 with an imaging function which concerns on one embodiment of this invention. It is a flowchart which shows the process sequence when the description part 6 for screen display in the instruction manual 4 is memorize | stored in the 1st memory | storage part 30 of the mobile telephone 2 with an imaging function. It is a figure which shows the external appearance of the mobile telephone 2 with an imaging function which concerns on one embodiment of this invention, Comprising: It is a fragmentary top view which shows the state during imaging | photography of the screen display description part.

  Hereinafter, embodiments of a mobile terminal device and an instruction manual for a mobile terminal device according to the present invention will be specifically described with reference to the drawings.

  1 to 5 illustrate a mobile phone 2 with an imaging function (corresponding to a mobile terminal device) and an instruction manual 4 (corresponding to an instruction manual for a mobile terminal device) according to an embodiment of the present invention. It is a figure referred for.

  FIG. 1 is a partial plan view showing a state in which a page on which a plurality of screen display explanation units 6 are printed (described) is opened, which is a paper instruction manual 4 according to the present embodiment. Here, as shown in FIG. 2, the screen display explanation section 6 is a function name 8 for various functions of the cellular phone 2 with an imaging function as will be described later, and an explanation of operations corresponding to this function. Is described and includes a function code 12 associated with this function.

  Each screen display explanation section 6 has its function name 8, description section 10, function code 12 and the like described in a region surrounded by a rectangular dotted frame 6a. Although not shown in the drawing, the instruction manual 4 has a plurality of screen display explanation parts 6 printed (described) for each page over the plurality of pages.

  The function code 12 of the screen display explanation unit 6 is composed of characters, graphics, or a combination thereof. As such a function code 12, for example, an alphabet or the like assigned differently for each function is rectangular. Symbols surrounded by a frame can be used.

  Further, the frame 6a of the screen display explanation unit 6 has a vertical and horizontal size ratio substantially the same as a vertical and horizontal size ratio of an image (shooting range) taken by the image pickup unit 34 of the portable terminal device 2 with an image pickup function described later. It is a dimensional ratio.

  FIG. 3 is a block diagram showing a circuit configuration of the mobile phone 2 with an imaging function according to the present embodiment. As shown in the figure, the mobile phone 2 with an imaging function includes a radio unit 20, an operation unit 22, a display unit 24, a speaker 26, a microphone 28, a first storage unit 30, a second storage unit 32, connected to an antenna. An imaging unit 34 and a control unit 36 for controlling them are provided.

  The imaging unit 34 uses an imaging element such as a CCD (Charge Coupled Device), and image data captured by the imaging unit 34 is stored in the first storage unit 30.

  In the first storage unit 30, a folder corresponding to the type of data to be stored is newly created or deleted by a user operation or a control operation of the control unit 36. Image data captured by the imaging unit 34 is stored in one of a plurality of folders in the first storage unit 30.

  In addition to the call function and the imaging function, the mobile phone with an imaging function 2 includes, for example, an e-mail transmission / reception function, an auto power on function, an auto power off function, an alarm function, a calculator function, and an instruction manual photographing function. The second storage unit 32 is identical to the function code 12 of the screen display explanation unit 6 shown in FIG. 2, which is determined in correspondence with each function of the mobile phone 2 with an imaging function. And the operation program of the mobile phone 2 with an imaging function are stored in advance.

  Here, the instruction manual photographing function refers to whether or not the image data photographed by the imaging unit 34 using the image recognition engine mounted on the mobile phone 2 with an imaging function is the data of the instruction manual. If it is determined that the image data is the data of the instruction manual, it refers to a function that stores the image data in the first storage unit 30.

  Next, based on the flowchart shown in FIG. 4, when the screen display explanation unit 6 in the instruction manual 4 shown in FIGS. 1 and 2 is stored in the first storage unit 30 of the mobile phone 2 with an imaging function. The processing procedure will be described.

  In the instruction manual 4, when the screen display explanation unit 6 describing the operation method of the function that the user has not yet learned is stored in the first storage unit 30 of the mobile phone 2 with an imaging function, The user activates the instruction manual photographing function and photographs the screen display explanation unit 6 using the imaging unit 34 (step S1 in FIG. 4).

  As shown in FIG. 5, the cellular phone 2 with an imaging function has an imaging unit (not shown) (FIG. 3) on the back surface opposite to the display surface of the display unit 24 of the housing 38 in which the display unit 24 is arranged. The image captured by the imaging unit 34 (not shown) is displayed on the display unit 24 that functions as a viewfinder.

  When the user captures a desired screen display explanation unit 6 of the instruction manual 4, the user can recognize characters and the like in the screen display explanation unit 6 displayed on the display unit 24. The shooting distance is adjusted so that the shooting is performed.

  When shooting is performed, the control unit 36 performs image processing or the like on the captured image data, and extracts the function code 12 written at a predetermined position of the screen display explanation unit 6 as the captured image data. Then, the second storage unit 32 is referred to determine whether or not the function code 12 is included in the captured image (step S2 in FIG. 4).

  When the function code 12 is detected from the captured image (YES in step S2), the control unit 36 recognizes that this image is the screen display description unit 6 and stores the image in the first storage unit 30. It is stored in a dedicated folder (step S3).

  In addition, when two or more images of the screen display explanation unit 6 are stored in the dedicated folder in the first storage unit 30 in this step S3, the control unit 36 sets the function code 12 for each. The comparison is made based on a certain rule, and the order of the screen display explanation units 6 in the dedicated folder is rearranged (same step S3). For example, when alphabets are used for the function codes 12, the screen display explanation units 6 are rearranged so that the function codes 12 are in alphabetical order.

  In step S 3, when there is no dedicated folder for storing the image of the screen display description unit 6 in the first storage unit 30, the control unit 36 stores the dedicated folder in the first storage unit 30. After the image is generated, the image of the screen display explanation unit 6 is stored in this dedicated folder.

  Further, when the control unit 36 does not detect the function code 12 from the photographed image in step S2 (NO in step S2), the control unit 36 displays the image in a folder different from the dedicated folder in the first storage unit 30. Etc. (step S4).

  As a method of using such a cellular phone 2 with an imaging function, the user performs an operation of causing the display unit 24 to display the image of the screen display explanation unit 6 stored in the dedicated folder of the first storage unit 30. In such a case, the control unit 36 causes the display unit 24 to display the image in the same state as when the screen display explanation unit 6 was photographed as shown in FIG. For this reason, even if it does not carry the instruction manual 4, it can be operated with reference to the explanation of the function of the mobile phone 2 with an imaging function that has not yet mastered the operation method.

  According to the mobile phone 2 with an imaging function and the instruction manual 4 thereof according to the present embodiment as described above, the user stores the information in the dedicated folder of the first storage unit 30 of the mobile phone 2 with the imaging function by an operation. Since the image of the screen display description unit 6 can be easily displayed on the display unit 24 in the same state as when the screen display description unit 6 is photographed as shown in FIG. Even if the mobile phone 4 is not carried, it can be operated with reference to the explanation of the functions of the mobile phone 2 with an imaging function that has not yet learned the operation method.

  Further, the frame 6a of the screen display explanation unit 6 of the instruction manual 4 has a vertical / horizontal dimension ratio of a vertical / horizontal dimension ratio of an image (shooting range) photographed by the imaging unit 34 of the mobile phone 2 with an imaging function. Since the ratios are almost the same, as shown in FIG. 5, the entire screen display explanation unit 6 can be photographed in a state where it is just within the photographing range of the imaging unit 34. When the image of the screen display description unit 6 is referred to later, the image of the screen display description unit 6 can be displayed large on the display unit 24 for easy viewing.

  Further, even in the conventional mobile terminal device with an imaging function, the user personally shoots the description in the instruction manual so that the captured image is stored in the storage unit in the mobile terminal device with the imaging function. Although it could be stored, there was a problem that the stored image could not be organized.

  On the other hand, according to the mobile phone 2 with the imaging function and the instruction manual thereof according to the present embodiment, the captured image of the screen display explanation unit 6 is the first storage unit of the mobile phone 2 with the imaging function. Since it is organized by being centrally stored in the 30 dedicated folders, it is possible to search for images of the screen display explanation unit 6 stored in the dedicated folder of the first storage unit 30. Management can be facilitated.

  In addition, the images of the screen display explanation unit 6 stored in the dedicated folder of the first storage unit 30 of the imaging function mobile phone 2 are arranged based on the function code 12, so that, for example, By the operation, the image of the screen display explanation unit 6 can be switched and displayed in the same order as described in the paper instruction manual 4 on the display unit 24. The search and management of the image of the screen display explanation unit 6 stored in the dedicated folder of the unit 30 is facilitated.

  In the present embodiment, as shown in FIGS. 1 and 2, the function name 8 is included in the screen display explanation unit 6, but the screen display explanation unit 6 includes the function name 8. It may be configured not to be included.

  In such a case, the function name corresponding to the function code 12 is stored in advance in the form of a table together with the function code 12 in the second storage unit 32 of the mobile phone 2 with an imaging function. At the same time, an operation was performed to display on the display unit 24 the image of the screen display explanation unit 6 that is captured and stored in the dedicated folder of the first storage unit 30 and does not include the function name 8. Sometimes, the control unit 36 extracts the name of the function corresponding to the function code 12 of the screen display explanation unit 6 from the second storage unit 32 and displays it in the display unit 24 together. Also good.

  Further, in the present embodiment, as shown in FIG. 2, as the function code 12, a symbol in which an alphabet and a rectangular frame figure are combined is used, but other types of characters, figures, and the like are used. It may be used and configured. For example, a bar code or the like may be used as the function code 12.

  In the present embodiment, the function code 12 is assigned a different symbol for each type of function. However, the same symbol may be assigned regardless of the type of function. In such a case, unlike the present embodiment, the control unit 36 rearranges the order of the screen display explanation units 6 in the dedicated folder based on the function code 12 in step S3 in FIG. Don't do it.

  In the present embodiment, the first storage unit 30 and the second storage unit 32 are provided. However, a single storage unit in which these are integrated may be provided. In such a case, an area corresponding to each of the first storage unit 30 and the second storage unit 32 in the present embodiment is allocated in this integrated storage unit. Needless to say.

  In the present embodiment, based on whether or not the function code 12 is included in the image captured by the imaging unit 34, the control unit 36 determines whether or not this image is the screen display explanation unit 6. At the same time (step S2 in FIG. 4), when this image is the screen display explanation unit 6, the image of this screen display explanation unit 6 is stored in a dedicated folder in the first storage unit 30. However (step S3 in FIG. 4), it is not necessarily stored in the dedicated folder.

  In another embodiment different from the present embodiment, the control unit 36 has the screen display explanation unit 6 in the shooting range of the imaging unit 34 only during the operation of the instruction manual shooting mode. It may be configured to detect that the image has been received or to have no camera shake by image processing or the like, and control to automatically shoot.

  Further, in the present embodiment, the case where the present invention is applied to the mobile phone 2 with an imaging function has been described. However, a portable imaging device, a PHS (Personal Handyphone System), and a PDA (Personal Digital Assistant) It goes without saying that the present invention can also be applied to such other portable terminal devices with an imaging function.

DESCRIPTION OF SYMBOLS 2 Mobile phone with an imaging function 4 Instruction manual 6 Screen display description part 6a Frame 8 Function name 10 Description part 12 Function code 20 Radio part 22 Operation part 24 Display part 26 Speaker 28 Microphone 30 First storage part 32 Second memory Unit 34 imaging unit 36 control unit 38 housing

Claims (3)

An imaging unit;
A control unit that executes a shooting function of shooting by the imaging unit,
When the control unit executes the shooting function , a frame surrounding the character information attached to the shooting target is within the shooting range based on the image data recognized by the image processing of the imaging unit. A mobile terminal device that automatically takes a picture when an image is detected. The mobile terminal device according to claim 1, wherein the frame surrounding the character information attached to the object to be photographed is a rectangular frame.   3. The mobile terminal device according to claim 1, wherein the control unit automatically performs shooting according to a camera shake state when the shooting function is executed. 4.