JP2007259500A - Portable terminal device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a portable terminal device that can correctly read codes, using simple operations. <P>SOLUTION: A cellular telephone 10 with camera includes a camera 12 that inputs target image information, a small-sized light 13 that emits light with the operation of an ON/OFF button 21, when reading bar codes, an LCD display part 15 that displays information, and a control section 31 having a CPU that controls the entire device. The control section 31 switches imaging procedures, according to objects such as natural images or bar codes; and when the procedures are switched to bar-code imaging, it recognizes the bar code, informs a user of a recognized result, and executes predetermined processing based on the contents recognized. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a mobile terminal device such as a digital camera or a camera-equipped mobile phone.

  In addition to the function as a so-called telephone for transmitting and receiving radio waves, a recent mobile phone having a screen display device such as a liquid crystal panel and an input device using key input can enjoy a function for exchanging mail and a game. The trend toward multi-functionality is progressing.

  In recent years, with the development of small, low power consumption image sensors, it has become possible to incorporate a camera in a portable device such as a mobile phone, and immediately send images taken by the built-in camera via e-mail. It is possible to do it. These built-in cameras are prioritized to be small, and have a lower resolution than general digital cameras.

  Moreover, recent cellular phones have a function of connecting to the Internet. In order to connect to the Internet, it is necessary to input a URL (Uniform Resource Locator) from the key, and it has been troublesome to enter a long URL with the key of the mobile phone. Therefore, an attempt is made to manage the URL with a unique number and read the printed barcode corresponding to the number with a barcode reader, thereby saving the trouble of inputting the URL and improving the convenience of the user. . In such an apparatus, it is necessary to separately connect a barcode reader to the mobile phone.

  Therefore, in a portable device with a built-in camera, if a barcode can be recognized with respect to a barcode image input by the built-in camera, such a service can be used without preparing a separate barcode reader.

  For example, Japanese Patent Laid-Open No. 2002-111909 discloses an information providing service in which a photo mode and a QR code (two-dimensional code) reading mode can be selected and set, and processing according to the setting mode is performed. Japanese Patent Application Laid-Open No. 9-259215 describes a code reader that increases the reading accuracy by processing a one-dimensional code with a line CCD and processing a two-dimensional code with an area CCD. However, there is no description about the setting of the camera image capture area according to the barcode type.

  Japanese Patent Application Laid-Open No. 2001-197186 describes that a telephone number is replaced with a two-dimensional bar code and the two-dimensional bar code is read by a CCD scanner attached to the telephone.

By the way, the resolution of the current built-in camera is lower than that of the image sensor used in the barcode reader, and it is difficult to recognize the barcode with high accuracy.
Further, as a cause of difficulty in recognizing the barcode, the width of the bar photographed in the input image is not constant. This is because the distance relationship between the barcode and the camera changes each time an input is made. In a close-up type scanner, the bar code can always be entered in a certain size, so the bar width can be determined in advance, but when shooting a bar code with a camera held by hand, a constant bar The width cannot be determined in advance.

  A method has been proposed in which the width of a bar is determined from a barcode image input by an image scanner and the barcode is recognized. For example, in Japanese Patent Application Laid-Open No. 2002-176509, a barcode included in an image captured by a camera is recognized, and if the captured image can be decoded, a speaker sound is generated, and the barcode data is stored and the image is stored. An apparatus for making a display on a display unit is disclosed.

JP 2002-111909 A Japanese Patent Laid-Open No. 9-259215 JP 2001-197186 A JP 2002-176509 A

  However, such a conventional mobile terminal with a camera has the following problems.

For example, since the physical size of a code to be read differs from that of a one-dimensional code or two-dimensional code, a camera used for a camera-equipped mobile phone having a relatively low resolution is more suitable for the size of the code. There was a problem that it was necessary to select a resolution.
Also, a camera that is normally set to shoot people or landscapes is not supposed to shoot in macro mode like barcodes, and cannot shoot barcode images that are suitable for reading. There was a problem.

  Furthermore, since the angle of view of the camera is relatively narrow, there is a problem that it is difficult to fit the code to be read within the shooting range of the camera. In this case, it is necessary to perform close-up photography. At this time, there is a problem that a stable image cannot be obtained because it is easily affected by the shadow of the apparatus main body.

The present invention has been made in view of such problems, and provides a portable terminal device capable of accurately reading a code with a simple operation, an information reading program, and a recording medium on which the program is recorded. With the goal.
Another object of the present invention is to provide a portable terminal device that can easily adjust the camera opening to the subject.

  The portable terminal device of the present invention includes an imaging unit that captures an image, a shooting procedure switching unit that switches a shooting target to a barcode, a display unit that displays an image obtained by the imaging unit, and the shooting procedure switching unit. When the bar code shooting is switched by the above, code recognition means for recognizing the bar code of the captured image is provided.

  More preferably, the imaging procedure switching unit changes the image capturing area in the imaging unit according to the barcode type.

  The photographing procedure switching means can switch at least one of gradation characteristics, contrast, brightness, white balance, exposure, depth of focus, contour enhancement, and resolution between a natural image and a barcode image. More preferred.

  The photographing procedure switching means displays an image on the display means at a high frame rate obtained from the imaging means until the code recognition means is activated at the time of barcode photographing switching, and after the code recognition means is activated It is more preferable to provide a frame rate control means for displaying an image at a frame rate necessary for the code recognition means.

  Furthermore, it is more preferable to include an illuminating unit that illuminates the subject, and an illuminating switching unit that turns on / off the illuminating unit may be provided.

Furthermore, it is preferable that a notification means for notifying the result recognized by the code recognition means is provided.
The notification means may notify the recognition result by sound, voice, or message display on the display means.

  Furthermore, a timer setting unit that counts a set time may be provided, and the notification unit may notify a recognition failure when the barcode cannot be recognized within the time set by the timer setting unit.

  The imaging unit may capture moving image / still image capturing with an area-type solid-state image sensor.

ADVANTAGE OF THE INVENTION According to this invention, in portable terminal devices, such as a mobile phone with a camera, a code | cord | chord can be read correctly by simple operation.
In addition, it is possible to realize a portable terminal device that can easily adjust the opening of the camera to the subject and improve the operability and usability of code reading.

  DESCRIPTION OF EMBODIMENTS Hereinafter, preferred embodiments of a portable terminal device of the present invention will be described in detail with reference to the accompanying drawings.

First, the basic concept of the present invention will be described. The case where the mobile terminal device according to the present invention is applied to a camera-equipped mobile phone is taken as an example.
(1) This camera-equipped mobile phone incorporates a small light that can be turned ON / OFF by a user operation. When reading a code such as a two-dimensional bar code, it is turned ON / OFF by a user operation. By turning the light ON / OFF by the user's operation, even if the peripheral light amount due to the lens characteristics is reduced, even if a shadow is superimposed on the read code by the terminal body, the code can be read stably. In the mode in which the light is always turned on at the time of reading the code, there is a case where there is an adverse effect due to the specular reflection.

(2) When the camera-equipped mobile phone reads the code, the image of the code being photographed is displayed on the LCD display unit in real time. By displaying the image of the code being photographed in real time, the user can check whether the barcode is photographed correctly by the camera. As a result, it is possible to prevent the code from sticking out of the screen or to produce a greatly distorted image, and the operability is improved. Further, after reading, the reading result can be immediately displayed on the screen, so that the reading result can be instantly known. Further, when the reading is completed, the user can be notified by sounding a reading end sound “ping pong or chili ring”.

(3) The reading operation is performed continuously for each image that is continuously captured, and continues until the reading is completed. At this time, since the time required for the reading process is long, the image is taken in at most about 2 FPS (frame per second) and the display is also about 2 FPS. This makes it difficult to align the code at an appropriate position while looking at the LCD display unit. Therefore, the mobile phone with camera does not execute the code reading process until the user gives an instruction, and displays a smooth moving image on the LCD display unit. As a result, the user can adjust the code to an appropriate position. When the code is in the proper position, operate the button to execute the reading process. At this time, the display drops to about 2 FPS, but since the code has already been photographed at an appropriate position, reading can be completed immediately and there is no problem.

(4) In addition, with a normal camera-equipped mobile phone, the color and the like are adjusted so as to be natural for the purpose of photographing a person or a landscape, so that it is not suitable for code reading. . Therefore, the camera-equipped mobile phone prepares and uses a code reading mode adjusted separately from the normal mode when reading the code. For example, the white balance and exposure are adjusted so that the contrast between light and dark in the code is emphasized, the correction coefficient is adjusted so that the contour (edge part) is more emphasized, and the resolution is adjusted. Prepare a barcode reading mode. When the user designates code reading, the bar code reading mode is automatically switched to.

(5) There are types of codes to be read such as one-dimensional codes and two-dimensional codes. There is a difference in the size of printed code and the thickness of the line for each code type. Therefore, the mobile phone with the camera designates whether to read one-dimensional code or two-dimensional code, and switches the image capturing range of the camera according to the designation. Also, the magnification at the time of display is optimized.

  FIG. 1 is a diagram showing the appearance of a portable terminal device according to an embodiment of the present invention based on the above basic concept, FIG. 1 (A) is a front view thereof, and FIG. 1 (B) is a rear view thereof. . The portable terminal device according to the present embodiment is an example in which the code reader is applied to a portable communication terminal of a camera-equipped cellular phone / PHS (Personal Handy-Phone System).

  In FIG. 1, reference numeral 10 denotes a camera-equipped mobile phone (mobile terminal device). A mobile phone main body 10a includes an antenna 11 for performing wireless communication, and a camera 12 that is built in the back of the main body 10a and inputs target image information. (Imaging means), a small light 13 (illumination means) that is built in the back of the main body 10a and emits light by a user operation or the like when reading a barcode, a loudspeaker 14 (part of the notification means) for receiving a call, LCD display section 15 (display means, part of notification means) for displaying information such as guidance and reception information for operation, image and text information, power key 16 for turning on / off power, incoming call, outgoing call, telephone Phone function keys 17 for switching functions, determining operations, etc., mode keys 18 for switching various functions, and keys for moving the selection target in the vertical and horizontal directions. Solkey 19, shutter key 20 that is a shutter button for determining input of the camera 12, light ON / OFF button 21 (lighting switching means) for turning on / off the light 13, membrane key (Membrane) for dialing such as inputting a telephone number key) 22 and a microphone 23 for inputting voice.

  The camera 12 is a CCD (Charge Coupled Device) (area type solid-state imaging device) camera of, for example, 340,000 pixels built in the mobile phone 10. The camera 12 has a single focus lens, and the depth of focus can be switched between normal shooting and barcode reading. The detailed configuration will be described later with reference to FIG.

  The LCD display unit 15 includes a dot matrix LCD display, a backlight PDP, EL, and drivers. The LCD display unit 15 displays image information input from the camera 12 at the time of shooting. When the code recognition is completed, a recognition result is displayed by a message such as a character or an icon. In addition, at the time of non-photographing, a number input from the dial key 22, various screens for a non-telephone function, icons indicating an operation state of the telephone function, and the like are displayed. Furthermore, the time is displayed during standby, and personal information, system status, and the like are displayed.

  The power key 16, the telephone function key 17, the mode key 18, the cursor key 19, the shutter key 20, the light ON / OFF button 21 and the dial key 22 are all manually operated, and the operated contents are controlled by the control unit 31 ( 2) as information. In the present embodiment, the shutter key 20 and the light ON / OFF button 21 are independent keys, but the function of these keys may be assigned to another key (for example, the mode key 18).

  FIG. 2 is a block diagram when the barcode reader is incorporated in a camera-equipped mobile phone.

  In FIG. 2, a mobile phone 10 is a portable information terminal such as a PDA (Personal Digital Assistants) or a PHS / mobile phone, and includes a control unit 31 (shooting procedure switching means, code recognition means, Information processing means, frame rate control means, timer setting means), ROM for storing control programs, fixed data, etc., semiconductor memory such as RAM, which is a working storage area of the CPU, and hard disk, etc. , A storage memory 32 for storing image information and audio signals, a camera 33 (imaging means) for inputting target image information, a light 34 (illumination means) that emits light by a user operation when reading a barcode, character information and images Display unit 35 for displaying information to the user (one of display means and notification means) A key input unit 36 that inputs and generates key operation information from a user, an antenna 37 that transmits and receives radio waves, a wireless unit 38 that controls transmission and reception of wireless communications, and a speaker 39 that outputs audio signals (part of a notification unit) The microphone 40 is configured to input an audio signal from the user.

  The control unit 31 controls the entire mobile phone 10 and has a barcode reading function. Based on key operations, the controller 31 captures barcodes, displays image information, recognizes barcodes, and processes based on recognized contents. Perform.

  In particular, the control unit 31 includes a shooting procedure switching unit that switches a shooting procedure according to a subject such as a natural image or a barcode, and a code recognition unit that recognizes a barcode (code decoding) when switched to barcode shooting. , Having a function as a notification means for notifying the user of the recognized result and an information processing means for performing a predetermined process based on the recognized content.

  Further, at the time of switching the bar code shooting, an image is displayed on the display unit 35 at a high frame rate obtained from the camera 33 until the code recognition unit is activated, and after the activation, the frame rate required for the code recognition unit is set. And has a function as a frame rate control means for displaying an image. The specific contents of the above functions will be described later with reference to the flow of FIG.

  The ROM is a read-only semiconductor memory that stores fixed data such as a program and communication control data required when the control unit 31 operates. The RAM is used as a so-called working memory that temporarily stores data relating to barcode recognition and communication, data used for calculation, calculation results, and the like. A program processed by the mobile phone 10 is developed and executed in this RAM. Moreover, a part of RAM consists of EEPROM (electrically erasable programmable ROM) which is an electrically rewritable non-volatile memory, and various specifications in the mobile phone 10 can be changed by changing a program written in the EEPROM. Can do. That is, recently, in order to avoid the time loss of changing the mask ROM for each debugging of the system development, the program ROM is a non-volatile memory, for example, EPROM, EEPROM, and the time for program development / modification time is greatly reduced. . Further, if the program is downloaded and the program contents of the EEPROM are rewritten, it is possible to easily upgrade functions or change functions.

  FIG. 3 is a diagram schematically showing the lens focal depth switching mechanism of the camera 12, and shows the focal depth switching mechanism between normal photographing and barcode reading.

  In FIG. 3, a camera module 50 comprising a solid-state imaging device such as a CCD and its signal output circuit, a lens unit 52 having a lens 51 therein and screwed onto the camera module 50, and an outer periphery of the lens unit 52 And a camera lever 53 that rotates the lens unit 52.

  The lens unit 52 is fitted to the camera module 50 with a screw. When the knob 53a of the camera lever 53 is moved in the direction A ← → B in FIG. Move in the Y direction. As a result, the focal length between the lens 51 mounted on the lens unit 52 and the camera module 50 is switched, and the focal depth at the time of normal photographing and barcode reading is switched. In the present embodiment, the camera lever 53 is slid by a drive unit (not shown) made of a solenoid or the like that receives a drive signal from the control unit 31 when the barcode is read, and the depth of focus is automatically switched. Yes. The camera body 10a (FIG. 1) may be provided with a slide knob that is linked to the knob 53a of the camera lever 53 so that the user can switch manually during macro shooting such as when reading a barcode.

  The operation of the camera-equipped cellular phone configured as described above will be described below.

  FIG. 4 is a flowchart showing the barcode reading operation of the mobile phone 10 and is executed by the control unit 31. In the figure, S indicates each step of the flow.

  FIG. 5 is a diagram showing a mode selection screen display example of the LCD display unit 15 of the mobile phone 10.

  When the user presses the mode key 18 in the standby state, a mode selection screen shown in FIG. 5A is displayed. In this state, when the “bar code” is selected by the cursor key 19 and the mode key 18 or the telephone function key 17 is pressed and determined, the bar code reading mode is entered and the code type selection screen shown in FIG. 5B is displayed. .

  The flow shown in FIG. 4 is started by the user's “barcode” selection operation. First, in step S1, the barcode reading mode is set. In this barcode reading mode setting, initial settings necessary for barcode reading are performed. In this initial setting, processing other than barcode reading processing, for example, proper shooting and camera storage, schedule management processing, etc., data storage, program activation necessary for barcode reading, barcode reading shown in FIG. Switch the focal depth switching mechanism at the time.

  In step S2, the code type is determined in response to a user instruction on the code type selection screen shown in FIG. 5B. If the code type is a one-dimensional code, the process proceeds to step S3. If the code type is a two-dimensional code, the process proceeds to step S3. .

  When the barcode reading mode is set, the user selects the type of code (one-dimensional code / 2-dimensional code). As described above, there are types of codes to be read such as one-dimensional codes and two-dimensional codes, and there are differences in the size of printed codes and the thickness of lines for each code type. Therefore, the user designates whether to read the one-dimensional code or the two-dimensional code, and the image capturing range of the camera and the magnification at the time of display are optimized according to the designation.

In the case of a one-dimensional code, the camera and display settings are set to predetermined values (set value 1) in step S3.
In the case of a two-dimensional code, a value different from the set value 1 (set value 2) is set in step S4.

  FIG. 6 is a diagram for explaining that the image capturing range and the magnification at the time of display differ between the one-dimensional code and the two-dimensional code.

  As shown in FIG. 6, in the case of a one-dimensional code, the shooting range of the camera is set to 640.times.480, and the display is set so that this camera image is an equal magnification. On the other hand, in the case of a two-dimensional code, the shooting range of the camera is set to 320 × 240 in the vertical direction, and the display is set so that the camera image is doubled in the vertical and horizontal directions. In other words, in the case of a one-dimensional code, a long barcode in a one-dimensional direction with a large amount of information is included in the horizontal photographing range of the camera, and in the case of a two-dimensional code, the photographing range of the camera (camera capture range) is set. The camera image is displayed in double the vertical and horizontal directions after being halved in the vertical and horizontal directions. In addition to this, common camera settings for the one-dimensional code and the two-dimensional code include settings such as edge component enhancement and contrast enhancement.

  Returning to the flow of FIG. 4, when the camera / display setting 1 in step S3 or the camera / display setting 2 in step S4 is performed, an event wait state is entered in step S5, and processing is switched depending on each event.

  The light ON / OFF operation event occurs when the user presses the light ON / OFF button 21, and when this event is read in step S5, the process proceeds to step S6, and the light 13 is turned ON / OFF according to the setting. .

  The reading start operation event occurs when the user presses a reading start button (for example, the telephone function key 17). When this event is read in step S5, the process proceeds to step S7, and a flag indicating the start of reading is set. To do. Further, as will be described later with reference to FIG. 10, in a configuration in which a mark indicating the position of the camera 12 is displayed on the LCD display unit 15, the mark may not be displayed after the reading is started.

  The frame capture event occurs when the camera 12 reads an image for one frame and the reading is completed. When this event is read in step S5, the process proceeds to step S8, and the read image is displayed on the LCD display unit 15 according to the setting. At this time, a mark 71 (see FIG. 10) indicating the position of the camera 12 may be displayed on the LCD display unit 15 at the same time.

  In step S9, it is determined whether or not to start the reading process. If the reading start flag is set (YES in step S9), the code reading process is started in step S10. If the reading fails, the process returns to reading the event in step S5.

  In step S11, it is determined whether or not the code reading is successful. If the code reading is successful (YES in step S11), the reading result is displayed on the LCD display unit 15 in step S12, and a confirmation sound is displayed on the speaker in step S13. 14 and the code reading by this flow is completed. The user's attention is alerted by the reproduction of the confirmation sound informing the completion of reading, and the user knows that the barcode reading has been completed.

  Before starting reading, the loop surrounded by the broken line in FIG. 4 is repeated. At this time, since code reading processing is not performed, smooth display can be performed at a high frame rate.

  FIG. 7 is a diagram showing a screen display example by the barcode reading process. FIG. 7A shows a shooting screen before reading, FIG. 7B shows a shooting screen during reading, and FIG. C) shows the screens of recognition results after the reading.

  Although an example in which the recognition target pattern is a two-dimensional code will be described, the recognition target image may be a character pattern in addition to a symbol pattern such as a one-dimensional / two-dimensional barcode.

  Since smooth display can be performed at a high frame rate before reading starts, for example, as shown in FIG. 7 (A), the user can see the code protruding from the screen (shooting area) on the screen. However, the camera 12 (the main body 10a of the mobile phone) can be easily operated so that the code fits within the screen. That is, since a delay in displaying the shooting screen before reading is very small, the user can operate the code so as to fit the code within the screen while looking at the screen. Then, as shown in FIG. 7B, the user performs a reading start operation when the code is placed on the screen, and then the reading result is displayed (see FIG. 7C).

  FIG. 8 is a diagram showing a screen display example by the barcode reading process. FIG. 8A shows a shooting screen before reading, FIG. 8B shows a shooting screen during reading, and FIG. C) shows the screens of recognition results after the reading.

  Further, as shown in FIG. 8A, when a part of the image is dark due to a shadow or the like, it is difficult to read the code. In the code reading, the camera 12 (the main body 10a of the mobile phone) is photographed by taking a close-up image of the reading code.

  In the present embodiment, the user can check the current input image by checking the screen, so if the code shown in FIG. 8A is shaded, the light ON / OFF button If the light 13 is turned on by operating 21, as shown in FIG. 8B, the influence of the shadow is eliminated and the reading succeeds (see FIG. 8C).

9A and 9B are views showing the appearance of a mobile terminal device according to another embodiment. FIG. 9A is a front view thereof, and FIG. 9B is a rear view thereof. The same components as those in FIG. 1 are denoted by the same reference numerals.
In FIG. 9, the camera-equipped mobile phone 60 (mobile terminal device) adds a mark 61 indicating the camera position by sticker / printing or the like directly behind the camera 12 on the back of the main body 10a (a place opposite to the opening of the camera 12). Yes.

  Since the user cannot see the camera position when viewing the LCD display unit 15, the camera 12 is difficult to move to the subject. This was particularly noticeable in close-up photography such as barcode reading.

  In the present embodiment, since the mark 61 is attached directly behind the opening of the camera 12, the user can easily operate the mark 61 when the camera 12 is aligned with the code to be read that is the subject.

  Depending on the position of the camera 12, the mark may be displayed on the LCD display unit 15 (marker display means) as shown in FIG.

  In FIG. 10, the camera-equipped mobile phone 70 (mobile terminal device) displays a mark 71 indicating the camera position on the LCD display unit 15 directly behind the camera 12 on the back of the main body 10a (a place opposite to the opening of the camera 12). .

  When displaying on the LCD display unit 15, it is preferable to turn it off simultaneously with the shutter. In the case of this configuration, in the reading start operation event in step S7 of FIG. 4, the reading may not be displayed after the reading is started. When displaying the image read in step S8 of FIG. 4 on the LCD display unit 15, the mark 71 indicating the position of the camera 12 may be displayed at the same time.

Thus, since the mark 71 is attached to the corresponding position of the camera 12 position, it becomes a guideline when the camera 12 is aligned with the code to be read, which is the subject, and the operation becomes easy.
FIG. 11 shows an example as another embodiment. FIG. 11 is a flowchart showing another embodiment of the barcode reading operation. The same processing parts as those in FIG. 4 are denoted by the same reference numerals.

  In FIG. 11, step S7 and step S9 in FIG. 4 are omitted. In this case, after a frame capture event is read in step S5, an image is displayed in step S8, and then the process immediately proceeds to step S10 to execute a code reading process.

  In this embodiment, an image cannot be displayed at a high frame rate before the code reading is started, but a user operation such as pressing a reading start button (for example, the telephone function key 17) can be omitted. There is an advantage that the number of operations can be simplified.

  As another embodiment, an image captured from a camera is stored in a storage memory, and after the image is displayed, the user can select whether or not to stop the code reading process with the image after stopping the image. It may be. If the user selects to start code reading, code reading is performed, otherwise, the stored image is discarded and a new image is taken in again from the camera.

  This embodiment is effective when the mobile terminal has a remarkably low processing capability and the code reading process takes 1 second or more. By deciding whether to start the code reading process after carefully observing the captured image, the user can execute code reading for images that clearly fail to read (images are blurred due to camera shake, etc.). First, take a picture again. This is because the number of times of time-consuming code reading processing can be minimized.

  As described above, the camera-equipped mobile phone 10 according to the present embodiment displays the camera 12 that inputs target image information, the small light 13 that emits light by operating the ON / OFF button 21 when reading a barcode, and the information. An LCD display unit 15 and a control unit 31 including a CPU that controls the entire apparatus are provided. The control unit 31 switches a shooting procedure depending on a subject such as a natural image or a barcode, and when the barcode shooting is switched, the barcode is displayed. Is recognized, the user is notified of the recognized result, and predetermined processing is executed based on the recognized content, so that the barcode used by the camera-equipped mobile phone having a relatively low resolution is read. Automatically shifts to a barcode reading mode suitable for barcode shooting, and the code is accurately obtained with a simple operation. It is possible to take look.

  Further, at the time of switching the barcode shooting, an image is displayed on the display unit 35 at a high frame rate obtained from the camera 33 until the code recognition process is started, and after the start, the image is displayed at a frame rate necessary for the code recognition process. Therefore, the reading operation is continuously performed for each continuously captured image, a smooth moving image can be displayed on the LCD display unit 15, and the code can be adjusted to an appropriate position. The above description is an illustration of a preferred embodiment of the present invention, and the scope of the present invention is not limited to this.

  Although the above embodiment is an example applied to a mobile phone, any device equipped with a camera (internal / external) such as a personal digital assistant such as a PDA, an information processing device such as a personal computer, etc. It is also applicable to the device. The code to be read may be any code.

  Moreover, in the said embodiment, although the name portable terminal device was used, this is for convenience of explanation, and of course, a communication terminal device, an information reading device, an information reading method, etc. may be sufficient.

  In the above-described embodiment, an example of displaying a message by a character or an icon on the display unit 15 and a notification by a reading end sound by the speaker 14 as the notification unit has been described. However, any notification method may be used, for example, a voice. Good. When notifying by voice, the mobile phone is provided with a voice output unit comprising a voice data generation chip, a D / A converter, an amplifier, a speaker, etc., and a message indicating that reading has been completed or has failed using the voice data generation chip. The content is synthesized and output by a speaker. It is also possible to display a message indicating that it is better to turn on the light 13 on the display unit 15 and a message indicating that the barcode type should be changed, or to notify by voice or sound in addition to the display.

  Further, the types, numbers, connection methods, and the like of each circuit unit, for example, the storage unit and the display unit that constitute the mobile terminal device are not limited to the above-described embodiments.

  Moreover, the portable terminal device demonstrated above is implement | achieved also by the program for functioning these portable terminal devices. This program is stored in a computer-readable recording medium. In the present invention, as the recording medium, the main memory itself of the control unit 31 shown in FIG. 2 may be a program medium, or a program reading device such as a CD-ROM drive is provided as an external storage device. Further, it may be a program medium such as a CD-ROM that can be read by inserting a recording medium therein. In any case, the stored program may be configured to be accessed and executed by the CPU of the control unit 31, or in any case, the program is read and the read program is not illustrated. The program may be downloaded to the program storage area and executed. This download program is assumed to be stored in advance in each device.

  Here, the program medium is a recording medium configured to be separable from the portable terminal device or the information processing device, and is a magnetic disk such as a magnetic tape or a cassette tape, a CD-ROM, a CD-R / RW, an MO, an MD. , DVD-ROM, DVD-RAM, DVD-RW and other optical disk systems, PC cards, compact flash cards (registered trademark), smart media (registered trademark), IC cards, SD cards (registered trademark), memory sticks (registered) It may be a medium carrying a fixed program including a semiconductor memory such as a card system such as a trademark) or a mask ROM, EPROM, EEPROM, flash ROM or the like.

  Further, the medium may be a medium that carries the program in a fluid manner so as to download the program from the communication network via a communication connection means that can be connected to an external communication network such as the Internet connection provider or the server terminal 400. . When the program is downloaded from the communication network as described above, the download program may be stored in advance or may be installed from another recording medium. The content stored in the recording medium is not limited to a program, and may be data.

It is a figure which shows the external appearance of the portable terminal device of embodiment of this invention. It is a block diagram at the time of incorporating the barcode reader of the portable terminal device of this Embodiment in the mobile phone with a camera. It is a figure which shows typically the lens focal depth switching mechanism of the camera of the portable terminal device of this Embodiment. It is a flowchart which shows barcode reading operation | movement of the portable terminal device of this Embodiment. It is a figure which shows the example of a mode selection screen display of the LCD display part of the portable terminal device of this Embodiment. It is a figure explaining the image taking-in range and the magnification at the time of display differing with the one-dimensional code / 2-dimensional code of the portable terminal device of this Embodiment. It is a figure which shows the example of a screen display by the barcode reading process of the portable terminal device of this Embodiment. It is a figure which shows the example of a screen display by the barcode reading process of the portable terminal device of this Embodiment. It is a figure which shows the external appearance of the portable terminal device of other embodiment. It is a figure which shows the external appearance of the portable terminal device of other embodiment. It is a flowchart which shows the barcode reading operation | movement of the portable terminal device of other embodiment.

Explanation of symbols

10 Mobile phone with camera (mobile terminal device)
10a Mobile phone body 11, 37 Antenna 12, 33 Camera (imaging means)
13, 34 Light (lighting means)
14,39 Speaker (part of the notification means)
15, 35 LCD display (part of display means and notification means)
16 Power key 17 Telephone function key 18 Mode key 19 Cursor key 20 Shutter key 21 Light ON / OFF button (lighting switching means)
22 Dial keys 23, 40 Microphone 31 Control unit (shooting procedure switching means, code recognition means, information processing means, frame rate control means, timer setting means)
32 Memory 36 Key input unit 50 Camera module 51 Lens 52 Lens unit 53 Camera lever

Claims (10)

An imaging means for capturing an image;
Shooting procedure switching means for switching the shooting target to a barcode,
Display means for displaying an image obtained by the imaging means;
A portable terminal device comprising: code recognition means for recognizing a barcode of a captured image when the photographing procedure switching means switches to barcode photography.   The portable terminal device according to claim 1, wherein the photographing procedure switching unit changes an image capturing area in the imaging unit in accordance with a barcode type.   The photographing procedure switching means switches at least one of gradation characteristics, contrast, brightness, white balance, exposure, depth of focus, contour enhancement, and resolution between a natural image and a barcode image. The mobile terminal device according to claim 1, wherein the mobile terminal device is a mobile terminal device.   The photographing procedure switching means displays an image on the display means at a high frame rate obtained from the imaging means until the code recognition means is activated at the time of barcode photographing switching, and after the code recognition means is activated 2. The portable terminal device according to claim 1, further comprising a frame rate control unit that displays an image at a frame rate necessary for the code recognition unit.   The portable terminal device according to claim 1, further comprising illumination means for illuminating the subject.   6. The portable terminal device according to claim 5, further comprising illumination switching means for turning on / off the illumination means.   2. The portable terminal device according to claim 1, further comprising notification means for notifying the result recognized by the code recognition means.   8. The portable terminal device according to claim 7, wherein the notification unit notifies the recognition result by sound, voice, or message display on the display unit. Furthermore, a timer setting means for measuring the set time is provided,
2. The portable terminal device according to claim 1, wherein the notification unit notifies the recognition failure when the barcode cannot be recognized within the time set by the timer setting unit.   The mobile terminal apparatus according to claim 1, wherein the imaging unit captures moving image / still image capturing with an area-type solid-state image sensor.

Images