CN110765998B

CN110765998B - Hand-held reader

Info

Publication number: CN110765998B
Application number: CN201911024466.4A
Authority: CN
Inventors: 贾飞飞
Original assignee: Hanwang Technology Co Ltd
Current assignee: Hanwang Technology Co Ltd
Priority date: 2019-10-25
Filing date: 2019-10-25
Publication date: 2020-11-20
Anticipated expiration: 2039-10-25
Also published as: CN110765998A

Abstract

The invention discloses a handheld reader which comprises a shell, a processor and a camera module, wherein the processor and the camera module are arranged in the shell; the shell is provided with an image acquisition window, and the light incident surface of the camera module faces the image acquisition window; the camera module comprises an image sensor, a filtering component and a lens, wherein the filtering component comprises at least two optical filters and a power part for driving the at least two optical filters to move, each optical filter is matched with at least one set reading mode, and different optical filters are matched with different reading modes; the processor is configured to: and controlling the power part to drive the matched optical filter to move to the filtering action position of the camera module according to the current reading mode of the reader.

Description

Hand-held reader

Technical Field

The invention relates to the technical field of digital equipment, in particular to a handheld reader.

Background

Currently, the handheld readers on the market include a touch-and-talk pen, a scanning pen, and the like. The point-reading pen is matched with a sound book for use, the paper surface of the sound book is printed with invisible codes in carbon ink color, the image patterns of the invisible codes printed at different positions of the sound book are different, and each image pattern has a unique number. And when the reading pen reads different positions, reading the invisible codes at the corresponding positions, determining the numbers of the invisible codes according to the image patterns of the read invisible codes, and searching the matched sound files in a file library stored by the reading pen according to the numbers for playing. The scanning pen is mainly used for reading text contents, when the scanning pen reads a text printed on a paper surface, a text image can be collected through an image sensor of the scanning pen, and further through image splicing processing and algorithm identification, the text contents in the text image are obtained. The scanning pen can be divided into a quick recording pen, a translation pen and the like according to specific functions, and the quick recording pen is mainly used for recording and storing read text contents; the translation pen further processes the read text content, for example, performs operations such as translation, pronunciation, display, and the like.

In the prior art, in order to enable the touch and talk pen to accurately read the invisible codes on the paper surface, the touch and talk pen may employ an RGB image sensor and an infrared filter, and stray light except for carbon black in incident light is filtered out through the infrared filter, so that an image acquired by the RGB image sensor only includes the invisible codes of carbon black and black text content on the page. This means that, when the existing click-to-read pen is expected to be expanded to be used as a scanning pen, the scanning pen can only read black text content, but the recognition capability of color characters, characters with background colors, characters with textures and the like is poor, even the characters cannot be recognized at all, and the recognition rate of the scanning pen equivalent to a single function cannot be obtained. For the scanning pen in the prior art, the visible light filter is used for collecting text images, so only visible light can reach the image sensor for imaging, but the invisible code layer is an infrared layer and cannot reflect visible light, so that the existing scanning pen cannot read the invisible code at all, and the recognition rate of a point-and-read pen with a single function cannot be obtained.

Disclosure of Invention

It is an object of embodiments of the present invention to provide a handheld reader that can support a plurality of reading modes and can obtain an identification rate of a reader supporting only a single mode for each reading mode.

According to a first aspect of the present invention, there is provided a handheld reader comprising a housing, a processor and a camera module, the processor and the camera module being disposed in the housing;

the shell is provided with an image acquisition window, and the light incident surface of the camera module faces the image acquisition window;

the camera module comprises an image sensor, a filtering component and a lens, wherein the filtering component comprises at least two optical filters and a power part for driving the at least two optical filters to move, each optical filter is matched with at least one set reading mode, and different optical filters are matched with different reading modes;

the processor is arranged to: and controlling the power part to drive the matched optical filter to move to the filtering action position of the camera module according to the current reading mode of the reader.

Optionally, the filter assembly further includes a mounting frame, the at least two filters are arranged side by side in the mounting frame, and the power member is configured to: the installation frame drives the at least two optical filters to synchronously move on a plane perpendicular to the optical axis of the camera module.

Optionally, the synchronous motion is a linear motion along a set direction, and a direction in which the at least two filters are arranged side by side is the same as the set direction.

Optionally, the filter assembly further includes a guide member, a guiding direction of the guide member is the same as the setting direction, and the guide member is connected to the mounting frame, and the connection enables the mounting frame to move along the setting direction under the guiding action of the guide member.

Optionally, the at least two filters are located between the image sensor and the lens; or, the at least two optical filters are positioned between the lens and the image acquisition window.

Optionally, the handheld reader has two set reading modes, namely a click-to-read mode and a scanning mode; the filtering component comprises an infrared filter matched with the point reading mode and a visible light filter matched with the scanning mode.

Optionally, the handheld reader further comprises a key circuit for selecting a current reading mode, a signal output terminal of the key circuit is connected with a signal input terminal of the processor, and the signal output terminal outputs an electrical signal representing the selected current reading mode.

Optionally, the handheld reader further comprises an infrared light module matched with the point reading mode and a visible light module matched with the scanning mode, the infrared light module and the visible light module are used for providing a light supplementing light source for the camera module, the switch control end of the infrared light module is connected with the first control signal output end of the processor, and the switch control end of the visible light module is connected with the second control signal output end of the processor.

Optionally, an optical cavity communicated with the image acquisition window is formed in the shell, and the camera module, the infrared light module and the visible light module are all arranged in the optical cavity.

Optionally, the circuit board pad of the infrared light module and the circuit board pad of the visible light module are located on the same plane, the plane passes through the camera module, and the camera module is parallel to the plane or located on the plane.

Optionally, the infrared light module and the visible light module are respectively arranged at two sides of the camera module; or the infrared light module and the visible light module are arranged on the same side of the camera module.

Optionally, the infrared light module is arranged adjacent to the image acquisition window relative to the camera module; and/or the presence of a gas in the gas,

the visible light module is arranged close to the image acquisition window relative to the camera module.

Optionally, the setting distance and the setting angle of the infrared light module relative to the image acquisition window enable the image acquisition window to be completely located within the irradiation range of the infrared light module; and/or the presence of a gas in the gas,

the setting distance and the setting angle of the visible light module relative to the image acquisition window enable the image acquisition window to be completely positioned in the irradiation range of the visible light module.

Optionally, the setting angle of the visible light module makes the optical axis of the visible light module inclined to the plane where the image capturing window is located; and/or the presence of a gas in the gas,

the setting angle of the infrared light module enables the optical axis of the infrared light module to be inclined to the plane where the image acquisition window is located.

The camera module of the handheld reader has at least two optical filters and a power component controlled by the processor, and the processor can control the power component to act according to the current reading mode selected by a user, so that the optical filters matched with the current reading mode are driven by the power component to move to the filtering action position of the camera module, the camera module can obtain the best image acquisition effect in different reading modes, and the reader of the embodiment can still obtain the identification rate equivalent to that of a scanning pen, a touch and talk pen and the like which only support a single mode under the condition of supporting multiple reading modes.

Other features of the present invention and advantages thereof will become apparent from the following detailed description of exemplary embodiments thereof, which proceeds with reference to the accompanying drawings.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description, serve to explain the principles of the invention.

FIG. 1 is a block schematic diagram showing the internal structural components of a handheld reader of an embodiment of the present invention;

FIG. 2 is a schematic diagram of a partial structure of a handheld reader according to an embodiment of the invention;

FIG. 3 is a schematic diagram of a partial structure of a handheld reader according to another embodiment of the present invention;

fig. 4 is a schematic structural diagram of a camera module according to an embodiment of the invention;

fig. 5 is a schematic structural diagram of a camera module according to another embodiment of the invention;

FIG. 6 is a schematic diagram of the filter assembly of FIG. 4 or 5;

FIG. 7 is a flow chart of a read control method of a handheld reader according to an embodiment of the invention;

FIG. 8 is a flow chart diagram of a read control method according to one example of the invention;

fig. 9 is a block schematic diagram of a read control device according to an embodiment of the present invention.

Description of reference numerals:

100-a housing; 110-an image acquisition window;

120-an optical cavity; 200-a camera module;

210-an image sensor; 220-lens;

230-a filter assembly; 231-an infrared filter;

232-visible light filter; 233-a mounting frame;

234-a guide; 235-a power element;

2351-a cam; 2352-oblique slot;

2353-needle bar; p-filter effect position;

310-infrared light module; 320-visible light module;

400-a key circuit; 500-a speaker;

600-a microphone; 700-display screen;

800-a communication module; 900-supply circuit;

1000-charging circuit 1100-headset interface;

1200-a USB interface; 1300-a memory;

1400-memory card connector; 1500-a drive circuit;

d-setting the direction; 9000-a read control device;

9100-a mode determination module; 9200-camera module control module;

9300-image recognition module; 9400-read processing module.

Detailed Description

Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, the numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present invention unless specifically stated otherwise.

The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.

Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.

In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.

< reader embodiment >

Embodiments of the present invention provide a handheld reader, which can support multiple reading modes, such as a touch reading mode and a scanning mode, at the same time, so that the reader has a touch reading pen function and a scan pen function, for example, the reader can realize the touch reading pen function by reading a hidden code printed on a paper surface, and realize the scan pen function by reading text contents on the paper surface.

The handheld reader according to an embodiment of the present invention may include a processor U1 shown in fig. 1 and a camera module 200 shown in fig. 2 and 3, where the camera module 200 is used for image capturing, and the processor U1 is used for performing control processing operations on various functional components of the reader to coordinate the functional components to complete the overall functions.

The above processor U1 and camera module 200 are both disposed in the housing 100 of the reader as shown in fig. 2 or 3.

In one embodiment, the housing 100 may be provided in any shape having an elongated form, such as having a pen-like shape, for ease of handling.

As shown in fig. 2 and 3, an image collecting window 110 is opened at the front end of the casing 100, so that light reflected by a paper surface can be incident into the camera module 200 through the image collecting window 100, and further, the camera module 200 collects a paper surface image.

The image capturing window 110 may be a square opening, and considering that the reader may be used as a scanning pen or a point-and-click pen, the size of the image capturing window 110 is, for example, but not limited to, 9mm x 6mm, and it should be noted that the shape and size of the image capturing window 110 are not specifically limited, and may be determined comprehensively according to the size of the image to be captured.

In this embodiment, the light incident surface of the camera module 200 needs to face the image capturing window 110, so that the light reflected by the paper surface entering through the image capturing window 110 can be incident into the camera module 200, thereby capturing the paper surface image.

In this embodiment, the camera module 200 includes an image sensor 210, a lens 220 and a filter assembly 230 as shown in fig. 4 and 5, and light entering the housing 100 through the image capturing window 110 is incident on the image sensor 210 for imaging through the filtering effect of the filter assembly 230.

In this embodiment, the image sensor 210 may be a CMOS image sensor.

In this embodiment, the reader can support two reading modes, i.e., a point reading mode and a scanning mode, and the filter assembly 230 includes two filters, as shown in fig. 4 and 5, one filter 231 is a filter matching the point reading mode, and the other filter 232 is a filter matching the scanning mode.

In other embodiments, the reader may also support other reading mode combinations, and the corresponding filtering component may refer to the configuration of this embodiment, which is not described herein again.

In this embodiment, the optical filter 231 may be an Infrared filter, and the band allowed by the Infrared filter is an Infrared (IR) band, and the spectral transmittance for the rest bands is very low and is almost zero. In this way, the image sensor 210 can obtain a black-and-white image that facilitates accurate recognition of the invisible code on the paper surface.

In this embodiment, the filter 232 may be a visible light filter, the band allowed by the visible light filter is a visible light band, the spectrum transmittance for the remaining bands is very low and is almost zero, wherein the color standard RGB almost includes all colors that can be perceived by human eyes. In this way, the image sensor 210 can obtain an image advantageous for accurately recognizing the text contents of various colors on the paper surface.

According to the assembly requirement of the camera module 200, the light entering the camera module 200 is incident on the photosensitive area of the image sensor 210 through one of the filters of the filter assembly 230. This means that, in any reading mode, only the light rays allowed by the matched filter can reach the photosensitive area of the image sensor 210 for imaging, so as to obtain the type of image required in the reading mode, obtain the best imaging effect in the reading mode, facilitate to identify the reading content matched with the reading mode from the image, and further complete the setting operation according to the reading content.

For example, in the case that the current reading mode is the point reading mode, only the light in the IR band can reach the photosensitive area of the image sensor 210 through the corresponding filter 231 (infrared filter) for imaging, and then a black-and-white image composed of IR pixels is obtained, so as to read the carbon black invisible code on the paper surface.

For another example, when the current reading mode of the reader is the scanning mode, only light in the visible light band can reach the photosensitive area of the image sensor 210 through the corresponding filter 232 (visible light filter) to form an image, so as to read the text content of each color on the paper surface.

As shown in fig. 4 to 6, the filtering assembly 230 further includes a power component 235 for driving the two

filters

231 and 232 to move, the power component 235 is controlled by the processor U1, so as to drive the filter matched with the current reading mode to move to a filtering position P of the camera module 200 under the control of the processor U1, where the filtering position P is an optical position where light incident on the image sensor 210 is filtered. For example, the filter action position P is such that the optical axis of the camera module 200 is perpendicular to any of the

filters

231 and 232 after the filters reach the filter action position P. Preferably, the optical axis of the camera module 200 is perpendicular to the optical filter and passes through the geometric center of the optical filter.

The filter assembly 230 may be provided with two power members 235, so that one power member 235 drives the filter 231 to move, and the other power member 235 drives the filter 232 to move. The filter assembly may also be provided with a power element 235, so that the power element 235 drives the two

filters

231 and 232 to move synchronously, which is not limited herein.

The movement of the filter 231 and the filter 232 driven by the power element 235 may be a linear movement, a rotational movement, or a combination thereof, which is not limited herein.

The power element 235 may be any type of power element capable of moving the

optical filters

231, 232 accordingly. For example, the power member 235 may include a motor, etc., and is not limited thereto.

In this embodiment, as shown in fig. 4 to 6, the filter assembly 230 may be provided with a mounting frame 233, and the

filters

231 and 232 are arranged side by side in the mounting frame 233. The filter assembly 230 is provided with a motive member 235, and the motive member 235 is configured to: the two

filters

231 and 232 are driven by the mounting frame 233 to move synchronously on a plane perpendicular to the optical axis of the camera module 200.

In this embodiment, the two filters 23 and 232 are always perpendicular to the optical axis of the camera module 200 in the mounting frame 233. Referring to fig. 4, when the current reading mode is the point-reading mode, the processor U1 may control the power element 235 to drive the mounting frame 233 to move the optical filter 231 to the filtering position P, and simultaneously move the optical filter 232 to a position other than the filtering position P. Referring to fig. 5, when the current reading mode is the scanning mode, the processor U1 may control the power element 235 to drive the mounting frame 233 to move, so as to transfer the optical filter 232 to the filtering position P, and simultaneously transfer the optical filter 231 to a position other than the filtering position P, thereby achieving the purpose of switching the corresponding optical filter according to the current reading mode.

In this embodiment, as shown in fig. 6, the power component 235 can drive the two

optical filters

231 and 232 to make a linear motion along a set direction D on a plane perpendicular to the optical axis of the camera module 200, so as to transfer the optical filter matched with the current reading mode to the filtering action position P through the linear motion. In this embodiment, the direction in which the two

filters

231, 232 are arranged side by side in the mounting frame 233 may be the same as the setting direction D.

In this embodiment, the power member 235 can be a linear motor, so as to drive the mounting frame 233 to move linearly along the setting direction D by the linear motor.

In this embodiment, the power member 235 may also adopt a rotating electrical machine (output torque) and a transmission mechanism, the transmission mechanism is configured to convert the rotating motion output by the rotating electrical machine into a linear motion, and therefore, the output shaft of the rotating electrical machine may be connected to the mounting frame 233 through the transmission mechanism, so as to drive the mounting frame 233 to make a linear motion along the setting direction D through the rotating electrical machine.

For example, the transmission mechanism may be a screw nut transmission mechanism in which a screw is connected to an output shaft of the rotating motor and a nut is connected to the mounting frame 233.

Also for example, the driving mechanism may be a cam driving mechanism, as shown in fig. 6, the cam driving mechanism may include a cam 2351 having an inclined groove 2352, and a needle bar 2353 engaged with the inclined groove 2352 to move in the inclined groove 2352, the cam 2351 is connected to an output shaft of a rotating motor to rotate the cam 2351 by the rotating motor, the needle bar 2353 is fixedly connected to the mounting frame 233, such that, when the cam 2351 rotates, the needle bar 2353 is always kept in the inclined groove and only drives the mounting frame 233 to move in the set direction D. Here, since the present embodiment has a low requirement for the accuracy of the position control, the cam 2351 may be implemented by fitting a spring on the round bar, that is, the inclined groove 2352 may be formed in a space between the springs.

In this embodiment, as shown in fig. 6, the filter assembly 230 may further include a guide 234, the guide 234 is guided in the same direction as the setting direction D, the guide 234 is connected to the mounting frame 233, and the connection enables the mounting frame 233 to move linearly along the setting direction D under the guiding action of the guide 234.

For example, the guiding member 234 may include a guiding rod extending along the setting direction D and a guiding ring connected with the guiding rod in a sliding fit manner, and the guiding ring is fixedly connected with the mounting frame 233. Here, the guide ring may be integrally formed with the mounting frame 233, or may be separately formed and then connected thereto, which is not limited herein.

For another example, the guiding element 234 may include a sliding slot extending along the setting direction D and a sliding block connected with the sliding slot in a sliding fit manner, and the sliding block is fixedly connected with the mounting frame 233. Here, the slider may be integrally formed with the mounting frame 233, or may be separately formed and then connected thereto, which is not limited herein.

In another embodiment, the power element 235 can also drive the mounting frame 233 to rotate on a plane perpendicular to the optical axis of the camera module 200, so as to drive the mounting frame 233 to rotate in different directions, so as to transfer the optical filter matching the current reading mode to the filtering position P, which is not limited herein.

In one embodiment, as shown in fig. 4, two

filters

231, 232 may be located between the image sensor 210 and the lens 220, i.e., a filtering position is located between the image sensor 210 and the lens 220, to filter light incident to the image sensor 210.

In another embodiment, as shown in fig. 5, two

optical filters

231 and 232 may also be located between the lens 220 and the image capturing window 110, that is, the filtering position P is located between the lens 220 and the image capturing window 110, so as to filter the light incident on the image sensor 210.

In one embodiment, as shown in fig. 2 and 3, an optical cavity 120 is formed inside the housing 100 and is communicated with the image capturing window 110, the camera module 200 is located in the optical cavity 120, and external light enters the optical cavity 120 through the image capturing window 110 and further enters the camera module 200 to capture an image.

In one embodiment, the optical axis of the camera module 200 may be perpendicular to the surface of the image capturing window 110.

In one embodiment, the optical axis of the camera module 200 may pass through the geometric center of the image capture window 110.

In one embodiment, the reader may further include a light supplement module to supplement light when the camera module collects images through the light supplement module. Here, because the reader when arranging in on the paper, image acquisition window 110 can be sheltered from by the paper, and consequently, the light of the environment that the camera module is located is darker, consequently, sets up the light filling module and carries out the light filling for camera module collection image and be favorable to improving the quality of the image of gathering greatly.

The light supplement module may include an infrared light module 310 matched with a touch reading mode and a visible light module 320 matched with a scanning mode corresponding to different reading modes.

The light supplement module is located in the housing 100, for example, in the optical cavity 120. The processor U1 can be used for controlling whether the light filling module starts, and then coordinates each functional component to complete the whole function.

In this embodiment, the infrared light module 310 and the visible light module 320 are used as light supplement light sources of the camera module 200, and light emitted by the infrared light module 310 and the visible light module 320 must be able to irradiate the image capturing window 110.

In one embodiment, the infrared light module 310 and the visible light module 320 may be disposed in the optical cavity 120 where the camera module 200 is located to provide effective light supplement for the camera module 200.

In one embodiment, the circuit board pads of the infrared light module 310 and the circuit board pads of the visible light module 320 may be located on the same plane, which may pass through the camera module 200, and the optical axis of the camera module 200 is parallel to or located on the plane. On the one hand, the structural design of the circuit board can be simplified, and the compactness of the internal structure of the reader is improved; on the other hand, the infrared light module 310 and the visible light module 320 can provide an image capturing environment with sufficient brightness for the camera module 200.

On this basis, the infrared light module 310 and the visible light module 320 can be separately disposed on two sides of the camera module 200 as shown in fig. 2. The infrared light module 310 and the visible light module 320 may also be disposed on the same side of the middle section of the camera module 200 as shown in fig. 3, which is not limited herein.

In one embodiment, the infrared light module 310 may be disposed adjacent to the image capturing window 110 relative to the camera module 200, so that the infrared light emitted by the infrared light module 310 can have a larger illumination intensity at the image capturing window 110, thereby enhancing a light supplementing effect of the infrared light supplementing, and improving the image quality of the image captured by the camera module 200.

In one embodiment, the visible light module 320 may be disposed adjacent to the image capturing window 110 relative to the camera module 200, so that the visible light emitted by the visible light module 320 can have a larger illumination intensity at the image capturing window 110, thereby enhancing the light supplementing effect of supplementing the visible light and improving the image quality of the image captured by the camera module 200.

In an embodiment, the setting distance of the infrared light module 310 relative to the image capturing window 110 and the setting angle relative to the image capturing window 110 may enable the image capturing window 110 to be completely located within the irradiation range of the infrared light module 310, so as to improve the uniformity of the infrared light irradiated on the image capturing window 110.

On the basis, the setting angle of the infrared light module 310 can enable the optical axis of the infrared light module 310 to be inclined to the plane where the image capturing window 110 is located, that is, the optical axis of the infrared light module 310 is not parallel to the plane nor perpendicular to the plane. The inclined arrangement can easily obtain better illumination uniformity under the condition that the image acquisition window 110 is completely positioned in the illumination range of the infrared light module 310.

In an embodiment, the setting distance of the visible light module 320 relative to the image capturing window 110 and the setting angle relative to the image capturing window 110 may enable the image capturing window 110 to be completely located within the irradiation range of the visible light module 320, so as to improve the uniformity of the infrared light irradiated on the image capturing window 110.

On the basis, the angle of the visible light module 320 can make the optical axis of the visible light module 320 inclined to the plane where the image capturing window 110 is located, i.e. the optical axis of the visible light module 320 is not parallel to the plane nor perpendicular to the plane. Due to the inclined arrangement, better irradiation uniformity can be easily obtained under the condition that the image acquisition window 110 is completely positioned in the irradiation range of the visible light module 320.

The image data output end of the image sensor of the camera module 200 is connected to the image data input end of the processor U1, so that the image sensor can transmit the acquired image data composed of RGB pixel arrays to the processor U1 for subsequent processing.

The switch control terminal of the infrared light module 310 is connected to the first control signal output terminal of the processor U1, so that the processor U1 can output a switch control signal to the switch control terminal of the infrared light module 310 through the first control signal output terminal, and further control the infrared light module 310 to be turned on or turned off.

The switch control terminal of the visible light module 320 is connected to the second control signal output terminal of the processor U1, so that the processor U1 can output a switch control signal to the switch control terminal of the visible light module 320 through the second control signal output terminal, thereby controlling the opening and closing of the visible light module 320.

In this embodiment, the processor U1, the visible light module 320, the infrared light module 310, and the image sensor 210 of the camera module 200 can be soldered to a circuit board or a plurality of circuit boards, and the required circuit connections can be made through the circuit boards. The circuit board may be fixedly mounted in the housing 100.

The processor U1 may be further configured to: identifying read contents matched with the current read mode from the image acquired by the camera module 200; and executing a setting operation corresponding to a current reading mode for the read content.

In this embodiment, the read content matched with the click-to-read mode is a hidden code, and the read content matched with the scan mode may be a text content.

Taking the identified read content as text content as an example, performing the setting operation corresponding to the scan mode on the read content may include: inputting and storing the read text; translating the read text, for example, into an english translation; driving an audio output device to play the read text or the translated text; and driving the display screen to display any one or more of the read text and/or the translated text so as to realize the function of the scanning pen.

Taking the identified read content as the invisible code as an example, executing the setting operation corresponding to the point-to-read mode on the read content may include: and searching a sound file matched with the invisible code in a file library stored in the reader for playing, namely realizing the function of the touch and talk pen.

As shown in fig. 1, the reader may include an audio output device such as a speaker 500 and/or a headphone interface 1100, which is coupled to the processor U1.

As shown in fig. 1, the reader may include an audio input device, such as a microphone 600, coupled to the processor U1.

As shown in fig. 1, the reader may include a communication module 800, the communication module 800 is connected with the processor U1, and the communication module 800 may include at least one of a bluetooth module, a WIFI module, and a ZIGBEE module. The reader may be communicatively coupled to an external device through the communication module 800.

As shown in fig. 1, the reader may include a display screen 700, the display screen 700 being coupled to the processor U1.

As shown in fig. 1, the reader may include a memory 1300, and the memory 1300 may be used to store instructions, recognized text, translated text, pre-stored sound files, and the like.

As shown in fig. 1, the reader may include a memory card connector 1400, such as a TF card connector, an SD card connector, or the like, to support expansion of the memory space.

As shown in fig. 1, the reader may include a communication interface module such as a USB interface 1200, which is connected to the processor U1 to connect an external device through the communication interface module, thereby communicating with the external device.

As shown in fig. 1, the reader may include a key circuit 400, a signal output terminal of the key circuit 400 is connected to a signal input terminal of the processor U1, and the key circuit 400 includes, for example, a key switch and a resistor, which are connected in series between a power terminal and a ground terminal of the reader, so as to output different electrical signals when the key switch is opened and closed, respectively, so that the processor U1 can identify the state of the key switch according to the received electrical signals. The reader may be configured with a key circuit for turning on reading, a key circuit for selecting a mode, a key circuit for controlling power on/off, and the like as required, which is not limited herein. For example, a key circuit may be provided for the user to select the current reading mode, where the electrical signal output by the key circuit indicates the current reading mode selected by the user.

As shown in fig. 1, the reader may include a power supply circuit 900, the power supply circuit 900 provides an operating power supply for all the electrical devices of the reader, including the processor U1, and the power supply circuit 900 may include a battery, a voltage conversion circuit, and the like.

As shown in fig. 1, the reader may include a charging circuit 1000 under the control of the processor U1 to charge the battery through the charging circuit 1000.

In this embodiment, the reader may include at least one of the above audio output device, audio input device, communication module, memory, communication interface module, display screen, and key circuit as required, so as to support the processor to execute a setting operation matching the identified content.

An alternative workflow of the reader according to the present embodiment may comprise: when a user holds the reader and places the reader on a paper surface, the processor U1 determines a current reading mode according to a reading instruction (for example, a reading switch is turned on), controls a matched optical filter to move to a filtering action position P of the camera module 200 according to the current reading mode, and starts the camera module 200 to collect an image; after the processor U1 acquires the image acquired by the camera module 200, identifying the read content matched with the current read mode from the image; and executing a setting operation corresponding to the current reading mode for the identified reading content.

According to the handheld reader of the embodiment, the camera module 200 has two optical filters, which are an infrared optical filter for collecting IR images to support a point reading pen function and a visible optical filter for collecting RGB images to support a scanning pen function, respectively, the camera module 200 further has a power component 235 controlled by the processor U1, the processor U1 can control the power component 235 to operate according to a current reading mode selected by a user, so as to drive the optical filter matched with the current reading mode to move to the filtering action position P of the camera module 200 through the power component 235, and thus, after the camera module 200 is started, corresponding IR images or RGB images can be collected based on the optical filter located at the filtering action position, and further, the setting operation matched with the current reading mode can be realized according to the collected images.

According to the handheld reader of the embodiment, since the IR image collected through the infrared filter includes the invisible codes of carbon black on the page, and the RGB image collected through the visible light filter includes the text contents of various colors on the page, the reader of the embodiment can still obtain the recognition rate of the wand and the point-and-read pen equivalent to a single function when having the wand function and the point-and-read pen function at the same time.

Each of the above embodiments is mainly described as different from the other embodiments, and the embodiments may be used alone or in combination with each other as needed, and are not limited herein.

< method examples >

The invention also provides a reading control method of the handheld reader, the handheld reader is provided with a camera module and a processor, an image sensor of the camera module is used for collecting images, and the handheld reader can be the handheld reader in any structural embodiment.

Fig. 7 is a flowchart illustrating a read control method according to an embodiment of the invention, which is executed by the processor U1 shown in fig. 1, for example. As shown in fig. 7, the read control method may include the following steps S7100 to S7400.

Step S7100, in response to the set read event, a current read mode of the reader is acquired.

In one embodiment, the reader may support a point-and-read mode and a scan mode.

The set read event may include at least one of: receiving an external instruction for starting reading, for example, triggering the external instruction through a key, a touch screen, an audio input device and the like; and detecting a change in movement of the reader, etc.

Step 7200, according to the obtained current reading mode, controlling the matched optical filter to move to the filtering position P of the camera module 200, and starting the camera module 200 to collect images.

In step S7200, the processor U1 controls the matched filter to move to the filtering position P, and then drives the camera module 200 to capture an image.

In one example, the filter 231 matching the reading mode is an infrared filter, and the filter 232 matching the scanning mode is a visible light filter.

In this example, the step S7200 may include: under the condition that the current reading mode is a point reading mode, controlling the matched infrared filter to move to a filtering action position P; and controlling the matched visible light filter to move to the filtering action position P under the condition that the current reading mode is the scanning mode.

According to this example, when the current reading mode is the point-reading mode, the camera module 200 collects an image of the invisible code layer through the action of the infrared filter, where the image is a black-and-white image; when the current reading mode is the scanning mode, under the action of the visible light filter, the camera module 200 collects an image of the text printing layer, where the image may be a color image or a black-and-white image.

In this embodiment, when the user uses the reader, the user may select the current reading mode, for example, select the current reading mode through a key circuit, a touch screen, an audio input device, and the like, which is not limited herein.

In one example, the operation of selecting the current read mode may be a set one read event.

In this embodiment, the current reading mode may also be determined by program setting. For example, the default reading mode is set to be the click-to-read mode, and in response to the reading event, the processor U1 controls the matched optical filter to move to the optical filtering action position P according to the default scanning mode, drives the camera module 200 to acquire an image, and determines whether the image belongs to the steganographic code image, if the image belongs to the steganographic code image, it is determined that the current reading mode is the default click-to-read mode, otherwise, it is determined that the current reading mode is the scanning mode.

Step S7300, according to the current reading mode, identifies the read content matching the current reading mode from the image.

In step S7300, the read content matched with the click-to-read mode is a hidden code, and the read content matched with the scan mode is a text content.

In one embodiment, the identifying the read content matching the current read mode from the image according to the current read mode in step S7300 may include: under the condition that the current reading mode is a point reading mode, selecting a partial area of the image according to a set size as a target area; and identifying the read content matched with the point-reading mode from the target area.

The set size may be smaller than the size of the image acquisition window, e.g. 3mm x 3 mm.

This approach is advantageous for reducing the data processing capacity of the processor, since the pattern of the invisible code can be recognized by the IR pixels corresponding to the target area.

In one embodiment, the identifying, in step S7300, the read content matching the current read mode from the image according to the current read mode may include: under the condition that the current reading mode is a scanning mode, extracting partial pixels from the image to generate a new image; read contents matching the scanning pattern are identified from the new image.

Since the resolution of the image acquired by the camera module is generally high, and the character recognition rate can be high when the resolution is lower than the resolution, the resolution of the image acquired in the scanning mode can be reduced by extracting part of pixels, so as to reduce the data processing amount. For example, the resolution of the image captured by the camera module is 320 x 240, whereas the resolution of the new image generated by decimating some of the pixels may be only 120 x 80.

In step S7400, a setting operation corresponding to the current reading mode is performed for the read content.

The step S7400 of executing the setting operation corresponding to the current reading mode for the reading content may include: and under the condition that the current reading mode is the point reading mode, controlling an audio output device of the reader to play the sound file matched with the recognized invisible code.

The sound file is pre-stored in the memory of the reader, and the processor U1 may determine the unique number of the invisible code after recognizing the invisible code, and search for a sound file matching the invisible code according to the unique number as an index.

In step S7400, the setting operation corresponding to the current reading mode may be performed on the read content, and the setting operation may further include: and in the case that the current reading mode is the scanning mode, executing setting operation aiming at the recognized text content.

It is clear to the skilled person that in scan mode, continuously acquired images need to be stitched together for recognition of text content. For the setting operation executed for the text content, reference may be made to the description in the embodiment of the apparatus, which is not described herein again.

According to the reading control method of the embodiment, the reader can switch the optical filter of the camera module 200 according to the current reading mode to transfer the optical filter matched with the current reading mode to the filtering action position P, so that the camera module 200 can acquire the image required by the current reading mode, and realize the functions of point reading or code scanning, and when each function is realized, the identification rates of the scanning pen with a single function and the point reading pen with a single function can be obtained.

In an embodiment, before the camera module 200 is started to capture an image, the reading control method may further include: and opening a light supplement module matched with the current reading mode of the reader, and collecting images for the camera module to supplement light.

In this embodiment, the light supplement module matched with the touch and talk mode can be an infrared light module, and/or the light supplement module matched with the scanning mode can be a visible light module.

Correspondingly, open the reader with current reading mode assorted light filling module, can include: under the condition that the current reading mode is the point reading mode, starting an infrared light supplementing module matched with the point reading mode; and/or, under the condition that the current reading mode is the scanning mode, the visible light supplementary lighting module matched with the scanning mode of the reader is started.

Because the reader is when arranging on the paper, image acquisition window 110 can be sheltered from by the paper, and consequently, the light of the environment that camera module 200 was located is darker, consequently, in this embodiment, open before camera module gathers the image and read the mode assorted light filling module with present and carry out the light filling, is favorable to improving the quality of gathering the image greatly.

< specific embodiment of the read control method >

Fig. 8 is a flowchart illustrating a read control method according to an embodiment of the method of the present invention, which may be implemented by the processor U1 shown in fig. 1.

As shown in fig. 8, the read control method may include the steps of:

step S8100, detecting a set reading event after the power is turned on, and executing the following step S8200 when an arbitrary reading event is detected, and ending the reading task when an arbitrary reading event is not detected, and circularly executing step S8100.

Step S8200, judging whether the current reading mode of the reader is a point reading mode or a scanning mode, and executing the following step S8310 under the condition that the current reading mode is the point reading mode; in the case of the scan mode, the following step S8410 is performed.

In step S8310, the infrared filter is controlled to move to the filtering position P, and the infrared light module is controlled to be turned on to supplement light, and then step S8320 is executed.

Step S8320, the camera module is started to collect the black and white image matched with the click-to-read mode, and then step S8330 is executed.

In step S8330, the black-and-white image acquired by the camera module in step S8320 is acquired, and then step S8340 is executed.

And step S8340, whether the image is a invisible code image or not is judged, if yes, the step S8350 is executed, and if not, the current reading task is ended.

In the case of an image with a covert code, the image is a covert code image.

Step S8350, recognizing the read invisible code according to the image, and then executing step S8360.

Step S8360, controlling the audio output device of the reader to play the sound file matched with the recognized invisible code.

In step S8410, the visible light filter is controlled to move to the filtering position P, the visible light module is controlled to be turned on to supplement light, and then step S8420 is executed.

In step S8420, the camera module is started to capture an image matching the scanning mode, and then step S8430 is executed.

In step S8430, the image acquired by the camera module in step S8320 is acquired, and then step S8440 is executed.

And step S8440, judging whether the image is a text image, if so, executing step S8450, and if not, ending the current reading task.

If the image has text content, the image is a text image.

In step S8450, the read text content is recognized based on the image, and then step S8460 is executed.

In step S8460, a setting operation is performed for the recognized text content.

Such as text entry, storage, translation, display, etc.

< apparatus embodiment >

Fig. 9 is a block schematic diagram of a read control device of a handheld reader according to an embodiment of the present invention.

As shown in fig. 9, the reading control apparatus 9000 includes a mode determination module 9100, a camera module control module 9200, an image recognition module 9300, and a reading processing module 9400.

The mode determination module 9100 is configured to obtain a current reading mode of the reader in response to a set reading event.

The camera module control module 9200 is configured to control the matched filter to move to the filtering position of the camera module of the reader according to the current reading mode, and start the camera module to collect an image.

The image identification module 9300 is used for identifying the reading content matched with the current reading mode from the image according to the current reading mode.

The read processing module 9400 is used for performing a setting operation corresponding to the current read mode on the read content.

In one embodiment, the camera module control module 9200 is further configured to start a light supplement module of the reader that matches the current reading mode before starting the camera module to collect an image, so as to supplement light for the image collected by the camera module 200.

In one embodiment, the reader has a dot read mode and a scan mode.

In this embodiment, the camera module control module 9200 can be used for the following operations when the light supplement module matched with the current reading mode of the reader is started: under the condition that the current reading mode is a point reading mode, starting an infrared light supplementing module matched with the point reading mode of the reader; and under the condition that the current reading mode is the scanning mode, starting a visible light supplementary lighting module matched with the scanning mode of the reader.

In this embodiment, the camera module control module 9200 can be used to control the matched filter to move to the filter action position of the camera module of the reader according to the current reading mode: under the condition that the current reading mode is a point reading mode, controlling the matched infrared filter to move to a filtering action position; and under the condition that the current reading mode is the scanning mode, controlling the matched visible light filter to move to the filtering action position.

In one embodiment, the read content matched with the read-on-demand mode is a cryptogram, and the read processing module 9400, when performing the setting operation corresponding to the current read mode on the read content, may be configured to: and under the condition that the current reading mode is the point reading mode, controlling an audio output device of the reader to play the sound file matched with the recognized invisible code.

In one embodiment, the image identifying module 9300, when identifying the read content matching the current read mode from the image according to the current read mode, can be configured to: under the condition that the current reading mode is a point reading mode, selecting a partial area of the image according to a set size as a target area; and identifying the read content matched with the point-reading mode from the target area.

In one embodiment, the image identifying module 9300, when identifying the read content matching the current read mode from the image according to the current read mode, can be configured to: under the condition that the current reading mode is a scanning mode, extracting partial pixels from the image to generate a new image; and identifying the read content matched with the scanning mode from the new image.

< hardware configuration embodiment >

In one embodiment, the handheld reader provided by the present invention may include the camera module 200, the processor U1 and the memory 1300 of any of the above reader embodiments, the camera module 200 is configured to capture an image and provide the image to the processor U1; memory 1300 is used to store executable instructions; the processor U1 is configured to execute the read control method of any of the above method embodiments under the control of the instructions.

In one embodiment, the handheld reader provided by the present invention may include the camera module 200 of any of the above reader embodiments, and the reading control device 9000 shown in fig. 9, where the camera module 200 is configured to capture an image and provide the image to the reading control device 9000.

In this embodiment, the respective modules of the reading control device 9000 may be implemented by the processor U1 in the above embodiment.

The hardware structure embodiment and the reader embodiment focus on describing different parts of the reader, and it is clear to those skilled in the art that any of the hardware structure embodiment and any of the reader embodiment may be used alone or in combination with each other, and are not limited herein.

The present invention may be an apparatus, method and/or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied therewith for causing a processor to implement various aspects of the present invention.

The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.

The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.

The computer program instructions for carrying out operations of the present invention may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, aspects of the present invention are implemented by personalizing an electronic circuit, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA), with state information of computer-readable program instructions, which can execute the computer-readable program instructions.

Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.

These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.

The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, by software, and by a combination of software and hardware are equivalent.

Having described embodiments of the present invention, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terms used herein were chosen in order to best explain the principles of the embodiments, the practical application, or technical improvements to the techniques in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the invention is defined by the appended claims.

Claims

1. A handheld reader is characterized by comprising a shell, a processor and a camera module, wherein the processor and the camera module are arranged in the shell;

the handheld reader has two set reading modes, namely a point reading mode and a scanning mode; the filtering component comprises an infrared filter matched with the point reading mode and a visible light filter matched with the scanning mode;

2. The handheld reader of claim 1, wherein the filter assembly further comprises a mounting frame, the at least two filters being disposed side-by-side in the mounting frame, the power member being configured to: the installation frame drives the at least two optical filters to synchronously move on a plane perpendicular to the optical axis of the camera module.

3. The handheld reader according to claim 2, wherein the synchronous motion is a linear motion along a set direction, and the direction in which the at least two filters are arranged side by side is the same as the set direction.

4. The handheld reader of claim 3, wherein the filter assembly further comprises a guide member, the guide member having a guide direction that is the same as the setting direction, the guide member being coupled to the mounting frame, the coupling causing the mounting frame to move in the setting direction under the guide of the guide member.

5. The handheld reader of claim 1, wherein the at least two filters are located between the image sensor and the lens; or, the at least two optical filters are positioned between the lens and the image acquisition window.

6. The handheld reader according to any one of claims 1 to 5, further comprising a key circuit for selecting a current reading mode, a signal output of the key circuit being connected to a signal input of the processor, wherein the signal output outputs an electrical signal representing the selected current reading mode.

7. The handheld reader according to any one of claims 1 to 5, further comprising an infrared light module matching the point reading mode and a visible light module matching the scanning mode, wherein the infrared light module and the visible light module are configured to provide a light supplementing light source for the camera module, a switch control end of the infrared light module is connected to the first control signal output end of the processor, and a switch control end of the visible light module is connected to the second control signal output end of the processor.

8. The handheld reader according to claim 7, wherein an optical cavity is formed in the housing in communication with the image capture window, the camera module, the infrared light module, and the visible light module being disposed within the optical cavity.

9. The handheld reader of claim 7, wherein the circuit board pads of the infrared light module and the circuit board pads of the visible light module are located on a same plane, the plane passing through the camera module, and an optical axis of the camera module is parallel to the plane or located on the plane.

10. The handheld reader of claim 7, wherein the infrared light module and the visible light module are disposed on two sides of the camera module; or the infrared light module and the visible light module are arranged on the same side of the camera module.

11. The handheld reader of claim 7, wherein the infrared light module is disposed adjacent to the image acquisition window relative to the camera module; and/or the presence of a gas in the gas,

12. The handheld reader according to claim 7, wherein the infrared light module is disposed at a distance and at an angle relative to the image acquisition window such that the image acquisition window is completely within an illumination range of the infrared light module; and/or the presence of a gas in the gas,

13. The handheld reader according to claim 12, wherein the setting angle of the visible light module is such that an optical axis of the visible light module is inclined to a plane in which the image capturing window is located; and/or the presence of a gas in the gas,