WO2023274090A1

WO2023274090A1 - Scanning method and system for portable electronic device, and electronic device and storage medium

Info

Publication number: WO2023274090A1
Application number: PCT/CN2022/101303
Authority: WO
Inventors: 匡楠
Original assignee: 展讯半导体(南京)有限公司
Priority date: 2021-06-28
Filing date: 2022-06-24
Publication date: 2023-01-05
Also published as: CN113596276B; CN113596276A

Abstract

Disclosed in the present invention are a scanning method and system for a portable electronic device, and an electronic device and a storage medium. The scanning method comprises the following steps: acquiring a preset inclination parameter of a portable electronic device when an imaging plane of the portable electronic device and the surface of a scanning object meet a preset scanning condition; acquiring a current inclination parameter of the portable electronic device; and if the difference between the current inclination parameter and the preset inclination parameter is within a preset range, controlling the portable electronic device to scan the surface of the scanning object. By means of the scanning method and system for a portable electronic device, and the electronic device and the storage medium provided in the present invention, the portable electronic device is maintained at a reasonable pose during a scanning process, thereby ensuring the precision of a scanning result, improving the efficiency of a scanning operation, and also making the scanning result more suitable for post-processing such as cropping.

Description

Scanning method and system for portable electronic device, electronic device and storage medium

technical field

The invention relates to the technical field of computers, in particular to a scanning method and system of a portable electronic device, the electronic device and a storage medium.

Background technique

More and more portable electronic devices are equipped with document scanning functions comparable to traditional scanners by virtue of powerful shooting functions and graphics and image processing capabilities.

However, when portable electronic devices such as mobile phones are scanned, the user usually needs to hold the operation, and for most users, during a hand-held scan, especially for a long text, the electronic device should always be held firmly to keep it in the The same plane is by no means easy. This will cause the portable electronic device to be unstable during the shooting process, and the scanned image will be easily deformed and distorted, and the content will be skewed and incomplete, which will affect the recognition rate and accuracy of the text, and even make post-processing difficult.

At present, some portable electronic devices use additional brackets and other equipment to fix the pose during the scanning process, but this not only takes up extra space, but also greatly reduces the portability and ease of operation of portable electronic devices as scanning tools.

Contents of the invention

The technical problem to be solved by the present invention is to provide a scanning method and system for a portable electronic device, an electronic device and a storage medium in order to overcome the defects in the prior art that it is difficult to control the position and posture of the scanning device resulting in poor scanning effect.

The present invention solves the above technical problems through the following technical solutions:

The invention provides a scanning method of a portable electronic device, and the scanning method comprises the following steps:

Acquiring a preset tilt parameter of the portable electronic device when the preset scanning condition is satisfied between the imaging plane of the portable electronic device and the surface of the scanning object;

Acquiring the current tilt parameter of the portable electronic device;

If the error between the current tilt parameter and the preset tilt parameter is within a preset range, the portable electronic device is controlled to scan the surface of the scanning object.

Preferably, the preset scanning conditions include: the imaging plane of the portable electronic device is parallel to the surface of the scanning object; the tilt parameters include a horizontal tilt angle.

Preferably, the preset scanning conditions include: the central axis of the imaging plane of the portable electronic device is parallel to the central axis of the surface of the object to be scanned; the tilt parameter includes a magnetic azimuth.

Preferably, the scanning method also includes:

Scanning the surface of the scanning object by dynamic shooting to obtain at least two frames of images;

The target image is acquired from all the images, wherein in all the images, the absolute value of the difference between the tilt parameter corresponding to the target image and the preset tilt parameter is the smallest.

Preferably, the scanning method also includes:

Scanning the surface of the scanning object by panoramic shooting to obtain at least two frames of images;

Obtaining a reference image from all images, wherein in all images, the absolute value of the difference between the tilt parameter corresponding to the reference image and the preset tilt parameter is the smallest;

performing affine transformation on images other than the reference image, so that the tilt parameters of the affine transformed image are consistent with the tilt parameters corresponding to the reference image;

Perform image fusion processing on the reference image and the image after affine transformation to obtain a panoramic image.

Preferably, the step of scanning the surface of the scanning object by panoramic shooting to obtain at least two frames of images further includes: obtaining a scanning distance corresponding to the image, and the scanning distance is the distance of the camera of the portable electronic device The distance to the surface of the scanning object in the focal length direction;

The scan distance corresponding to the reference image is the reference scan distance;

The step of performing affine transformation on images other than the reference image also makes the scanning distance of the image after affine transformation consistent with the reference scanning distance.

Preferably, the scanning method also includes:

Acquiring at least two sets of correspondences between scanning distances and the area ratio of the scanning object in the imaging area of the portable electronic device under the scanning distances; the scanning distance is the focal length direction of the camera of the portable electronic device the distance to the surface of the scanned object;

determining an optimal scanning distance based on the correspondence;

Generate first prompt information, where the first prompt information includes the optimal scanning distance.

Preferably, after the step of acquiring the current tilt parameter of the portable electronic device, it further includes:

If the error between the current tilt parameter and the preset tilt parameter exceeds a preset range, second prompt information is generated, and the second prompt information is used to prompt the user to adjust the portable electronic device so that the The error is reduced to within the preset range.

The present invention also provides a scanning system of a portable electronic device, the scanning system comprising:

A parameter preset module, configured to obtain a preset tilt parameter of the portable electronic device when the preset scanning condition is satisfied between the imaging plane of the portable electronic device and the surface of the scanning object;

A parameter acquisition module, configured to acquire the current tilt parameter of the portable electronic device;

A scanning control module, configured to control the portable electronic device to scan the surface of the scanning object when the error between the current tilt parameter and the preset tilt parameter is within a preset range.

Preferably, the preset scanning condition includes: the imaging plane of the portable electronic device is parallel to the surface of the scanning object; the tilt parameter includes a horizontal tilt angle.

Preferably, the scanning system also includes:

A dynamic shooting module, configured to scan the surface of the scanned object by dynamic shooting to obtain at least two frames of images;

The target image acquiring module is configured to acquire the target image from all the images, wherein in all the images, the absolute value of the difference between the tilt parameter corresponding to the target image and the preset tilt parameter is the smallest.

Preferably, the scanning system also includes:

A panoramic shooting module, configured to scan the surface of the scanning object by panoramic shooting to obtain at least two frames of images;

A reference image acquisition module, configured to obtain a reference image from all images, wherein in all images, the absolute value of the difference between the tilt parameter corresponding to the reference image and the preset tilt parameter is the smallest;

An affine transformation module, configured to perform affine transformation on images other than the reference image, so that the tilt parameters of the affine transformed image are consistent with the tilt parameters corresponding to the reference image;

A panoramic image acquisition module, configured to perform image fusion processing on the reference image and the image after affine transformation, so as to acquire a panoramic image.

Preferably, the panoramic shooting module is further configured to: acquire a scanning distance corresponding to the image, the scanning distance being the distance from the camera of the portable electronic device to the surface of the scanning object in the focal length direction;

The affine transformation module is further configured to make the scanning distance of the affine transformed image consistent with the reference scanning distance.

Preferably, the scanning system also includes:

The imaging area analysis module is used to obtain the corresponding relationship between at least two sets of scanning distances and the area ratio of the scanning object in the imaging area of the portable electronic device under the scanning distance; the scanning distance is the The distance from the camera of the device to the surface of the scanned object in the focal length direction;

An optimal distance determination module, configured to determine an optimal scanning distance based on the correspondence;

The first prompt information module is configured to generate first prompt information, where the first prompt information includes the optimal scanning distance.

Preferably, the scanning system also includes:

The second prompt information module is configured to generate second prompt information when the error between the current tilt parameter and the preset tilt parameter exceeds a preset range, and the second prompt information is used to prompt the user to adjust the portable Electronic equipment, so that the error is reduced to within the preset range.

The present invention also provides an electronic device, including a memory, a processor, and a computer program stored on the memory and operable on the processor. When the processor executes the computer program, the above-mentioned scanning method of the portable electronic device is realized. .

The present invention also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the above scanning method for a portable electronic device is realized.

The positive and progressive effect of the present invention is: by providing a scanning method and system for a portable electronic device, an electronic device and a storage medium, the portable electronic device can maintain a reasonable posture during the scanning process, thereby ensuring the accuracy of the scanning result and improving the accuracy of the scanning result. It improves the efficiency of the scanning operation and makes the scanned results more suitable for post-processing such as cropping.

Description of drawings

FIG. 1 is a flowchart of a scanning method of a portable electronic device according to Embodiment 1 of the present invention.

FIG. 2 is a schematic diagram of obtaining a preset magnetic azimuth in Embodiment 1 of the present invention.

Fig. 3 is a schematic diagram of obtaining level readings in Embodiment 1 of the present invention.

FIG. 4 is a schematic diagram of a scanning object and an imaging area in Embodiment 1 of the present invention.

FIG. 5 is a block diagram of a scanning system of a portable electronic device according to Embodiment 2 of the present invention.

FIG. 6 is a structural block diagram of an electronic device according to Embodiment 3 of the present invention.

detailed description

The present invention is further illustrated below by means of examples, but the present invention is not limited to the scope of the examples.

Example 1

Referring to Fig. 1, the present embodiment specifically provides a scanning method of a portable electronic device, comprising the following steps:

S1. Acquiring a preset tilt parameter of the portable electronic device when the preset scanning condition is satisfied between the imaging plane of the portable electronic device and the surface of the scanning object.

S2. Obtain the current tilt parameter of the portable electronic device.

S3. If the error between the current tilt parameter and the preset tilt parameter is within a preset range, control the portable electronic device to scan the surface of the scanning object.

The portable electronic device in this embodiment is an electronic device with an image capturing function; including but not limited to a mobile phone and a tablet computer. Preferably, the shooting resolution of the electronic device meets the scanning resolution requirements. For example, the document scanning usually requires a resolution of 200dpi (Dots Per Inch, dots per inch), then the highest resolution of the corresponding electronic device should be able to reach Corresponding parameters to meet the scanning resolution of 200dpi. For ease of description, this embodiment only uses a mobile phone as an example to describe the scanning method of a portable electronic device. Similarly, for the scanned object, it is usually text, pattern or a combination thereof in a rectangular paper, and usually the scanned object has a relatively flat surface. In this embodiment, only the above-mentioned scanned text is used as the scanned object for illustration. It can be understood that the scanning method in this embodiment is not limited to the above-mentioned application scenarios of mobile phones and scanning text.

Step S1 acquires a preset tilt parameter of the portable electronic device when the preset scanning condition is satisfied between the imaging plane of the portable electronic device and the surface of the scanning object.

Usually, when scanning documents or certificates, professional scanners are used to fix the pressing paper, so there will be no deformation of the scanning results caused by the change of the shooting angle during the scanning process. However, it is difficult to ensure that the camera of the mobile phone is parallel to the scanned text in the process of scanning with a handheld mobile phone, and the scanned text is easily skewed and the content is incomplete. Even post-correction by scanning software is difficult. For example, because the original rectangular text is captured as a trapezoid, post-correction processing may require adjusting the text to a trapezoid or reducing the text content to ensure the shape of the text.

Therefore, in order to ensure that the mobile phone can maintain a reasonable posture during the scanning process to shoot the scanned text, step S1 first obtains the tilt parameters of the imaging plane of the mobile phone when the surface of the scanned text meets the preset scanning conditions. The preset scanning conditions It can be considered as the pose parameter sampling performed by the mobile phone based on the scanned text when the scanned text is in a relatively static environment. The purpose is to obtain a preset tilt parameter for the mobile phone based on the sampling result, and perform scanning according to the tilt parameter. During operation, satisfy the relatively ideal pose state and obtain the scanning effect that meets the requirements.

Among them, the imaging plane of the mobile phone is the image plane, and the imaging plane of the mobile phone is a photosensitive element such as a CCD (charge coupled device, charge coupled device). Usually, it is parallel to the shape of the tablet-shaped mobile phone, but it does not rule out that the shape of the mobile phone is relatively unique in the design of some electronic devices or the camera is installed on the side of the mobile phone, etc., then the imaging plane is not necessarily the plane formed by the mobile phone as a whole. coincident or parallel. To obtain the preset tilt parameters of the mobile phone, a plane that meets the maximum degree of correlation and the best evaluation standard with the scanning state of the mobile phone is required. Although theoretically the focal plane of the mobile phone is parallel to the imaging plane, depending on the scanned object, the focal plane needs to be adjusted to coincide with the image plane. Therefore, in this embodiment, the imaging plane of the mobile phone is set as a reference for the tilt parameter.

For scanned text, it can be placed flat in different positions, for example, it may be a horizontal desktop, it may be an inclined desk, and it may even be attached to a vertical wall or ceiling.

Obtaining the preset tilt parameters of the mobile phone can be implemented according to actual scenarios, and is not limited to a specific method. Due to the above-mentioned defects in the prior art, this embodiment aims to ensure that the imaging plane of the mobile phone and the surface of the scanned text have corresponding inclination parameters as much as possible, such as being parallel. Therefore, generally, to acquire the preset tilt parameters, as long as the tilt parameters of the surface on which the text is scanned are obtained, the preset tilt parameters of the mobile phone can be correspondingly acquired and set.

For example, if the desktop for placing the scanned text is a known horizontal desktop or a vertical wall, the relevant preset tilt parameters of the mobile phone can be directly obtained. Another example is that the corresponding parameters of the scanned text can be sensed and obtained through sensors. On this basis, step S1 can realize the acquisition of the preset tilt parameters for the mobile phone.

Step S2 obtains the current tilt parameter of the portable electronic device. As mentioned above, in the case of obtaining the preset tilt parameters of the mobile phone, it is also necessary to obtain the current tilt parameters of the mobile phone for comparison and calculation, and to determine whether the current pose of the mobile phone meets the above scanning requirements. Of course, the above-mentioned preset and current tilt parameters may include more than one kind, but they are calculated and compared in a one-to-one correspondence to obtain judgment results.

If the error between the current inclination parameter and the preset inclination parameter exceeds the preset range, it can be considered that scanning with the pose of the mobile phone at this time will not be able to obtain a satisfactory scanning result. Therefore, some necessary prompts can be sent to the user on the mobile phone; for example, the type of tilt parameter, the deviation angle, etc., so that the user can correct the scanning operation.

On the contrary, if the error between the current tilt parameter and the preset tilt parameter is within the preset range, step S3 controls the mobile phone to scan the scanned text. The preset range can usually be set according to the requirements for scanning precision, for example, for higher scanning precision, the preset range can be set close to zero. Since the above conditions are met, it can be considered that the scanning of the mobile phone pose at this time can obtain the scanning results that meet the requirements, that is, the content is complete, and the deformation is controllable and small.

As an optional implementation manner, the preset scanning condition is that the imaging plane of the portable electronic device is parallel to the surface of the scanning object. The tilt parameter is the horizontal tilt angle.

In order to overcome the above-mentioned problems caused by the non-parallel between the imaging plane of the mobile phone and the surface of the scanned text, the preset scanning condition is set in this embodiment to be that the imaging plane of the portable electronic device is parallel to the surface of the scanned object. Correspondingly, set the tilt parameter as the horizontal tilt angle. Horizontal inclination, that is, the angle formed by a straight line or plane and the horizontal plane. The preset horizontal inclination can represent the horizontality of the scanned text. For example, the scanned text on a horizontal desktop has a horizontal inclination of 0°; correspondingly, if the preset scanning condition is that the mobile phone is parallel to the scanned text, the mobile phone The condition for scanning is also that the horizontal inclination angle is 0°. Of course, those skilled in the art will know that the preset scanning conditions may also include other setting methods besides the above-mentioned imaging plane of the portable electronic device being parallel to the surface of the scanning object. For example, the error value of the horizontal inclination angle between the imaging plane of the portable electronic device and the surface of the scanning object is a preset interval. Specifically, for example, the error value of the horizontal inclination angle of the mobile phone and the surface of the scanned text is ±5°.

A spirit level is a commonly used measuring tool for measuring angles, and is used to measure horizontal inclination, horizontal position and vertical position of equipment installation, etc. According to the shape of the level, it can be divided into universal level, column level, frame level, ruler level and so on. The level tube of the bubble-type universal level is made of glass. The inner wall of the level tube is a curved surface with a certain radius of curvature. The tube is filled with liquid. When the level tilts, the air bubbles in the level tube will move toward the raised end of the level. , so as to determine the position of the horizontal plane. The larger the radius of curvature of the inner wall of the vial, the higher the resolution and the higher the accuracy of the level. In addition, an inductive spirit level with a readout display has similar functionality.

In this embodiment, if the mobile phone has the above-mentioned spirit level, and the appearance of the mobile phone is planar, which meets the requirement that the above-mentioned imaging plane is parallel to the overall plane of the mobile phone; then to make the mobile phone meet the preset scanning conditions, that is, the mobile phone is parallel to the scanned text, the following methods can be used accomplish:

Place the mobile phone close to the surface of the scanned text, and obtain the reading α of the level at this time as the preset horizontal inclination, which represents the inclination of the scanned text surface. Adjusting the posture of the mobile phone during scanning according to the reading α can ensure that the imaging plane and the surface of the scanned text maintain a good parallelism during the scanning process, and obtain better scanning results.

In this embodiment, by setting the preset scanning condition that the imaging plane of the portable electronic device is parallel to the surface of the scanning object, and setting the tilt parameter as a horizontal inclination angle, it is ensured that the imaging plane of the portable device can be parallel to the surface of the scanning object during the scanning process, thereby The deformation of the scanned image due to the excessively large included angle between the above two planes is avoided, the quality and ease of handling of the scanned text are ensured, and the scanning effect is improved.

As another optional implementation manner, the preset scanning condition is that the central axis of the imaging plane of the portable electronic device is parallel to the central axis of the surface of the scanning object; the tilt parameter is a magnetic azimuth.

Another difficulty in scanning text with portable devices such as mobile phones is that traditional scanning devices can place the scanned text at a fixed position to ensure that the scanned text is located in the imaging plane of the scanning device’s camera as a whole during the scanning, shooting and imaging process, and the scanning The central axis of the surface of the text is parallel or nearly parallel to the central axis of the imaging plane, so as to obtain a scanning result including a complete scan image with edges flush with the scanned text edges. Scanning by holding and other methods can usually ensure the overall imaging of the scanned text surface, but due to the above-mentioned reason that the pose of the mobile phone is not fixed, it is very easy to cause the final image due to the misalignment of the viewfinder frame during the shooting process. In the scanned image, the scanned text is skewed and requires post-processing such as rotation and cutting.

In order to overcome the above-mentioned problems caused by the inconsistency between the imaging plane of the mobile phone and the surface of the scanned text in the projection direction, this embodiment sets the preset scanning condition to be that the central axis of the imaging plane of the portable electronic device is parallel to the central axis of the surface of the scanned object. ;The tilt parameter is the magnetic azimuth.

The magnetic azimuth is the direction of the compass pointer, which is the angle between the north end of the magnetic meridian passing through a certain point and the clockwise direction to a certain straight line (that is, the line connecting magnetic south and magnetic north on the north and south poles of the earth). Of course, there is a magnetic declination because the north and south magnetic poles of the earth do not coincide with the north and south poles. The magnetic declination angles of various places are different depending on the latitude and longitude. to obtain relatively accurate readings. However, in this embodiment, the readings of the compass are obtained for the central axis of the imaging plane of the portable electronic device and the central axis of the surface of the scanned object, in order to determine their relative relationship, so there is no influence of the above-mentioned magnetic declination on the two located at the same place.

The preset magnetic azimuth can characterize the placement direction of the scanned text. Assuming that the scanned text is placed in a certain direction first, the imaging plane needs to be in this direction according to the above preset scanning conditions. Of course, those skilled in the art can know that the preset scanning conditions may also include other setting methods besides the above-mentioned direction of the imaging plane of the portable electronic device being consistent with the surface of the scanning object. For example, the central axis of the imaging plane of the portable electronic device and the central axis of the surface of the scanning object are within a preset interval. Specifically, for example, the error value between the central axis of the imaging plane of the portable electronic device and the central axis of the surface of the scanning object is ±5°.

In this embodiment, if the mobile phone has a compass function, and the shape of the mobile phone is rectangular, then the following methods can be used to make the mobile phone meet the above preset scanning conditions:

As shown in Figure 2, you can place the mobile phone close to the surface of the scanned text, and keep the two adjacent edges of the mobile phone flush with the two adjacent edges of the scanned text. Of course, it is understandable that the viewfinder needs to be maintained at this time Matches the length and width of the scanned text. Then, the reading β of the compass at this time is obtained as the preset magnetic azimuth, and the preset magnetic azimuth represents the placement direction of the scanned text surface. Adjusting the posture of the mobile phone during scanning according to the reading β can ensure that the imaging plane and the scanning text surface maintain a relatively consistent direction during the scanning process, and obtain better scanning results.

Of course, in addition to the above methods, the preset magnetic azimuth can also be obtained in other ways, such as aligning the mobile phone viewfinder with the scanned text in advance, and displaying vertical and horizontal indicator lines on the mobile phone viewfinder for easy alignment. When scanning the edge of the text, obtain the above preset magnetic azimuth.

In this embodiment, by setting the preset scanning condition that the imaging plane of the portable electronic device is consistent with the central axis direction of the scanning object surface, and setting the tilt parameter as the magnetic azimuth angle, the imaging plane of the portable electronic device and the scanning object surface are guaranteed during the scanning process. The orientation of the projection direction is consistent, thereby avoiding the imaging distortion of the scanned image due to the inconsistency of the directions of the above two planes, which is difficult to handle, and improving the quality of the scanned text.

As an optional implementation, the scanning method of this embodiment also includes the steps:

S41. Scanning the surface of the scanning object by dynamic shooting to obtain at least two frames of images.

S42. Acquire the target image from all the images, wherein, among all the images, the absolute value of the difference between the tilt parameter corresponding to the target image and the preset tilt parameter is the smallest.

At present, most mobile phones and other electronic devices that can be used as portable electronic devices have a dynamic shooting function, that is, they can shoot continuous images in a short time, usually up to 8 pictures per second and above. Utilizing the dynamic shooting function can better make up for the defect that the portable electronic device itself is not fixed in position and posture caused by scanning by holding or other methods.

Step S41 scans the surface of the object to be scanned by dynamic shooting to obtain at least two frames of images, that is, continuously shoots the scanned text through the above-mentioned dynamic shooting method to obtain continuous shooting images. Step S42 From all the images obtained by the above-mentioned continuous shooting, based on the comparison with the preset tilt parameters, select the image corresponding to the tilt parameter with the smallest absolute value of the difference between the preset tilt parameters as the target image, that is, the final scanning result .

In step S42 , it will be described by taking the above-mentioned horizontal inclination set as the inclination parameter when the function of the spirit level is used as an example. The spirit level is a bubble-type disk spirit level with a four-quadrant two-dimensional coordinate scale of abscissa and ordinate, and the horizontal inclination can be obtained by reading the ordinate and abscissa of the bubble. Then assume that when the scanned text is placed on the desktop, the coordinate reading of the bubble of the level is (x’, y’), then for n images obtained after continuous shooting, the coordinate reading of the bubble in it is obtained:

Wherein, (x _i , y _i ) are the coordinate readings of the bubbles of the spirit level in the i-th image, respectively. Therefore, corresponding to the finally obtained A _i is the target image that meets the requirements, that is, the imaging plane of the mobile phone that is closest to the parallel to the surface of the scanned text when shooting.

As an example, as shown in Figure 3, assuming that the scanned text is placed on a horizontal desktop, the obtained preset horizontal inclination angle is 0°, that is, the level bubble is centered when the mobile phone sticker is placed on the scanned text, and the coordinates are (0, 0); assuming that the mobile phone is held and the bubble passes the origin (0,0) along the dotted line track of the dotted line in Figure 3 to complete the dynamic shooting and obtain a set of images, only need to calculate:

The target image can be obtained.

Similarly, the above steps S41 and S42 are applicable to the application scenario where the tilt parameter is the magnetic azimuth angle, and in one application scenario, the above two current tilt parameters including at least the horizontal tilt angle and the magnetic azimuth angle can be combined with their respective The preset tilt parameters are compared, and the absolute values of the differences obtained respectively can be comprehensively calculated according to a certain weight.

For example, according to the above steps, the absolute value of the difference between the horizontal inclination of each picture and the preset horizontal inclination is T _α , and the absolute value of the difference between the horizontal inclination of each picture and the preset horizontal inclination is T _β , if the weight of the horizontal inclination consistent with the preset is set to 0.6, and the weight of the magnetic azimuth consistent with the preset is set to 0.4, then the comprehensive value of the absolute value of the difference between the tilt parameters of each picture S=T _α *0.6 +T _β *0.4, so that among all the images obtained by continuous shooting, the S with the minimum value is obtained; the corresponding image is the target image. In addition, it should be understood that the tilt parameters in this embodiment include but are not limited to the above two manners and combinations.

This embodiment makes full use of the dynamic shooting function of the portable electronic device, and overcomes the deviation of the scanned image caused by the unavoidable shaking during the shooting process by automatically selecting the best, thereby increasing the possibility of obtaining pictures that meet the quality requirements, and By replacing multiple scans with one continuous shooting, the scanning efficiency and scanning effect of portable devices are improved.

In an optional implementation manner, the scanning method of this embodiment further includes:

S401. Scan the surface of the scanned object by panoramic shooting, so as to obtain at least two frames of images.

S402. Acquire a reference image from all the images, wherein, among all the images, the absolute value of the difference between the tilt parameter corresponding to the reference image and the preset tilt parameter is the smallest.

S403. Perform affine transformation on images other than the reference image, so that the tilt parameters of the affine transformed image are consistent with the tilt parameters corresponding to the reference image.

S404. Perform image fusion processing on the reference image and the image after affine transformation to obtain a panoramic image.

At present, most mobile phones and other electronic devices that can be used as portable electronic devices also have a panoramic shooting function for taking panoramic photos (Panoramic Photo). Photos taken from the full range of the scene. In most cases, the scanned text is A4 (210 mm × 297 mm) size paper, but there are also some special content such as scrolls, code texts, etc. that require long strips of scanned text with a large aspect ratio as a carrier. In this application In order to scan all the text in the scene, it can be realized by panoramic shooting. However, in the process of panoramic shooting, the phone is held for a long time, and the camera is prone to shake and shift, resulting in poor shooting results. The long text scanning technology provided in this embodiment improves on the above defects caused by the unstable pose of the scanning device during the scanning process.

Step S401 scans the surface of the object to be scanned by dynamic shooting to obtain at least two frames of images, that is, continuously shoots the scanned text through the above-mentioned dynamic shooting method to obtain continuous shooting images. Step S42 From all the images obtained by the continuous shooting, based on the comparison with the preset tilt parameters, select the image corresponding to the tilt parameter with the smallest absolute value of the difference between the preset tilt parameters as the reference image. Of course, for step S402, the horizontal inclination, magnetic azimuth and other inclination parameters can also be evaluated, and the evaluation results can also be combined and evaluated in different ways such as weights as described in the previous embodiment. Since the specific principles involved are similar and no longer repeat.

Usually, the realization of panoramic shooting is divided into the following steps: feature detection, feature matching, calculation of homography matrix, image deformation and image stitching. Step S402 Obtain the reference image from all the captured images as the reference basis for feature detection and feature matching. Since the absolute value of the difference between the tilt parameter corresponding to the reference image and the preset tilt parameter is the smallest in all images, it can be considered that The reference image has a strong pose reference evaluation significance. The panorama image generation result based on the tilt parameters of the reference image and other image features can also better restore the content of the scanned text.

Step S403 performs affine transformation on images other than the reference image, so that the tilt parameters of the affine transformed image are consistent with the tilt parameters corresponding to the reference image.

Affine transformation, also known as affine mapping, refers to performing a linear transformation in a vector space in geometry followed by a translation to transform it into another vector space. The calculation process may include translation, rotation, scaling, shearing, and reflection; the calculated results have characteristics: the line segments are still line segments after the affine transformation and the ratio between them remains unchanged. In the process of generating the panoramic image, since the image with higher quality obtained in this embodiment is used as the reference image, other images are affine transformed based on the reference image to obtain a group of images, which can ensure the quality of the panoramic image.

Step S404 performs image fusion processing on the reference image and the affine transformed image to obtain a panoramic image. Since the image after affine transformation has a high degree of fitting of feature points, the accuracy of feature point extraction, matching, and registration for each image is higher when performing image fusion stitching, and the overlapping boundaries of each image are more accurate. The processing is more precise, resulting in better panoramic images.

This embodiment uses the panoramic image dynamic shooting function of the portable electronic device to scan long texts, and obtains the reference image based on the tilt parameters, so as to ensure that a more accurate panoramic image can be generated, and solves the problem of panoramic images caused by human operation errors in the shooting process in the past. Image distortion and lower quality issues improve scanning of long text on portable devices.

For the above embodiment, step S301 further includes: acquiring a scanning distance corresponding to the image, where the scanning distance is the distance from the camera of the portable electronic device to the surface of the scanning object in the focal length direction. The scanning distance corresponding to the reference image is the reference scanning distance; Step S303 also makes the scanning distance of the affine transformed image consistent with the reference scanning distance.

TOF (Time-of-Flight) camera is a 3D (three-dimensional) camera that uses a modulated light source to illuminate the scene and observes the reflected light for distance measurement. It uses the TOF measurement principle to determine the distance between the camera and the object or the surrounding environment. And generate a depth image or 3D image through the measured points. The principle of distance measurement is to measure the time required for light to travel a certain distance in a medium, usually the time it takes for the pulsed emitted light to reach the object and reflect back to the sensor. Since the TOF camera can collect depth of field information and obtain more image details, it can not only obtain more high-precision feature points for subsequent image fusion operations, but also obtain finer scanning effects. In this embodiment, the precise scanning distance is obtained by the TOF camera, which is helpful for more accurate feature matching in the process of image fusion. In this embodiment, by setting the comprehensive evaluation of the scanning distance and obtaining the reference image, the reference image has a higher reference significance in the process of generating the panoramic image, further improves the accuracy of the panoramic image, and further improves the image distortion problem of long text scanning And improved the scanning effect of portable devices for long text.

S501. Obtain a corresponding relationship between at least two sets of scanning distances and the area ratio of the scanning object within the imaging area of the portable electronic device under the scanning distances. It can be understood that the scanning distance is the same as that in the previous embodiment, which is the distance from the camera of the portable electronic device to the surface of the scanning object in the focal length direction.

S502. Determine an optimal scanning distance based on the corresponding relationship;

S503. Generate first prompt information, where the first prompt information includes the optimal scanning distance.

Referring to Fig. 4, for a fixedly placed scanning object A, in order to minimize unnecessary repeated scanning, its image a should be included in the imaging area a' of the portable electronic device as much as possible during the scanning process, and at the same time, in order to To ensure the scanning accuracy for later processing, the area ratio a/a' of the image a in the imaging area a' should be maximized as much as possible.

Specifically, step S501 can be during the preparation process of scanning, that is, the focusing stage, or during the scanning process, when it is detected that the distance between the camera of the portable electronic device and the surface of the scanned object changes in the focal length direction, the text can be obtained through text edge detection. Parameters such as range and text edge, and on this basis, at least two sets of correspondences between scanning distances and the above-mentioned area ratios are obtained. Step S502 calculates based on this and obtains the appropriate distance for scanning based on the placement position of the current scanning object, which is the optimal scanning distance. The optimal scanning distance is the scanning distance at which the area ratio a/a' is the maximum value while ensuring that the edges of the text all fall into the aforementioned imaging area a'.

Finally, step S503 displays the optimal scanning distance to help the user adjust the portable electronic device in time to scan more accurately.

In this embodiment, the area ratio of the scanned text is obtained by analyzing the imaged area of the scanned text, and then the optimal scanning distance for the scanned text is determined and prompted to the user, thereby helping to obtain a better scanning effect. Get the highest possible scan clarity while ensuring scan productivity.

In an optional implementation manner, after step S2, it also includes:

S3'. If the error between the current inclination parameter and the preset inclination parameter exceeds the preset range, generate second prompt information, the second prompt information is used to prompt the user to adjust the portable electronic device to reduce the error to within the preset range.

Specifically, when the inclination parameter is the horizontal inclination, if the current horizontal inclination is 30°, the preset horizontal inclination is 5°, and the preset error range is 10°; then the current horizontal inclination and the preset horizontal inclination If the error of 25° exceeds the preset range, a second prompt message will be issued. For example, the absolute value of the difference between the current horizontal inclination and the preset horizontal inclination can be displayed in real time, and a green arrow is displayed when it is detected that the absolute value is close to the above-mentioned preset range value; A red warning arrow is displayed when the range value is preset.

When the tilt parameter is magnetic azimuth, if the current magnetic azimuth is 20° south by west, the preset magnetic azimuth is 5° north by west, and the preset error range is 10°; then the current magnetic azimuth If the error of 25° between the angle and the preset magnetic azimuth exceeds the preset range, a second prompt message will be issued. At this time, the absolute value of the difference between the current magnetic azimuth and the preset magnetic azimuth can be displayed on the electronic device in real time, and an arrow can be displayed to indicate the direction in which the user should turn the portable electronic device. At the same time, the color of the arrow can be detected A green arrow is displayed when the absolute value of the difference is close to the preset range value; otherwise, a red warning arrow is displayed when the absolute value is detected to be far from the preset range value.

In this embodiment, when the tilt parameter exceeds the preset range during the scanning process of the portable electronic device, a targeted prompt is issued to help the user correct the deviation, which is beneficial to obtain a better scanning effect and improves user experience.

This embodiment provides a scanning method for a portable electronic device, so that the portable electronic device maintains a reasonable posture during the scanning process, thereby ensuring the accuracy of the scanning result, improving the efficiency of the scanning operation, and making the scanning result more suitable. For post-processing such as cropping.

Example 2

Referring to Fig. 5, this embodiment specifically provides a scanning system for portable electronic devices, and the scanning system includes:

The parameter preset module 1 is used to acquire the preset tilt parameters of the portable electronic device when the preset scanning condition is satisfied between the imaging plane of the portable electronic device and the surface of the scanning object;

A parameter acquisition module 2, configured to acquire the current tilt parameter of the portable electronic device;

The scanning control module 3 is configured to control the portable electronic device to scan the surface of the scanning object when the error between the current tilt parameter and the preset tilt parameter is within a preset range.

The portable electronic device in this embodiment is an electronic device with an image capturing function; including but not limited to a mobile phone and a tablet computer. Preferably, the shooting resolution of the electronic device meets the scanning resolution requirements. For example, the document scanning requires a resolution of 200dpi, and the highest resolution of the corresponding electronic device should be able to meet the corresponding parameters to meet the scanning requirements of 200dpi. resolution. For ease of description, this embodiment only uses a mobile phone as an example to describe the scanning system of a portable electronic device. For the scanned object, it is generally text, pattern or a combination thereof in a rectangular paper, and usually the scanned object has a relatively flat surface. In this embodiment, only the above-mentioned scanned text is used as the scanned object for illustration. It can be understood that the scanning system of this embodiment is not limited to the above-mentioned application scenarios of mobile phones and scanning text.

The parameter preset module 1 acquires a preset tilt parameter of the portable electronic device when the preset scanning condition is satisfied between the imaging plane of the portable electronic device and the surface of the scanning object.

Therefore, in order to ensure that the mobile phone can maintain a reasonable pose during the scanning process for shooting the scanned text, the parameter preset module 1 first obtains the tilt parameters of the imaging plane of the mobile phone when the surface of the scanned text meets the preset scanning conditions. Assuming that the scanning condition can be considered as the pose parameter sampling performed by the mobile phone based on the scanned text when the scanned text is in a relatively static environment, the purpose is to obtain a preset tilt parameter for the mobile phone based on the sampling result. When the parameters perform the scanning operation, the relatively ideal pose state is satisfied, and the scanning effect that meets the requirements is obtained.

Wherein, the imaging plane of the mobile phone is the image plane, and the imaging plane of the mobile phone is a photosensitive element such as a CCD. Usually, it is parallel to the shape of the tablet-shaped mobile phone, but it does not rule out that the shape of the mobile phone is relatively unique in the design of some electronic devices or the camera is installed on the side of the mobile phone, etc., then the imaging plane is not necessarily the plane formed by the mobile phone as a whole. coincident or parallel. To obtain the preset tilt parameters of the mobile phone, a plane that meets the maximum degree of correlation and the best evaluation standard with the scanning state of the mobile phone is required. Although theoretically the focal plane of the mobile phone is parallel to the imaging plane, depending on the scanned object, the focal plane needs to be adjusted to coincide with the image plane. Therefore, in this embodiment, the imaging plane of the mobile phone is set as a reference for the tilt parameter.

For example, if the desktop for placing the scanned text is a known horizontal desktop or a vertical wall, the relevant preset tilt parameters of the mobile phone can be directly obtained. Another example is that the corresponding parameters of the scanned text can be sensed and obtained through sensors. On this basis, the parameter preset module 1 can realize the acquisition of the preset tilt parameters for the mobile phone.

The parameter acquisition module 2 acquires the current tilt parameter of the portable electronic device. As mentioned above, in the case of obtaining the preset tilt parameters of the mobile phone, it is also necessary to obtain the current tilt parameters of the mobile phone for comparison and calculation, and to determine whether the current pose of the mobile phone meets the above scanning requirements. Of course, the above-mentioned preset and current tilt parameters may include more than one kind, but they are calculated and compared in a one-to-one correspondence to obtain judgment results.

On the contrary, if the error between the current tilt parameter and the preset tilt parameter is within the preset range, the scanning control module 3 controls the mobile phone to scan the scanned text. The preset range can usually be set according to the requirements for scanning precision, for example, for higher scanning precision, the preset range can be set close to zero. Since the above conditions are met, it can be considered that the scanning of the mobile phone pose at this time can obtain the scanning results that meet the requirements, that is, the content is complete, and the deformation is controllable and small.

As an optional implementation manner, the preset scanning condition is that the imaging plane of the portable electronic device is parallel to the surface of the scanning object; the tilt parameter is a horizontal tilt angle.

The preset magnetic azimuth can characterize the placement direction of the scanned text. Assuming that the scanned text is placed in a certain direction first, the imaging plane should also be in this direction according to the above preset scanning conditions. Of course, those skilled in the art can know that the preset scanning conditions may also include other setting methods besides the above-mentioned direction of the imaging plane of the portable electronic device being consistent with the surface of the scanning object. For example, the central axis of the imaging plane of the portable electronic device and the central axis of the surface of the scanning object are within a preset interval. Specifically, for example, the error value between the central axis of the imaging plane of the portable electronic device and the central axis of the surface of the scanning object is ±5°. In this embodiment, if the mobile phone has a compass function, and the shape of the mobile phone is rectangular, then the following methods can be used to make the mobile phone meet the above preset scanning conditions:

Place the mobile phone close to the surface of the scanned text, and keep the two adjacent edges of the mobile phone flush with the two adjacent edges of the scanned text. Of course, it is understandable that the length and width of the viewfinder frame and the scanned text should be maintained at this time unanimous. Then, the reading β of the compass at this time is obtained as the preset magnetic azimuth, and the preset magnetic azimuth represents the placement direction of the scanned text surface. Adjusting the posture of the mobile phone during scanning according to the reading β can ensure that the imaging plane and the scanning text surface maintain a relatively consistent direction during the scanning process, and obtain better scanning results.

As an optional implementation manner, the scanning system of this embodiment also includes:

A dynamic photographing module 41, configured to scan the surface of the scanned object through dynamic photographing to obtain at least two frames of images;

The target image acquiring module 42 is configured to acquire the target image from all the images, wherein in all the images, the absolute value of the difference between the tilt parameter corresponding to the target image and the preset tilt parameter is the smallest.

The dynamic photographing module 41 scans the surface of the scanning object through dynamic photographing to obtain at least two frames of images, that is, continuously photographs the scanned text in the above-mentioned dynamic photographing manner to obtain continuous photographing images. The target image acquisition module 42 selects the image corresponding to the tilt parameter with the smallest absolute value of the difference between the preset tilt parameters based on the comparison with the preset tilt parameters from all the images obtained by the above-mentioned continuous shooting, as the target image, that is, the final scan results.

For the target image acquisition module 42 , it will be described by taking the above-mentioned horizontal inclination set as the inclination parameter when it has the function of the spirit level as an example. Referring to Figure 3, the spirit level is a bubble-type disk spirit level with a four-quadrant two-dimensional coordinate scale of abscissa and ordinate, and the horizontal inclination can be obtained by reading the ordinate and abscissa of the bubble. Then assume that when the scanned text is placed on the desktop, the coordinate reading of the bubble of the level is (x’, y’), then for n images obtained after continuous shooting, the coordinate reading of the bubble in it is obtained:

Likewise, this embodiment is applicable to the application scenario where the tilt parameter is the magnetic azimuth, and in one application scenario, the above two current tilt parameters including at least the horizontal tilt and the magnetic azimuth can be combined with the respective preset The tilt parameters are compared, and the absolute value of the difference obtained separately can be comprehensively calculated according to a certain weight.

In an optional implementation manner, the scanning system of this embodiment further includes:

A panoramic shooting module 401, configured to scan the surface of the scanned object by panoramic shooting to obtain at least two frames of images;

A reference image acquisition module 402, configured to acquire a reference image from all images, wherein in all images, the absolute value of the difference between the tilt parameter corresponding to the reference image and the preset tilt parameter is the smallest;

An affine transformation module 403, configured to perform affine transformation on images other than the reference image, so that the inclination parameters of the affine transformed image are consistent with the inclination parameters corresponding to the reference image;

The panoramic image acquisition module 404 is configured to perform image fusion processing on the reference image and the affine transformed image to acquire a panoramic image.

At present, most mobile phones and other electronic devices that can be used as portable electronic devices also have a panoramic shooting function for taking panoramic photos. Panoramic photos usually refer to shooting that conforms to the normal effective angle of view of the human eye or includes the angle of view above the peripheral vision of both eyes or even a complete 360° scene range. Photo. Most of the scanned text is A4 size paper, but there are also some special content such as scrolls, code texts, etc. that require long strips of scanned text with a large aspect ratio as the carrier. In this application scenario, in order to store all the text Scanning can be achieved by panoramic shooting. However, in the process of panoramic shooting, the phone is held for a long time, and the camera is prone to shake and shift, resulting in poor shooting results. The long text scanning technology provided in this embodiment improves on the above defects caused by the unstable pose of the scanning device during the scanning process.

The panoramic shooting module 401 scans the surface of the scanning object through dynamic shooting to obtain at least two frames of images, that is, continuously shoots the scanned text through the above-mentioned dynamic shooting method to obtain continuous shooting images. The reference image acquisition module 402 selects the image corresponding to the tilt parameter with the smallest absolute value of the preset tilt parameter difference as the reference image from all the images obtained by the continuous shooting, based on the comparison with the preset tilt parameter. Of course, the reference image acquisition module 402 can also evaluate the horizontal inclination, magnetic azimuth and other inclination parameters, and the evaluation results can also be combined and evaluated in different ways such as weights as described in the previous embodiment. Let me repeat.

Usually, the realization of panoramic shooting is divided into the following steps: feature detection, feature matching, calculation of homography matrix, image deformation and image stitching. The reference image acquisition module 402 obtains the reference image from all captured images as a reference basis for feature detection and feature matching, because in all images, the absolute value of the difference between the tilt parameter corresponding to the reference image and the preset tilt parameter is the smallest , it can be considered that the reference image has a strong pose reference evaluation significance. The panorama image generation result based on the tilt parameters of the reference image and other image features can also better restore the content of the scanned text.

The affine transformation module 403 performs affine transformation on images other than the reference image, so that the inclination parameters of the affine transformed image are consistent with the inclination parameters corresponding to the reference image.

The panoramic image acquisition module 404 performs image fusion processing on the reference image and the affine transformed image to acquire a panoramic image. Since the image after affine transformation has a high degree of fitting of feature points, the accuracy of feature point extraction, matching, and registration for each image is higher when performing image fusion stitching, and the overlapping boundaries of each image are more accurate. The processing is more precise, resulting in better panoramic images.

This embodiment uses the panoramic image dynamic shooting function of the portable electronic device to scan long texts, and obtains the reference image based on the tilt parameters, thereby ensuring that a more accurate panoramic image can be generated, and solving the problems caused by human operation errors in the shooting process in the past. Panoramic image distortion and lower quality issues improve the scanning performance of long text on portable devices.

For the above embodiments, the panoramic shooting module 401 is also used to acquire the scanning distance corresponding to the image, and the scanning distance is the distance from the camera of the portable electronic device to the surface of the scanning object in the focal length direction. The scanning distance corresponding to the reference image is the reference scanning distance; the panoramic image acquisition module 404 is also configured to make the scanning distance of the affine transformed image consistent with the reference scanning distance.

The TOF camera is a 3D camera that uses a modulated light source to illuminate the scene and observe the reflected light for distance measurement. It uses the TOF measurement principle to determine the distance between the camera and the object or the surrounding environment, and generates a depth image or 3D image through the measured points. The distance principle is to measure the time required for light to travel a certain distance in a medium, usually the time it takes for the pulsed emitted light to reach the object and reflect back to the sensor. Since the TOF camera can collect depth of field information and obtain more image details, it can not only obtain more high-precision feature points for subsequent image fusion operations, but also obtain finer scanning effects. In this embodiment, the precise scanning distance is obtained by the TOF camera, which is helpful for more accurate feature matching in the process of image fusion.

In this embodiment, by setting the comprehensive evaluation of the scanning distance and obtaining the reference image, the reference image has a higher reference significance in the process of generating the panoramic image, further improves the accuracy of the panoramic image, and further improves the image distortion problem of long text scanning And improved the scanning effect of portable devices for long text.

The imaging area analysis module 51 is configured to obtain at least two sets of correspondences between scanning distances and the area ratio of the scanning object within the imaging area of the portable electronic device under the scanning distances. It can be understood that the scanning distance is the same as that in the previous embodiment, which is the distance from the camera of the portable electronic device to the surface of the scanning object in the focal length direction.

An optimal distance determination module 52, configured to determine an optimal scanning distance based on the correspondence;

The first prompt information module 53 is configured to generate first prompt information, which includes the optimal scanning distance.

Specifically, the imaging area analysis module 51 can detect that the distance between the camera of the portable electronic device and the surface of the scanned object changes in the focal length direction during the scanning preparation process, that is, the focusing stage, or during the scanning process. Detect and obtain parameters such as text range and text edge, and on this basis, obtain at least two sets of corresponding relationships between scanning distances and the above-mentioned area ratios. Based on this, the optimal distance determination module 52 calculates which distance should be used for scanning based on the placement position of the current scanning object, and the distance is the optimal scanning distance. The optimal scanning distance is the scanning distance at which the area ratio a/a' is the maximum value while ensuring that the edges of the text all fall into the aforementioned imaging area a'.

Finally, the first prompt information module 53 displays the optimal scanning distance to help the user adjust the portable electronic device in time to scan more accurately.

In an optional embodiment, the scanning system further includes a second prompt information module, configured to generate second prompt information when the error between the current tilt parameter and the preset tilt parameter exceeds a preset range, and the second prompt information It is used to prompt the user to adjust the portable electronic device to reduce the error within the preset range.

Specifically, when the inclination parameter is the horizontal inclination, if the current horizontal inclination is 30°, the preset horizontal inclination is 5°, and the preset error range is 10°; then the current horizontal inclination and the preset horizontal inclination If the error of 25° exceeds the preset range, the second prompt information module generates second prompt information. For example, the absolute value of the difference between the current horizontal inclination and the preset horizontal inclination can be displayed in real time, and a green arrow is displayed when it is detected that the absolute value is close to the above-mentioned preset range value; A red warning arrow is displayed when the range value is preset.

When the tilt parameter is magnetic azimuth, if the current magnetic azimuth is 20° south by west, the preset magnetic azimuth is 5° north by west, and the preset error range is 10°; then the current magnetic azimuth If the error of 25° between the angle and the preset magnetic azimuth exceeds the preset range, the second prompt information module generates second prompt information. At this time, the absolute value of the difference between the current magnetic azimuth and the preset magnetic azimuth can be displayed on the electronic device in real time, and an arrow can be displayed to indicate the direction in which the user should turn the portable electronic device. At the same time, the color of the arrow can be detected A green arrow is displayed when the absolute value of the difference is close to the preset range value; otherwise, a red warning arrow is displayed when the absolute value is detected to be far from the preset range value.

In this embodiment, when the tilt parameter exceeds the preset range during the scanning process of the portable electronic device, a targeted prompt is generated to help the user correct the deviation, which is beneficial to obtain a better scanning effect and improves user experience.

This embodiment provides a scanning system for a portable electronic device, so that the portable electronic device maintains a reasonable posture during the scanning process, thereby ensuring the accuracy of the scanning result, improving the efficiency of the scanning operation, and making the scanning result more suitable. For post-processing such as cropping.

Example 3

FIG. 6 is a schematic structural diagram of an electronic device provided by Embodiment 3 of the present invention. The electronic device includes a memory, a processor, and a computer program stored in the memory and operable on the processor. When the processor executes the program, the scanning method of the portable electronic device in Embodiment 1 is realized. The electronic device 30 shown in FIG. 6 is only an example, and should not limit the functions and scope of use of the embodiments of the present invention.

As shown in FIG. 6, the electronic device 30 may be in the form of a general-purpose computing device, for example, it may be a server device. Components of the electronic device 30 may include, but are not limited to: at least one processor 31 , at least one memory 32 , and a bus 33 connecting different system components (including the memory 32 and the processor 31 ).

The bus 33 includes a data bus, an address bus, and a control bus.

The memory 32 may include a volatile memory, such as a random access memory (RAM) 321 and/or a cache memory 322 , and may further include a read only memory (ROM) 323 .

Memory 32 may also include a program/utility tool 325 having a set (at least one) of program modules 324 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, which Each or some combination of the examples may include the implementation of a network environment.

The processor 31 executes various functional applications and data processing by running the computer program stored in the memory 32 , such as the scanning method of the portable electronic device in Embodiment 1 of the present invention.

Electronic device 30 may also communicate with one or more external devices 34 (eg, keyboards, pointing devices, etc.). Such communication may occur through input/output (I/O) interface 35 . Also, the model generation device 30 can also communicate with one or more networks (eg, a local area network (LAN), a wide area network (WAN) and/or a public network, such as the Internet) via a network adapter 36 . As shown in FIG. 6 , network adapter 36 communicates with other modules of model generation device 30 via bus 33 . It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the model generating device 30, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID (disk array) systems, tape drives, and data backup storage systems.

It should be noted that although several units/modules or subunits/modules of an electronic device are mentioned in the above detailed description, such division is only exemplary and not mandatory. Actually, according to the embodiment of the present invention, the features and functions of two or more units/modules described above may be embodied in one unit/module. Conversely, the features and functions of one unit/module described above can be further divided to be embodied by a plurality of units/modules.

Example 4

This embodiment provides a computer-readable storage medium, on which a computer program is stored. When the program is executed by a processor, the scanning method for the portable electronic device in Embodiment 1 is implemented.

Wherein, the readable storage medium that can be used more specifically may include, but is not limited to: portable disk, hard disk, random access memory, read-only memory, erasable programmable read-only memory, optical storage device, magnetic storage device or any of the above-mentioned the right combination.

In a possible implementation, the present invention can also be implemented in the form of a program product, which includes program code. When the program product runs on the terminal device, the program code is used to make the terminal device execute the portable In scanning methods for electronic devices.

Wherein, the program code for executing the present invention may be written in any combination of one or more programming languages, and the program code may be completely executed on the user equipment, partially executed on the user equipment, or used as an independent software Package execution, partly on the user device and partly on the remote device, or entirely on the remote device.

Although the specific implementation of the present invention has been described above, those skilled in the art should understand that this is only an example, and the protection scope of the present invention is defined by the appended claims. Those skilled in the art can make various changes or modifications to these embodiments without departing from the principle and essence of the present invention, but these changes and modifications all fall within the protection scope of the present invention.

Claims

A scanning method for a portable electronic device, characterized in that the scanning method comprises the following steps:

Acquiring a preset tilt parameter of the portable electronic device when the preset scanning condition is satisfied between the imaging plane of the portable electronic device and the surface of the scanning object;

Acquiring the current tilt parameter of the portable electronic device;

If the error between the current tilt parameter and the preset tilt parameter is within a preset range, the portable electronic device is controlled to scan the surface of the scanning object.
The scanning method for a portable electronic device according to claim 1, wherein the preset scanning condition includes: the imaging plane of the portable electronic device is parallel to the surface of the scanning object; and the inclination parameter includes a horizontal inclination.
The scanning method of a portable electronic device according to claim 1, wherein the preset scanning condition comprises: the central axis of the imaging plane of the portable electronic device is parallel to the central axis of the surface of the scanning object; the tilt parameter Includes magnetic azimuth.
The scanning method of a portable electronic device according to any one of claims 1-3, wherein the scanning method further comprises:

Scanning the surface of the scanning object by dynamic shooting to obtain at least two frames of images;

The target image is acquired from all the images, wherein in all the images, the absolute value of the difference between the tilt parameter corresponding to the target image and the preset tilt parameter is the smallest.
The scanning method of a portable electronic device according to any one of claims 1-3, wherein the scanning method further comprises:

Scanning the surface of the scanning object by panoramic shooting to obtain at least two frames of images;

Obtaining a reference image from all images, wherein in all images, the absolute value of the difference between the tilt parameter corresponding to the reference image and the preset tilt parameter is the smallest;

performing affine transformation on images other than the reference image, so that the tilt parameters of the affine transformed image are consistent with the tilt parameters corresponding to the reference image;

Perform image fusion processing on the reference image and the image after affine transformation to obtain a panoramic image.
The scanning method of a portable electronic device according to claim 5, wherein the step of scanning the surface of the scanning object by panoramic shooting to obtain at least two frames of images further comprises: obtaining a scan corresponding to the image distance, the scanning distance is the distance from the camera of the portable electronic device to the surface of the scanning object in the focal length direction;

The scanning distance corresponding to the reference image is the reference scanning distance;

The step of performing affine transformation on images other than the reference image also makes the scanning distance of the image after affine transformation consistent with the reference scanning distance.
The scanning method of portable electronic device as claimed in claim 1, is characterized in that, described scanning method also comprises:

Acquiring at least two sets of correspondences between scanning distances and the area ratio of the scanning object in the imaging area of the portable electronic device under the scanning distances; the scanning distance is the focal length direction of the camera of the portable electronic device the distance to the surface of the scanned object;

determining an optimal scanning distance based on the correspondence;

Generate first prompt information, where the first prompt information includes the optimal scanning distance.
The scanning method of the portable electronic device according to claim 1, wherein, after the step of obtaining the current tilt parameter of the portable electronic device, it also includes:

If the error between the current tilt parameter and the preset tilt parameter exceeds a preset range, second prompt information is generated, and the second prompt information is used to prompt the user to adjust the portable electronic device so that the The error is reduced to within the preset range.
A scanning system for a portable electronic device, characterized in that the scanning system includes:

A parameter preset module, configured to obtain a preset tilt parameter of the portable electronic device when the preset scanning condition is satisfied between the imaging plane of the portable electronic device and the surface of the scanning object;

A parameter acquisition module, configured to acquire the current tilt parameter of the portable electronic device;

A scanning control module, configured to control the portable electronic device to scan the surface of the scanning object when the error between the current tilt parameter and the preset tilt parameter is within a preset range.
The scanning system of a portable electronic device according to claim 9, wherein the preset scanning condition includes: the imaging plane of the portable electronic device is parallel to the surface of the scanning object; and the inclination parameter includes a horizontal inclination.
The scanning system of a portable electronic device according to claim 9, wherein the preset scanning conditions include: the central axis of the imaging plane of the portable electronic device is parallel to the central axis of the surface of the scanning object; the tilt parameter Includes magnetic azimuth.
The scanning system of a portable electronic device according to any one of claims 9-11, wherein the scanning system further comprises:

A dynamic shooting module, configured to scan the surface of the scanned object by dynamic shooting to obtain at least two frames of images;

The target image acquiring module is configured to acquire the target image from all the images, wherein in all the images, the absolute value of the difference between the tilt parameter corresponding to the target image and the preset tilt parameter is the smallest.
The scanning system of a portable electronic device according to any one of claims 9-11, wherein the scanning system further comprises:

A panoramic shooting module, configured to scan the surface of the scanning object by panoramic shooting to obtain at least two frames of images;

A reference image acquisition module, configured to obtain a reference image from all images, wherein in all images, the absolute value of the difference between the tilt parameter corresponding to the reference image and the preset tilt parameter is the smallest;

An affine transformation module, configured to perform affine transformation on images other than the reference image, so that the tilt parameters of the affine transformed image are consistent with the tilt parameters corresponding to the reference image;

A panoramic image acquisition module, configured to perform image fusion processing on the reference image and the affine transformed image to acquire a panoramic image.
The scanning system of a portable electronic device according to claim 13, wherein the panoramic shooting module is also used for: acquiring a scanning distance corresponding to the image, and the scanning distance is the focal length of the camera of the portable electronic device The distance to the surface of the scanned object in the direction;

The scanning distance corresponding to the reference image is the reference scanning distance;

The affine transformation module is further configured to make the scanning distance of the affine transformed image consistent with the reference scanning distance.
The scanning system of portable electronic equipment as claimed in claim 9, is characterized in that, described scanning system also comprises:

The imaging area analysis module is used to obtain the corresponding relationship between at least two sets of scanning distances and the area ratio of the scanning object in the imaging area of the portable electronic device under the scanning distance; the scanning distance is the The distance from the camera of the device to the surface of the scanned object in the focal length direction;

An optimal distance determination module, configured to determine an optimal scanning distance based on the correspondence;

The first prompt information module is used to generate first prompt information, and the first prompt information includes the optimal scanning distance.
The scanning system of portable electronic equipment as claimed in claim 9, is characterized in that, described scanning system also comprises:

The second prompt information module is configured to generate second prompt information when the error between the current tilt parameter and the preset tilt parameter exceeds a preset range, and the second prompt information is used to prompt the user to adjust the portable Electronic equipment, so that the error is reduced to within the preset range.
An electronic device, comprising a memory, a processor, and a computer program stored in the memory and operable on the processor, wherein any one of claims 1-8 is implemented when the processor executes the computer program The scanning method of the portable electronic device.
A computer-readable storage medium, on which a computer program is stored, wherein, when the computer program is executed by a processor, the scanning method for a portable electronic device according to any one of claims 1-8 is implemented.
A chip, characterized in that the chip is used to execute the method according to any one of claims 1-8.
A chip module, characterized in that the chip module includes a communication interface and a chip, wherein: the communication interface is used for internal communication of the chip module, or for communication between the chip module and external equipment; The chip is used to execute the method according to any one of claims 1-8.