CN117119113B - Camera self-calibration method and device of electronic equipment and electronic equipment - Google Patents
Camera self-calibration method and device of electronic equipment and electronic equipment Download PDFInfo
- Publication number
- CN117119113B CN117119113B CN202311364367.7A CN202311364367A CN117119113B CN 117119113 B CN117119113 B CN 117119113B CN 202311364367 A CN202311364367 A CN 202311364367A CN 117119113 B CN117119113 B CN 117119113B
- Authority
- CN
- China
- Prior art keywords
- camera
- calibration
- electronic device
- effective area
- electronic equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000001514 detection method Methods 0.000 claims abstract description 39
- 238000002360 preparation method Methods 0.000 claims abstract description 37
- 238000004590 computer program Methods 0.000 claims description 10
- 230000004044 response Effects 0.000 claims description 9
- 238000003860 storage Methods 0.000 claims description 7
- 238000005286 illumination Methods 0.000 claims description 5
- 230000001502 supplementing effect Effects 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000012015 optical character recognition Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 101000579646 Penaeus vannamei Penaeidin-1 Proteins 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000003708 edge detection Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/14—Image acquisition
- G06V30/142—Image acquisition using hand-held instruments; Constructional details of the instruments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/00002—Diagnosis, testing or measuring; Detecting, analysing or monitoring not otherwise provided for
- H04N1/00007—Diagnosis, testing or measuring; Detecting, analysing or monitoring not otherwise provided for relating to particular apparatus or devices
- H04N1/00018—Scanning arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/00002—Diagnosis, testing or measuring; Detecting, analysing or monitoring not otherwise provided for
- H04N1/00026—Methods therefor
- H04N1/00029—Diagnosis, i.e. identifying a problem by comparison with a normal state
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/00002—Diagnosis, testing or measuring; Detecting, analysing or monitoring not otherwise provided for
- H04N1/00071—Diagnosis, testing or measuring; Detecting, analysing or monitoring not otherwise provided for characterised by the action taken
- H04N1/00082—Adjusting or controlling
- H04N1/00087—Setting or calibrating
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/04—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa
- H04N1/19—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays
- H04N1/195—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays the array comprising a two-dimensional array or a combination of two-dimensional arrays
- H04N1/19594—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays the array comprising a two-dimensional array or a combination of two-dimensional arrays using a television camera or a still video camera
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
Abstract
The invention relates to the technical field of electronics, and provides a camera self-calibration method and device of electronic equipment and the electronic equipment. The camera self-calibration method of the electronic equipment comprises the following steps: receiving a first input for camera calibration of an electronic device; responding to the first input, controlling the electronic equipment to output guide information, wherein the guide information is used for guiding a user to finish calibration preparation work of the electronic equipment; determining that calibration preparation work is completed, controlling a camera to start to operate, and acquiring a detection image obtained by image acquisition of a scanning window; and extracting an effective area in the detection image, and carrying out parameter configuration on the camera based on the position parameters corresponding to the effective area. The invention can complete the automatic calibration of the camera with the assistance of the user, has simple and quick operation, ensures the accuracy of the camera in extracting the effective area in the scanned image, and ensures the accuracy of the Chinese character recognition result in the image.
Description
Technical Field
The present invention relates to the field of electronic technologies, and in particular, to a method and an apparatus for self-calibrating a camera of an electronic device, and an electronic device.
Background
In recent years, with the rapid discovery of artificial intelligence, electronic devices such as dictionary pens and scanners gradually enter lives of people, and great convenience is brought to work and study of people. For example, a dictionary pen, which combines machine vision technology and dictionary paperless technology, integrates the traditional paper book word-finding function into one intelligent dictionary pen. The dictionary pen collects images of paper documents through the camera and recognizes characters in the images, for example, the dictionary pen realizes the function of word searching through optical character recognition (Optical Character Recognition, abbreviated as OCR).
The cameras used by the dictionary pens belong to smaller electronic components, and because of mass production, the production quality of each camera can not be accurately guaranteed to meet the requirements, and the production quality is stirred up and down, so that the working parameters of part of cameras are unstable, and the image acquisition quality of the cameras is affected.
In practical application, once the existing dictionary pen leaves the factory, a user cannot calibrate the working parameters of the camera of the dictionary pen, and once the working parameters of the camera are unstable, the dictionary pen is difficult to accurately scan and fetch words through the camera.
Disclosure of Invention
The invention provides a camera self-calibration method and device of electronic equipment and the electronic equipment, which are used for solving the problem that a current user is difficult to calibrate working parameters of a camera of a scanning pen.
The invention provides a camera self-calibration method of electronic equipment, which comprises the following steps:
receiving a first input for camera calibration of an electronic device;
controlling the electronic equipment to output guide information in response to the first input, wherein the guide information is used for guiding a user to finish calibration preparation work of the electronic equipment;
determining that the calibration preparation work is completed, controlling the camera to start to operate, and acquiring a detection image obtained by acquiring an image of a scanning window;
and extracting an effective area in the detection image, and carrying out parameter configuration on the camera based on the position parameter corresponding to the effective area.
According to the camera self-calibration method of the electronic equipment, the step of controlling the electronic equipment to output the guide information comprises the following steps:
controlling a display screen on the electronic equipment to start operation so as to display the guide information;
and/or controlling the electronic equipment to send the guide information to a terminal equipment so that a user can acquire the guide information through the terminal equipment.
According to the camera self-calibration method of the electronic equipment, the guide information comprises at least one of the following information:
placing the electronic device horizontally;
along the shooting direction of the camera, determining that the front side of the scanning window is free of a shielding object;
and determining that the front side of the scanning window has no illumination or reflective object along the shooting direction of the camera.
According to the camera self-calibration method of the electronic device provided by the invention, the step of determining that the calibration preparation work is completed and controlling the camera to start and run comprises the following steps:
receiving a second input to the electronic device to complete the calibration preparation;
and responding to the second input, and controlling the camera to start running.
The camera self-calibration method of the electronic equipment provided by the invention further comprises the following steps: and after the calibration preparation work is determined to be completed, controlling the camera to start running and controlling a light supplementing lamp of the electronic equipment to be started.
The camera self-calibration method of the electronic equipment provided by the invention further comprises the following steps:
determining that the scanning pictures acquired by the camera are not received twice continuously and/or the scanning pictures acquired by the camera cannot be identified twice continuously, and controlling the electronic equipment to output calibration prompt information;
and executing the first input step according to the calibration prompt information.
According to the camera self-calibration method of the electronic equipment, one vertical side edge of the scanning window is provided with the positioning edge, the detection image comprises an effective area to be determined and a positioning auxiliary area where the positioning edge is located, and the positioning auxiliary area is arranged on one side of the effective area along the horizontal direction;
correspondingly, the step of extracting the effective area in the detection image comprises the following steps:
determining the position information of the positioning auxiliary area based on the position information of the positioning edge;
and determining the position of the effective area based on the position information of the positioning auxiliary area and the target width of the effective area.
The invention also provides a camera self-calibration device of the electronic equipment, which comprises:
the first input module is used for receiving a first input for calibrating the camera of the electronic equipment;
the information guiding module is used for responding to the first input and controlling the electronic equipment to output guiding information, and the guiding information is used for guiding a user to finish calibration preparation work of the electronic equipment;
the image acquisition module is used for determining that the calibration preparation work is completed, controlling the camera to start to operate, and acquiring a detection image obtained by image acquisition of a scanning window;
and the parameter configuration module is used for extracting an effective area in the detection image and carrying out parameter configuration on the camera based on the position parameter corresponding to the effective area.
The invention also provides electronic equipment, which comprises a memory, a processor and a computer program stored in the memory and capable of running on the processor, wherein the camera self-calibration method of the electronic equipment is realized when the processor executes the computer program.
The present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a camera self-calibration method of an electronic device as described in any of the above.
The invention also provides a computer program product comprising a computer program which when executed by a processor implements a camera self-calibration method of an electronic device as described in any one of the above.
According to the camera self-calibration method and device for the electronic equipment and the electronic equipment, the electronic equipment can be controlled to start automatic calibration on the camera according to the first input, before calibration, the electronic equipment is controlled to output guide information so as to guide a user to finish calibration preparation work on the electronic equipment, in the calibration process, the camera is controlled to acquire detection images corresponding to a scanning window, the effective area in the detection images is extracted, and parameter configuration is carried out on the camera based on position parameters corresponding to the effective area, so that calibration on working parameters of the camera is finished.
According to the method disclosed by the invention, after the electronic equipment leaves the factory, the automatic calibration of the camera can be completed under the assistance of the user according to the use requirement of the user on the camera or the current state of the camera, the operation is simple and quick, the stability of working parameters of the camera is ensured under the condition that the use of the user is not influenced, and the accuracy of scanning and reading words of the equipment is ensured.
Drawings
In order to more clearly illustrate the invention or the technical solutions of the prior art, the following description will briefly explain the drawings used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are some embodiments of the invention, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic flow chart of a camera self-calibration method of an electronic device provided by the invention;
FIG. 2 is a control block diagram of a dictionary pen provided by the present invention;
FIG. 3 is a schematic diagram of a dictionary pen showing calibration prompt information;
FIG. 4 is a schematic diagram of a dictionary pen display guide information structure provided by the present invention;
FIG. 5 is a schematic diagram of the structure of the dictionary pen for camera self-calibration provided by the invention;
FIG. 6 is a schematic diagram of a detected image of a scanning window acquired by a camera in a dictionary pen provided by the invention;
fig. 7 is a schematic structural diagram of a camera self-calibration device of an electronic device according to the present invention;
fig. 8 is a schematic structural diagram of an electronic device provided by the present invention.
Reference numerals:
1. dictionary pens; 11. a control main board; 12. a camera; 13. a display screen; 14. a control button; 15. triggering a switch; 16. scanning a window; 101. a pen body; 102. a pen point; 1011. a pen holding position;
2. detecting an image; 21. a first fixed region; 22. a second fixed region; 23. a third fixed region; 24. a fourth fixed region; 25. an effective area; 211. and positioning the edge.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The method and apparatus for camera self-calibration of the electronic device and the electronic device provided by the embodiments of the present invention are described in detail below with reference to fig. 1 to 8 through specific embodiments and application scenarios thereof.
As shown in fig. 1, an embodiment of the present invention provides a camera self-calibration method of an electronic device, including the following steps:
step 110, a first input is received for camera calibration of an electronic device.
It is understood that the electronic device may be a device that captures images for text recognition, e.g., a dictionary pen, scanner, smart phone, etc. Among them, for convenience of description, the electronic device shown in the following embodiments may be determined as a dictionary pen.
As shown in fig. 2 to 5, the dictionary pen 1 includes a camera 12, a control button 14, a trigger switch 15, and a control main board 11; the camera 12, the control button 14 and the trigger switch 15 are respectively connected with the control main board 11, the control button 14 and the control main board 11 are positioned on the pen body 101, the display screen 13 connected with the control main board 11 is further arranged on the pen body 101, the control button 14 is positioned at a pen holding position 1011 on the pen body 101, and the camera 12 and the trigger switch 15 are respectively arranged at the pen head 102 of the dictionary pen 1 and correspond to the scanning window 16 on the pen head 102.
Wherein the control main board 11 is configured to control the camera 12 to start according to the first trigger signal of the control button 14 and enter a preparation mode; controlling the camera 12 to enter a scanning mode according to a second trigger signal of the trigger switch 15; and entering a calibration mode to calibrate the camera 12 based on the first input.
In practical application, when the camera on the dictionary pen can not collect the scanned image on the paper and the screen waiting scanning medium for many times, the dictionary pen can receive the first input and enter the calibration mode to start the calibration of the camera.
Of course, if the user finds that the camera on the dictionary pen cannot acquire a clear scan image on the medium to be scanned during the process of using the dictionary pen, the user may actively perform the first input to the dictionary pen, so that the dictionary pen starts calibration of the camera.
Wherein the first input may be represented as at least one of:
first, the first input may appear as a physical key input.
In this embodiment, the dictionary pen is provided with a physical key corresponding to the calibration mode, and the first input of the user is received, which may be expressed as that the user presses or slides the corresponding physical key.
Second, the first input may be presented as a touch input, including but not limited to a click input, a slide input, a press input, and the like.
In this embodiment, the display screen on the dictionary pen is configured as a touch screen, and the touch screen is connected to the control motherboard of the dictionary pen, and receives the first input of the user, which may be represented by receiving a touch operation of the user in a touch area of the touch screen.
Third, the first input may appear as a voice input.
In this embodiment, a pickup may be further provided on the dictionary pen, and the pickup is connected to a control board of the dictionary pen. The pickup can enter a calibration mode by the control main board of the dictionary pen when receiving a voice instruction such as 'starting automatic calibration of the camera', so as to start automatic calibration of the camera.
Of course, in other embodiments, the first input may take other forms, including but not limited to character input, etc., which may be specifically determined according to actual needs, which is not limited by the embodiment of the present invention.
In step 120, in response to the first input, the electronic device is controlled to output guiding information, where the guiding information is used to guide the user to complete the calibration preparation work for the electronic device.
It can be understood that after the dictionary pen receives the first input, the dictionary pen can output the guiding information in a mode of graphic display or voice broadcasting on site, and the guiding information can also be sent to the smart phone bound with the dictionary pen so that a user can review through the smart phone.
The guiding information is used for guiding a user to set the gesture of placing the dictionary pen and the environment of placing the dictionary pen before the calibration of the camera is carried out, so that the influence of relevant environmental factors on the accuracy of the calibration of the camera is avoided.
And 130, determining that calibration preparation work is completed, controlling the camera to start to operate, and acquiring a detection image obtained by image acquisition of the scanning window.
It will be appreciated that when the user completes the calibration preparation, the user may input a determination instruction to the dictionary pen, and the dictionary pen may learn from the determination instruction that the user has completed the calibration preparation for the dictionary pen.
Of course, this embodiment may further set a response time for the first input, and the user may complete calibration preparation for the dictionary pen within the response time, and when the response time arrives, the dictionary pen may automatically determine that calibration preparation is completed.
When the camera is controlled to start, the camera shoots the scanning window to obtain a detection image corresponding to the scanning window as shown in fig. 6.
In the detection image, the left rectangular area and the right rectangular area are fixed areas, respectively correspond to the left baffle and the right baffle of the scanning window, the upper rectangular area and the lower rectangular area are also fixed areas, respectively scan the spring small feet on the upper side and the lower side of the scanning window, the colors of the spring small feet are different, the brightness of the whole area is also different, and the display effect of the detection image is further affected. Meanwhile, the region in the middle of the detected image is an effective region (Region of interest, abbreviated as ROI) containing characters, which can be acquired when the medium is scanned, and the effective region is used as variable information in an imaging region of the camera, and the brightness is influenced by the light source and four fixed regions.
And 140, extracting an effective area in the detection image, and carrying out parameter configuration on the camera based on the position parameters corresponding to the effective area.
It can be understood that when the detected image is processed, the effective area can be determined by combining the geometric parameters of the effective area according to the position information of any one of the four fixed areas, and then the parameters of the camera are configured according to the position parameters corresponding to the effective area, so that the dictionary pen can directly determine the effective area of the acquired image based on the configured parameters.
It should be noted that, the parameter configuration for the dictionary pens is performed for each dictionary pen based on the detected image collected by the dictionary pen, that is, the position parameters of the effective area are configured one-to-one with the dictionary pen, each dictionary pen has the position parameters of the effective area corresponding to the dictionary pen, and the position parameters of the effective areas corresponding to different dictionary pens may be different.
For the camera self-calibration method shown in the embodiment, the method can control the electronic device to start automatic calibration of the camera according to the first input, and before calibration, control the electronic device to output guide information so as to guide a user to complete calibration preparation work of the electronic device.
According to the method disclosed by the invention, after the electronic equipment leaves the factory, the automatic calibration of the camera can be completed under the assistance of the user according to the use requirement of the user on the camera or the current state of the camera, the operation is simple and quick, the stability of working parameters of the camera is ensured under the condition that the use of the user is not influenced, and the accuracy of scanning and reading words of the equipment is ensured.
In some embodiments, the camera self-calibration method shown in this embodiment further includes the following steps:
determining that the scanning pictures acquired by the camera are not received twice in succession and/or the scanning pictures acquired by the camera cannot be identified twice in succession, and controlling the electronic equipment to output calibration prompt information; and executing the first input step according to the calibration prompt information.
It can be understood that when the pen point of the dictionary pen is close to the medium to be scanned, the trigger switch is triggered, the control main board controls the camera to scan the medium to be scanned according to trigger information fed back by the trigger switch, and the scanned picture acquired by the camera is transmitted to the control main board in real time.
If the control main board does not receive the scanning pictures acquired by the camera twice continuously, the camera can be judged to need to be calibrated. Of course, the control main board cannot receive the scanned pictures acquired by the camera, and besides the working parameters of the camera need to be reconfigured, the camera may also be in fault.
In some examples, the recognition result of the scan picture acquired by the camera may be further determined in a case where it is determined that the camera has not failed. If the control main board cannot recognize the scanned picture twice continuously, the camera can be judged to need to be calibrated.
As shown in fig. 3, when it is determined that the camera needs to be calibrated, the control main board may control the display screen of the dictionary pen to display calibration prompt information. For example, the calibration hint information is "no content identified, suggesting to upgrade the precision scanning function". At this time, two virtual buttons of "calibration" and "cancel" are displayed on the lower side of the calibration prompt information, and the operator may click on the "calibration" button to perform the step of the first input.
In some embodiments, the step of controlling the electronic device to output the guiding information includes: controlling a display screen on the electronic equipment to start running so as to display guide information;
and/or the control electronic equipment sends the guiding information to the terminal equipment so that the user can acquire the guiding information through the terminal equipment.
As shown in fig. 4, after the step of the first input is performed by the operator, the control main board controls the display screen of the dictionary pen to display guiding information in response to the first input, so as to guide the user to complete the calibration preparation work of the dictionary pen.
Wherein the guidance information includes at least one of the following information:
placing the electronic device horizontally;
along the shooting direction of the camera, determining that the front side of the scanning window is free of a shielding object;
and determining that the front side of the scanning window has no illumination or reflective object along the shooting direction of the camera.
It can be understood that, because the calibration work on the camera is usually carried out indoors, and the lighting lamp is usually arranged on the roof of the room, the influence of the light rays emitted by the lighting lamp on the brightness around the scanning window can be reduced to a certain extent by horizontally placing the dictionary pen; meanwhile, the dictionary pen is horizontally placed, so that the optical axis of the camera is horizontally arranged, image processing is conveniently carried out on the detection image obtained by the camera collecting and scanning window, operation work is simplified, and an effective area in the detection image is quickly and accurately obtained.
Meanwhile, in the case of horizontally placing the dictionary pen, it is necessary to determine that there is no obstruction within a preset distance of the front side of the scanning window. Wherein the preset distance is greater than or equal to 50cm.
In addition, in the case of horizontally placing the dictionary pen, by determining that the front side of the scanning window has no illumination or reflective object, the influence of the ambient light on the brightness around the scanning window can be further ensured.
In some embodiments, the step of determining that calibration preparation is completed and controlling the camera to start operation includes:
receiving a second input to perform a calibration preparation for the electronic device;
in response to the second input, the camera is controlled to start operating.
It can be understood that the control main board can display the virtual button of 'ok' at the lower side of the calibration prompt information while controlling the display screen to display the calibration prompt information, and the operator can click the 'ok' button to complete the second input.
Then, the control main board responds to the second input to control the camera to start operation and acquire a detection image obtained by image acquisition of the scanning window.
In some embodiments, the camera self-calibration method shown in this embodiment further includes:
after the calibration preparation work is determined to be completed, the camera is controlled to start to operate, and meanwhile, the light supplementing lamp of the electronic equipment is controlled to be started.
It can be appreciated that, for the dictionary pen, according to the focal length range of the camera, a light-compensating lamp needs to be configured for the camera to ensure that the camera collects clear images based on the illumination environment provided by the light-compensating lamp.
Therefore, the embodiment controls the camera and the light supplementing lamp to start running at the same time, so that the working condition of the camera can be truly simulated when the camera is calibrated, and the parameter configuration of the camera is more accurately ensured according to the detection image acquired by the camera.
In some embodiments, a positioning edge is disposed on one vertical side of the scanning window, and the detection image includes an effective area to be determined and a positioning auxiliary area where the positioning edge is located, where the positioning auxiliary area is disposed on one side of the effective area along a horizontal direction.
Accordingly, the step of extracting the effective area in the detection image shown in the embodiment includes:
determining the position information of the positioning auxiliary area based on the position information of the positioning edge;
the position of the effective area is determined based on the position information of the positioning assistance area and the target width of the effective area.
As shown in fig. 6, the detection image 2 includes a first fixed region 21, a second fixed region 22, a third fixed region 23, and a fourth fixed region 24; the first fixed area 21 corresponds to the left baffle of the scanning window, the third fixed area 23 corresponds to the right baffle of the scanning window, the second fixed area 22 corresponds to the upper spring foot of the scanning window, and the fourth fixed area 24 corresponds to the lower spring foot of the scanning window.
The first fixing area 21, the second fixing area 22, the third fixing area 23 and the fourth fixing area 24 enclose a rectangular frame structure, and the effective area 25 is arranged on the inner side of the rectangular frame structure; the first fixing area 21 is provided with a positioning edge 211, and the positioning edge 211 may be an area with a special color mark disposed in the first fixing area 21, and the positioning edge 211 may be identified by performing edge detection on the first fixing area 21, so as to obtain the position information of the positioning edge 211.
Further, the step of extracting the effective area in the detection image includes:
determining an abscissa of the first vertical boundary of the effective area, which is close to the first fixed area in the horizontal direction, based on the position information of the positioning edge in the first fixed area;
determining an abscissa of a second vertical boundary of the effective area, which is close to the third fixed area in the horizontal direction, based on the abscissa of the first vertical boundary and the target width of the effective area;
the effective area is determined based on the abscissa of the first vertical boundary, the abscissa of the second vertical boundary, and the ordinate of the two boundaries of the effective area in the vertical direction, the vertical direction being perpendicular to the horizontal direction.
In practical application, an image corresponding to the first fixed area can be cut in the detection image, binarization processing is carried out on the cut image, and the abscissa of the left boundary and the right boundary of the positioning edge is extracted based on the image after the binarization processing; and determining the abscissa of the first vertical boundary of the effective area, which is close to the first fixed area in the horizontal direction, based on the abscissas of the left and right boundaries of the positioning edge.
As shown in fig. 7, the embodiment of the invention further provides a camera self-calibration device of an electronic device, which includes the following modules:
a first input module 710 for receiving a first input for camera calibration of the electronic device.
An information guiding module 720, configured to control the electronic device to output guiding information in response to the first input, where the guiding information is used to guide the user to complete calibration preparation for the electronic device;
the image acquisition module 730 is configured to determine that calibration preparation is completed, control the camera to start running, and acquire a detection image obtained by performing image acquisition on the scanning window;
the parameter configuration module 740 is configured to extract an effective area in the detected image, and perform parameter configuration on the camera based on a position parameter corresponding to the effective area.
Specifically, the camera self-calibration device shown in this embodiment may control the electronic device to start automatic calibration on the camera according to the first input, and before the calibration, control the electronic device to output guide information to guide a user to complete calibration preparation work on the electronic device, in the calibration process, control the camera to collect a detection image corresponding to a scanning window, and perform parameter configuration on the camera by extracting an effective area in the detection image based on a position parameter corresponding to the effective area, thereby completing calibration on working parameters of the camera.
According to the device disclosed by the invention, the automatic calibration of the camera can be completed under the assistance of the user according to the use requirement of the user on the camera or the current state of the camera, the operation is simple and quick, the stability of the working parameters of the camera is ensured under the condition that the use of the user is not influenced, and the accuracy of the scanning and the word reading of the equipment is ensured.
In some embodiments, the image acquisition module 730 shown in this embodiment specifically includes:
a second input module for receiving a second input for performing a calibration preparation for the electronic device;
and the control module is used for responding to the second input and controlling the camera to start running.
Fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, where the electronic device may be a dictionary pen, a scanner, a smart phone, etc.
As shown in fig. 8, the electronic device may include: processor 810, communication interface (Communications Interface) 820, memory 830, and communication bus 840, wherein processor 810, communication interface 820, memory 830 accomplish communication with each other through communication bus 840. The processor 810 may invoke logic commands in the memory 830 to perform the following method:
receiving a first input for camera calibration of an electronic device;
responding to the first input, controlling the electronic equipment to output guide information, wherein the guide information is used for guiding a user to finish calibration preparation work of the electronic equipment;
determining that calibration preparation work is completed, controlling a camera to start to operate, and acquiring a detection image obtained by image acquisition of a scanning window;
and extracting an effective area in the detection image, and carrying out parameter configuration on the camera based on the position parameters corresponding to the effective area.
In addition, the logic commands in the memory 830 described above may be implemented in the form of software functional units and may be stored in a computer readable storage medium when sold or used as a stand alone product. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in the form of a software product stored in a storage medium, comprising several commands for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
Embodiments of the present invention also provide a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, is implemented to perform the methods provided by the above embodiments, for example, comprising:
receiving a first input for camera calibration of an electronic device;
responding to the first input, controlling the electronic equipment to output guide information, wherein the guide information is used for guiding a user to finish calibration preparation work of the electronic equipment;
determining that calibration preparation work is completed, controlling a camera to start to operate, and acquiring a detection image obtained by image acquisition of a scanning window;
and extracting an effective area in the detection image, and carrying out parameter configuration on the camera based on the position parameters corresponding to the effective area.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on this understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several commands for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the respective embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; while the invention has been described in detail with reference to the foregoing embodiments, it will be appreciated by those skilled in the art that variations may be made in the techniques described in the foregoing embodiments, or equivalents may be substituted for elements thereof; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (9)
1. A camera self-calibration method of an electronic device, comprising:
receiving a first input for camera calibration of an electronic device;
controlling the electronic equipment to output guide information in response to the first input, wherein the guide information is used for guiding a user to finish calibration preparation work of the electronic equipment;
determining that the calibration preparation work is completed, controlling the camera to start to operate, and acquiring a detection image obtained by acquiring an image of a scanning window;
extracting an effective area in the detection image, and carrying out parameter configuration on the camera based on position parameters corresponding to the effective area;
a positioning edge is arranged on one vertical side edge of the scanning window, the detection image comprises an effective area to be determined and a positioning auxiliary area where the positioning edge is located, and the positioning auxiliary area is arranged on one side of the effective area along the horizontal direction;
correspondingly, the step of extracting the effective area in the detection image comprises the following steps:
determining the position information of the positioning auxiliary area based on the position information of the positioning edge;
determining the position of the effective area based on the position information of the positioning auxiliary area and the target width of the effective area;
the electronic device is a dictionary pen.
2. The camera self-calibration method of an electronic device according to claim 1, wherein the step of controlling the electronic device to output guide information comprises:
controlling a display screen on the electronic equipment to start operation so as to display the guide information;
and/or controlling the electronic equipment to send the guide information to a terminal equipment so that a user can acquire the guide information through the terminal equipment.
3. The method of camera self-calibration of an electronic device according to claim 1, wherein the guidance information includes at least one of:
placing the electronic device horizontally;
along the shooting direction of the camera, determining that the front side of the scanning window is free of a shielding object;
and determining that the front side of the scanning window has no illumination or reflective object along the shooting direction of the camera.
4. The method for self-calibration of a camera of an electronic device according to claim 1, wherein said determining that said calibration preparation is completed and controlling said camera to start operation comprises:
receiving a second input to the electronic device to complete the calibration preparation;
and responding to the second input, and controlling the camera to start running.
5. The method for camera self-calibration of an electronic device of claim 1, further comprising: and after the calibration preparation work is determined to be completed, controlling the camera to start running and controlling a light supplementing lamp of the electronic equipment to be started.
6. The camera self-calibration method of an electronic device according to any one of claims 1 to 5, further comprising:
determining that the scanning pictures acquired by the camera are not received twice continuously and/or the scanning pictures acquired by the camera cannot be identified twice continuously, and controlling the electronic equipment to output calibration prompt information;
and executing the first input step according to the calibration prompt information.
7. A camera self-calibration device for an electronic device, comprising:
the first input module is used for receiving a first input for calibrating the camera of the electronic equipment;
the information guiding module is used for responding to the first input and controlling the electronic equipment to output guiding information, and the guiding information is used for guiding a user to finish calibration preparation work of the electronic equipment;
the image acquisition module is used for determining that the calibration preparation work is completed, controlling the camera to start to operate, and acquiring a detection image obtained by image acquisition of a scanning window;
the parameter configuration module is used for extracting an effective area in the detection image and carrying out parameter configuration on the camera based on the position parameter corresponding to the effective area;
a positioning edge is arranged on one vertical side edge of the scanning window, the detection image comprises an effective area to be determined and a positioning auxiliary area where the positioning edge is located, and the positioning auxiliary area is arranged on one side of the effective area along the horizontal direction;
correspondingly, the step of extracting the effective area in the detection image comprises the following steps:
determining the position information of the positioning auxiliary area based on the position information of the positioning edge;
determining the position of the effective area based on the position information of the positioning auxiliary area and the target width of the effective area;
the electronic device is a dictionary pen.
8. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method of camera self-calibration of the electronic device of any one of claims 1 to 6 when the computer program is executed by the processor.
9. A non-transitory computer readable storage medium having stored thereon a computer program, wherein the computer program when executed by a processor implements the camera self-calibration method of an electronic device as claimed in any of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311364367.7A CN117119113B (en) | 2023-10-20 | 2023-10-20 | Camera self-calibration method and device of electronic equipment and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311364367.7A CN117119113B (en) | 2023-10-20 | 2023-10-20 | Camera self-calibration method and device of electronic equipment and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117119113A CN117119113A (en) | 2023-11-24 |
| CN117119113B true CN117119113B (en) | 2024-01-23 |
Family
ID=88805865
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311364367.7A Active CN117119113B (en) | 2023-10-20 | 2023-10-20 | Camera self-calibration method and device of electronic equipment and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117119113B (en) |
Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5249069A (en) * | 1991-02-11 | 1993-09-28 | Eastman Kodak Company | Method and apparatus for automatic alignment of front and rear scanning cameras |
| JP2006337873A (en) * | 2005-06-03 | 2006-12-14 | Fujifilm Holdings Corp | Exposure device and exposure method |
| JP2006337874A (en) * | 2005-06-03 | 2006-12-14 | Fujifilm Holdings Corp | Exposure device and exposure method |
| US7623274B1 (en) * | 2004-12-22 | 2009-11-24 | Google Inc. | Three-dimensional calibration using orientation and position sensitive calibration pattern |
| WO2010118292A1 (en) * | 2009-04-09 | 2010-10-14 | Dynavox Systems, Llc | Calibration free, motion tolerant eye-gaze direction detector with contextually aware computer interaction and communication methods |
| US8059154B1 (en) * | 2008-10-06 | 2011-11-15 | Verint Systems Ltd. | Systems and methods for automatic camera calibration |
| CN110213456A (en) * | 2019-06-10 | 2019-09-06 | Oppo广东移动通信有限公司 | Scan document bearing calibration, electronic device and computer readable storage medium |
| CN111080571A (en) * | 2019-11-15 | 2020-04-28 | 北京迈格威科技有限公司 | Camera shielding state detection method and device, terminal and storage medium |
| CN111783768A (en) * | 2020-07-07 | 2020-10-16 | 科大讯飞股份有限公司 | Scanning pen |
| CN111783769A (en) * | 2020-08-17 | 2020-10-16 | 深圳市学之友科技有限公司 | Camera calibration device and method applied to scanning translation pen and dictionary pen |
| CN113382171A (en) * | 2021-06-21 | 2021-09-10 | 车路通科技(成都)有限公司 | Traffic camera automatic correction method, device, equipment and medium |
| CN113873145A (en) * | 2021-09-02 | 2021-12-31 | 北京城市网邻信息技术有限公司 | Vehicle source information acquisition method and device, electronic equipment and readable medium |
| WO2022022715A1 (en) * | 2020-07-30 | 2022-02-03 | 华为技术有限公司 | Photographing method and device |
| DE102020122319A1 (en) * | 2020-08-26 | 2022-03-03 | Jenoptik Optical Systems Gmbh | Method and control device for calibrating a laser scanner device for material processing |
| DE102020214250A1 (en) * | 2020-11-12 | 2022-05-12 | Robert Bosch Gesellschaft mit beschränkter Haftung | Method for providing calibration data for calibrating a camera, method for calibrating a camera, method for producing at least one predefined point-symmetrical area and device |
| GB202210561D0 (en) * | 2021-07-30 | 2022-08-31 | Canon Kk | Image pickup apparatus used as action camera, calibration system, control method for image pickup apparatus, and storage medium storing control program for... |
| CN115002443A (en) * | 2022-04-29 | 2022-09-02 | 北京城市网邻信息技术有限公司 | Image acquisition processing method and device, electronic equipment and storage medium |
| CN116193108A (en) * | 2023-04-24 | 2023-05-30 | 知行汽车科技(苏州)股份有限公司 | Online self-calibration method, device, equipment and medium for camera |
| CN116363174A (en) * | 2021-12-27 | 2023-06-30 | Oppo广东移动通信有限公司 | Parameter calibration method, storage medium, co-processing chip and electronic equipment |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3929384B2 (en) * | 2002-10-23 | 2007-06-13 | オリンパス株式会社 | Viewfinder, photographing apparatus, marker presenting member, and photographing method for calibration |
| US6809330B2 (en) * | 2002-12-18 | 2004-10-26 | Lockheed Martin Corporation | Automatic calibration and built-in diagnostic procedures for line scan cameras |
| US9677899B2 (en) * | 2014-12-01 | 2017-06-13 | Thinkware Corporation | Electronic apparatus, control method thereof, computer program, and computer-readable recording medium |
| JP6914669B2 (en) * | 2017-02-14 | 2021-08-04 | キヤノン株式会社 | Imaging device and its control method |
-
2023
- 2023-10-20 CN CN202311364367.7A patent/CN117119113B/en active Active
Patent Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5249069A (en) * | 1991-02-11 | 1993-09-28 | Eastman Kodak Company | Method and apparatus for automatic alignment of front and rear scanning cameras |
| US7623274B1 (en) * | 2004-12-22 | 2009-11-24 | Google Inc. | Three-dimensional calibration using orientation and position sensitive calibration pattern |
| JP2006337873A (en) * | 2005-06-03 | 2006-12-14 | Fujifilm Holdings Corp | Exposure device and exposure method |
| JP2006337874A (en) * | 2005-06-03 | 2006-12-14 | Fujifilm Holdings Corp | Exposure device and exposure method |
| US8059154B1 (en) * | 2008-10-06 | 2011-11-15 | Verint Systems Ltd. | Systems and methods for automatic camera calibration |
| WO2010118292A1 (en) * | 2009-04-09 | 2010-10-14 | Dynavox Systems, Llc | Calibration free, motion tolerant eye-gaze direction detector with contextually aware computer interaction and communication methods |
| CN110213456A (en) * | 2019-06-10 | 2019-09-06 | Oppo广东移动通信有限公司 | Scan document bearing calibration, electronic device and computer readable storage medium |
| CN111080571A (en) * | 2019-11-15 | 2020-04-28 | 北京迈格威科技有限公司 | Camera shielding state detection method and device, terminal and storage medium |
| CN111783768A (en) * | 2020-07-07 | 2020-10-16 | 科大讯飞股份有限公司 | Scanning pen |
| WO2022022715A1 (en) * | 2020-07-30 | 2022-02-03 | 华为技术有限公司 | Photographing method and device |
| CN111783769A (en) * | 2020-08-17 | 2020-10-16 | 深圳市学之友科技有限公司 | Camera calibration device and method applied to scanning translation pen and dictionary pen |
| DE102020122319A1 (en) * | 2020-08-26 | 2022-03-03 | Jenoptik Optical Systems Gmbh | Method and control device for calibrating a laser scanner device for material processing |
| DE102020214250A1 (en) * | 2020-11-12 | 2022-05-12 | Robert Bosch Gesellschaft mit beschränkter Haftung | Method for providing calibration data for calibrating a camera, method for calibrating a camera, method for producing at least one predefined point-symmetrical area and device |
| CN113382171A (en) * | 2021-06-21 | 2021-09-10 | 车路通科技(成都)有限公司 | Traffic camera automatic correction method, device, equipment and medium |
| GB202210561D0 (en) * | 2021-07-30 | 2022-08-31 | Canon Kk | Image pickup apparatus used as action camera, calibration system, control method for image pickup apparatus, and storage medium storing control program for... |
| CN113873145A (en) * | 2021-09-02 | 2021-12-31 | 北京城市网邻信息技术有限公司 | Vehicle source information acquisition method and device, electronic equipment and readable medium |
| CN116363174A (en) * | 2021-12-27 | 2023-06-30 | Oppo广东移动通信有限公司 | Parameter calibration method, storage medium, co-processing chip and electronic equipment |
| CN115002443A (en) * | 2022-04-29 | 2022-09-02 | 北京城市网邻信息技术有限公司 | Image acquisition processing method and device, electronic equipment and storage medium |
| CN116193108A (en) * | 2023-04-24 | 2023-05-30 | 知行汽车科技(苏州)股份有限公司 | Online self-calibration method, device, equipment and medium for camera |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117119113A (en) | 2023-11-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101002899B1 (en) | Character recognition method and apparatus | |
| EP2704061A2 (en) | Apparatus and method for recognizing a character in terminal equipment | |
| US10089557B2 (en) | Method and apparatus for recognizing characters | |
| CN107451127B (en) | Word translation method and system based on image and mobile device | |
| US10291843B2 (en) | Information processing apparatus having camera function and producing guide display to capture character recognizable image, control method thereof, and storage medium | |
| CN103916592A (en) | Apparatus and method for photographing portrait in portable terminal having camera | |
| CN111429767A (en) | Image-text photographing and identifying device | |
| CN106407977B (en) | Method and device for positioning and searching target content | |
| CN111182167B (en) | File scanning method and electronic equipment | |
| CN112492201B (en) | Photographing method and device and electronic equipment | |
| CN111609926B (en) | Stray light intensity detection method and device, detection terminal and readable storage medium | |
| CN113452991B (en) | Lens focusing state determining method, device, equipment and storage medium | |
| CN117119113B (en) | Camera self-calibration method and device of electronic equipment and electronic equipment | |
| EP2793458B1 (en) | Apparatus and method for auto-focusing in device having camera | |
| JP5835035B2 (en) | Character recognition program and character recognition device | |
| US9961217B2 (en) | Electronic apparatus with instruction reception unit receiving instruction indicated by user and computer-readable medium with program | |
| JP6390163B2 (en) | Information processing apparatus, information processing method, and program | |
| CN107491778B (en) | Intelligent device screen extraction method and system based on positioning image | |
| US20140022386A1 (en) | Information display method and device | |
| CN106954009B (en) | Map acquisition device and method and portable terminal | |
| US10877641B2 (en) | Image adjustment method, apparatus, device and computer readable storage medium | |
| CN111328447A (en) | Automatic focusing method and device | |
| KR100772581B1 (en) | Dictionary report providing apparatus having camera part and providing method thereof | |
| JP5223739B2 (en) | Portable character recognition device, character recognition program, and character recognition method | |
| JP2012226085A (en) | Electronic apparatus, control method and control program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |