WO2019041651A1 - Image correction method, apparatus and device, and computer readable storage medium - Google Patents

Image correction method, apparatus and device, and computer readable storage medium Download PDF

Info

Publication number
WO2019041651A1
WO2019041651A1 PCT/CN2017/116731 CN2017116731W WO2019041651A1 WO 2019041651 A1 WO2019041651 A1 WO 2019041651A1 CN 2017116731 W CN2017116731 W CN 2017116731W WO 2019041651 A1 WO2019041651 A1 WO 2019041651A1
Authority
WO
WIPO (PCT)
Prior art keywords
coordinate
image
camera
writing board
blackboard
Prior art date
Application number
PCT/CN2017/116731
Other languages
French (fr)
Chinese (zh)
Inventor
杨铭
Original Assignee
广州视源电子科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州视源电子科技股份有限公司 filed Critical 广州视源电子科技股份有限公司
Publication of WO2019041651A1 publication Critical patent/WO2019041651A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/04Context-preserving transformations, e.g. by using an importance map

Definitions

  • the present invention relates to image processing technology, and more particularly to an image correction method, apparatus, device, and computer readable storage medium.
  • the writing board on the electronic whiteboard provided by the touch screen terminal has the advantages of no dust, no effort and easy erasing, so the electronic whiteboard is gradually popularized in the teaching classroom.
  • the electronic whiteboard can not restore some details such as the pen, which may result in poor viewing of the saved blackboard, especially for courses that need to restore handwriting details, such as art, calligraphy, and so on.
  • auxiliary educational equipment such as a triangular board.
  • the touch screen will misjudge that the triangular board is the content of the board and display it, resulting in more unnecessary contents of the final displayed board.
  • the invention provides an image correction method, device, device and computer readable storage medium, so as to restore the real picture displayed by the writing board after automatically capturing an image of the book content on the classroom, and improve the readable image of the captured image. Sex.
  • an embodiment of the present invention provides an image correction method, including:
  • the image acquired by the camera After confirming that the image acquired by the camera includes the tablet on which the blackboard image is displayed, the image acquired by the camera is corrected to the blackboard image according to the coordinate mapping relationship.
  • an embodiment of the present invention further provides an image correction apparatus, where the apparatus includes:
  • a photographing module configured to acquire a target image of the writing board by the camera in response to the triggering instruction; wherein the writing board is formed with a plurality of markers;
  • An acquiring module configured to acquire a first coordinate according to a preset algorithm, where the first coordinate is a coordinate of the identifier in the target image;
  • mapping module configured to obtain, according to the second coordinate and the first coordinate, a coordinate mapping relationship between the writing board and an image acquired by the camera; wherein the second coordinate is that the identifier is in the The coordinates on the writing pad;
  • the correction module is configured to correct the image acquired by the camera to the blackboard image according to the coordinate mapping relationship after the image obtained by the confirmation camera includes the tablet on which the blackboard image is displayed.
  • an embodiment of the present invention further provides an apparatus, where the apparatus includes:
  • One or more processors are One or more processors;
  • a memory for storing one or more programs
  • the one or more programs are executed by the one or more processors such that the one or more processors implement the image correction method described above.
  • an embodiment of the present invention further provides a computer readable storage medium having stored thereon a computer program, the program being implemented by the processor to implement the image correction method described above.
  • an image of the writing board is acquired by the camera by making the identifier on the writing board, so that the image acquired by the writing board and the camera can be obtained according to the coordinates of the marker on the writing board and the coordinates in the image acquired by the camera.
  • the coordinate mapping relationship between the two can be used to restore the actual picture displayed on the tablet after automatically capturing the image of the board content on the board. Solving the problem of automatic distortion of the image of the book is affected by the distortion of the image, and the effect of improving the readability of the captured image is achieved.
  • Embodiment 1 is a flowchart of an image correction method according to Embodiment 1 of the present invention.
  • FIG. 2a is a schematic diagram of an image taken by a camera in Embodiment 1 of the present invention.
  • 2b is a schematic diagram showing an image displayed on a tablet in the first embodiment of the present invention.
  • FIG. 3 is a flowchart of an image correction method according to Embodiment 2 of the present invention.
  • FIG. 4 is a schematic structural diagram of an image correcting apparatus according to Embodiment 3 of the present invention.
  • FIG. 5 is a schematic structural diagram of a device according to Embodiment 4 of the present invention.
  • Embodiment 1 is a flowchart of an image correction method according to Embodiment 1 of the present invention.
  • the present embodiment is applicable to a method for performing distortion correction on an image of a board book content captured by a camera.
  • the method may be performed by an image correction device, including The following steps 110 to 130 are performed.
  • Step 110 Acquire a target image of the writing board by using a camera in response to the triggering instruction; wherein the writing board is formed with a plurality of markers;
  • the target image of the writing board is acquired by the camera, that is, the image taken by the camera facing the writing board is as shown in FIG. 2a, and since the camera is facing the writing board, all the display contents on the writing board can be photographed, and the image displayed on the writing board is as Figure 2b shows.
  • Step 120 Acquire a first coordinate according to a preset algorithm, where the first coordinate is a coordinate of the identifier in the target image.
  • Step 130 Obtain a coordinate mapping relationship between the writing board and an image acquired by the camera according to the second coordinate and the first coordinate; wherein the second coordinate is the identifier on the writing board The coordinates on the top.
  • Step 140 After confirming that the image acquired by the camera includes the tablet on which the blackboard image is displayed, correct the image acquired by the camera to the blackboard image according to the coordinate mapping relationship.
  • a plurality of markers are formed on the tablet, which may be printed on the tablet or inlaid with markers, and the coordinates of the markers on the tablet are known during the design and production of the tablet. Since the tablet displays a picture, the coordinates of the tablet are equivalent to the image coordinates displayed on the tablet.
  • the marker can be detected and the coordinates can be read according to the image detection algorithm.
  • the coordinate mapping relationship between the two images can be obtained, and with this relationship, the subsequently captured image can be restored to the image displayed on the tablet. That is, after the image including the board content is captured by the camera, the board image displayed by the tablet may be obtained according to the image acquired by the camera and the coordinate mapping relationship.
  • the specific reduction method is to use the mapping relationship to find the coordinates on the captured image corresponding to the coordinates in the image to be restored, and take the feature values (such as RGB values or gray values to represent the feature values of the colors on the coordinates). ) as the feature value of the coordinates in the image to be restored.
  • the marker with the coordinates P B (u B , v B , 0) on the writing board has the coordinates P I (u I , v I , 0) in the captured target image, and P B (u B can be set.
  • the conversion function between v B , 0) and P I (u I , v I , 0) is:
  • H is a matrix of 3*3, and one element can be used as the homogeneous coordinate.
  • at least 4 markers must be combined, and 8 sets of equations can be combined to solve the matrix H.
  • the coordinate mapping parameters between the writing board and the target image can be obtained by using the Zhang's calibration method, that is, the internal and external parameters of the camera calibration are obtained; other more complicated calibration methods can also be used.
  • the conversion function can be directly used as a coordinate mapping relationship between the tablet and the image acquired by the camera. For each coordinate on the image displayed on the tablet to be restored, the conversion function is used to find a corresponding camera shot. The coordinates in the image.
  • the identifier of the embodiment of the present invention may be a silk screen with a large contrast difference between the background of the writing board and the background of the writing board, or a silk screen on the special jig, or even a bulb or an infrared diode embedded in the writing board, and the marker is a writing. Intrinsic to the board or fixture, the coordinates will not change easily, so the calibration accuracy is high.
  • the marker is arranged on the border of the writing board so as not to cover the content of the writing board, so that the mapping relationship can be performed under the condition that the writing board is normally used, and can be recalibrated at any time, thereby improving the reliability of saving the image of the blackboard in time.
  • the corresponding image detection algorithm needs to be set to read the coordinates of the marker.
  • the feature value corresponding to each coordinate may be read under a specific color model, and the region pattern corresponding to the set feature value range is extracted by using the binarization method as the identifier. Things.
  • the edge detection method may also be used and the edge is obtained by fitting the edge with the set model, that is, step 120 includes: detecting an edge of the identifier in the target image; and searching for the identifier according to the detected edge
  • the coordinates of the specified corner point are taken as the first coordinate.
  • the embodiment further provides a preferred manner to implement step 130.
  • step 130 may obtain an internal parameter of the camera according to the coordinates of the identifier on the tablet and the coordinates of the identifier in the target image by using a Zhang's calibration method or other more complicated algorithms.
  • the outer parameter is equivalent to obtaining a coordinate mapping relationship between the image displayed by the tablet and the image captured by the camera.
  • the blackboard image displayed by the tablet can be obtained from the image of the board content captured by the camera.
  • the internal parameters can be corrected. Specifically, after the camera is calibrated according to the first coordinate and the second coordinate, and the internal parameter and the external parameter of the camera are obtained, the method further includes:
  • Adjusting coordinates are calculated according to the theoretical parameters of the modified identifier according to the external parameters
  • the internal parameters of the camera are replaced with the coordinate mapping parameters.
  • the internal parameters of the camera include a camera main point, a focal length, and a distortion parameter, which may be represented by ⁇ ;
  • the external parameters of the camera are obtained by the image on the target panel and the distortion caused by the elimination of the internal parameters of the captured image.
  • the theoretical coordinate P' B of the marker can be obtained from P I (u I , v I , 0).
  • the coordinate mapping parameter between P C and P I is calculated, and the inner parameter ⁇ is replaced by the coordinate mapping parameter, so that the coordinate mapping relationship between the image displayed by the tablet that reduces the error and the image acquired by the camera is obtained.
  • the correction of the theoretical coordinates can be realized through human-computer interaction, avoiding errors caused by external environmental factors.
  • the theoretical coordinate of the identifier does not match the second coordinate
  • the theoretical coordinate of the identifier is modified to match the second coordinate, and specifically includes:
  • the above specific scheme allows the user to drag the marker to a position that the user thinks matches the coordinates of the marker on the tablet using an input device such as a mouse or a touch screen, and then correct the internal parameter ⁇ according to the position.
  • This method visualizes the parameters and allows the user to visually evaluate whether the current parameters are accurate enough and to make manual adjustments.
  • the image of the writing board is acquired by the camera by making the identifier on the writing board, so that the writing board and the camera can be obtained according to the coordinates of the marker on the writing board and the coordinates in the image acquired by the camera.
  • the coordinate mapping relationship between the acquired images so that the real picture displayed on the tablet can be restored after automatically capturing the image of the board content contained in the class. Solving the problem of automatic distortion of the image of the book is affected by the distortion of the image, and the effect of improving the readability of the captured image is achieved.
  • FIG. 3 is a flowchart of an image correction method according to Embodiment 2 of the present invention.
  • the present embodiment is applicable to a case where distortion correction is performed on an image of a board book content captured by a camera, and the method may be performed by an image correction device.
  • the difference between this embodiment and the first embodiment is that the first embodiment records the coordinate mapping relationship between the image displayed by the tablet and the image captured by the camera by using a coordinate mapping parameter or a conversion function, and the embodiment records in a list manner.
  • the image correction method provided in this embodiment includes:
  • Step 310 Acquire a target image of the writing board by the camera in response to the triggering instruction; wherein the writing board is formed with a plurality of markers;
  • Step 320 Acquire a first coordinate according to a preset algorithm, where the first coordinate is a coordinate of the identifier in the target image;
  • Step 330 Calculate a conversion function between the first coordinate and the second coordinate
  • Step 340 Establish a mapping list between each coordinate in the writing board and coordinates in the image acquired by the camera according to the conversion function.
  • the above steps 330 and 340 first calculate a conversion function between the coordinates of the marker on the tablet and the coordinates in the captured image, and then establish a mapping list of coordinates according to the conversion function.
  • the coordinates on the captured image corresponding to the coordinate points on the board image can be directly obtained by looking up the table, and the feature value is read as its own feature value.
  • the method further includes:
  • Step 350 After confirming that the image acquired by the camera includes the writing board displaying the blackboard image, querying the mapping list to obtain coordinates in the image acquired by the camera corresponding to each coordinate in the blackboard image;
  • Step 360 Read the feature value of the queried coordinate as the feature value of the corresponding coordinate in the blackboard image.
  • Steps 350 and 360 enable the captured image to be corrected in time during the teaching process, and further displayed in the classroom through the display terminal in real time.
  • the image of the writing board is acquired by the camera by making the identifier on the writing board, so that the writing board and the camera can be obtained according to the coordinates of the marker on the writing board and the coordinates in the image acquired by the camera.
  • FIG. 4 is a schematic structural diagram of an image correction apparatus according to Embodiment 3 of the present invention, where the apparatus includes:
  • the photographing module 410 is configured to acquire a target image of the writing board by the camera in response to the triggering instruction; wherein the writing board is formed with a plurality of markers;
  • the obtaining module 420 is configured to acquire a first coordinate according to a preset algorithm, where the first coordinate is a coordinate of the identifier in the target image;
  • a mapping module 430 configured to obtain, according to the second coordinate and the first coordinate, a coordinate mapping relationship between the writing board and an image acquired by the camera; wherein the second coordinate is that the identifier is in the The coordinates on the writing board;
  • the correction module 440 is configured to correct the image acquired by the camera to the blackboard image according to the coordinate mapping relationship after the image obtained by the confirmation camera includes the tablet on which the blackboard image is displayed.
  • mapping module 430 includes:
  • a calculating unit configured to calculate a conversion function between the first coordinate and the second coordinate
  • a table building unit configured to establish, according to the conversion function, a mapping list between each coordinate in the writing board and coordinates in an image acquired by the camera;
  • the image correcting device further includes:
  • a table lookup unit configured to query the map list after the image obtained by the confirmation camera includes the tablet with the blackboard image, and obtain coordinates in the image acquired by the camera corresponding to each coordinate in the book image;
  • a replacement unit configured to read the feature value of the queried coordinate as the feature value of the corresponding coordinate in the blackboard image.
  • the obtaining module 420 includes:
  • a detecting unit configured to detect an edge of the identifier in the target image
  • a searching unit configured to search for coordinates of the specified corner point in the identifier as the first coordinate according to the detected edge.
  • the mapping module 430 includes a calibration unit, configured to obtain an internal parameter and an external parameter of the camera according to the first coordinate and the second, calibration camera.
  • the mapping module 430 further includes:
  • a prediction unit configured to calculate, by the first coordinate, a theoretical coordinate of the identifier according to the inner parameter and the outer parameter;
  • a correction unit configured to modify a theoretical coordinate of the identifier to match the second coordinate if the theoretical coordinate of the identifier does not match the second coordinate
  • An adjusting unit configured to calculate an adjusted coordinate according to the theoretical parameter of the modified identifier according to the external parameter
  • a correction parameter calculation unit configured to calculate a coordinate mapping parameter between the adjustment coordinate and the first coordinate
  • a second replacement unit configured to replace the internal parameter of the camera by using the coordinate mapping parameter.
  • the modifying unit specifically includes:
  • a display unit configured to obtain an image displayed by the tablet according to an image captured by the camera and an internal parameter and an external parameter of the camera; display the obtained image through the touch screen terminal, and correspond to a theoretical coordinate of the identifier on the image
  • the location provides a drag handle
  • a detecting unit configured to detect whether the drag control point is dragged by a user to a position corresponding to another coordinate
  • a modifying unit if yes, determining that the theoretical coordinate of the identifier does not match the second coordinate; modifying a theoretical coordinate of the identifier to a coordinate of the drag control point;
  • a maintaining unit if not, determining that the theoretical coordinate of the identifier matches the second coordinate.
  • the image correction device provided by the embodiment of the present invention may perform an image correction method provided by any embodiment of the present invention, and has a function module and a beneficial effect corresponding to the execution method.
  • FIG. 5 is a schematic structural diagram of a device according to Embodiment 4 of the present invention.
  • the device includes a processor 510, a memory 520, an input device 530, an output device 540, and a camera 550 for capturing an image;
  • the number of the processors 510 may be one or more, and one processor 510 is taken as an example in FIG. 5; the processor 510, the memory 520, the input device 530, and the output device 540 in the device may be connected by a bus or other manner. In 5, the bus connection is taken as an example.
  • the memory 520 is used as a computer readable storage medium, and can be used for storing a software program, a computer executable program, and a module, such as a program instruction/module corresponding to the image correction method in the embodiment of the present invention (for example, a shooting module in the image correction device) 410.
  • a program instruction/module corresponding to the image correction method in the embodiment of the present invention (for example, a shooting module in the image correction device) 410.
  • the processor 510 performs various functional applications and data processing of the device by executing software programs, instructions, and modules stored in the memory 520, that is, implementing the image correction method described above.
  • the memory 520 may mainly include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to usage of the terminal, and the like. Further, the memory 520 may include a high speed random access memory, and may also include a nonvolatile memory such as at least one magnetic disk storage device, flash memory device, or other nonvolatile solid state storage device. In some examples, memory 520 can further include memory remotely located relative to processor 510, which can be connected to the device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • Input device 530 can be used to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the device.
  • the output device 540 can include a display device such as a display screen.
  • a fifth embodiment of the present invention further provides a computer readable storage medium storing a computer program, where the program is implemented by a computer processor to implement an image correction method, the method comprising:
  • the image acquired by the camera After confirming that the image acquired by the camera includes the tablet on which the blackboard image is displayed, the image acquired by the camera is corrected to the blackboard image according to the coordinate mapping relationship.
  • the computer readable storage medium storing the computer program, the computer executable instructions are not limited to the method operations as described above, and may also perform the image correction method provided by any embodiment of the present invention. Related operations in .
  • the present invention can be implemented by software and necessary general hardware, and can also be implemented by hardware, but in many cases, the former is a better implementation. .
  • the technical solution of the present invention which is essential or contributes to the prior art, may be embodied in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk of a computer. , Read-Only Memory (ROM), Random Access Memory (RAM), Flash (FLASH), hard disk or optical disk, etc., including a number of instructions to make a computer device (can be a personal computer)
  • the server, or network device, etc. performs the methods described in various embodiments of the present invention.
  • the included units and modules are only divided according to functional logic, but are not limited to the above-mentioned partitioning, as long as the corresponding functions can be implemented;
  • the specific names of the functional units are also for convenience of distinguishing from each other and are not intended to limit the scope of the present invention.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)

Abstract

Disclosed in the present invention is an image correction method, comprising: obtaining a target image of a writing board by means of a video camera in response to a trigger instruction, wherein a plurality of markers is manufactured on the writing board; obtaining a first coordinate according to a preset algorithm, wherein the first coordinate is a coordinate of the marker in the target image; obtaining, according to a second coordinate and the first coordinate, a coordinate mapping relation between the writing board and an image obtained by the video camera, wherein the second coordinate is a coordinate of the marker on the writing board; correcting the image obtained by the video camera as a blackboard-writing image according to the coordinate mapping relation after confirming that the image obtained by the video camera contains the writing board displaying the blackboard-writing image. Accordingly, also disclosed in the present invention are an image correction apparatus and device, and a computer readable storage medium. Implementing the present invention can solve the problem that the image distortion occurs in automatic capture of the blackboard-writing image to affect reading, and the readability of the captured image can be improved.

Description

图像校正方法、装置、设备和计算机可读存储介质Image correction method, device, device and computer readable storage medium 技术领域Technical field
本发明涉及图像处理技术,尤其涉及一种图像校正方法、装置、设备和计算机可读存储介质。The present invention relates to image processing technology, and more particularly to an image correction method, apparatus, device, and computer readable storage medium.
背景技术Background technique
在触摸屏终端提供的电子白板上书写板书具有无粉尘、书写不费力和方便擦除等优势,因此电子白板逐渐在教学课堂上普及使用。但其并不能替代传统黑板,因为电子白板不能还原出笔锋等一些细节,可能导致保存的板书观看效果不佳,特别对一些需要还原笔迹细节的课程,如美术、书法课等。而且无法排除辅助教育设备(如三角板等)的干扰,例如使用三角板在黑板进行量测时,触摸屏会误判此三角板是板书内容,并进行显示,导致最终显示的板书多了多余的内容。The writing board on the electronic whiteboard provided by the touch screen terminal has the advantages of no dust, no effort and easy erasing, so the electronic whiteboard is gradually popularized in the teaching classroom. However, it is not a substitute for the traditional blackboard, because the electronic whiteboard can not restore some details such as the pen, which may result in poor viewing of the saved blackboard, especially for courses that need to restore handwriting details, such as art, calligraphy, and so on. Moreover, it is impossible to exclude the interference of auxiliary educational equipment (such as a triangular board). For example, when using a triangular board to measure on the blackboard, the touch screen will misjudge that the triangular board is the content of the board and display it, resulting in more unnecessary contents of the final displayed board.
而传统的书写板,如黑板和白板,不便于保存老师在书写板上书写的板书内容。如果学生或老师需要记录板书内容,则要对书写板进行拍照。人工进行拍照影响上课质量,但如果设置自动拍照的摄像机进行自动拍照,则采集到的图像会有畸变,不方便阅读。Traditional writing boards, such as blackboards and whiteboards, are not convenient for keeping the contents of the board written by the teacher on the writing pad. If the student or teacher needs to record the contents of the board, take a picture of the board. Manually taking photos affects the quality of the class, but if you set up an automatic camera to take an automatic photo, the captured image will be distorted and inconvenient to read.
发明内容Summary of the invention
本发明提供一种图像校正方法、装置、设备和计算机可读存储介质,以实现在自动拍摄课堂上的包含板书内容的图像后可还原出书写板显示的真实画面, 提高拍摄的图像的可读性。The invention provides an image correction method, device, device and computer readable storage medium, so as to restore the real picture displayed by the writing board after automatically capturing an image of the book content on the classroom, and improve the readable image of the captured image. Sex.
第一方面,本发明实施例提供了一种图像校正方法,包括:In a first aspect, an embodiment of the present invention provides an image correction method, including:
响应于触发指令,通过摄像机获取书写板的目标图像;其中,所述书写板上制作有多个标识物;Acquiring, by the camera, a target image of the tablet in response to the triggering instruction; wherein the writing board is formed with a plurality of markers;
依据预设算法获取第一坐标;其中,所述第一坐标为所述标识物在所述目标图像中的坐标;Obtaining a first coordinate according to a preset algorithm; wherein the first coordinate is a coordinate of the identifier in the target image;
根据第二坐标和所述第一坐标,获得所述书写板与所述摄像机获取的图像之间的坐标映射关系;其中,所述第二坐标为所述标识物在所述书写板上的坐标;Obtaining a coordinate mapping relationship between the writing board and an image acquired by the camera according to the second coordinate and the first coordinate; wherein the second coordinate is a coordinate of the identifier on the writing board ;
在确认摄像机获取的图像中包含显示有板书图像的书写板之后,根据所述坐标映射关系,将所述摄像机获取的图像校正为所述板书图像。After confirming that the image acquired by the camera includes the tablet on which the blackboard image is displayed, the image acquired by the camera is corrected to the blackboard image according to the coordinate mapping relationship.
第二方面,本发明实施例还提供了一种图像校正装置,该装置包括:In a second aspect, an embodiment of the present invention further provides an image correction apparatus, where the apparatus includes:
拍摄模块,用于响应于触发指令,通过摄像机获取书写板的目标图像;其中,所述书写板上制作有多个标识物;a photographing module, configured to acquire a target image of the writing board by the camera in response to the triggering instruction; wherein the writing board is formed with a plurality of markers;
获取模块,用于依据预设算法获取第一坐标;其中,所述第一坐标为所述标识物在所述目标图像中的坐标;An acquiring module, configured to acquire a first coordinate according to a preset algorithm, where the first coordinate is a coordinate of the identifier in the target image;
映射模块,用于根据第二坐标和所述第一坐标,获得所述书写板与所述摄像机获取的图像之间的坐标映射关系;其中,所述第二坐标为所述标识物在所述书写板上的坐标;a mapping module, configured to obtain, according to the second coordinate and the first coordinate, a coordinate mapping relationship between the writing board and an image acquired by the camera; wherein the second coordinate is that the identifier is in the The coordinates on the writing pad;
校正模块,用于在确认摄像机获取的图像中包含显示有板书图像的书写板之后,根据所述坐标映射关系,将所述摄像机获取的图像校正为所述板书图像。The correction module is configured to correct the image acquired by the camera to the blackboard image according to the coordinate mapping relationship after the image obtained by the confirmation camera includes the tablet on which the blackboard image is displayed.
第三方面,本发明实施例还提供了一种设备,该设备包括:In a third aspect, an embodiment of the present invention further provides an apparatus, where the apparatus includes:
一个或多个处理器;One or more processors;
存储器,用于存储一个或多个程序;a memory for storing one or more programs;
摄像机,用于拍摄图像;a camera for taking images;
当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现上述的图像校正方法。The one or more programs are executed by the one or more processors such that the one or more processors implement the image correction method described above.
第四方面,本发明实施例还提供了一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现上述的图像校正方法。In a fourth aspect, an embodiment of the present invention further provides a computer readable storage medium having stored thereon a computer program, the program being implemented by the processor to implement the image correction method described above.
本发明实施例通过制作标识物在书写板上,通过摄像机获取书写板的图像,使得可以根据标识物在书写板上的坐标和在摄像机获取的图像中的坐标,得到书写板与摄像机获取的图像之间的坐标映射关系,从而可以在自动拍摄课堂上的包含板书内容的图像后,还原出书写板显示的真实画面。解决自动拍摄板书图像会有图形畸变影响阅读的问题,实现提高拍摄的图像的可读性的效果。In the embodiment of the present invention, an image of the writing board is acquired by the camera by making the identifier on the writing board, so that the image acquired by the writing board and the camera can be obtained according to the coordinates of the marker on the writing board and the coordinates in the image acquired by the camera. The coordinate mapping relationship between the two can be used to restore the actual picture displayed on the tablet after automatically capturing the image of the board content on the board. Solving the problem of automatic distortion of the image of the book is affected by the distortion of the image, and the effect of improving the readability of the captured image is achieved.
附图说明DRAWINGS
图1是本发明实施例一提供的图像校正方法的流程图;1 is a flowchart of an image correction method according to Embodiment 1 of the present invention;
图2a是本发明实施例一中摄像机拍摄的图像示意图;2a is a schematic diagram of an image taken by a camera in Embodiment 1 of the present invention;
图2b是本发明实施例一中书写板显示的图像示意图;2b is a schematic diagram showing an image displayed on a tablet in the first embodiment of the present invention;
图3是本发明实施例二提供的图像校正方法的流程图;3 is a flowchart of an image correction method according to Embodiment 2 of the present invention;
图4是本发明实施例三提供的图像校正装置的结构示意图;4 is a schematic structural diagram of an image correcting apparatus according to Embodiment 3 of the present invention;
图5是本发明实施例四提供的设备的结构示意图。FIG. 5 is a schematic structural diagram of a device according to Embodiment 4 of the present invention.
具体实施方式Detailed ways
下面结合附图和实施例对本发明作进一步的详细说明。可以理解的是,此处所描述的具体实施例仅仅用于解释本发明,而非对本发明的限定。另外还需要说明的是,为了便于描述,附图中仅示出了与本发明相关的部分而非全部结构。The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. It should also be noted that, for ease of description, only some, but not all, of the structures related to the present invention are shown in the drawings.
实施例一Embodiment 1
图1为本发明实施例一提供的图像校正方法的流程图,本实施例可适用于对摄像机拍摄的包含板书内容的图像进行畸变校正的情况,该方法可以由图像校正装置来执行,具体包括如下步骤110至130。1 is a flowchart of an image correction method according to Embodiment 1 of the present invention. The present embodiment is applicable to a method for performing distortion correction on an image of a board book content captured by a camera. The method may be performed by an image correction device, including The following steps 110 to 130 are performed.
步骤110、响应于触发指令,通过摄像机获取书写板的目标图像;其中,所述书写板上制作有多个标识物;Step 110: Acquire a target image of the writing board by using a camera in response to the triggering instruction; wherein the writing board is formed with a plurality of markers;
其中,通过摄像机获取书写板的目标图像,即通过朝向书写板的摄像机拍摄的图像如图2a所示,由于摄像机朝向书写板,因此能拍摄书写板上所有显示内容,书写板上显示的图像如图2b所示。Wherein, the target image of the writing board is acquired by the camera, that is, the image taken by the camera facing the writing board is as shown in FIG. 2a, and since the camera is facing the writing board, all the display contents on the writing board can be photographed, and the image displayed on the writing board is as Figure 2b shows.
步骤120、依据预设算法获取第一坐标;其中,所述第一坐标为所述标识物在所述目标图像中的坐标。Step 120: Acquire a first coordinate according to a preset algorithm, where the first coordinate is a coordinate of the identifier in the target image.
步骤130、根据第二坐标和所述第一坐标,获得所述书写板与所述摄像机获取的图像之间的坐标映射关系;其中,所述第二坐标为所述标识物在所述书写板上的坐标。Step 130: Obtain a coordinate mapping relationship between the writing board and an image acquired by the camera according to the second coordinate and the first coordinate; wherein the second coordinate is the identifier on the writing board The coordinates on the top.
步骤140、在确认摄像机获取的图像中包含显示有板书图像的书写板之后,根据所述坐标映射关系,将所述摄像机获取的图像校正为所述板书图像。Step 140: After confirming that the image acquired by the camera includes the tablet on which the blackboard image is displayed, correct the image acquired by the camera to the blackboard image according to the coordinate mapping relationship.
该图像校正方法的工作原理:How the image correction method works:
在书写板上制作多个标识物,可以是在书写板上印制标识物或镶嵌标识物, 在设计和生产书写板的过程中已知标识物在书写板上的坐标。由于书写板会显示画面,则书写板的坐标与书写板显示的图像坐标等同。通过摄像机拍摄目标图像后,依据图像检测算法可以检测出标识物,读取其坐标。根据标识物在两个图像中的坐标,可以求取两个图像之间的坐标映射关系,利用该关系,可以将后续拍摄的图像,还原为书写板上显示的图像。即在通过所述摄像机拍摄包含板书内容的图像之后,可根据所述摄像机获取的图像和所述坐标映射关系,获得所述书写板显示的板书图像。具体还原的方法是,利用该映射关系找到待还原的图像中的坐标对应的在拍摄的图像上的坐标,取其特征值(如RGB值或灰度值等表征该坐标上的色彩的特征值)作为待还原的图像中该坐标的特征值。A plurality of markers are formed on the tablet, which may be printed on the tablet or inlaid with markers, and the coordinates of the markers on the tablet are known during the design and production of the tablet. Since the tablet displays a picture, the coordinates of the tablet are equivalent to the image coordinates displayed on the tablet. After the target image is captured by the camera, the marker can be detected and the coordinates can be read according to the image detection algorithm. According to the coordinates of the identifier in the two images, the coordinate mapping relationship between the two images can be obtained, and with this relationship, the subsequently captured image can be restored to the image displayed on the tablet. That is, after the image including the board content is captured by the camera, the board image displayed by the tablet may be obtained according to the image acquired by the camera and the coordinate mapping relationship. The specific reduction method is to use the mapping relationship to find the coordinates on the captured image corresponding to the coordinates in the image to be restored, and take the feature values (such as RGB values or gray values to represent the feature values of the colors on the coordinates). ) as the feature value of the coordinates in the image to be restored.
简单地,书写板上坐标为P B(u B,v B,0)的标识物,在拍摄的目标图像中坐标为P I(u I,v I,0),可设P B(u B,v B,0)与P I(u I,v I,0)之间的转换函数为:
Figure PCTCN2017116731-appb-000001
利用多个标识物的坐标值联立,可以求解出矩阵H的各个元素的值,从而获得该转换函数,在具体实施时,H是3*3的矩阵,并且有一个元素可作为齐次坐标,则至少须有4个标识物,联立8组方程,可求解出矩阵H。此外,还可以用张氏标定法求书写板与所述目标图像之间的坐标映射参数,即获得摄像机标定的内外参数;还可以用其他更复杂的标定方法。
Simply, the marker with the coordinates P B (u B , v B , 0) on the writing board has the coordinates P I (u I , v I , 0) in the captured target image, and P B (u B can be set. The conversion function between v B , 0) and P I (u I , v I , 0) is:
Figure PCTCN2017116731-appb-000001
By using the coordinate values of the plurality of markers, the values of the elements of the matrix H can be solved, thereby obtaining the conversion function. In the specific implementation, H is a matrix of 3*3, and one element can be used as the homogeneous coordinate. , at least 4 markers must be combined, and 8 sets of equations can be combined to solve the matrix H. In addition, the coordinate mapping parameters between the writing board and the target image can be obtained by using the Zhang's calibration method, that is, the internal and external parameters of the camera calibration are obtained; other more complicated calibration methods can also be used.
在具体实施时,可以直接使用该转换函数作为书写板与摄像机获取的图像之间的坐标映射关系,对于待还原的书写板显示的图像上的每一坐标,利用该转换函数找到对应在摄像机拍摄的图像中的坐标。In a specific implementation, the conversion function can be directly used as a coordinate mapping relationship between the tablet and the image acquired by the camera. For each coordinate on the image displayed on the tablet to be restored, the conversion function is used to find a corresponding camera shot. The coordinates in the image.
本发明实施例标识物可以是书写板边框上与书写板背景色彩反差较大的丝印,也可以是特制治具上的丝印,甚至是镶嵌在书写板上的灯泡或红外二极管,标识物是书写板或治具固有的,其坐标不会轻易发生改变,因此标定精度高。 标识物设置在书写板边框上,以免遮住书写板的内容,使得求取映射关系可以在正常使用书写板的情况下进行,随时可以重新标定,提高及时保存板书图像的可靠性。The identifier of the embodiment of the present invention may be a silk screen with a large contrast difference between the background of the writing board and the background of the writing board, or a silk screen on the special jig, or even a bulb or an infrared diode embedded in the writing board, and the marker is a writing. Intrinsic to the board or fixture, the coordinates will not change easily, so the calibration accuracy is high. The marker is arranged on the border of the writing board so as not to cover the content of the writing board, so that the mapping relationship can be performed under the condition that the writing board is normally used, and can be recalibrated at any time, thereby improving the reliability of saving the image of the blackboard in time.
对于特制的标识物,需要设定相应的图像检测算法读取标识物的坐标。对于颜色与书写板背景色彩反差较大的标识物,可在特定的颜色模型下,读取各坐标对应的特征值,使用二值化方法提取设定的特征值范围所对应的区域图案作为标识物。也可以采用边缘检测方法并用设定的模型拟合边缘得到标识物坐标,即步骤120包括:在所述目标图像中检测所述标识物的边缘;根据检测到的所述边缘,查找所述标识物中指定角点的坐标,作为所述第一坐标。For a special marker, the corresponding image detection algorithm needs to be set to read the coordinates of the marker. For a marker with a large contrast between the color and the background color of the tablet, the feature value corresponding to each coordinate may be read under a specific color model, and the region pattern corresponding to the set feature value range is extracted by using the binarization method as the identifier. Things. The edge detection method may also be used and the edge is obtained by fitting the edge with the set model, that is, step 120 includes: detecting an edge of the identifier in the target image; and searching for the identifier according to the detected edge The coordinates of the specified corner point are taken as the first coordinate.
在上述技术方案的基础上,本实施例还提供一种优选的方式实现步骤130。Based on the foregoing technical solution, the embodiment further provides a preferred manner to implement step 130.
具体地,步骤130根据所述标识物在所述书写板上的坐标和所述标识物在所述目标图像中的坐标,采用张氏标定法或其他更复杂的算法,可以获得摄像机的内参数和外参数,相当于获得所述书写板显示的图像与所述摄像机拍摄的图像之间的坐标映射关系。根据所述内参数和外参数,可以从摄像机拍摄的包含板书内容的图像,获得书写板显示的板书图像。Specifically, step 130 may obtain an internal parameter of the camera according to the coordinates of the identifier on the tablet and the coordinates of the identifier in the target image by using a Zhang's calibration method or other more complicated algorithms. And the outer parameter is equivalent to obtaining a coordinate mapping relationship between the image displayed by the tablet and the image captured by the camera. According to the internal parameter and the external parameter, the blackboard image displayed by the tablet can be obtained from the image of the board content captured by the camera.
进一步地,为了减小误差,可对内参数进行校正。具体地,在根据第一坐标和第二坐标,标定摄像机,获得摄像机的内参数和外参数后,还包括:Further, in order to reduce the error, the internal parameters can be corrected. Specifically, after the camera is calibrated according to the first coordinate and the second coordinate, and the internal parameter and the external parameter of the camera are obtained, the method further includes:
由所述第一坐标根据所述内参数和外参数计算得到标识物的理论坐标;Calculating, by the first coordinate, a theoretical coordinate of the identifier according to the inner parameter and the outer parameter;
如果所述标识物的理论坐标与所述第二坐标不匹配,则修改所述标识物的理论坐标,使其与第二坐标匹配;If the theoretical coordinate of the identifier does not match the second coordinate, modifying the theoretical coordinate of the identifier to match the second coordinate;
由修改后的所述标识物的理论坐标根据所述外参数计算得到调整坐标;Adjusting coordinates are calculated according to the theoretical parameters of the modified identifier according to the external parameters;
计算所述调整坐标和所述第一坐标之间的坐标映射参数;Calculating a coordinate mapping parameter between the adjustment coordinate and the first coordinate;
使用所述坐标映射参数替换所述摄像机的内参数。The internal parameters of the camera are replaced with the coordinate mapping parameters.
在上述进一步方案中,其中,摄像机的内参数包括相机主点、焦距和畸变参数等,可用θ表示;摄像机的外参数为目标面板上的图像与由拍摄的图像消除内参数引起的畸变后得到的图像之间的单应性矩阵,可用M表示,则H=θ*M。根据该转换函数可以从P I(u I,v I,0)获得标识物的理论坐标P′ B。如果该理论坐标P′ B和第二坐标不匹配,则将其修改为匹配的坐标P B(即在无误差的情况下由P I根据内参数θ和外参数M计算应得的准确的坐标值),由修改后的理论坐标根据外参数M可得到调整坐标P C=MP B。计算P C和P I之间的坐标映射参数,使用该坐标映射参数替换内参数θ,即可得到降低误差的书写板显示的图像与所述摄像机获取的图像之间的坐标映射关系。 In the above further solution, wherein the internal parameters of the camera include a camera main point, a focal length, and a distortion parameter, which may be represented by θ; the external parameters of the camera are obtained by the image on the target panel and the distortion caused by the elimination of the internal parameters of the captured image. The homography matrix between images can be represented by M, then H = θ * M. According to the conversion function, the theoretical coordinate P' B of the marker can be obtained from P I (u I , v I , 0). If the theoretical coordinate P' B and the second coordinate do not match, it is modified to the matched coordinate P B (ie, the accurate coordinate calculated by P I from the internal parameter θ and the outer parameter M without error) Value), the adjusted coordinate P C =MP B can be obtained from the modified theoretical coordinates according to the external parameter M. The coordinate mapping parameter between P C and P I is calculated, and the inner parameter θ is replaced by the coordinate mapping parameter, so that the coordinate mapping relationship between the image displayed by the tablet that reduces the error and the image acquired by the camera is obtained.
在具体实施时,对理论坐标的修正可以通过人机交互实现,避免由外部环境因素引起的误差。In the specific implementation, the correction of the theoretical coordinates can be realized through human-computer interaction, avoiding errors caused by external environmental factors.
具体地,所述如果所述标识物的理论坐标与所述第二坐标不匹配,则修改所述标识物的理论坐标,使其与第二坐标匹配,具体包括:Specifically, if the theoretical coordinate of the identifier does not match the second coordinate, the theoretical coordinate of the identifier is modified to match the second coordinate, and specifically includes:
根据摄像机拍摄的图像和摄像机的内参数、外参数,获得所述书写板显示的图像;Obtaining an image displayed by the writing board according to an image captured by the camera and an internal parameter and an external parameter of the camera;
通过触摸屏终端显示获得的图像,并在该图像上所述标识物的理论坐标所对应的位置提供拖拽控点;Displaying the obtained image through the touch screen terminal, and providing a drag control point at a position corresponding to the theoretical coordinate of the identifier on the image;
检测所述拖拽控点是否被用户拖拽至其他坐标所对应的位置;Detecting whether the drag control point is dragged by the user to a position corresponding to other coordinates;
若是,则判定所述标识物的理论坐标与所述第二坐标不匹配;将所述标识物的理论坐标修改为所述拖拽控点的坐标;If yes, determining that the theoretical coordinate of the identifier does not match the second coordinate; modifying the theoretical coordinate of the identifier to the coordinate of the drag control point;
若否,则判定所述标识物的理论坐标与所述第二坐标匹配。If not, it is determined that the theoretical coordinates of the marker match the second coordinate.
上述具体方案允许用户使用输入设备,例如鼠标或触摸屏,将标识物拖拽到用户认为与标识物在书写板上的坐标匹配的位置,然后根据该位置修正内参数θ。这种方法使得参数可视化,能够让用户直观地评价当前参数是否足够精准,并实现人工调整。The above specific scheme allows the user to drag the marker to a position that the user thinks matches the coordinates of the marker on the tablet using an input device such as a mouse or a touch screen, and then correct the internal parameter θ according to the position. This method visualizes the parameters and allows the user to visually evaluate whether the current parameters are accurate enough and to make manual adjustments.
本实施例的技术方案,通过制作标识物在书写板上,通过摄像机获取书写板的图像,使得可以根据标识物在书写板上的坐标和在摄像机获取的图像中的坐标,得到书写板与摄像机获取的图像之间的坐标映射关系,从而可以在自动拍摄课堂上的包含板书内容的图像后,还原出书写板显示的真实画面。解决自动拍摄板书图像会有图形畸变影响阅读的问题,实现提高拍摄的图像的可读性的效果。In the technical solution of the embodiment, the image of the writing board is acquired by the camera by making the identifier on the writing board, so that the writing board and the camera can be obtained according to the coordinates of the marker on the writing board and the coordinates in the image acquired by the camera. The coordinate mapping relationship between the acquired images, so that the real picture displayed on the tablet can be restored after automatically capturing the image of the board content contained in the class. Solving the problem of automatic distortion of the image of the book is affected by the distortion of the image, and the effect of improving the readability of the captured image is achieved.
实施例二Embodiment 2
图3为本发明实施例二提供的图像校正方法的流程图,本实施例可适用于对摄像机拍摄的包含板书内容的图像进行畸变校正的情况,该方法可以由图像校正装置来执行。本实施例与实施例一的区别点在于,实施例一以坐标映射参数或转换函数记录书写板显示的图像与所述摄像机拍摄的图像之间的坐标映射关系,本实施例以列表的方式记录该坐标映射关系。本实施例提供的图像校正方法包括:FIG. 3 is a flowchart of an image correction method according to Embodiment 2 of the present invention. The present embodiment is applicable to a case where distortion correction is performed on an image of a board book content captured by a camera, and the method may be performed by an image correction device. The difference between this embodiment and the first embodiment is that the first embodiment records the coordinate mapping relationship between the image displayed by the tablet and the image captured by the camera by using a coordinate mapping parameter or a conversion function, and the embodiment records in a list manner. The coordinate mapping relationship. The image correction method provided in this embodiment includes:
步骤310、响应于触发指令,通过摄像机获取书写板的目标图像;其中,所述书写板上制作有多个标识物;Step 310: Acquire a target image of the writing board by the camera in response to the triggering instruction; wherein the writing board is formed with a plurality of markers;
步骤320、依据预设算法获取第一坐标;其中,所述第一坐标为所述标识物在所述目标图像中的坐标;Step 320: Acquire a first coordinate according to a preset algorithm, where the first coordinate is a coordinate of the identifier in the target image;
步骤330、计算所述第一坐标与所述第二坐标之间的转换函数;Step 330: Calculate a conversion function between the first coordinate and the second coordinate;
步骤340、根据所述转换函数,建立所述书写板中每一坐标与所述摄像机获取的图像中的坐标之间的映射列表。Step 340: Establish a mapping list between each coordinate in the writing board and coordinates in the image acquired by the camera according to the conversion function.
上述步骤330和340先计算标识物在书写板上的坐标和在拍摄的图像中的坐标之间的转换函数,再根据转换函数建立坐标的映射列表。这种方法使得在后续还原书写板显示的板书图像时,可直接查表获得板书图像上各坐标点对应的在拍摄图像上的坐标,读取其特征值作为自身的特征值。在还原图像的时候无需根据转换函数计算,提高处理速度,即在步骤340后,还包括:The above steps 330 and 340 first calculate a conversion function between the coordinates of the marker on the tablet and the coordinates in the captured image, and then establish a mapping list of coordinates according to the conversion function. In this method, when the board image displayed on the tablet is subsequently restored, the coordinates on the captured image corresponding to the coordinate points on the board image can be directly obtained by looking up the table, and the feature value is read as its own feature value. When the image is restored, it is not necessary to calculate according to the conversion function, and the processing speed is increased, that is, after step 340, the method further includes:
步骤350、在确认摄像机获取的图像中包含显示有板书图像的书写板之后,查询所述映射列表,获得所述板书图像中每一坐标所对应的摄像机获取的图像中的坐标;Step 350: After confirming that the image acquired by the camera includes the writing board displaying the blackboard image, querying the mapping list to obtain coordinates in the image acquired by the camera corresponding to each coordinate in the blackboard image;
步骤360、读取查询到的坐标的特征值,作为所述板书图像中对应坐标的特征值。Step 360: Read the feature value of the queried coordinate as the feature value of the corresponding coordinate in the blackboard image.
步骤350和步骤360使得在教学过程中,可以及时地对拍摄的图像进行校正处理,进一步可实时地通过显示终端展示在课堂上。 Steps 350 and 360 enable the captured image to be corrected in time during the teaching process, and further displayed in the classroom through the display terminal in real time.
本实施例的技术方案,通过制作标识物在书写板上,通过摄像机获取书写板的图像,使得可以根据标识物在书写板上的坐标和在摄像机获取的图像中的坐标,得到书写板与摄像机获取的图像之间的转换函数,进而获得两张图像之间的坐标对应列表,从而可以在自动拍摄课堂上的包含板书内容的图像后,不需要根据转换函数计算对应的坐标值,只需要查表以及像素插值,即可还原出书写板显示的真实画面。In the technical solution of the embodiment, the image of the writing board is acquired by the camera by making the identifier on the writing board, so that the writing board and the camera can be obtained according to the coordinates of the marker on the writing board and the coordinates in the image acquired by the camera. Obtaining the conversion function between the images, thereby obtaining a coordinate correspondence list between the two images, so that after automatically capturing the image containing the contents of the blackboard in the classroom, it is not necessary to calculate the corresponding coordinate values according to the conversion function, and only need to check The table and pixel interpolation can restore the real picture displayed on the tablet.
实施例三Embodiment 3
图4为本发明实施例三提供的图像校正装置的结构示意图,该装置包括:4 is a schematic structural diagram of an image correction apparatus according to Embodiment 3 of the present invention, where the apparatus includes:
拍摄模块410,用于响应于触发指令,通过摄像机获取书写板的目标图像;其中,所述书写板上制作有多个标识物;The photographing module 410 is configured to acquire a target image of the writing board by the camera in response to the triggering instruction; wherein the writing board is formed with a plurality of markers;
获取模块420,用于依据预设算法获取第一坐标;其中,所述第一坐标为所述标识物在所述目标图像中的坐标;The obtaining module 420 is configured to acquire a first coordinate according to a preset algorithm, where the first coordinate is a coordinate of the identifier in the target image;
映射模块430,用于根据第二坐标和所述第一坐标,获得所述书写板与所述摄像机获取的图像之间的坐标映射关系;其中,所述第二坐标为所述标识物在所述书写板上的坐标;a mapping module 430, configured to obtain, according to the second coordinate and the first coordinate, a coordinate mapping relationship between the writing board and an image acquired by the camera; wherein the second coordinate is that the identifier is in the The coordinates on the writing board;
校正模块440,用于在确认摄像机获取的图像中包含显示有板书图像的书写板之后,根据所述坐标映射关系,将所述摄像机获取的图像校正为所述板书图像。The correction module 440 is configured to correct the image acquired by the camera to the blackboard image according to the coordinate mapping relationship after the image obtained by the confirmation camera includes the tablet on which the blackboard image is displayed.
作为一种实施方式,映射模块430包括:As an implementation manner, the mapping module 430 includes:
计算单元,用于计算所述第一坐标与所述第二坐标之间的转换函数;a calculating unit, configured to calculate a conversion function between the first coordinate and the second coordinate;
建表单元,用于根据所述转换函数,建立所述书写板中每一坐标与所述摄像机获取的图像中的坐标之间的映射列表;a table building unit, configured to establish, according to the conversion function, a mapping list between each coordinate in the writing board and coordinates in an image acquired by the camera;
则所述图像校正装置还包括:The image correcting device further includes:
查表单元,用于在确认摄像机获取的图像中包含显示有板书图像的书写板之后,查询所述映射列表,获得所述板书图像中每一坐标所对应的摄像机获取的图像中的坐标;a table lookup unit, configured to query the map list after the image obtained by the confirmation camera includes the tablet with the blackboard image, and obtain coordinates in the image acquired by the camera corresponding to each coordinate in the book image;
替换单元,用于读取查询到的坐标的特征值,作为所述板书图像中对应坐标的特征值。And a replacement unit, configured to read the feature value of the queried coordinate as the feature value of the corresponding coordinate in the blackboard image.
优选地,获取模块420包括:Preferably, the obtaining module 420 includes:
检测单元,用于在所述目标图像中检测所述标识物的边缘;a detecting unit, configured to detect an edge of the identifier in the target image;
查找单元,用于根据检测到的所述边缘,查找所述标识物中指定角点的坐标,作为所述第一坐标。And a searching unit, configured to search for coordinates of the specified corner point in the identifier as the first coordinate according to the detected edge.
作为另一种实施方式,所述映射模块430包括标定单元,用于根据所述第一坐标和所述第二,标定摄像机,获得所述摄像机的内参数和外参数。As another implementation manner, the mapping module 430 includes a calibration unit, configured to obtain an internal parameter and an external parameter of the camera according to the first coordinate and the second, calibration camera.
所述映射模块430还包括:The mapping module 430 further includes:
预测单元,用于由第一坐标根据所述内参数和外参数计算得到标识物的理论坐标;a prediction unit, configured to calculate, by the first coordinate, a theoretical coordinate of the identifier according to the inner parameter and the outer parameter;
修正单元,用于如果所述标识物的理论坐标与所述第二坐标不匹配,则修改所述标识物的理论坐标,使其与第二坐标匹配;a correction unit, configured to modify a theoretical coordinate of the identifier to match the second coordinate if the theoretical coordinate of the identifier does not match the second coordinate;
调整单元,用于由修改后的所述标识物的理论坐标根据所述外参数计算得到调整坐标;An adjusting unit, configured to calculate an adjusted coordinate according to the theoretical parameter of the modified identifier according to the external parameter;
修正参数计算单元,用于计算所述调整坐标和所述第一坐标之间的坐标映射参数;a correction parameter calculation unit, configured to calculate a coordinate mapping parameter between the adjustment coordinate and the first coordinate;
第二替换单元,用于使用所述坐标映射参数替换所述摄像机的内参数。And a second replacement unit, configured to replace the internal parameter of the camera by using the coordinate mapping parameter.
进一步地,所述修正单元具体包括:Further, the modifying unit specifically includes:
显示单元,用于根据摄像机拍摄的图像和摄像机的内参数、外参数,获得所述书写板显示的图像;通过触摸屏终端显示获得的图像,并在该图像上所述标识物的理论坐标所对应的位置提供拖拽控点;a display unit, configured to obtain an image displayed by the tablet according to an image captured by the camera and an internal parameter and an external parameter of the camera; display the obtained image through the touch screen terminal, and correspond to a theoretical coordinate of the identifier on the image The location provides a drag handle;
检测单元,用于检测所述拖拽控点是否被用户拖拽至其他坐标所对应的位置;a detecting unit, configured to detect whether the drag control point is dragged by a user to a position corresponding to another coordinate;
修改单元,用于若是,则判定所述标识物的理论坐标与所述第二坐标不匹配;将所述标识物的理论坐标修改为所述拖拽控点的坐标;a modifying unit, if yes, determining that the theoretical coordinate of the identifier does not match the second coordinate; modifying a theoretical coordinate of the identifier to a coordinate of the drag control point;
维持单元,用于若否,则判定所述标识物的理论坐标与所述第二坐标匹配。And a maintaining unit, if not, determining that the theoretical coordinate of the identifier matches the second coordinate.
本发明实施例所提供的图像校正装置可执行本发明任意实施例所提供的图像校正方法,具备执行方法相应的功能模块和有益效果。The image correction device provided by the embodiment of the present invention may perform an image correction method provided by any embodiment of the present invention, and has a function module and a beneficial effect corresponding to the execution method.
实施例四Embodiment 4
图5为本发明实施例四提供的一种设备的结构示意图,如图5所示,该设备包括处理器510、存储器520、输入装置530、输出装置540和用于拍摄图像的摄像机550;设备中处理器510的数量可以是一个或多个,图5中以一个处理器510为例;设备中的处理器510、存储器520、输入装置530和输出装置540可以通过总线或其他方式连接,图5中以通过总线连接为例。FIG. 5 is a schematic structural diagram of a device according to Embodiment 4 of the present invention. As shown in FIG. 5, the device includes a processor 510, a memory 520, an input device 530, an output device 540, and a camera 550 for capturing an image; The number of the processors 510 may be one or more, and one processor 510 is taken as an example in FIG. 5; the processor 510, the memory 520, the input device 530, and the output device 540 in the device may be connected by a bus or other manner. In 5, the bus connection is taken as an example.
存储器520作为一种计算机可读存储介质,可用于存储软件程序、计算机可执行程序以及模块,如本发明实施例中的图像校正方法对应的程序指令/模块(例如,图像校正装置中的拍摄模块410、获取模块420、映射模块430和校正模块440)。处理器510通过运行存储在存储器520中的软件程序、指令以及模块,从而执行设备的各种功能应用以及数据处理,即实现上述的图像校正方法。The memory 520 is used as a computer readable storage medium, and can be used for storing a software program, a computer executable program, and a module, such as a program instruction/module corresponding to the image correction method in the embodiment of the present invention (for example, a shooting module in the image correction device) 410. An acquisition module 420, a mapping module 430, and a correction module 440). The processor 510 performs various functional applications and data processing of the device by executing software programs, instructions, and modules stored in the memory 520, that is, implementing the image correction method described above.
存储器520可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序;存储数据区可存储根据终端的使用所创建的数据等。此外,存储器520可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实例中,存储器520可进一步包括相对于处理器510 远程设置的存储器,这些远程存储器可以通过网络连接至设备。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 520 may mainly include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to usage of the terminal, and the like. Further, the memory 520 may include a high speed random access memory, and may also include a nonvolatile memory such as at least one magnetic disk storage device, flash memory device, or other nonvolatile solid state storage device. In some examples, memory 520 can further include memory remotely located relative to processor 510, which can be connected to the device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
输入装置530可用于接收输入的数字或字符信息,以及产生与设备的用户设置以及功能控制有关的键信号输入。输出装置540可包括显示屏等显示设备。 Input device 530 can be used to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the device. The output device 540 can include a display device such as a display screen.
实施例五Embodiment 5
本发明实施例五还提供一种存储有计算机程序的计算机可读存储介质,所述程序在由计算机处理器执行时用于实现一种图像校正方法,该方法包括:A fifth embodiment of the present invention further provides a computer readable storage medium storing a computer program, where the program is implemented by a computer processor to implement an image correction method, the method comprising:
响应于触发指令,通过摄像机获取书写板的目标图像;其中,所述书写板上制作有多个标识物;Acquiring, by the camera, a target image of the tablet in response to the triggering instruction; wherein the writing board is formed with a plurality of markers;
依据预设算法获取第一坐标;其中,所述第一坐标为所述标识物在所述目标图像中的坐标;Obtaining a first coordinate according to a preset algorithm; wherein the first coordinate is a coordinate of the identifier in the target image;
根据第二坐标和所述第一坐标,获得所述书写板与所述摄像机获取的图像之间的坐标映射关系;其中,所述第二坐标为所述标识物在所述书写板上的坐标;Obtaining a coordinate mapping relationship between the writing board and an image acquired by the camera according to the second coordinate and the first coordinate; wherein the second coordinate is a coordinate of the identifier on the writing board ;
在确认摄像机获取的图像中包含显示有板书图像的书写板之后,根据所述坐标映射关系,将所述摄像机获取的图像校正为所述板书图像。After confirming that the image acquired by the camera includes the tablet on which the blackboard image is displayed, the image acquired by the camera is corrected to the blackboard image according to the coordinate mapping relationship.
当然,本发明实施例所提供的一种存储有计算机程序的计算机可读存储介质,其计算机可执行指令不限于如上所述的方法操作,还可以执行本发明任意实施例所提供的图像校正方法中的相关操作.Of course, the computer readable storage medium storing the computer program, the computer executable instructions are not limited to the method operations as described above, and may also perform the image correction method provided by any embodiment of the present invention. Related operations in .
通过以上关于实施方式的描述,所属领域的技术人员可以清楚地了解到,本发明可借助软件及必需的通用硬件来实现,当然也可以通过硬件实现,但很 多情况下前者是更佳的实施方式。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在计算机可读存储介质中,如计算机的软盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、闪存(FLASH)、硬盘或光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例所述的方法。Through the above description of the embodiments, those skilled in the art can clearly understand that the present invention can be implemented by software and necessary general hardware, and can also be implemented by hardware, but in many cases, the former is a better implementation. . Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk of a computer. , Read-Only Memory (ROM), Random Access Memory (RAM), Flash (FLASH), hard disk or optical disk, etc., including a number of instructions to make a computer device (can be a personal computer) The server, or network device, etc.) performs the methods described in various embodiments of the present invention.
值得注意的是,上述图像校正装置的实施例中,所包括的各个单元和模块只是按照功能逻辑进行划分的,但并不局限于上述的划分,只要能够实现相应的功能即可;另外,各功能单元的具体名称也只是为了便于相互区分,并不用于限制本发明的保护范围。It should be noted that, in the embodiment of the image correcting apparatus, the included units and modules are only divided according to functional logic, but are not limited to the above-mentioned partitioning, as long as the corresponding functions can be implemented; The specific names of the functional units are also for convenience of distinguishing from each other and are not intended to limit the scope of the present invention.
注意,上述仅为本发明的较佳实施例及所运用技术原理。本领域技术人员会理解,本发明不限于这里所述的特定实施例,对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本发明的保护范围。因此,虽然通过以上实施例对本发明进行了较为详细的说明,但是本发明不仅仅限于以上实施例,在不脱离本发明构思的情况下,还可以包括更多其他等效实施例,而本发明的范围由所附的权利要求范围决定。Note that the above are only the preferred embodiments of the present invention and the technical principles applied thereto. Those skilled in the art will appreciate that the present invention is not limited to the specific embodiments described herein, and that various modifications, changes and substitutions may be made without departing from the scope of the invention. Therefore, the present invention has been described in detail by the above embodiments, but the present invention is not limited to the above embodiments, and other equivalent embodiments may be included without departing from the inventive concept. The scope is determined by the scope of the appended claims.

Claims (10)

  1. 一种图像校正方法,其特征在于,包括:An image correction method, comprising:
    响应于触发指令,通过摄像机获取书写板的目标图像;其中,所述书写板上制作有多个标识物;Acquiring, by the camera, a target image of the tablet in response to the triggering instruction; wherein the writing board is formed with a plurality of markers;
    依据预设算法获取第一坐标;其中,所述第一坐标为所述标识物在所述目标图像中的坐标;Obtaining a first coordinate according to a preset algorithm; wherein the first coordinate is a coordinate of the identifier in the target image;
    根据第二坐标和所述第一坐标,获得所述书写板与所述摄像机获取的图像之间的坐标映射关系;其中,所述第二坐标为所述标识物在所述书写板上的坐标;Obtaining a coordinate mapping relationship between the writing board and an image acquired by the camera according to the second coordinate and the first coordinate; wherein the second coordinate is a coordinate of the identifier on the writing board ;
    在确认摄像机获取的图像中包含显示有板书图像的书写板之后,根据所述坐标映射关系,将所述摄像机获取的图像校正为所述板书图像。After confirming that the image acquired by the camera includes the tablet on which the blackboard image is displayed, the image acquired by the camera is corrected to the blackboard image according to the coordinate mapping relationship.
  2. 如权利要求1所述的图像校正方法,其特征在于,所述标识物制作在所述书写板的边缘。The image correction method according to claim 1, wherein said marker is formed at an edge of said writing board.
  3. 如权利要求1所述的图像校正方法,其特征在于,所述根据第二坐标和所述第一坐标,获得所述书写板与所述摄像机获取的图像之间的映射关系,具体包括:The image correction method according to claim 1, wherein the obtaining a mapping relationship between the tablet and the image acquired by the camera according to the second coordinate and the first coordinate comprises:
    计算所述第一坐标与所述第二坐标之间的转换函数;Calculating a conversion function between the first coordinate and the second coordinate;
    根据所述转换函数,建立所述书写板中每一坐标与所述摄像机获取的图像中的坐标之间的映射列表;Establishing a mapping list between each coordinate in the tablet and coordinates in an image acquired by the camera according to the conversion function;
    则所述在确认摄像机获取的图像中包含显示有板书图像的书写板之后,根据所述坐标映射关系,将所述摄像机获取的图像校正为所述板书图像,具体包括:Then, after the image obtained by the confirmation camera includes the tablet with the blackboard image, the image acquired by the camera is corrected to the blackboard image according to the coordinate mapping relationship, and specifically includes:
    在确认摄像机获取的图像中包含显示有板书图像的书写板之后,查询所述 映射列表,获得所述板书图像中每一坐标所对应的摄像机获取的图像中的坐标;After confirming that the image acquired by the camera includes the tablet displaying the blackboard image, querying the mapping list to obtain coordinates in the image acquired by the camera corresponding to each coordinate in the blackboard image;
    读取查询到的坐标的特征值,作为所述板书图像中对应坐标的特征值。The feature value of the queried coordinate is read as the feature value of the corresponding coordinate in the blackboard image.
  4. 如权利要求1至3任一项所述的图像校正方法,其特征在于,所述依据预设算法获取第一坐标,具体包括:The image correction method according to any one of claims 1 to 3, wherein the acquiring the first coordinate according to the preset algorithm comprises:
    在所述目标图像中检测所述标识物的边缘;Detecting an edge of the identifier in the target image;
    根据检测到的所述边缘,查找所述标识物中指定角点的坐标,作为所述第一坐标。Based on the detected edge, the coordinates of the specified corner point in the identifier are searched for as the first coordinate.
  5. 如权利要求1至3任一项所述的图像校正方法,其特征在于,所述标识物是印制或镶嵌在所述书写板上的。The image correction method according to any one of claims 1 to 3, wherein the marker is printed or mounted on the tablet.
  6. 一种图像校正装置,其特征在于,包括:An image correction device, comprising:
    拍摄模块,用于响应于触发指令,通过摄像机获取书写板的目标图像;其中,所述书写板上制作有多个标识物;a photographing module, configured to acquire a target image of the writing board by the camera in response to the triggering instruction; wherein the writing board is formed with a plurality of markers;
    获取模块,用于依据预设算法获取第一坐标;其中,所述第一坐标为所述标识物在所述目标图像中的坐标;An acquiring module, configured to acquire a first coordinate according to a preset algorithm, where the first coordinate is a coordinate of the identifier in the target image;
    映射模块,用于根据第二坐标和所述第一坐标,获得所述书写板与所述摄像机获取的图像之间的坐标映射关系;其中,所述第二坐标为所述标识物在所述书写板上的坐标;a mapping module, configured to obtain, according to the second coordinate and the first coordinate, a coordinate mapping relationship between the writing board and an image acquired by the camera; wherein the second coordinate is that the identifier is in the The coordinates on the writing pad;
    校正模块,用于在确认摄像机获取的图像中包含显示有板书图像的书写板之后,根据所述坐标映射关系,将所述摄像机获取的图像校正为所述板书图像。The correction module is configured to correct the image acquired by the camera to the blackboard image according to the coordinate mapping relationship after the image obtained by the confirmation camera includes the tablet on which the blackboard image is displayed.
  7. 如权利要求6所述的图像校正装置,其特征在于,所述映射模块包括:The image correction device according to claim 6, wherein the mapping module comprises:
    计算单元,用于计算所述第一坐标与所述第二坐标之间的转换函数;a calculating unit, configured to calculate a conversion function between the first coordinate and the second coordinate;
    建表单元,用于根据所述转换函数,建立所述书写板中每一坐标与所述摄 像机获取的图像中的坐标之间的映射列表;a table building unit, configured to establish, according to the conversion function, a mapping list between each coordinate in the writing board and coordinates in an image acquired by the camera;
    则所述校正模块包括:Then the correction module comprises:
    查表单元,用于在确认摄像机获取的图像中包含显示有板书图像的书写板之后,查询所述映射列表,获得所述板书图像中每一坐标所对应的摄像机获取的图像中的坐标;a table lookup unit, configured to query the map list after the image obtained by the confirmation camera includes the tablet with the blackboard image, and obtain coordinates in the image acquired by the camera corresponding to each coordinate in the book image;
    替换单元,用于读取查询到的坐标的特征值,作为所述板书图像中对应坐标的特征值。And a replacement unit, configured to read the feature value of the queried coordinate as the feature value of the corresponding coordinate in the blackboard image.
  8. 如权利要求7所述的图像校正装置,其特征在于,所述获取模块包括:The image correction device according to claim 7, wherein the acquisition module comprises:
    检测单元,用于在所述目标图像中检测所述标识物的边缘;a detecting unit, configured to detect an edge of the identifier in the target image;
    查找单元,用于根据检测到的所述边缘,查找所述标识物中指定角点的坐标,作为所述第一坐标。And a searching unit, configured to search for coordinates of the specified corner point in the identifier as the first coordinate according to the detected edge.
  9. 一种设备,其特征在于,所述设备包括:A device, characterized in that the device comprises:
    一个或多个处理器;One or more processors;
    存储器,用于存储一个或多个程序;a memory for storing one or more programs;
    摄像机,用于拍摄图像;a camera for taking images;
    当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现如权利要求1-5中任一所述的图像校正方法。The one or more programs are executed by the one or more processors such that the one or more processors implement the image correction method of any of claims 1-5.
  10. 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,该程序被处理器执行时实现如权利要求1-5中任一所述的图像校正方法。A computer readable storage medium having stored thereon a computer program, characterized in that the program is executed by a processor to implement the image correction method according to any one of claims 1-5.
PCT/CN2017/116731 2017-08-30 2017-12-17 Image correction method, apparatus and device, and computer readable storage medium WO2019041651A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710762077.6A CN107516292A (en) 2017-08-30 2017-08-30 Method for correcting image, device, equipment and computer-readable recording medium
CN201710762077.6 2017-08-30

Publications (1)

Publication Number Publication Date
WO2019041651A1 true WO2019041651A1 (en) 2019-03-07

Family

ID=60724387

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/116731 WO2019041651A1 (en) 2017-08-30 2017-12-17 Image correction method, apparatus and device, and computer readable storage medium

Country Status (2)

Country Link
CN (1) CN107516292A (en)
WO (1) WO2019041651A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112489114A (en) * 2020-11-25 2021-03-12 深圳地平线机器人科技有限公司 Image conversion method and device, computer readable storage medium and electronic equipment
CN113420581A (en) * 2020-10-19 2021-09-21 杨宏伟 Correction method and device for written document image, electronic equipment and readable medium

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110111383B (en) * 2018-05-08 2022-03-18 广东聚华印刷显示技术有限公司 Glass substrate offset correction method, device and system
CN108764152B (en) * 2018-05-29 2020-12-04 北京物灵智能科技有限公司 Method and device for realizing interactive prompt based on picture matching and storage equipment

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105488779A (en) * 2014-09-18 2016-04-13 宝山钢铁股份有限公司 Camera distortion correction calibration board and calibration method
CN105763829A (en) * 2014-12-18 2016-07-13 联想(北京)有限公司 Image processing method and electronic device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102147918B (en) * 2010-02-09 2015-08-19 新奥特(北京)视频技术有限公司 Based on external parameters of cameras defining method and the system of stadium markings
CN102479379B (en) * 2010-11-19 2014-09-03 义晶科技股份有限公司 Image rectification method and relevant image rectification system
CN103150721B (en) * 2013-01-10 2015-07-29 杭州先临三维科技股份有限公司 The mistake identification point minimizing technology of scanner calibration plate image and scaling board
CN103929584B (en) * 2013-01-15 2017-11-03 瑞昱半导体股份有限公司 Method for correcting image and image calibrating circuit

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105488779A (en) * 2014-09-18 2016-04-13 宝山钢铁股份有限公司 Camera distortion correction calibration board and calibration method
CN105763829A (en) * 2014-12-18 2016-07-13 联想(北京)有限公司 Image processing method and electronic device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113420581A (en) * 2020-10-19 2021-09-21 杨宏伟 Correction method and device for written document image, electronic equipment and readable medium
CN112489114A (en) * 2020-11-25 2021-03-12 深圳地平线机器人科技有限公司 Image conversion method and device, computer readable storage medium and electronic equipment
CN112489114B (en) * 2020-11-25 2024-05-10 深圳地平线机器人科技有限公司 Image conversion method, image conversion device, computer readable storage medium and electronic equipment

Also Published As

Publication number Publication date
CN107516292A (en) 2017-12-26

Similar Documents

Publication Publication Date Title
WO2020199906A1 (en) Facial keypoint detection method, apparatus and device, and storage medium
WO2019041651A1 (en) Image correction method, apparatus and device, and computer readable storage medium
CN107464266B (en) Bearing calibration, device, equipment and the storage medium of camera calibration parameter
US10847073B2 (en) Image display optimization method and apparatus
US9697431B2 (en) Mobile document capture assist for optimized text recognition
JPH0887594A (en) Provision method of perfect and distortionless computer display of image
WO2022143283A1 (en) Camera calibration method and apparatus, and computer device and storage medium
WO2019033659A1 (en) Method, device and apparatus for displaying board-writing for teaching, and computer-readable storage medium
WO2019041652A1 (en) Image correction method, apparatus and device, and computer readable storage medium
JP2014220720A (en) Electronic apparatus, information processing method, and program
US9921054B2 (en) Shooting method for three dimensional modeling and electronic device supporting the same
WO2022105569A1 (en) Page direction recognition method and apparatus, and device and computer-readable storage medium
CN104142760B (en) The localization method of interactive projection equipment and its interaction pen
US20150294447A1 (en) Image acquisition using a level-indication icon
CN102023763B (en) Positioning method of touch system camera
WO2024055531A1 (en) Illuminometer value identification method, electronic device, and storage medium
CN104122978A (en) Display frame adjusting system and method
JP6030890B2 (en) Image processing unit, image processing method, and stand type scanner
JP2017199288A (en) Image processing device, image processing method and program
CN115797468A (en) Automatic correction method, device and equipment for mounting height of fisheye camera
CN111241974B (en) Bill information acquisition method, device, computer equipment and storage medium
CN112637587B (en) Dead pixel detection method and device
US9639768B2 (en) Methods and systems to adaptively detect object borders from electronic device images
CN112291445B (en) Image processing method, device, equipment and storage medium
CN112070695A (en) Correction method of registration matrix and computer equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17922985

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 15.10.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 17922985

Country of ref document: EP

Kind code of ref document: A1