CN106131505B - System for realizing cloud board image splicing and recording method - Google Patents

System for realizing cloud board image splicing and recording method Download PDF

Info

Publication number
CN106131505B
CN106131505B CN201610703291.XA CN201610703291A CN106131505B CN 106131505 B CN106131505 B CN 106131505B CN 201610703291 A CN201610703291 A CN 201610703291A CN 106131505 B CN106131505 B CN 106131505B
Authority
CN
China
Prior art keywords
cloud
microprocessor
board
cloud board
splicing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610703291.XA
Other languages
Chinese (zh)
Other versions
CN106131505A (en
Inventor
何赛灵
何金龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Changshu Zheda Zijin Optoelectronic Technology Research Center
Original Assignee
Suzhou Longnuofa Information System Engineering Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Longnuofa Information System Engineering Co ltd filed Critical Suzhou Longnuofa Information System Engineering Co ltd
Priority to CN201610703291.XA priority Critical patent/CN106131505B/en
Publication of CN106131505A publication Critical patent/CN106131505A/en
Application granted granted Critical
Publication of CN106131505B publication Critical patent/CN106131505B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038Image mosaicing, e.g. composing plane images from plane sub-images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/62Text, e.g. of license plates, overlay texts or captions on TV images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Studio Devices (AREA)

Abstract

The invention discloses a method and a system for splicing and recording cloud board images, wherein the method comprises a cloud board, a camera, a cloud board image, a microprocessor and a communication interface module; one or more cameras are respectively arranged on the periphery of the cloud plate, and cloud plate pictures of parts with different visual angles are collected; the cameras are connected with the microprocessor, and each camera transmits the shot cloud board picture information to the microprocessor for splicing; the microprocessor is connected with the communication interface module and is transmitted to the mobile phone end in a wireless mode, and the mobile phone end sends the image data to the cloud. Compared with similar electromagnetic products, the invention can be operated by any object by using the electronic cloud board infrared technology without a special pen, and has long service life, mature and stable technology.

Description

System for realizing cloud board image splicing and recording method
Technical Field
The invention belongs to the technical field of cloud board image splicing, and relates to a technology capable of realizing that a complete image is sent to a cloud end for storage after the cloud board collects and splices images at various visual angles.
Background
In the modern teaching field, multimedia technology application and interaction enhancement are the mainstream directions of teaching development, and people can see various multimedia projection devices or interactive teaching devices in a common classroom or an educational conference hall. The electronic cloud board is a suitable tool which is most popular in traditional offline open occasions such as teaching and meetings, and can be in information communication with a computer to form an interactive collaborative meeting or teaching environment. Compared with the traditional blackboard which is not erased at one time, the electronic cloud board can record and store the whole teaching and learning process in real time. Therefore, with the advent of national education informatization policy, the electronic cloud board is used as a main carrier of education informatization, and the development tendency is more superior to that of bamboo-breaking in one year.
The electronic cloud board employs OCR, optical character recognition technology, which refers to a process in which an electronic device (such as a scanner or a digital camera) checks a character printed on paper, determines its shape by detecting dark and light patterns, and then translates the shape into a computer text by a character recognition method, that is: the method is a technology for converting characters in a paper document into an image file of a black-and-white dot matrix in an optical mode aiming at print characters, and converting the characters in the image into a text format through recognition software for further editing and processing by word processing software. From image to result output, the image input, image pre-processing, character feature extraction, comparison and identification are carried out, and finally the error characters are corrected through manual correction, and the result is output.
The image stitching technology is a technology for stitching a plurality of images with overlapped parts (which may be obtained at different times, different viewing angles or different sensors) into a large-scale seamless high-resolution image. Image registration and image fusion are two key technologies for image stitching. The traditional cloud board cannot record and store various information on the lower drawing board in real time, or errors exist in recorded images, and a novel cloud board image recording method is provided for solving the problems.
Disclosure of Invention
1. The object of the invention is to provide a method for producing a high-quality glass.
Aiming at the defects of the existing cloud board erasing and storage technology, the invention provides a technology for shooting partial information of four corners of a cloud board by using four cameras, completing image splicing by a microprocessor and transmitting the image to a cloud end, and solves the problems that the existing cloud board cannot timely store information on the board and the like, so that the application is more intelligent.
2. The technical scheme adopted by the invention is disclosed.
The cloud board image splicing and recording system comprises a cloud board, a camera, a cloud board picture, a microprocessor and a communication interface module; one or more cameras are respectively arranged on the periphery of the cloud plate, and cloud plate pictures of parts with different visual angles are collected; the cameras are connected with the microprocessor, and each camera transmits the shot cloud board picture information to the microprocessor for splicing; the microprocessor is connected with the communication interface module and is transmitted to the mobile phone end in a wireless mode, and the mobile phone end sends the image data to the cloud.
Preferably, the edge of the cloud plate is provided with an edge strip.
Preferably, the device further comprises a power supply, and the microprocessor is connected with the power supply.
Preferably, the vertical distance between the detection surface of the camera and the white board is 2-3 mm.
The cloud board image splicing and recording method provided by the invention comprises the following steps:
step 1, installing one or more cameras around a cloud plate to collect cloud plate pictures with different visual angles;
step 2, the camera transmits the cloud board picture to the microprocessor, and the microprocessor completes the splicing of the cloud board picture;
step 3, identifying whether a blackboard erasing action exists, if so, storing the currently spliced images, then realizing the erasing action by the microprocessor, and if not, skipping to the step 4;
and 4, judging whether the preset time is up to the interval T, and if the preset time is up, acquiring cloud board pictures of different visual angle parts by the four cameras, splicing the whole cloud board picture and sending out.
Preferably, in the step 3, the cloud board recognizes and translates the optical character by using an OCR technology, when the eraser is placed at a position determined at the upper left corner of the whiteboard, the camera automatically recognizes the action of holding the eraser by a human hand, and judges that the eraser is used for erasing the whiteboard, and the microprocessor performs an erasing action.
Preferably, in the step 3, a preset gesture recognition is adopted, the camera collects gestures for wiping the whiteboard, and the microprocessor performs an erasing action.
Preferably, in the step 1 and the step 4, when the whiteboard information is recorded, the sound is recorded in synchronization with the time, and is used as a sound source in the recording process, and the remote terminal plays the whole image and plays the sound synchronously.
3. The invention has the beneficial effects.
(1) According to the invention, the cloud board images at multiple angles are spliced into a complete panoramic image in real time, so that the influence of a moving object is solved, the shooting cost is greatly reduced and the imaging efficiency is improved.
(2) The invention sets two methods to identify the erasing and writing actions of the operator, and reduces the error rate that the image is not saved because the erasing and writing are missed to be identified.
(3) The pen for the cloud board has no excessive limitation, and can be an oil pen, a chalk and the like.
(4) The invention is applied to occasions such as class, communication, meeting and the like, and has high utilization rate.
Drawings
Fig. 1 is a working principle diagram of the invention patent.
Fig. 2 is a schematic structural diagram of an embodiment of the invention.
The system comprises a cloud board 1, a camera 2, a cloud board array 3, a microprocessor 4 and a power supply and communication interface module 5.
Detailed Description
The invention is further described with reference to the following figures.
Example 1
The cloud board image splicing and recording system comprises a cloud board 1, a camera 2, a cloud board picture 3, a microprocessor 4, a communication interface module 5 and a power supply, wherein the microprocessor 4 is connected with the power supply; one or more cameras are respectively arranged on the periphery of the cloud board 1, and the cloud board pictures 3 with different visual angles are collected; the cameras 2 are connected with the microprocessor 4, and each camera 2 transmits the shot cloud board picture 3 information to the microprocessor 4 for splicing; microprocessor is connected with communication interface module 5, transmits to the cell-phone end through wireless mode, and the cell-phone end sends image data to the high in the clouds, and 1 edge of cloud board sets up the strake, and 2 detection faces of camera are 2-3mm apart from the blank vertical distance.
A cloud board image splicing and recording method comprises the following steps:
step 1, installing one or more cameras on the periphery of a cloud board respectively to collect cloud board pictures 3 with different visual angles;
step 2, the camera transmits the cloud board picture 3 to the microprocessor 4, and the microprocessor 4 completes splicing of the cloud board picture 3;
step 3, identifying whether a blackboard erasing action exists, if so, storing the currently spliced images, then realizing the erasing action by the microprocessor 4, and if not, skipping to the step 4;
and 4, judging whether the preset time is up to the interval T, if so, acquiring the cloud board pictures 3 with different visual angles by the four cameras, splicing the whole cloud board pictures to send out, recording the sound and the time synchronously when recording the white board information, taking the sound as a sound source in the recording process, and playing the whole picture and the sound synchronously by the remote terminal.
The erasing action is realized by the following steps: the cloud board utilizes OCR technology to recognize and translate optical characters, when the eraser is placed at a determined position at the upper left corner of the white board, the camera 2 automatically recognizes the action of holding the eraser by a human hand, the action is judged to be erasing the white board, and the microprocessor erases the action.
Erasing action another implementation: and the preset gesture recognition is adopted, the gesture for wiping the white board is collected by the camera, and the microprocessor performs the wiping action.
Example 2
In the invention, a plurality of cameras are respectively arranged at a plurality of corners of a cloud plate 1, and four cameras are taken as examples below, and white edgings are added at the edge of the cloud plate. The four cameras 2 are connected with the same single chip microcomputer 4, and the single chip microcomputer 4 is directly connected with the power supply and communication interface module 5. After the writing on the cloud board is started, the camera 2 automatically records the whole cloud board picture once every delta T, and the whole cloud board picture is stored for later use after the microprocessor 4 finishes splicing. Meanwhile, when the camera 2 is provided with a cloud board to be wiped by an operator, the system can also send data to an upper computer or a network after the four cloud board pictures 3 are spliced by the microprocessor 4 before the cloud board is wiped. The upper computer or the network can upload picture information to the cloud end, and in the image processing process, sound can be synchronously recorded and is called out for playing. When the eraser is set to be in the dotted line frame of fig. 2, the camera automatically recognizes as the indication of erasing the cloud board. Or the action of any one of the four cameras for shooting the operator is an erasing instruction, and the system completes the splicing and uploading of the four partial images before.
The cameras arranged at the four corners of the cloud board are used for shooting pictures at all angles on the cloud board, and the vertical distance between the detection surface of each camera and the cloud board is 2-3 mm. After the camera realizes the single-frame images collected by different visual angle parts, the microprocessor can complete the image splicing. Before the cloud board is wiped, the system automatically identifies the action of the cloud board, records four images, and transmits the complete images to a mobile phone end through wireless methods such as wifi after the four images are spliced by a microprocessor. The mobile phone can send the image data to the cloud. Meanwhile, the camera can automatically shoot every other fixed time T, and a plurality of images are fully automatically generated into a panoramic image and uploaded to the cloud.
The cloud plate can recognize and translate optical characters by using OCR technology. The system is provided with two methods for identifying blackboard erasing actions: 1, when the eraser is placed at a determined position at the upper left corner of the cloud board, the camera automatically recognizes the action of holding the eraser by a human hand, and the cloud board is judged to be erased. 2, specific gesture recognition, the camera can recognize the gesture of the cloud wiping board. And splicing the four pictures into a panoramic picture before an operator rubs the cloud board. Or after a whole cloud board picture is written, the system automatically completes splicing. After splicing, the data is transmitted to the mobile phone end through wireless methods such as wifi and the like. And the mobile phone end sends the image data to the cloud end for calling out when needed. Meanwhile, the system can also set one beat at intervals of delta T as original data and record the middle process. When recording the cloud board information, the sound is recorded in synchronization with time as a sound source for the recording process. The cloud can play the whole picture, the sound is played synchronously, and the middle process can be omitted without playing. And after the complete page is spoken, automatically turning the page.
The mode of identifying the picture: the microprocessor calculates the position of the pen point according to the position of the image point and the included angle and distance between the two image sensors, namely two image sensors are used for photographing the same target from different positions, the obtained image is subjected to image processing by utilizing a feature extraction algorithm, a matching algorithm and the like, then the corresponding point of the target on the two images is found, the difference of the horizontal coordinates of the two points on the image coordinate system is the parallax, and the depth information of the object is recovered by utilizing the relation between the parallax and the three-dimensional coordinate.
In three-dimensional space, the cameras are located in the Z =0 plane, and the connecting line of the centers of the two cameras is parallel to the X axis and is separated by b. The focal length of the camera is f and the object is located in the Z = L plane. When the first camera is used for photographing, the coordinate origin is placed at the center of the first camera, and the position of the object point is (X = X0, Y =0, Z = L). The hour point position is (X = X1, Y =0, Z = 0). According to the ideal optical imaging relationship, the relationship between the image point and the object point is as follows: x0/x1= L/f. When the second camera is used for photographing, the coordinate origin is placed at the center of the second camera, the position of the object point is (X = X0-b, Y =0, Z = L), and the position of the image point is (X = X2, Y =0, Z = 0). According to the ideal optical imaging relationship, the relationship between the image point and the object point is as follows: x0-b/x2= L/f. The relation between the image point and the object point when two cameras are used for taking pictures simultaneously obtains L = bf/(x2-x1), wherein,
Figure 208142DEST_PATH_IMAGE002
the difference of the positions of the points Q imaged on the left and right graphs is parallax, b is a baseline distance, and f is a focal length of the combined objective lens, so that the Z-axis coordinate information of the object point corresponding to each image point can be calculated as long as the parallax graph and the camera parameters b and f exist.
In the implementation case of the invention, by using the electronic cloud board infrared technology, compared with similar electromagnetic products, any object can be operated without a special pen, the service life is long, and the technology is mature and stable. The modern infrared technology can resist dust and water and is also suitable for the touch technology under the harsh environment requirement. Teachers and students use the cloud board pen shaped like chalk to completely replace the function of the traditional chalk, so that various damages caused by the chalk can be avoided, resources are saved, and a healthy, environment-friendly and energy-saving teaching mode is comprehensively realized. Can use rich and colorful multimedia resources and can write or mark at any time. Teaching process can easily be preserved into teaching video and send the student, and the student need not to listen and talk while doing the note again, also can exchange each other and research teaching video between the teacher, improves the teaching level.

Claims (6)

1. A system for realizing cloud board image splicing and recording method is characterized in that: the cloud board comprises a cloud board (1), a camera (2), a cloud board picture (3), a microprocessor (4) and a communication interface module (5); one or more cameras are respectively arranged on the periphery of the cloud plate (1) to collect cloud plate pictures (3) with different visual angles; the cameras (2) are connected with the microprocessor (4), and each camera (2) transmits the information of the shot cloud board picture (3) to the microprocessor (4) for splicing; the microprocessor is connected with the communication interface module (5) and is transmitted to the mobile phone end in a wireless mode, and the mobile phone end sends the image data to the cloud end;
the method comprises the following steps:
step 1, installing one or more cameras around a cloud plate to collect cloud plate pictures (3) with different visual angles;
step 2, the camera transmits the cloud board picture (3) to the microprocessor (4), and the microprocessor (4) completes the splicing of the cloud board picture (3);
step 3, identifying whether a motion of wiping a cloud board exists, if so, storing the currently spliced images, then, realizing the erasing motion by a microprocessor (4), recording four images, splicing the four images by the microprocessor, then, transmitting the complete images to a mobile phone end, and if not, skipping to the step 4;
step 4, judging whether the preset time of the interval T is reached, if the preset time is reached, acquiring cloud board pictures (3) of different visual angle parts by the four cameras, and splicing the whole cloud board picture to send out;
in the step 3, the cloud board recognizes and translates the optical characters by using an OCR technology, when the eraser is placed at a determined position at the upper left corner of the cloud board, the camera (2) automatically recognizes the action of holding the eraser by a person, the action is judged as erasing the cloud board, and the microprocessor erases the optical characters.
2. The system for realizing the cloud board image splicing and recording method according to claim 1, wherein: the edge of the cloud plate (1) is provided with an edge strip.
3. The system for realizing the cloud board image splicing and recording method according to claim 1, wherein: the device also comprises a power supply, and the microprocessor (4) is connected with the power supply.
4. The system for realizing the cloud board image splicing and recording method according to claim 1, wherein: the vertical distance between the detection surface of the camera (2) and the cloud board is 2-3 mm.
5. The system for realizing the cloud board image splicing and recording method according to claim 1, wherein: in the step 3, preset gesture recognition is adopted, the camera collects gestures of the cloud wiping plate, and the microprocessor performs wiping action.
6. The system for realizing the cloud board image splicing and recording method according to claim 1, wherein: in the step 1 and the step 4, when the cloud board information is recorded, the sound is recorded synchronously with the time and is used as a sound source in the recording process, and the remote terminal plays the whole picture and plays the sound synchronously.
CN201610703291.XA 2016-08-23 2016-08-23 System for realizing cloud board image splicing and recording method Active CN106131505B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610703291.XA CN106131505B (en) 2016-08-23 2016-08-23 System for realizing cloud board image splicing and recording method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610703291.XA CN106131505B (en) 2016-08-23 2016-08-23 System for realizing cloud board image splicing and recording method

Publications (2)

Publication Number Publication Date
CN106131505A CN106131505A (en) 2016-11-16
CN106131505B true CN106131505B (en) 2022-01-07

Family

ID=57280165

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610703291.XA Active CN106131505B (en) 2016-08-23 2016-08-23 System for realizing cloud board image splicing and recording method

Country Status (1)

Country Link
CN (1) CN106131505B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109766897A (en) * 2018-12-14 2019-05-17 深圳壹账通智能科技有限公司 Paintbrush method for searching, device, equipment and storage medium based on image recognition

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101813995A (en) * 2010-05-12 2010-08-25 福州锐达数码科技有限公司 Method for recognizing gesture on infrared induction type electronic whiteboard
CN102096812A (en) * 2011-01-30 2011-06-15 吴柯维 Teacher blackboard writing action detection method for intelligent teaching recording and playing system
CN205946030U (en) * 2016-08-23 2017-02-08 苏州龙诺法信息系统工程有限公司 Cloud board image mosaicking and recording system

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7260278B2 (en) * 2003-11-18 2007-08-21 Microsoft Corp. System and method for real-time whiteboard capture and processing
US7554576B2 (en) * 2005-06-20 2009-06-30 Ricoh Company, Ltd. Information capture and recording system for controlling capture devices

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101813995A (en) * 2010-05-12 2010-08-25 福州锐达数码科技有限公司 Method for recognizing gesture on infrared induction type electronic whiteboard
CN102096812A (en) * 2011-01-30 2011-06-15 吴柯维 Teacher blackboard writing action detection method for intelligent teaching recording and playing system
CN205946030U (en) * 2016-08-23 2017-02-08 苏州龙诺法信息系统工程有限公司 Cloud board image mosaicking and recording system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
面向高校教学应用的课堂录播系统设计研究;宋楚杰;《中国优秀硕士学位论文全文数据库 社会科学Ⅱ辑》;20140815(第8期);第7-11页 *

Also Published As

Publication number Publication date
CN106131505A (en) 2016-11-16

Similar Documents

Publication Publication Date Title
US9807263B2 (en) Mobile document capture assistance using augmented reality
CN102411854B (en) Classroom teaching mixing technology application system based on enhanced reality and method thereof
CN113504852A (en) Control method of recording and broadcasting integrated intelligent comprehensive screen blackboard system
CN104575120B (en) Display system for aided teaching
CN111242962A (en) Method, device and equipment for generating remote training video and storage medium
JP6008076B2 (en) Projector and image drawing method
CN105549725A (en) Three-dimensional scene interaction display device and method
CN102147684B (en) Screen scanning method for touch screen and system thereof
CN111050017A (en) Picture and text photographing equipment
CN203608274U (en) Intelligent broadcasting tracking system based on television language
CN108874187A (en) A kind of projector Notes System
KR102492423B1 (en) Diy electronic blackboard-based remote lecture providing system and method therefor
CN111179650A (en) Platform system for automatic documenting of paper writing board writing and explanation
CN111325853B (en) Remote coaching system and method based on augmented reality glasses
CN105321388A (en) Method for making electronic record for electronic class based on electronic blackboard
AU2020287351A1 (en) Virtualization of physical activity surface
CN113506476A (en) Intelligent interconnected blackboard
CN203217804U (en) Teaching integrated machine
CN103680225A (en) Teaching all-in-one machine and multi-input display method thereof
CN104965625B (en) A kind of Visual Teaching display systems
CN106131505B (en) System for realizing cloud board image splicing and recording method
CN103531047A (en) Video presenter capable of achieving 3D interactive display
CN207397518U (en) Wireless mobile objects projection system
CN206181175U (en) Scanning writing content's pen when writing
CN109300342A (en) A kind of intelligent sharing blackboard

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20220615

Address after: 215500 Building 1 Xianshi Road, Changshu High-tech Industrial Development Zone, Suzhou City, Jiangsu Province

Patentee after: CHANGSHU ZHEDA ZIJIN OPTOELECTRONIC TECHNOLOGY RESEARCH CENTER

Address before: 215500 Building 1, dongdongdongnanhui, Huijin Third Road, Changshu high tech Industrial Development Zone, Suzhou City, Jiangsu Province

Patentee before: SUZHOU LONGNUOFA INFORMATION SYSTEM ENGINEERING CO.,LTD.

TR01 Transfer of patent right