CN104200710A - Novel wireless multimedia interactive teaching system and fault treatment method - Google Patents

Abstract

The invention relates to a novel wireless multimedia interactive teaching system and a fault treatment method. The system is provided with an interactive exhibition stand for real-time interaction and interactive commenting. The interactive exhibition stand adopts a 5-megapixel high-definition sensor, realizes output of 1080P30-frame high-definition digital images, is used in combination with an all-in-one machine, an electronic white board and a wireless teaching instrument, allows an operator to comment and modify a real-object picture output by a real-object exhibition stand in a wireless or wired way and meanwhile remotely control related functional buttons of a wireless video exhibition stand in a wireless or wired way, and realizes real-time synchronous interaction of all teaching terminals by virtue of synchronous output of the optical all-in-one machine and the mobile teaching instrument.

Description

A kind of novel radio multimedium interactive education system and fault handling method

Technical field

The present invention is the mutual exhibition booth that the first item of the information-based application release of oriented towards education possesses real-time, interactive, interaction point screen.

Background technology

" three chi dais; a chalk " are the real pictures of Traditional Classroom, but along with interaction technique, development of Mobile Internet technology, the fast developments such as wireless technology, Traditional Classroom is Challenge also, and country explicitly points out in " 10 years development plans of IT application in education sector " will be by the information-based means such as cloud computing, mobile Internet, realizes the modernization in traditional classroom with intelligent, can interconnect with digitized campus network, can realize educational resource and share.

Education terminal mainly comprises video showing platform, all-in-one (electronic whiteboard or projection screen etc.) and other teaching aid equipment.Wherein, visual real object display stand can clearly display data, teaching materials, material object, lantern slide etc., therefore go up, and be the indispensable teaching equipment of multi-media classroom, be widely used in various information technique teaching.Common video showing platform comprises: camera, light source, table top and PC end are controlled software.Books, file, material object etc. are placed on the table top of show stand, the camera that is positioned at table top top is aimed at after material object, can on projecting plane, export picture in kind.Existing video presenter, uses inconvenience because many reasons cause:

1, resolution is not high: 850,000 resolution that the sensor resolution that uses 2M is 1024*768, on the screen projecting to more than 82 cun, resolution seems that not, details cannot be shown

2, frame per second is inadequate, real-time not: be generally the display speed of 12 frames, take motionless text all right, but directly write at projection scene, has very strong stagnation sense and retardance.Use inconvenience

3, cannot directly write: existing show stand is directly photographed images directly projection after simple processing normally, cannot on original image, carry out other processing, and in the actual process of giving lessons teacher's mark of need to punctuating on projected picture, can be according to the person's of giving lessons the mark that need to carry out emphasis

4, cannot move control: the movement of not supporting of existing show stand is controlled, and user can only control on limit, exhibition booth, so just the person of giving lessons is limited in to displaying edge of table, to the great inconvenience of having given lessons.When need operator for projected picture on the ad-hoc location of material picture while carrying out emphasis instruction, easily occur between operation inconvenience, the site limitation of giving lessons, PC and the problem such as show stand distance.Meanwhile, existing teaching multimedia equipment this cannot be wireless interconnected, can not carry out in real time annotations and comments amendment, affect the mutual and teacher of teachers and students and freely bring into play.

This project has been researched and developed a kind of novel radio multimedium interactive education system for the problems referred to above, adopt 5,000,000 high definition sensors, realize the clear digital picture output of 1080P 30 vertical frame dimension, machine integrally combines, electronic whiteboard, and wireless teaching instrument uses, realizing operator is annotated and commented on and revises the picture in kind of real object exhibition booth output by wireless and netting twine, wireless video exhibition booth correlation function button is carried out to wireless and Long-distance Control netting twine simultaneously, utilize the synchronous output of optics all-in-one and Mobile Teaching instrument, realize all instructional terminals real-time synchronization mutual, realize truly in real time, wireless dynamic teaching, solve for many years, teacher can not leave the passive situation of teaching in dais, promote teaching interaction.

Summary of the invention

A kind of novel radio multimedium interactive education system and fault handling method, possesses real-time, interactive, the mutual exhibition booth of interaction point screen, adopt 5,000,000 high definition sensors, realize the clear digital picture output of 1080P 30 vertical frame dimension, machine integrally combines, electronic whiteboard, and wireless teaching instrument uses, realizing operator is annotated and commented on and revises the picture in kind of real object exhibition booth output by wireless and netting twine, wireless video exhibition booth correlation function button is carried out to wireless and Long-distance Control netting twine simultaneously, utilize the synchronous output of optics all-in-one and Mobile Teaching instrument, realize all instructional terminals real-time synchronization mutual, it is characterized in that, technical indicator:

The fault handling method that it is characterized in that this device is:

(1), switch power supply back light do not work, without image.

Process: check whether supply socket switch is opened, and whether socket contacts well.

, after switch power supply, upper lamp can be bright, but without image or judder.

Process: check that whether video line connection is correct, whether video line connection terminal weares and teares, drops.

, in the time being switched to certain road video, sound has cross-talk.

Process: reduce the volume output of relevant device.

, image shows, but other buttons are all inoperative, Mobile exhibiting object image is still motionless.

Process: image is in frozen state, then by a freeze frame.

(5), image blurring.

Process: exhibition booth now may be in Manual focusing state; Click automatic focus key, forward automatic focus to.Also may be " to haze " because ambient humidity causes too greatly pick-up lens, the ambient humidity of should taking measures to reduce.The phenomenon that hazes in half an hour after general start can disappear.

, in the time that automatic focus is unclear, can check whether close-up speckles with dust, please be by special lens wiping paper wiped clean gently if any dust.

, except above-mentioned 6 of listing, other any projects that relate to detachable maintaining must be operated by specialized engineering personnel.

  

Brief description of the drawings

  

Fig. 1 show stand

Fig. 2 connector socket mark

Fig. 3 display device shows exhibition booth the machine camera lens picture

The pull-up of Fig. 4 armed lever

Fig. 5 armed lever is folding

Fig. 6 button operation

Fig. 7 multimedia system

Fig. 8 factory arranges interface

Fig. 9 system applies framework

Figure 10 system mutual flow process

Figure 11 system chart

Figure 12 core block diagram

Figure 13 power management

Figure 14 hardware system block diagram

embodiment

The mutual exhibition booth of the silver-colored high-definition multimedia of China is domestic first item, is also the mutual exhibition booth that the information-based first item of applying release of oriented towards education possesses real-time, interactive, interaction point screen.

The mutual exhibition booth of the silver-colored high-definition multimedia of China has all traditional functions of video presenter, in addition, aspect a lot of, has unique innovation to break through.Be different from traditional exhibition booth, the mutual the highest support in the exhibition booth 1080P pixel output of China's silver, pioneering two HDMI interfaces; Export for 30 frame/seconds in real time, and picture is smooth at a high speed; Built-in blank software, annotates and comments on, punctuates, files and adjust back courseware at any time; Support various documents or files in stream media to play; And built-in microphone, can whole process record whole presentation process, forms sound courseware.

The highest support 1080P output, the pioneering two HDMI interfaces in the whole nation are supported input and output simultaneously, lecturer's picture of giving lessons is more clear beautiful, make student more easily catch Classroom Information, elimination student can not understand the puzzlement of course content in time because not seeing picture, obviously improves the efficiency of giving lessons.

Export for 30 frame/seconds in real time, break through the conventional video show stand demonstration limitation of 12 frame/seconds, make picture exhibition no longer fuzzy unsmooth, and it is smooth, perfect extremely to the greatest extent more at a high speed, remove lecturer's trouble and worry of giving lessons completely, avoid stagnating and causing classroom progress to disturb, interrupt the give lessons problem of thinking of lecturer because of picture, greatly improved lecturer's the enthusiasm of giving lessons, make class demonstration, teachers and students' interaction more smooth without hindrance.

Built-in blank software, can annotate and comment in time courseware, punctuate and file, for follow-up teaching leaves abundant reference.In the time that lecturer requires emphasis emphasis, without recarding, punctuate, only need readjustment annotation file, just the emphasis of giving lessons, difficult point can be presented in before Eyes of Students in real time, not only facilitate lecturer to give lessons but also facilitate student to understand memory.

The all functions key of the more built-in video presenter of blank software, lecturer is without stiff ground button, only need on blank, click by touch-control, just random select tool, easy manipulation, has avoided lecturer to interrupt the awkward situation of the thinking of giving lessons because diverting sb.'s attention looking up function button.

Without external computer, play-over the courseware on USB flash disk or SD storage card, comprise various documents and files in stream media broadcasting.Lecturer gives lessons freer, and other operating computer again, only need be inserted into USB flash disk or SD card on exhibition booth, just can freely play courseware data.

Exhibition booth built-in microphone, can whole process record whole presentation process, forms sound courseware, and for the resource of preparing lessons, give lessons of lecturer's accumulating and enriching, after giving lessons, lecturer can integrate, refine the lecture contents of oneself, constantly promotes quality of instruction.

In addition, the mutual exhibition booth of China silver also has more details optimization, such as autonomous apolegamy Wireless mouse pen, make lecturer can be more smooth, accurately demonstration courseware is annotated and commented on and is punctuated; Support SD card access facility, have the extending space of magnanimity and stronger file memory function etc.

Technical parameter

As shown in Figure 1: show stand each several part title

As shown in Figure 2: connector socket mark

DC 12V: power supply input

The input of VGA IN:VGA signal

The output of VGA OUT:VGA signal

AUDIO: audio frequency output

The input of HDMI IN:HDMI signal

The output of HDMI OUT:HDMI signal

USB-B: connect PC, data transmission

USB1/USB2: circumscribed USB equipment

LAN: netting twine connects

SD CARD:SD clamping enters

Show stand is installed for the first time

Show stand is taken out in packing case, and all packing materials are removed in carefulness, by armed lever pull-up, make camera be positioned at demonstration platform center.

Attention: should regulate when lamp lamp to connect armed lever in adjusting, directly lampshade not exerted oneself, to make the damage of exempting from into lamp.

Concrete operations can be referring to as Fig. 4, and 5

Show stand start

Connect exhibition booth power supply, use VGA line (HDMI line) to connect exhibition booth and display device.

Turn on the power switch, after start, show and enter system interface:

Keypress function

Key panel operation and USB mouse action are supported in the mutual exhibition booth of the silver-colored high-definition multimedia of China

As shown in Figure 6, the machine/determining: under computing machine image switching state, click this key for switching back the machine camera lens picture;

Under readjustment picture, clicking this key is selected picture or the video that needs readjustment

Record: click this key and start to record exhibition booth local signal video, again click and stop recording, video file is kept in the storage space of exhibition booth (memory priority level: USB flash disk >SD card > the machine internal memory)

Computing machine: click this key and be switched to computer input signal

Brightness+-: brightness of image regulated

Poly-(closely) far away: manual adjustments figure image focu

Direction navigation key: selection has been preserved under call back scheme picture or video

Preserve: preserve picture to exhibition booth storage space interior (memory priority level: USB flash disk >SD card > the machine internal memory)

Playback: open picture and the videogram preserved under local state, click and return to the machine under call back scheme

Positive negative film: this key is circulation key, for the selection of positive → negative film → positive

Upper and lower lamp: this key is circulation key, for the selection of the upper lamp → lower lamp → lamp that entirely goes out → go up

Mirror image: image is with horizon glass picture-vertical mirror-level, vertical mirror formatted output

Freeze frame: this key is circulation key, clicks freeze frame, again clicks and returns

Contrast with screen: click and enter same screen to conversation structure, again click and return

Automatic: to click and carry out automatic focus and Automatic white balance operation

Convergent-divergent: zoom in or out image

Circumscribed USB mouse action

In the USB interface of exhibition booth, access USB mouse, the left button of clicking the mouse, ejects and controls icon:

1, : represent currently in the machine camera lens real-time pictures, intercept current picture and also enter picture endorsement page after clicking, this icon becomes simultaneously , representing current is picture annotations and comments operation screens, returns to real-time video picture and need again click icon.

2, : under real-time pictures state, click pen and automatically intercept current picture and enter and under blank endorsement page, picture operation screen state, click as selecting pen, putting left mouse button can be to the picture annotations and comments of punctuating.There are three kinds of available redness of color, yellow, blueness.

3, : under blank endorsement page, click and select rubber to remove annotations and comments, under this menu, have frame to select rubber and full scale clearance two functions

4, : under blank endorsement page, click and select handwriting thickness, under this menu, have thin , in , thick three kinds of person's handwritings.

5, : click successively picture rotation 90,180,270

6, : click and preserve picture

7, : click and start recorded video, again click and stop Record and Save

8, : click picture and video that readjustment has been preserved, selective with the demonstration of thumbnail form after entering, the left button of clicking the mouse is chosen a certain width picture or video, full screen display and broadcasting; Mouse is clicked thumbnail can delete picture or video in three seconds, again clicks and returns to the machine camera lens picture;

9, : click and eject secondary Control-Menu

: zoom in/out: picture or picture amplification are dwindled

: brightness plus-minus regulates

: focus on far and near adjusting

: automatic focus and Automatic white balance

: the upper and lower lamp switch of On/Off

: freeze frame

: image mirrors is switched

: the positive negative film of image switches

: with screen contrast

: title locking

Click enters title lock function, occurs 4 tool bars under screen:

: increase and freeze Title area

: reduce and freeze Title area

: adjustment is freezed Title area and is moved up and down

: picture-in-picture function, after clicking, image has been preserved in ejection, is presented at the lower right corner of screen after selection one width picture

10, : click and exit exhibition booth real-time exhibition, enter the main interface of exhibition booth multimedia system

Multimedia system

As shown in Figure 7,

: click and return to exhibition booth camera lens picture

: click and enter file management, and can read the file in SD card and the USB flash disk that accesses exhibition booth

: open any browser

: click and enter the system settings such as exhibition booth title, resolution, network, speech selection

The machine arranges

As shown in Figure 8, after the system of entering arranges, acquiescence enters the machine interface is set.The machine title can be set and enter factory mode.

Note: factory mode please be seeked advice from manufacturer and be asked help to ask.

Show and arrange

According to the actual conditions of different multimedia display device, exhibition booth provides multiple output resolution ratio, advises that output resolution ratio that you select approaches the original resolution of display device as far as possible, to reach best display effect.

Network settings

Connected with network cable, to exhibition booth, arranges network IP, in the time that exhibition booth can not automatic acquisition IP address, please select manual setting.After successful connection, can show the link information of current network

Language arranges

System is supported simplified form of Chinese Character, English bilingual interface.You can select corresponding Language Interface to use according to the use habit of oneself.

System arranges

In the time that exhibition booth goes wrong, can attempt restarting terminal device or factory reset solves some problems that may occur in your use procedure.

In the time having available firmware upgrade version, can click " DFU " and carry out guidance system and enter firmware upgrade process.

(1), this equipment is exact instrument, the appropriateness of need exerting oneself when use, evenly; While rotating each position, need with the hands, one is hand steered steady, rotates on the other hand, can not Overexertion or to the direction that can not rotate firmly, in order to avoid artificial damage equipment.

(2), the camera of this video presenter positive negative sense in the time that horizontal or vertical direction is rotated is all no more than 180 °.

, use before, must check voltage, whether frequency conforms to.Room supply socket should be tripod, and zero line, live wire, ground wire wiring are correct, ground wire reliable ground.

(4), layman forbids opening cover plate.As true need are opened cover plate, must first pull out power lead; Otherwise, easily send out electric shock accidents.

(5), forbid that show stand uses, deposits in moist (relative humidity is greater than 75%), the place of easily soaking, drenching with rain.Otherwise the serviceable life of exhibition booth and reliability, security all can reduce.

(6), forbid, by the camera lens part of finger or other sordid object touch cameras, please use special lens wiping paper as needs are clean, and wiping being firmly unsuitable excessive.Otherwise, damage eyeglass and image effect.

(7) the abnormal conditions (as extraordinary noise, smell, temperature rising, smog etc.) that, may occur in use product should be taked following emergency measures:

1., powered-down switch;

2., timely and producer gets in touch.

(8), guarantee the prompting of children's safety:

Must guard against children and play, need special messenger to keep an eye on or be placed on the place that children do not reach.

(9), the points for attention in the situation such as power failure or movement:

1., have a power failure after, answer powered-down switch.

2., need to move time, should first powered-down, pull up attaching plug and other line.

Fault and disposal route

(1), switch power supply back light do not work, without image.

Process: check whether supply socket switch is opened, and whether socket contacts well.

, after switch power supply, upper lamp can be bright, but without image or judder.

Process: check that whether video line connection is correct, whether video line connection terminal weares and teares, drops.

, in the time being switched to certain road video, sound has cross-talk.

Process: reduce the volume output of relevant device.

, image shows, but other buttons are all inoperative, Mobile exhibiting object image is still motionless.

Process: image is in frozen state, then by a freeze frame.

(5), image blurring.

Process: exhibition booth now may be in Manual focusing state; Click automatic focus key, forward automatic focus to.Also may be " to haze " because ambient humidity causes too greatly pick-up lens, the ambient humidity of should taking measures to reduce.The phenomenon that hazes in half an hour after general start can disappear.

, in the time that automatic focus is unclear, can check whether close-up speckles with dust, please be by special lens wiping paper wiped clean gently if any dust.

, except above-mentioned 6 of listing, other any projects that relate to detachable maintaining must be operated by specialized engineering personnel.

Maintenance and the points for attention of safeguarding

(1), suggestion is used and deposits within the scope of following temperature and relative humidity:

Temperature: 0---45 DEG C;

Relative humidity: be less than 75%, non-solidifying state;

(2), please avoid following position of sound production as far as possible:

1., expose to sunlight or local and other thermal objects limits near heat radiation device (as well heater) on;

2., be subject to vibrations or unstable place;

3., there is the place of the corrosive gass such as soda acid.

, this product allows with the transport of general means of transport, but should avoid being exposed to the sun, high vibration, fall, drench with rain and break rules and regulations and dismantle.

(4), this product should be stored in dry the totally indoor of acidity or other harmful gas that ventilate, do not have around.

System survey

Interactive type wireless exhibition booth is that a new exhibition booth product of releasing is prepared by company, playing major functions and features is to pass through wireless transmission, guarantee exhibition booth output signal is synchronizeed with handheld terminal, and can on handheld terminal, directly control and mark, can allow teacher no longer be confined to the enterprising line operate in limit, exhibition booth, improve classroom operating efficiency, promote interactive teaching.

Teacher, in hand-hold wireless middle-end, can arbitrarily walk about in classroom, output signal that can real time inspection exhibition booth, and can the image of projection be marked in real time and be write.And also can mark and write by notebook and computer.

System mutual process analysis

System is divided into exhibition booth side and two parts of handheld terminal side, and interactive flow process as shown in figure 10.

Image section flow process is as follows:

1: the data that exhibition booth side A10 treatment S ensor passes over

2: exhibition booth side A10 encodes Sensor data be sent to network

3: the image code stream that handheld terminal side A10 receives network is decoded and send aobvious

4: handheld terminal A10 receives after touch signal, the processing such as draw, and pass back to exhibition booth side by networking after number order being processed simultaneously

5: exhibition booth lateral root is processed accordingly according to instruction

6: circulation

The benefit of doing like this has

1: hand-held side to write time delay few, smooth and can see immediately effect

2: exhibition booth side can not show certain operations interface etc., and what projector was seen is net result, and picture is succinctly effective

System module design

System can be divided into three parts

The design of interactive type wireless exhibition booth

Interactive software design

Wireless handheld terminal design

Interactive type wireless exhibition booth

Design frame chart as shown in figure 11, block diagram brief introduction: continue to use the framework of 7 type exhibition booths, use A10 platform to replace original processor. compare with existing exhibition booth, many WIFI functions in function, HDMI and VGA can export simultaneously.

The type selecting of nucleus module/IC

PMU, DC-DC, DDR3, NAND FLASH, network chip, all uses the former factory of A10 proposed model.This programme is without autonomous type selecting device.

A, A10 brief introduction

Dominant frequency 1.5GHz(ARM Cortex-A8) employing Mali-400MP Graphics Processing Unit

Run Google Android operating system, version is not quite clear

Maximum decodable code 2160P video (3840 × 2160 pixel)

Multi-screen output function, when output, the machine screen has demonstration

Support 3D video-game, support HDMI output

Support DDR3 32bit internal memory

Integrated LVDS, SATA etc.

A10 block diagram as shown in figure 12

Power management

Power unit, uses 12V Power supply, transfers to after 5V through a road 1482, and by PMU, DC-DC etc. generate each road power supply

The load capacity of the each road of system power supply as shown in figure 13, under power distribution table:

Estimate whole system power consumption 6W left and right

Interactive type wireless exhibition booth

Design frame chart is as shown in figure 14:

Block diagram brief introduction: continue to use the framework of 7 type exhibition booths, use TI platform to replace original processor. compare with existing exhibition booth, many WIFI functions in function, HDMI and VGA can export simultaneously.

Nucleus module

Each functional module definition and function are as follows:

Detailed design

1, camera lens part

According to the division of product type, 4 models have been used 3 kinds of sensor.Model one is used the 7 existing camera lenses in type exhibition booth, and between DM365, passes through serial communication.This model debugged after in the exploitation of carrying out other model.

Compatible it his 3 class sensor, the chip FIN1216 that unstrings increases 4bit signal, supports 12bit SENSOR.External interface is unchanged.

2, key part

Completed by DM365 by key control, simultaneously reserved ADKEY interface.

3, DM365 core

Digital video input and output: YUVsensor, RAW sensor are supported in input; 8-12bit.Output 16bitYC signal.As figure below:

JTAG:JTAG interface is mainly used to do the burned of hardware debug, initial U-BOOT.PCB LAYOUT slip-stick artist should be noted putting of interface position, keeps to the side as far as possible.

NAND FLASH:NAND FLASH is mainly used in storing U-BOOT, kernel, application program, picture.When upgrading, should reserve cushion space, to prevent that upgrading from makeing mistakes, memory partitioning timing should be noted.

SD card: due to without main mouthful of USB, SD bayonet socket is offered to user and use as mobile storage.Also can carry out program upgrade simultaneously.

4, MDIN380 part

Chip feature is as follows:

(1) input and output 1080p pattern

(2) input and output syntype 3D noise reduction

(3) dual input, three outputs, can be non-homogeneous, supports VGA, CVBS, aberration, HDMI, digital rgb.

(4) the direct pin to of last generation product MDIN241 pin upgrading 340

(5) embedded large capacity DDR RAM

(6) support WDR wide dynamically: use MDIN380 to complete the conversion of digital to analogy, its peripheral interface is abundant, has image special effect and regulates.

5. power unit

System power supply planning is as follows:

+ 12V inputs be converted into+5V of You Yi road 1482, and by integrated 2 DCDC of single-chip power source design TI (TPS68058) monolithic, 3LDO, coordinates voltage monitoring chip TPS3808G01, completes the control to 365 electrifying timing sequences

Each road Voltage-output power supply capacity etc. sees the following form

The maximum 740MA of 12V input total current.

Claims (1)

1. the fault handling method of a novel radio multimedium interactive education system, possesses real-time, interactive, the mutual exhibition booth of interaction point screen, adopt 5,000,000 high definition sensors, realize the clear digital picture output of 1080P 30 vertical frame dimension, machine integrally combines, electronic whiteboard, and wireless teaching instrument uses, realizing operator is annotated and commented on and revises the picture in kind of real object exhibition booth output by wireless and netting twine, wireless video exhibition booth correlation function button is carried out to wireless and Long-distance Control netting twine simultaneously, utilize the synchronous output of optics all-in-one and Mobile Teaching instrument, realize all instructional terminals real-time synchronization mutual, it is characterized in that, technical indicator:

The fault and the disposal route that it is characterized in that this device are:

, switch power supply back light do not work, without image.

Process: check whether supply socket switch is opened, and whether socket contacts well.

, after switch power supply, upper lamp can be bright, but without image or judder.

Process: check that whether video line connection is correct, whether video line connection terminal weares and teares, drops.

, in the time being switched to certain road video, sound has cross-talk.

Process: reduce the volume output of relevant device.

, image shows, but other buttons are all inoperative, Mobile exhibiting object image is still motionless.

Process: image is in frozen state, then by a freeze frame.

, image blurring.

Process: exhibition booth now may, in Manual focusing state, click automatic focus key, forwards automatic focus to; Also may be " to haze " because ambient humidity causes too greatly pick-up lens, the ambient humidity of should taking measures to reduce, the phenomenon that hazes in half an hour after general start can disappear.

, in the time that automatic focus is unclear, can check whether close-up speckles with dust, please be by special lens wiping paper wiped clean gently if any dust.

, except above-mentioned 6 of listing, other any projects that relate to detachable maintaining must be operated by specialized engineering personnel.