CN103067259A

CN103067259A - Method and device used for sending and display and execution of special message instructions and based on instant messaging

Info

Publication number: CN103067259A
Application number: CN2012105725037A
Authority: CN
Inventors: 符晓友; 符蕾; 梁兆祺
Original assignee: Individual
Current assignee: Individual
Priority date: 2012-12-24
Filing date: 2012-12-24
Publication date: 2013-04-24
Anticipated expiration: 2032-12-24
Also published as: CN103067259B

Abstract

The invention relates to instant messaging communication technology, in particular to a method and a device used for sending, display and execution of special message instructions and based on instant messaging. The method and the device used for sending, display and execution of the special message instructions and based on the instant messaging solve the problem that existing instant messaging (IM) communication technology is relatively single in function. According to the fact that a certain message or a special instruction manually or automatically is encoded in the mode of general, shortcut buttons and the like through an instant messaging software after a strengthened definition into a character string message with a predefined format, the character string message with the predefined format is sent to the other end of the IM which is connected with the character message, the character string message is decoded into messages in formats such as a certain readable character, an image text or a Flash according to identification of the character string with the predefined format, and the messages are used for display, record and control. According to the device made by utilization of the technology, remote telemetry and telecontrol can be executed, such as an Internet of Things terminal, a conference system, a digital signage, an intelligent meter, an intelligent household electric appliance, an intelligent vehicle and a telerobot.

Description

Special information command based on instant messaging sends and demonstration manner of execution and device

Technical field

The present invention relates to the instant messaging technology, what relate in particular to the special information expanded based on the instant messaging technology and special order manually and automatically gathers transmission, demonstration, record and Long-distance Control manner of execution and device, is specially special information command based on instant messaging and sends and show manner of execution and device; Specifically can show as the software that possesses this function, integrated (installation) has the product of this software, such as internet-of-things terminal, digital signage, intelligence instrument, intelligent appliance, intelligent entrance guard, intelligent transportation instrument, remote-controlled robot etc.

Background technology

As everyone knows, existing IM instant messaging technology, its function is from initial word dialog, develop into present mutual blit sheet, the sound packing sends, system's expression (the spcial character transcoding calls the built-in little picture of software), self-defined expression (being sent to the other side's this locality or high in the clouds picture), voice-enabled chat, Video chat, Sharing Whiteboard, remote desktop control etc., the use scenes scope normally one to one, the one-to-many people, and group chat etc., appearance along with chat software of automation IM robot, chat software all is the text chat that people's chat develops into human and computer people (IM robot or IM plug-in program) from two ends, this is for raising the efficiency, save human resources and have greatly improved, such chat software comprises the Hi of Baidu, QQ, Ali Wang Wang, POPO, Skype, MSN etc. have reached part or all of function.Although there are many powerful functions in various IM chat software, such as, the picture and text display window that chat conversations is arranged in these software interfaces, the message registration display window, video window etc., but still do not have a kind of IM chat software to have the picture and text multimedia display window of (content and the form of expression) multiwindow of being controlled by the other side who connects, still not automatically (or remote manual control) some special information (such as some information such as the temperature that obtain by transducer) or special order are (in check such as send some by quick botton, predefined especially, instruction is carried out in the far-end control of safety) application of passing to the other end of communication by the instant messaging technology; Aspect control; although there is a small amount of IM chat software that passes through to go to carry out some programs; the report of system command (such as passing through API:ShellExecute); but usually can cause serious potential safety hazard; be taken as software security flaw and strictly take precautions against and the shutoff of upgrading; and it is not in check to the other end transmission of communication by the instant messaging technology; safety; the special command information function (passing back to a certain predetermined window such as taking pictures) of special predefined format and the application of making control by control I/O chip (or by other control interface, such as USB interface).In a word, existing IM instant messaging technical functionality is relatively single.

Summary of the invention

The present invention solves the relatively single problem of existing IM instant messaging technical functionality; Its purpose is exactly to increase in the IM MSN can edit and sends the special information that contains " character string of special identifier " and special order and " fast input frame module " original input frame compatibility, " fast custom button module ", " multimedia input module ", " I/O capturing and coding module ", " automatic command responder module ", cooperates original " audio-video collection module "; Increase simultaneously that (also can by the other side who connects by sending instruction Control the content and the form of expression) " the picture and text multimedia display module of multiwindow ", " record output module ", " I/O export Executive Module ", " in conjunction with this locality or high in the clouds formal output module ", " the automatic-answering back device output module " and original " audio frequency and video output module " can select to control form that docking collects mail that breath is understood, shown, record and receiving terminal system reached by I/O control execution; After certain information (such as temperature, humidity, speed etc.) is gathered with known technological means, be encoded to a kind of word character string information of predetermined format, pass through MSN, pass to and be attached thereto the other end that connects, follow unified " spcial character agreement ", word character string by the identification predetermined format, it is decoded as certain picture and text that can read multimedia forms such as (or) Flash information, and according to the appointment that the other side controls by connection, be shown in one of multiwindow, or record and control.Send special command information (passing back to a certain predetermined window such as taking pictures) in check, safe, special predefined format or pass through the application that control I/O chip (or by other control interface, such as USB interface) is made control by the other end of instant messaging technology to communication.So, the two-way separately predefine of both sides of this mode communication is finished demonstration, record and the control function that the other side is needed to the specific deciphering of instant message (judged carry out by the automatic logic of program).The present invention also sends to the other side's (server-side) by " spcial character agreement sending module " with " spcial character agreement " simultaneously, and the other side is by " the spcial character agreement is accepted module " renewal " spcial character agreement "." spcial character agreement " can preserve with document form or database form, also can be saved in high in the clouds.

The present invention adopts following technical scheme to realize: special information, instruction transmission and demonstration, manner of execution based on instant messaging comprise:

The edit step of information, instruction;

The forwarding step based on instant messaging of information, instruction;

Based on the receiving step of instant messaging to information, instruction;

The step that the information, the instruction that receive are automatically identified, decoded;

The execution in step of information, instruction;

It is characterized in that: set up in the edit step of information, instruction with the special information of " spcial character agreement " coding, the editting function of instruction; In the step that the information, the instruction that receive are automatically identified, decoded, identify, decode with the special information command of " spcial character agreement " coding with unified " spcial character agreement "; Set up the execution function of special information, instruction in the execution in step of information, instruction;

The special information, the editting function of instruction with " spcial character agreement " coding of wherein setting up, realize with one or more following edit modes according to the difference of special information, instruction:

(1), the manual directly input of quick input frame: except original input content and give the function of certain html format, can give fast other additional special information, instruction such as orders such as control the other side display windows;

(2), quick custom button: click predefined quick custom button and generate special information, instruction;

(3), multimedia input: multi-media sensor triggers predefined special information, instruction produces by (acoustic control, body move work, touch screen writing character stroke etc.);

(4), I/O capturing and coding input: be subjected to the control of " automatic-answering back device output " executive mode in the execution in step of information, instruction, the audio-video signal autocoding that the data of being imported into by transducer that will gather through I/O or audio ﹠ video equipment are imported into generates special information, instruction, and the special information that will generate, instruction send through the forwarding step based on instant messaging automatically;

(5), automatic command is replied input: be subjected to the control of " automatic-answering back device output " executive mode in the execution in step of information, instruction, predefined command content autocoding is generated special information, instruction, and the direct or indirect special information that will generate, instruction send through the forwarding step based on instant messaging automatically;

The special information of setting up in the execution in step of information, instruction, the execution function of instruction, realize with one or more following executive modes according to the difference of special information, instruction:

(1), multiwindow picture and text multimedia display: specify the layout pattern of multiwindow and specify certain window to be set to special display mode (such as full frame) and show picture and text or other format media information in certain window;

(2), record output: the database or the file that record or be written to appointment with text formatting;

(3), carry out output: carry out the operation corresponding with certain special information, instruction;

(4), in conjunction with this locality or high in the clouds formal output: that output produces because carrying out with some, from this locality or the high in the clouds information or the state that return be shown on the display window of appointment, following several concrete output form is arranged:

(4.1) according to the special information command that receives, cooperate third-party script, api interface behind high in the clouds (space), third party's (such as third party's microblogging) propelling movement special parameter, picture and text, multimedia file, show the accordingly result that returns; Such as sending microblogging to third party's microblogging, sends successfully the as a result corresponding information such as " microblogging sends successfully " that afterwards demonstration returns;

(4.2) according to the special information command that receives, demonstration or the picture and text multimedia resource information that broadcast is local or specific URL high in the clouds is returned;

(4.3) cooperate this locality or third party, the script in high in the clouds, api interface, show this locality that is combined with special parameter (receiving) or the URL high in the clouds picture and text multimedia messages that return;

(5), automatic-answering back device output: trigger one of " input of I/O capturing and coding " in the edit mode of calling special information, instruction, " automatic command is replied input " according to the special information command that receives.

The edit mode of special information command also comprises " spcial character agreement " input: be subjected to the control of " automatic-answering back device output " executive mode in the execution in step of information, instruction, to generate special information, instruction for special information, the required spcial character agreement autocoding of instruction encoding, and the special information that will generate, instruction send or backup to high in the clouds through the forwarding step based on instant messaging automatically; " automatic-answering back device output " executive mode in the special information command executive mode is called " spcial character agreement " input editing mode according to the special information, the instruction triggers that receive; Simultaneously special information command executive mode comprises that also " spcial character agreement " receives: according to instruction the other side of reception or " the spcial character agreement " in high in the clouds are shown, are saved in this locality or backups to high in the clouds.

Realize that " carrying out output " in the executive mode of execution function of special information, instruction comprises the signal by I/O hardware interface output control simulation or digital device.

Realize that " the manual directly input of quick input frame " in the edit mode of special information, instruction contains supplemental button, drop-down (selections), gets (single choice) ready or tick the mode of (compound selection), can play up transmission with the word content of inputting according to the specific format of " the spcial character agreement " of certain appointment fast.

The method is by to MSN or comprise plug-in unit and MSN that the web page code of server moves in the browser mode imposes the increased functionality expansion and realizes; Perhaps the form with expanded function software realizes on existing MSN by " plug-in ".

Special information, instruction transmission and demonstration, final controlling element based on instant messaging comprise:

The editor module of information, instruction;

The sending module based on instant messaging of information, instruction;

Based on the receiver module of instant messaging to information, instruction;

The module that the information, the instruction that receive are automatically identified, decoded;

The Executive Module of information, instruction;

It is characterized in that: the editor module of information, instruction has been set up with the special information of " spcial character agreement " coding, the editting function of instruction; To the module that the information, the instruction that receive are automatically identified, decoded, identify, decode with the special information command of " spcial character agreement " coding with unified " spcial character agreement "; The Executive Module of information, instruction has been set up the execution function of special information, instruction;

The editor module of information, instruction the special information, the editting function of instruction with " spcial character agreement " coding of setting up wherein, realize with one or more following editor modules according to the difference of special information, instruction:

(1), the manual directly input module of quick input frame: except original input content and give the function of certain html format, can give fast other additional command information such as orders such as control the other side display windows;

(2), quick custom button module: click predefined quick custom button and generate special information, instruction;

(3), multimedia input module: trigger predefined special information, instruction generation by multi-media sensor;

(4), I/O capturing and coding input module: be subjected to the control of " automatic-answering back device output module " in the Executive Module of information, instruction, the audio-video signal autocoding that the data of being imported into by transducer that will gather through I/O or audio ﹠ video equipment are imported into generates special information, instruction, and the special information that will generate, instruction send through the sending module based on instant messaging automatically;

(5), automatic command is replied input module: be subjected to the control of " automatic-answering back device output module " in the execution in step of information, instruction, predefined command content autocoding is generated special information, instruction, and the direct or indirect special information that will generate, instruction send through the sending module based on instant messaging automatically;

The execution function of the special information that the Executive Module of information, instruction is set up, instruction, realize with one or more following Executive Modules according to the difference of special information, instruction:

(1), multiwindow picture and text multimedia display module: specify the layout pattern of multiwindow and specify certain window to be set to special display mode and show picture and text or other format media information in certain window;

(2), record output module: the database or the file that record or be written to appointment with text formatting;

(3), carry out output module: carry out the operation corresponding with certain special information, instruction;

(4), in conjunction with this locality or high in the clouds formal output module: that output produces because carrying out with some, from this locality or the high in the clouds information or the state that return be shown on the display window of appointment, following several concrete output module form is arranged:

(4.1) according to the special information command that receives, cooperate third-party script, api interface to push special parameter, picture and text, multimedia file to high in the clouds, third party after, show the accordingly result that returns;

(4.3) cooperate this locality or third party, the script in high in the clouds, api interface, show and return this locality or the URL high in the clouds picture and text multimedia messages that is combined with special parameter (receiving);

(5), automatic-answering back device output module: trigger one of " I/O capturing and coding input module " in the editor module that calls special information, instruction, " automatic command is replied input module " according to the special information command that receives.

The editor module of special information command also comprises " spcial character agreement " input module: be subjected to the control of " automatic-answering back device output module " in the Executive Module of information, instruction, to generate special information, instruction for special information, the required spcial character agreement autocoding of instruction encoding, and the special information that will generate, instruction send or backup to high in the clouds through the sending module based on instant messaging automatically; " automatic-answering back device output module " in the special information command Executive Module calls " spcial character agreement " input module according to the special information, the instruction triggers that receive; Simultaneously special information command Executive Module also comprises " spcial character agreement " receiver module: according to instruction the other side of reception or " the spcial character agreement " in high in the clouds are shown, are saved in this locality or backups to high in the clouds.

Realize that " execution output module " in the Executive Module of execution function of special information, instruction comprises the signal by I/O hardware interface output control simulation or digital device.

Realize that " the manual directly input module of quick input frame " in the editor module of special information, instruction contains supplemental button, drop-down (selections), gets the mode of (single choice) or ticking (final election) ready, except original input content and give the function of certain html format, can give fast other additional special information, instruction such as orders such as control the other side display windows, namely can fast the content of input be played up transmission according to additional certain customizing messages instruction mode.

The special information instant communication client systems soft ware of this special information instant communication client system and device drive end (or server-side) is except the instant communication function of routine, before instant message transmission module, expanded " the quick scene mode " of conventional picture and text input frame by " quick input frame module ", so that literal picture input frame has become " quick input frame ", expanded simultaneously " quick custom button module ", " multimedia input module ", " the I/O capturing and coding module " that can customize and reached " automatic-answering back device module "; Wherein " quick custom button " can freely create increase by the operator, the instruction that sends after the title of each button and the click, can be by operator's self-defining (only customed product), its quantity and the form of expression are unrestricted in theory, can authorize different quantity, pattern restriction according to commercial license during implementation, such as pattern for a plurality of different control template UI(user interfaces can be set) page, the button of certain pattern of carrying some etc. on each page; Wherein " multimedia input module " can be " the virtual quick custom button " that has other input control form to control, and these forms comprise certain action that a particular volume sense command action, the self-defined scribble order of the order symbol on the touch-screen, the handheld device before acoustic control order, the video camera applies built-in gyro sensor etc.; Wherein " audio-video collection module " is that the local audio frequency and video pictorial information of existing collection is to the other side's module, " I/O capturing and coding module " is the information that gathers for internal or external certain or certain several transducer, after obtaining acquisition instructions, automatically the information that gathers is sent by the instant message sending module according to certain specific form, " automatic command responder module " then replys with special information command form, and " spcial character agreement sending module " then sends local spcial character agreement according to instruction and be used for showing to the other side, download or send local spcial character agreement to high in the clouds.More than the startup of " audio frequency and video output module ", " I/O capturing and coding module ", " automatic command responder module " can be subjected to the triggering of " automatic-answering back device output module "." automatic-answering back device output module " be different from conventional literal reply (as " I am busy to leave for a moment ", " the QA mode is replied etc.); but contain when meeting predefined logical condition for one or more customizing messages that receives; consists of one " virtual quick custom button "; at this " virtual quick custom button " when enabling, the generation of one of Automatically invoked " audio-video collection module ", " I/O capturing and coding module ", " automatic command responder module " and send some customizing messages or coded command information to the other side.These " virtual quick custom buttons " can freely create increase by the operator, and the instruction of the title of each button, the logical condition that comprises and the rear transmission that is triggered can customize or by operator's self-defining.More than the specific instruction information that produces of several modes send to the other side via " instant message sending module ".

After " instant messaging receiver module " receives information, except in conventional word dialog box, exporting the output of conventional picture character dialog information and audio frequency and video, expanded the following way of output:

" multiwindow picture and text multimedia display module " is according to command information, this locality of Word message, pictorial information or the appointment that the other side can be sent or high in the clouds picture and text multimedia messages are shown to the display window of appointment, such as being applied to the remote-controled digital label of far-end, certain picture and text multimedia display window can be appointed as screen mode toggle, or multiwindow shows simultaneously, or shows in turn each window;

Sending " [window1] [show=fullscreen] TextString[/show] [/window1] " meaning such as: the other side is that instant message character string " TextString " is shown to the window that is designated " window1 ", and the window that telecommunication customer end is designated " window1 " is set to screen mode toggle;

" record output module ", be different from known session log, extra self-defining command script according to receiving can be kept at the specific appointed information that receives local file, local data base or push record data to high in the clouds, in order to further use.

Such as: " [log] [logname=' temprec.log '] 2012101816:48:23 water temperature 26 degree [/logname] [/log] " are showing instant message character string " 2012101816:48:23 water temperature 26 degree " and are preserving and add in file " temprec.log " log file by name in the dialog box;

" I/O exports Executive Module " is according to the command information that receives, to directly carry I/O chip, I/O output card or continuous slave computer (or single-chip microcomputer) by plate, after giving I/O control interface and final controlling element with control level, further control ratio such as motor, light etc. are finished the action of expectation.

By the I/O port command level that the level of local I/O control output end mouth " 3 " is output as after " 1 " and the maintenance " 1500ms " local control output end mouth " 3 " is output as " 0 " such as: " [control] [out3] 11500[/out] [/control] " representative.In certain example, rotate forward the time of 1500ms such as the revolver of a small scale robot of the positive level of this 1500ms control;

The information of " in conjunction with this locality or high in the clouds formal output module " output can be shown to some specific this locality or high in the clouds return information or high in the clouds information on the display window of appointment, and following several mode or its combination are arranged:

(A) according to the command information that receives, cooperate third-party script, api interface (space), third party (such as third party's microblogging) to push special parameter, picture and text, multimedia file to high in the clouds; Such as sending microblogging to third party's microblogging, send successfully rear " sending successfully " information that shows.

(B) according to the command information that receives, show or broadcast this locality or specific URL high in the clouds picture and text multimedia resource information; Play a local video file such as the window in certain appointment; Such as a pictures that shows high in the clouds at certain specified window.

(C) cooperate this locality or third party, the script in high in the clouds, api interface, show this locality or URL high in the clouds picture and text multimedia messages in conjunction with special parameter (receiving).Such as in conjunction with return after the local Flash instrument template of the data call that receives can show data by " simulated intelligence instrument " with the Flash animate of parameter; After sending coordinate data to third party's map web site, return " map of region "; Such as send to high in the clouds return behind some data that receive and the instrument template parameter can show data by " simulated intelligence instrument " with the Flash animate of parameter.

" automatic-answering back device output module " calls one of local " audio-video collection module ", " I/O capturing and coding module ", " automatic command responder module ", " spcial character agreement sending module " according to instruction triggers and generates and send some customizing messages.

" automatic-answering back device output module " output form: the special information that receive that receive by or some are with the automatic-answering back device of related triggering after logical calculated of certain logical relation, and these logical relations are self-defined and preservation by the client.The information command of output can trigger one of following several response modes:

A. trigger local " audio-video collection module ", will return audio stream, video flowing, audio/video flow or start camera according to the local audio frequency and video work of specifying information instruction triggers and take pictures and beam back photo.

B. triggering " I/O capturing and coding module ", will according to the local I/O pick-up transducers of specifying information instruction triggers equipment, be that special Word message is beamed back with the data encoding that collects.

C. trigger " automatic command responder module ", with the form automatic-answering back device of instruction.According to the information of sending, when meeting the condition of employing " automatic command is replied ", according to the information of sending, go " automatic command library of responses " to search, and return so that instruction mode is corresponding;

" automatic command library of responses " can be self-built local text, database or high in the clouds data.

In addition, the two ends that are connected, follow unified " spcial character agreement ", by sending instruction by " automatic command responder module " triggering " spcial character agreement sending module ", can check " the spcial character agreement " of servo client or back up " the spcial character agreement " of servo client;

Simultaneously by sending instruction by " automatic command responder module " triggering " spcial character agreement receiver module ", " spcial character agreement " according to command reception the other side or high in the clouds shows, is saved in this locality, realizes " the spcial character agreement " of servo client revised or the renewal upgrading.

Described " spcial character agreement ", that mentions in above-mentioned demonstration contains " [" and "] " sign, can use the combination of any literal and symbol as sign, so that its content is sent inner predefined special instruction according to this agreement after can correctly being identified according to " special (predefine) decides character string beginning and end positioning mark " or " deciding to be converted to the character string that meets the XML standard after the character string conversion through special (predefine) " by client software.Can express the same instruction with " [campic] [cam=0] window1[/cam] [/campic] " such as " { campic}{cam=0}window1{/cam}{/campic} ", " [video camera] [No0] window1[/No] [/ video camera] ", "＜/* UC0window1*/〉 " etc., be that predefined sign is different with rule, as long as transmitting terminal is consistent with rule with the predefined implication of receiver section, meet certain rule and get final product, be i.e. self-defining instant messaging " spcial character agreement ".Predefined instant messaging " spcial character agreement " can be in software predefine or reserve interface for User Defined instant messaging " spcial character agreement " by software, or obtain from the template of high in the clouds class instant messaging " spcial character agreement ", or push " agreement " template by " spcial character agreement sending/receiving module " to server-side from drive end.All these instant messagings " spcial character agreement " functional specification does not cause potential safety hazard to the computer security leak in limited controllable function scope.In a word, described " spcial character agreement " is that those skilled in the art obtain easily, formulate and realize.

The present invention consists of by such method: it is can unwatched client that the both sides of instant messaging can have at least one party, this client is logined automatically with an IM instant messaging ID identity, its system has the abnormal condition of 16 pairs of systems of house dog and wakes up, by it being sent specifically by specific character string or containing the instruction that the character string of special identifier consists of, finish some remote measurement, the functions such as remote control, can be widely used in conglomerate, show specific graph text information such as the one or more long-range electronic digit labels of remote control, in many ways the interactive conference system in multiple terminals, the multiple terminals interactive education system, Internet of Things is expanded and is used, telemonitoring and greenhouse of control, the long-distance intelligent instrument, unmanned, robot of Long-distance Control is used for the audio frequency and video dialogue and does some remote control actions etc.

All client software functions are by containing the MSN of expanding through increased functionality or being attached to the software form realization that " externally hung software " or web page code (can comprise plug-in unit and server) outside the existing MSN move in the browser mode based on the instant messaging technology, and through integrated with related hardware after the secondary predefine function, can dispose use; Same function also can be formed by the additional plug-in customized software regarded as output controlling of MSN; According to the different application scene, customize different client softwares and adapt to different system environmentss, such as Windows, Linux, Mac OS, iOS, Android, Windows Phone, Symbian, Windows Mobile, Java, embedded system etc.Integrated transducer hardware can externally be expanded (such as PC+I/O capture card+transducer) therewith, also can be integrated in the hardware system (carrying GPS receiving chip, temperature sensor etc. such as plate); Integrated control hardware is integrated in the hardware system therewith, and such as small type mobile devices, the hardware such as integrated I/O control chip on mainboard also can be by connecting slave computer expansion control (such as the next single-chip microcomputer of PC+).

Description of drawings

Fig. 1 is special information, instruction transmission and the demonstration that the present invention is based on instant messaging, the structural representation of final controlling element.

Among the figure: 1-microphone, 2 cameras, 3 transducers and I/O acquisition hardware, 4 groups, 5 servers, 6 networks, 7 high in the clouds data, 8 special information instant communication client system and device server-sides (or drive end), 9 special information instant communication client system and device drive ends (or server-side), 10 special information instant communication client softwares, 11 displays, 12 loud speakers, 13I/O control interface and final controlling element, 14 keyboard and mouses, 15 touch-screens, 16 house dogs;

Embodiment

For making purpose of the present invention, technical scheme and advantage clearer, clear and definite, developing simultaneously referring to accompanying drawing, the present invention is described in more detail for embodiment.

As shown in Figure 1, special information instant communication client system and device 9 adopts the special information based on instant messaging of the present invention, instruction transmission and demonstration, manner of execution and device to work out by microphone 1, camera 2, transducer and I/O acquisition hardware 3, special information instant communication client software 10(), display 11, loud speaker 12, control interface and final controlling element 13, keyboard and mouse 14, touch-screen 15, house dog 16 etc. form.Wherein special information instant communication client software 10 contains " quick input frame module ", " quick custom button module ", " multimedia input module ", " audio-video collection module ", " I/O capturing and coding module ", " automatic command responder module ", " spcial character agreement sending module ", " instant message sending module ", " instant message receiver module ", " automatic decoding module ", " automatic-answering back device output module ", " audio frequency and video output module ", " multiwindow picture and text multimedia display module ", " record output module ", " I/O exports Executive Module ", " in conjunction with this locality or high in the clouds formal output module ", " spcial character agreement receiver module " reaches " other functional module ".

When special information instant communication client system and device drive end (or server-side) 9 is initiated an application link to another special information instant communication client system and device server-side (or drive end) 8,6 put 8 state and address with the linking request instant communication server 5 special information instant communication client system and device server-sides of inquiry (or drive end) that lead through the Internet, satisfy such as condition of contact, then special information instant communication client system and device drive end (or server-side) 9 direct and especially information instant communication client system and device server-sides (or drive end) 8 link to each other can proper communication, and can mutually transfer immediate news." drive end " for sending command end, " server-side " for receiving parsing and carrying out command end, this communication is two-way equity.Following just " generating mode of command information and transmission " and " reception of information command and output form " narrates respectively the method for its realization.

The generating mode of command information and transmission

The present invention implements like this, and specific character string or the character string (being special information command) that contains special identifier reach modes such as " spcial character agreement sending modules " one or a combination set of generation by " quick input frame module ", " quick custom button module ", " multimedia input module ", " I/O capturing and coding module ", " automatic command responder module ":

1. by the manual directly input of quick input frame; This quick input frame contains the mode that proprietary format played up and sent button (forms such as button, bitButton), drop-down selection (ComboBox), single choice (Radio) or tick (CheckBox) specifies, and can fast the graph-text content of input be played up (such as increasing certain special identifier or applying mechanically certain format module) transmission according to certain specific format.Like this can be higher than the conventional instant communication client picture and text input frame efficient of compatibility; Such as under the scene of selecting (be specifically as follows drop-down selection or click the mode such as selection) " the other side Window1 shows full frame picture and text ", after picture and text input frame input photo information sends, the character string of input can be changed to " photo information [/Show] [/Window1] of [Window1] [Show=fullscreen] input " and send by automatic reformatting, the result who carries out is after the other side receives this instant message, and the photo information of transmission is shown in the Window1 window of the software under the screen mode toggle.This is very convenient in long-range advertisement, digital signage, (long-range) conference system etc. are used.Certainly this " quick input frame " also can not add to play up especially and send in normal way conventional instant message photo information to the other side, the compatibility that software is possessed form a connecting link.

2. click in advance predefined quick custom button and carry out the built-in command generation;

Such as after clicking a quick custom button name and being called " front camera is taken pictures ", program is issued to continuous instant communication client automatically with the be associated instant message " [campic] [cam=0] window1[/cam] [/campic] " of binding of this quick custom button, and expression is clapped a photo with the remote client end front-facing camera that links to each other and transferred back to the window of local client " window1 ".Above-mentioned " binding is associated " can present and realize in modes such as " ListView ", presets " specific character string " relevant information and can be kept at this locality or high in the clouds with the form of file or the form of database.This is very convenient in Remote is used.

3. triggering predefined command information by multi-media sensor (acoustic control, action, touch screen writing symbol etc.) predefined " virtual quick custom button " produces;

Such as, certain " virtual quick custom button " points to touch screen writing, stroke left can send the client that self-defining related binding specific character string instant message " [control] [out4] 11000[/out] [/control] " links to each other to far-end and transferred immediate news this moment, after far-end is received this information, far-end software can be automatic escape control distal end I/O the 4th port output high level 1000ms(1 second), control small remote control airship drive fan left powers up 1 second of work." binding is associated " of above-mentioned " multimedia action " and " virtual quick custom button " and " virtual quick custom button " and " specific character string " also can present and realize relatedly in modes such as " ListView ", presets " specific character string " relevant information and can be kept at this locality or high in the clouds with the form of file or the form of database.This is very convenient in Remote is used.

By the transducer image data through I/O capturing and coding Module Generation;

Such as: after obtaining collecting temperature and turning back to the instruction " [control] [adin2] datetime coolant-temperature gage [/adin] [/control] " of the continuous client of far-end, the client software automatic execution instruction makes and is connected to the simulation A/D input image data that interface I/O input is numbered " 2 ", and the conversion production form mails to the remote client end that links to each other therewith for the instant message character string of " [log] [logname=' temprec.log '] 2012101816:48:23 water temperature 26 degree [/logname] [/log] "; This is very practical in long-haul telemetry is used.

5. trigger predetermined condition by the information of importing decoding into and automatically trigger " automatic command responder module " through " automatic-answering back device output module ", with the form automatic-answering back device of instruction.According to the information of sending, when meeting the condition of employing " automatic command is replied ", according to the information of sending, go " automatic command library of responses " to search, and return so that instruction mode is corresponding; " automatic command library of responses " can be self-built local text, database or high in the clouds data.

Such as: be higher than 35 degree Celsius and relative air humidity starts the ventilation axial flow blower greater than 80% the time such as self-defined when far-end greenhouse air temperature, like this, when up-to-date these two special information that receive and after satisfying condition, software automatically will encode " [control] [out=7] 1600000[/out] [/control] " transfer immediate news to the client that far-end links to each other, after far-end is received this information, the automatic escape control of software meeting I/O the 7th port output high level 600000ms(10 minute) after, namely powered up work 10 minutes by Control greenhouse axial flow blower.

Aforesaid " predetermined format (being the spcial character agreement) ", that mentions in above-mentioned demonstration contains " [" and "] " sign, can use the combination of any literal and symbol as sign, so that its content is sent inner predefined special instruction according to this agreement after can correctly being identified according to " special (predefine) decides character string beginning and end positioning mark " or " deciding to be converted to the character string that meets the XML standard after the character string conversion through special (predefine) " by client software 10.Can express the same instruction with " [campic] [cam=0] window1[/cam] [/campic] " such as " { campic}{cam0}window1{/cam}{/campic} ", " [video camera] [No0] window1[/No] [/ video camera] ", "＜/* UC0window1*/〉 " etc., be that predefined sign is different with rule, as long as transmitting terminal is consistent with rule with the predefined implication of receiver section, meet certain rule and get final product, be i.e. self-defining instant messaging " spcial character agreement ".Predefined instant messaging " spcial character agreement " can be in software predefine or reserve interface for User Defined instant messaging " spcial character agreement " by software, or obtain from the template of high in the clouds class instant messaging " spcial character agreement ", or push " agreement " template by " spcial character agreement sending/receiving module " to server-side from drive end.All these instant messagings " spcial character agreement " functional specification does not cause potential safety hazard to the computer security leak in limited controllable function scope.

The reception of information command and output form

Present MSN all possesses the literal communication function, as some word character string being increased some predetermined special identifier, then the other side in conversation is the other meaning by escape, be " smile " expression etc. such as " [em] e100[/em] " by escape, in the dialogue frame, be shown as a picture or GIF animation, the present invention breaks through the limited application of this routine, the special information instant communication client software 10 of special information instant communication client system and device drive end (or server-side) 9 except the instant messaging receiving function of routine, (content and the form of expression that also can be controlled by sending instruction by the other side who connects) " the multiwindow picture and text multimedia display module " that employing can be selected to control, " record output module ", " I/O exports Executive Module ", " in conjunction with this locality or high in the clouds formal output module " is output as following several forms one or a combination set of with some specific character string or the character string that contains special identifier:

1. multiwindow picture and text multimedia display module output form: specify the layout pattern of multiwindow and specify certain window (window outside dialogue literal window or the dialogue literal window) to be set to special display mode (such as full frame) and show picture and text (or other format media) information in certain window (window outside dialogue literal window or the dialogue literal window); Such as when receiving " [Window1] [Show=fullscreen] TextString[/Show] [/Window1] " this instant message instruction, the result of execution is shown to written historical materials " TextString " in the Window1 window under the screen mode toggle of local software.This is very practical in long-range advertisement, digital signage, (long-range) conference system etc. are used.

2. record the output module output form: the record beyond the session log, with text formatting record or write into Databasce;

Such as when receiving " [log] [logname=' temprec.log '] 2012101816:48:23 water temperature 26 degree [/logname] [/log] " this instant message instruction, the result of execution is recorded to information material " 2012101816:48:23 water temperature 26 degree " in the journal file of local file " temprec.log " by name.This is very practical in remote measurement is used.

3.I/O output Executive Module output form: command execution, by predefined built-in command carry out certain operation (such as take pictures, the transducer image data) or by I/O hardware interface output control simulation or digital device (such as control light, relay etc., or further finish control by slave computer).

Such as when receiving " [control] [out=4] 11000[/out] [/control] " this instant message instruction, local software can be automatic the 4th port output high level 1000ms(1 second of the local control of escape control output interface I/O circuit), control small remote control airship drive fan left powers up 1 second of work.This is very practical in Remote is used.

4. in conjunction with this locality or high in the clouds formal output module output form: the information of output can be shown to some specific this locality or high in the clouds return information or high in the clouds information on the display window of appointment, and following several mode or its combination are arranged:

(A) according to the command information that receives, cooperate third-party script, api interface (such as the space), third party (such as third party's microblogging) to push special parameter, picture and text, multimedia file to high in the clouds; Send to certain microblogging such as sending content with certain microblogging account, and return information such as " sending successfully ".

Such as:

" [weibo] [url=aaa] [userid=bbb] [userpw=ccc] [title=ddd] [pic] [cam=1] [/cam] [/pic] [/title] [/userpw] [/userid] [/url] [/weibo] " to third party's microblogging " aaa ", take " bbb " as user name, " ccc " as login password, to send title be " ddd ", the photo upload of clapping with the rear camera sends microblogging, sends successfully rear demonstration " sending successfully " information.

Such as:

" [windows6] [url] [video] d:/res/video/ad1.mp4[/video] [/url] [/windows6] " is illustrated in the window that instant communication client is designated " window6 " and plays local video file " d:/res/video/ad1.mp4 ";

Such as:

" [windows2] [url] [pic] http://www.inforany.com/pic/ad-picture.jpg[/pic] [/url] [/windows2] " represent high in the clouds picture " http://www.inforany.com/pic/ad-picture.jpg " is shown to the window that instant communication client is designated " window2 ";

(C) cooperate this locality or third party, the script in high in the clouds, api interface, show this locality or URL high in the clouds picture and text multimedia messages in conjunction with special parameter (receiving).Such as in conjunction with return after the local Flash instrument template of the data call that receives can show data by " simulated intelligence instrument " with the Flash animate of parameter; After sending coordinate data to third party's map web site, return " map of region "; Such as send to high in the clouds return behind some data that receive and the instrument template parameter can show data by " simulated intelligence instrument " with the Flash animate of parameter, this is very flexible in intelligence instrument is used.

Such as:

Returning " the digital formula intelligent thermometer " by with the Flash animate of parameter that can show data after the data " temp=63.2 " that " [windows5] [url] d:/res/swf/tempdigital3.swf temp=63.2[/url] [/windows5] " expression sends and receives to local Flash resource address " d:/res/swf/tempdigital3.swf " is presented on the window that is designated " windows5 ".

Such as:

" [windows1] [url] http://www.inforany.com/map/51ditu.asp x=11657746﹠amp; Y=3987866[/url] [/windows1] " send latitude, longitude and be respectively " 11657746 " and " 3987866 " to third party's map web site after, " map of region " that demonstration is returned in the window that is designated " windows1 ";

Such as:

Returning " the simulated pointer formula intelligent thermometer " by with the Flash animate of parameter that can show data after the data " temp=42 " that " [windows3] [url] http://www.inforany.com/swf/tempanylog1.swf temp=42[/url] [/windows3] " expression sends and receives to high in the clouds Flash resource address " http://www.inforany.com/swf/tempanylog1.swf " is presented on the window that is designated " windows3 ".

5. automatic-answering back device output module output form: the special information that receive that receive by or some trigger an automatic-answering back device so that certain logical relation is related after logical calculated, and these logical relations are self-defined and preserve by the client.The information command of output can trigger one of following several response modes:

Such as: clap the window that a photo transfers back to continuous remote client end " window1 " when receiving " [campic] [cam=0] window1[/cam] [/campic] " information age table with local front-facing camera, namely " automatic-answering back device output module " will trigger local " audio-video collection module " and remove collection and transmission picture;

B. triggering " I/O capturing and coding module ", will according to local certain the pick-up transducers equipment of I/O of specifying information instruction triggers, be that special Word message is beamed back with the data encoding that collects.

Such as: after receiving " [control] [adin=2] datetime coolant-temperature gage [/adin] [/control] ", to trigger " I/O capturing and coding module " automatic execution instruction and make and be connected to the simulation A/D input image data that interface I/O input is numbered " 2 ", and the conversion production form mails to the remote client end that links to each other therewith for the instant message character string of " [log] [logname=' temprec.log '] 2012-10-1816:48:23 water temperature 26 degree [/logname] [/log] ";

E. trigger " spcial character agreement sending module ".Trigger this module according to information command, can check " the spcial character agreement " of servo client;

Such as: when receiving " [XMPP] [Action=show] Windows4[/Action] [/XMPP] " information, will trigger " spcial character agreement sending module " and go to send " spcial character agreement " inventory is designated " Windows4 " to the other side window demonstration.

Such as: when receiving " [XMPP] [Action=backup] [url]

Http:// www.inforany.com/xmpp/backup.asp id=548629﹠amp; Key=887684137[/url] [/Action] [/XMPP] " during information, will trigger " spcial character agreement sending module " go to send " spcial character agreement " inventory to high in the clouds " Http:// www.inforany.com/xmpp/backup.asp" and write password take id as " 548629 " and backup to high in the clouds as " 887684137 ".

This application can be consulted distant place server-side " spcial character agreement ", so as to upgrade in time and expand " spcial character agreement " expression function backup to high in the clouds.

" spcial character agreement receiver module " shows, is saved in this locality according to " the spcial character agreement " in command reception the other side or high in the clouds.

Such as: when receiving

" [XMPP] [Action=update] [url]] http://www.inforany.com/xmpp/setting.asp id=548629﹠amp; Key=887684137[/url] [/Action] [/XMPP] " during information, will trigger " spcial character agreement receiver module " and remove to receive high in the clouds " spcial character agreement " inventory and upgrade and be saved in this locality.Wherein the high in the clouds exemplary address is:

" Http:// www.inforany.com/xmpp/backup.asp", the demonstration id be that " 548629 ", example password are " 887684137 ".

This application can be made amendment or upgrades upgrading " the spcial character agreement " of this locality.

Certainly as special information instant communication client systems soft ware 10, in order to finish known basic function, " other functional module " to be arranged also, here no longer narration.

As special information instant communication client software 10, can in user management, set up group 4, the various ways such as the foundation of dialogue can be one to one, one-to-many, like this for raise the efficiency, dispose flexibly, a plurality of functions of special information client are helpful, but relate to the safety that information shows and operates as special information instant communication client software 10, in order to improve its reliability, confidentiality, except adopting conventional " blacklist " control, adopt " white list " good friend restriction of strengthening, strictly limit good friend's " control authority ".

According to different embodiment, its configuration may be different, such as quantity, access way etc. in implementation for above-mentioned special information instant communication client system and device drive end (or server-side) 9

Concrete example is as follows:

Microphone 1 can be plate carry or external, can be monophony or multichannel;

Camera 2 can be plate carry or external, can be single head or three-dimensional double end, can be preposition and rearmounted;

Transducer and I/O acquisition hardware 3 be according to concrete application, can integrate with system hardware or external, can be single or multiple, can be one species or different types of (such as temperature sensor, GPS sensor);

Special information instant communication client software 10 can be according to the different application scene, customize different client softwares to adapt to different system environmentss, such as Windows, Linux, Mac OS, iOS, Android, embedded system etc., and according to different hardware configuration and functional requirement, its functional module can suitably be deleted or increase;

Display 11 can be integrated in the shell with system board or external, can be single or multiple, can be one species or different types of (such as LCD touch-screen, LED display etc.);

Loud speaker 12 can be integrated in the shell with system board or external, can be single or multiple, can be one species or different types of (such as earphone, sound equipment etc.);

I/O control interface and final controlling element 13 can be integrate, be integrated in system board in the shell or external, can be single or multiple, can be one species or different types of (such as photoelectricity isolation output, Transistor-Transistor Logic level output, COM port output, USB interface output, relay output etc.), the final controlling element general reference can be applied to device or the Industry Control actuating equipment of actuator and can pass through the again device of row control of slave computer, and final execution unit has common electric light source, motor, electromagnetically operated valve, electromagnet etc.;

More than all hardware of mentioning (or equipment), its external mode comprises wired and wireless mode, wired mode refers to use the Special-purpose connecting line cable connector of certain standard (or by) of this hardware to connect; Wireless mode comprises proprietary radio transceiver chip mode, WiFi(WLAN (wireless local area network)) connected mode, BlueTooth(bluetooth), DLNA (Digital Living Network Alliance multi-screen interconnection protocol), NFC(near-field communication) etc. a certain adaptive mode.

The range of application of this special information instant communication client system and device drive end (or server-side) 9 is at aspects such as life, work production, Internet of Things, securities, uses very extensively, and specifically applicating example is as follows:

Life kind: have certain IM(instant messaging) long-distance intelligent air-conditioning ID(account), refrigerator, fish jar, automobile, electric motor car, gate inhibition, life are with robot etc.;

The technical essential of above-mentioned life kind Realization of Product is as follows:

Intelligent air condition, refrigerator, fish jar, automobile, electric motor car, gate inhibition, life robot: can integrate with host's product, authorized long-distance user be connected to intelligent air condition, heliostat, refrigerator, fish jar, automobile, electric motor car, gate inhibition, life with robot after, according to specific instruction, can pass the parameters such as image, video, temperature are also controlled host's product by specific instruction some actions back;

Work production: have certain IM(instant messaging) counseling services robot ID(account), unmanned vehicle (as being used for the low-speed small dirigible of shooting, remote sensing), ups power, digital signage, auxiliary intelligent process control etc.;

The technical essential that Realization of Product is produced in above-mentioned work is as follows:

Counseling services robot: the ID that certain IM is arranged, and automatically login, and there is the house dog supervision to activate at any time, the counseling services robot can have the outward appearance of certain robot, be equipped with drive some action (as shake the head, rotary head, walk, turn to, arm action etc.) electromechanics mechanism, after authorized long-distance user is connected to counseling services robot and ringing tone video conversation, distant place user can with the people's dialogue around robot this locality, and the action by specific instruction control;

Unmanned vehicle: the ID that certain IM is arranged, and automatically login, and there is the house dog supervision to activate at any time, electromechanics mechanism is housed drives some action (rise, descend, advance, turn to, The Cloud Terrace action, take action etc.), after authorized long-distance user is connected to unmanned vehicle, obtain the GPS locus of unmanned vehicle and be presented on the map by specific instruction, and control some actions of unmanned vehicle by specific instruction;

Ups power: obtain some achievement datas of ups power by specific instruction, and control the certain operations of ups power by specific instruction;

Digital signage: each digital signage has the ID of certain IM, and automatically login, and there is the house dog supervision to activate at any time, the content-data in high in the clouds perhaps in showing directly by specific instruction to the transmission of this digital signage, and by specific instruction control it is presented on the software interface window of appointment, and the concrete coupled system software of software interface window is defined on certain hardware display (such as No. 2 displays in the PC), and adaptive therewith; Different digital signage can form a group, under authorized user control, can send specific instruction to this group or certain member, to raise the efficiency.Certainly can also be by the switch of instruction control figure label, and can control camera the picture of digital signage is beamed back to verify and monitor.

Internet of Things: for a large object, such as a container, store of goods are being deposited in the inside, a RFID can not carry enough information, at this moment, contain goods information (RFID reader through reading RFID information and these information being automatically converted to, bar-code reader etc.) after special information instant communication client system and device and this container are integrated, can regularly fix a point to high in the clouds (space) automatically upload various parameters according to the format module of appointment, picture, the information such as position, equal like this IM(instant messaging of a lot of Internet of Things information package to) the ID(account) high in the clouds (space) inner, granted access person can access this address, URL(high in the clouds according to this ID) obtain packed Internet of Things bulk information;

Security: the ID that certain IM is arranged, and automatically login, and there is the house dog supervision to activate at any time, use in conjunction with the client on the mobile device, can login and manage the product that this patented technology is housed that is monitored whenever and wherever possible, obtain the information such as the relevant image of environment, video, sound, and make relevant Remote action, such as opening door lock.

Claims

1. based on special information, instruction transmission and demonstration, the manner of execution of instant messaging, comprising:

The edit step of information, instruction;

The forwarding step based on instant messaging of information, instruction;

Based on the receiving step of instant messaging to information, instruction;

The execution in step of information, instruction;

(3), multimedia input: trigger predefined special information, instruction generation by multi-media sensor;

(1), multiwindow picture and text multimedia display: specify the layout pattern of multiwindow and specify certain window to be set to special display mode and show picture and text or other format media information in certain window;

2. the special information based on instant messaging according to claim 1, instruction transmission and demonstration, manner of execution, it is characterized in that: the edit mode of special information command also comprises " spcial character agreement " input: be subjected to the control of " automatic-answering back device output " executive mode in the execution in step of information, instruction, to generate special information, instruction for special information, the required spcial character agreement autocoding of instruction encoding, and the special information that will generate, instruction send or backup to high in the clouds through the forwarding step based on instant messaging automatically; " automatic-answering back device output " executive mode in the special information command executive mode is called " spcial character agreement " input editing mode according to the special information, the instruction triggers that receive; Simultaneously special information command executive mode comprises that also " spcial character agreement " receives: according to instruction the other side of reception or " the spcial character agreement " in high in the clouds are shown, are saved in this locality or backups to high in the clouds.

3. the special information based on instant messaging according to claim 1 and 2, instruction transmission and demonstration, manner of execution is characterized in that: realize that " carrying out output " in the executive mode of execution function of special information, instruction comprises the signal by I/O hardware interface output control simulation or digital device.

4. the special information based on instant messaging according to claim 1 and 2, instruction transmission and demonstration, manner of execution, it is characterized in that: realize that " the manual directly input of quick input frame " in the edit mode of special information, instruction contains supplemental button, drop-down (selections), gets (single choice) ready or tick the mode of (compound selection), can play up transmission with the word content of inputting according to the specific format of " the spcial character agreement " of certain appointment fast.

5. the special information based on instant messaging according to claim 3, instruction transmission and demonstration, manner of execution, it is characterized in that: realize that " the manual directly input of quick input frame " in the edit mode of special information, instruction contains supplemental button, drop-down selection, gets single choice ready or tick the mode of compound selection, can play up transmission with the graph-text content of inputting according to the specific format of " the spcial character agreement " of certain appointment fast.

6. the special information based on instant messaging according to claim 1 and 2, instruction transmission and demonstration, manner of execution is characterized in that: the method is by to MSN or comprise plug-in unit and MSN that the web page code of server moves in the browser mode imposes the increased functionality expansion and realizes; Perhaps the form with expanded function software realizes on existing MSN by " plug-in ".

7. based on special information, instruction transmission and demonstration, the final controlling element of instant messaging, comprising:

The editor module of information, instruction;

The sending module based on instant messaging of information, instruction;

Based on the receiver module of instant messaging to information, instruction;

The Executive Module of information, instruction;

(1), the manual directly input module of quick input frame: except original input content and give the function of certain html format, can give fast other additional special information, instruction such as orders such as control the other side display windows;

8. the special information based on instant messaging according to claim 7, instruction transmission and demonstration, final controlling element, it is characterized in that: the editor module of special information command also comprises " spcial character agreement " input module: be subjected to the control of " automatic-answering back device output module " in the Executive Module of information, instruction, to generate special information, instruction for special information, the required spcial character agreement autocoding of instruction encoding, and the special information that will generate, instruction send or backup to high in the clouds through the sending module based on instant messaging automatically; " automatic-answering back device output module " in the special information command Executive Module calls " spcial character agreement " input module according to the special information, the instruction triggers that receive; Simultaneously special information command Executive Module also comprises " spcial character agreement " receiver module: according to instruction the other side of reception or " the spcial character agreement " in high in the clouds are shown, are saved in this locality or backups to high in the clouds.

9. it is characterized in that according to claim 7 or 8 described special information based on instant messaging, instruction transmission and demonstration, final controlling element: realize that " execution output module " in the Executive Module of execution function of special information, instruction comprises the signal by I/O hardware interface output control simulation or digital device.

10. according to claim 7 or 8 described special information based on instant messaging, instruction sends and shows, final controlling element, it is characterized in that: realize special information, " the manual directly input module of quick input frame " in the editor module of instruction contains supplemental button, drop-down selection, get the mode of single choice or ticking final election ready, except original input content and give the function of certain html format, can give fast other the additional special information such as orders such as control the other side display windows, instruction namely can be played up transmission with the content of input according to additional certain customizing messages instruction mode fast.