CN104050109A

CN104050109A - Method, equipment and system for expanding peripherals

Info

Publication number: CN104050109A
Application number: CN201410252459.0A
Authority: CN
Inventors: 王�琦
Original assignee: Hisense Mobile Communications Technology Co Ltd
Current assignee: Hisense Mobile Communications Technology Co Ltd
Priority date: 2014-06-09
Filing date: 2014-06-09
Publication date: 2014-09-17

Abstract

The invention discloses a method, equipment and a system for expanding peripherals. Display equipment serves as main equipment, a mobile terminal serves as a co-processor and a newly-added periphery of the main equipment, when the display equipment needs to use the periphery of mobile equipment, the display equipment sends a control instruction of a user for the periphery of the mobile equipment to the periphery of the mobile equipment so as to enable the periphery of the mobile equipment to operate according to the control instruction, and the display equipment processes data obtained after the periphery of the mobile equipment operates and displaying according to the processed data. The hardware processing capability of the display equipment is improved by means of the mobile equipment, and a richer periphery function is added to the display equipment.

Description

A kind of method of expanding peripherals, equipment and system

Technical field

The present invention relates to smart machine field, relate in particular to a kind of expanding peripherals method, equipment and system.

Background technology

Along with showing developing rapidly of industry, high configuration, multi-functional display device emerge in an endless stream, the demand that user experiences the high-quality of display device is also in continuous lifting, in the case of the hardware configuration such as processor, internal memory of display device (as intelligent television) is constant, cannot makes user experience better and be promoted.

For intelligent television, the demand of intelligent television being experienced in order to meet user, carries out HardwareUpgring conventionally in the following ways to intelligent television: the first is the high configuration of continuous upgrading purchase intelligent television product; The second is embedded upgrading module in intelligent television, upgrades out-of-date module and reaches the object to TV upgrading.

But there are the following problems for mode in second: need to reserve because of intelligent television the space that holds update module, need to consider inner mounting means in TV structure, cause intelligent television complex structural designs; Need when module user to start dismounting upgrading is installed, domestic consumer's operation has certain difficulty; It is general etc. that expensive, the different TV of scalable module producer different upgrading modules are difficult to.

To sum up, in prior art, exist the problem that display device peripheral functionality is not enriched.

Summary of the invention

The invention provides a kind of method of expanding peripherals, the problem of not enriching in order to solve the display device peripheral functionality that exists in prior art.

The invention provides a kind of method of expanding peripherals, comprise: display device according to receive for controlling first steering order of peripheral hardware of mobile device, generate the second steering order that described peripheral hardware can be identified, the outer peripheral hardware of described mobile device inside or the peripheral hardware of expansion or the compound peripheral hardware of being made as of wherein said mobile device;

Described display device sends to described peripheral hardware by described mobile device by described the second steering order, so that described peripheral hardware operates according to described the second steering order.

Preferably, described display device also comprises after described the second steering order being sent to described peripheral hardware by described mobile device:

Described display device receives described peripheral hardware by described mobile device and operates according to described the second steering order the data that obtain, and the described data of receiving are processed; Or

Described display device reception operates according to described the second steering order the data that obtain to described peripheral hardware by described mobile device and carries out data after treatment.

Preferably, described display device according to receive for controlling first steering order of peripheral hardware of described mobile device, before generating the second steering order that peripheral hardware can identify, also comprise:

Described display device receives the peripheral hardware list of the described mobile device of described mobile device transmission, and the peripheral hardware list of setting up described display device according to the peripheral hardware list of described mobile device;

The described peripheral hardware that described display device is selected according to user, shows the service that corresponding operation interface or running background are corresponding;

Wherein, the peripheral hardware list of described display device comprises the peripheral hardware of described mobile device and the peripheral hardware of described display device.

Transmitting element, for described the second steering order is sent to corresponding peripheral hardware, so that described peripheral hardware operates according to described the second steering order.

The embodiment of the present invention provides a kind of method of expanding peripherals, comprising:

Mobile device receive from described display device for controlling second steering order of peripheral hardware of mobile device, the outer peripheral hardware of described mobile device inside or the peripheral hardware of expansion or the compound peripheral hardware of being made as of wherein said mobile device;

Described the second steering order is sent to corresponding peripheral hardware by described mobile device, so that described peripheral hardware operates according to described the second steering order.

Preferably, described the second steering order is sent to corresponding peripheral hardware by described mobile device, so that before described peripheral hardware operates according to described the second steering order, also comprise:

Described mobile device sends the peripheral hardware list of described mobile device to described display device, so that described display device is set up the peripheral hardware list of described display device according to the peripheral hardware list of described mobile device;

Preferably, described mobile device also comprises after described the second steering order is sent to corresponding peripheral hardware:

Described mobile device operates the data retransmission obtaining to described display device by the described peripheral hardware of receiving according to described the second steering order; Or

Described mobile device operates according to described the second steering order the data that obtain by the described peripheral hardware of receiving and processes, and data after treatment are sent to described display device.

The system that the invention provides a kind of expanding peripherals, comprising:

Display device, for according to receive for controlling first steering order of peripheral hardware of mobile device, generate the second steering order that described peripheral hardware can be identified, the outer peripheral hardware of described mobile device inside or the peripheral hardware of expansion or the compound peripheral hardware of being made as of wherein said mobile device; By described mobile device, described the second steering order is sent to described peripheral hardware, so that described peripheral hardware operates according to described the second steering order;

Mobile device, for receive from described display device for controlling second steering order of peripheral hardware of mobile device, the outer peripheral hardware of described mobile device inside or the peripheral hardware of expansion of being made as of wherein said mobile device; Described the second steering order is sent to corresponding peripheral hardware, so that described peripheral hardware operates according to described the second steering order.

The invention provides the display device in a kind of expanding peripherals system, comprising:

Control signal generation unit, for according to receive for controlling first steering order of peripheral hardware of mobile device, generate the second steering order that described peripheral hardware can be identified, the outer peripheral hardware of described mobile device inside or the peripheral hardware of expansion or the compound peripheral hardware of being made as of wherein said mobile device;

Control signal transmitting element, for by described mobile device, described the second steering order being sent to described peripheral hardware, so that described peripheral hardware operates according to described the second steering order.

Preferably, described display device also comprises processing unit, and described processing unit is used for:

After described control signal transmitting element sends to described peripheral hardware by described mobile device by described the second steering order, described processing unit receives described peripheral hardware by described mobile device and operates according to described the second steering order the data that obtain, and the described data of receiving are processed; Or

After described control signal transmitting element sends to described peripheral hardware by described mobile device by described the second steering order, described processing unit reception operates according to described the second steering order the data that obtain to described peripheral hardware by described mobile device and carries out data after treatment.

Preferably, described display device also comprises that peripheral hardware list sets up unit and performance element,

Before described control signal generation unit generates the second steering order that described peripheral hardware can identify, the peripheral hardware list of unit for the described mobile device that receives described mobile device and send set up in described peripheral hardware list, and the peripheral hardware list of setting up described display device according to the peripheral hardware list of described mobile device; Wherein, the peripheral hardware list of described display device comprises the peripheral hardware of described mobile device and the peripheral hardware of described display device;

Before described control signal generation unit generates the second steering order that described peripheral hardware can identify, the described peripheral hardware of described performance element for selecting according to user, shows the service that corresponding operation interface or running background are corresponding.

The invention provides the mobile device in a kind of expanding peripherals system, comprising:

Receiving element, for receive from described display device for controlling second steering order of peripheral hardware of mobile device, the outer peripheral hardware of described mobile device inside or the peripheral hardware of expansion or the compound peripheral hardware of being made as of wherein said mobile device;

Preferably, described transmitting element also for:

Before described the second steering order is sent to corresponding peripheral hardware by described transmitting element, described transmitting element is also for send the peripheral hardware list of described mobile device to described display device, so that described display device is set up the peripheral hardware list of described display device according to the peripheral hardware list of described mobile device;

Preferably, described mobile device also comprises processing unit, and described processing unit is used for:

After described the second steering order is sent to corresponding peripheral hardware by described transmitting element, described processing unit operates the data retransmission obtaining to described display device by the described peripheral hardware of receiving according to described the second steering order; Or

After described the second steering order is sent to corresponding peripheral hardware by described transmitting element, described processing unit operates according to described the second steering order the data that obtain by the described peripheral hardware of receiving and processes, and data after treatment are sent to described display device.

The method of a kind of expanding peripherals that the embodiment of the present invention provides, using display device as main equipment, mobile terminal is as coprocessor and the newly-increased peripheral hardware of main equipment, in the time that display device need to use the peripheral hardware of mobile device, display device sends to user the peripheral hardware of mobile device to the steering order of mobile device peripheral hardware, mobile device peripheral hardware is operated according to steering order, data after display device operates mobile device peripheral hardware are processed, show according to data after treatment, the method has promoted the hardware handles ability of display device by mobile device, increase the abundant peripheral functionality of display device.

Brief description of the drawings

The method schematic diagram of a kind of opertaing device that Fig. 1 provides for the embodiment of the present invention 1;

The method schematic diagram of a kind of opertaing device that Fig. 2 provides for the embodiment of the present invention 2;

Fig. 3 is a kind ofly fixed on the assembling schematic diagram on display device by mobile device for what the embodiment of the present invention 3 provided;

The system construction drawing of a kind of opertaing device that Fig. 4 provides for the embodiment of the present invention 4;

The structural drawing of the display device in the system of a kind of opertaing device that Fig. 5 provides for the embodiment of the present invention 5;

The structural drawing of the mobile device in the system of a kind of opertaing device that Fig. 6 provides for the embodiment of the present invention 6.

Embodiment

Along with the day by day lifting of user to mobile terminal performance requirement, the configuration of mobile terminal can realize 4 core processors, 2.3GHz dominant frequency, 3GB RAM (random access memory), high-performance GPU (Graphic Processing Unit, graphic process unit) etc. accurate PC (Personal Computer, PC) performance of rank, can directly drive 2K or 4K resolution display, possesses 3G/4G/WIFI (Wireless Fidelity, WiMAX connects)/bluetooth/infrared/USB (Universal Serial Bus, USB (universal serial bus)) etc. function, bring desirable user to experience to user.But user changes the speed of mobile terminal, in the situation that not breaking down, mobile terminal is just eliminated, cause the waste of resource.

Based on the processor existing in prior art at display device (as intelligent television), in the constant situation of the hardware configuration such as internal memory, the problem that display device peripheral functionality is not enriched, the embodiment of the present invention provides a kind of method by means of height configuration mobile terminal expansion display device peripheral hardware, using display device as main equipment, mobile terminal is as coprocessor and the newly-increased peripheral hardware of main equipment, in the time that display device need to use the peripheral hardware of mobile device, display device sends to user the peripheral hardware of mobile device to the steering order of mobile device peripheral hardware, mobile device peripheral hardware is operated according to steering order, data after display device operates mobile device peripheral hardware are processed, show according to data after treatment.

The method has promoted the hardware handles ability of display device by mobile device, increased abundant peripheral functionality.

For example, original display device is limited to algorithm and processor computing power to voice recognition processing not precisely time, and display device utilizes the powerful calculating ability of mobile device to carry out voice real-time analysis processing; Display device also can utilize the outer if more high-resolution image acquisition of display device support of carrying of mobile device, or utilizes bluetooth/WIFI function of mobile device, realizes bluetooth/WIFI route, makes display device expand more peripheral functionality.

In order to make technical matters solved by the invention, technical scheme and beneficial effect clearer, below in conjunction with drawings and Examples, the present invention is described in more detail.Should be appreciated that specific embodiment described herein, only in order to explain the present invention, is not intended to limit the present invention.

Embodiment 1

The method of a kind of expanding peripherals provided by the invention as shown in Figure 1, the method comprises:

Step 101: display device according to receive for controlling first steering order of peripheral hardware of mobile device, generate the second steering order that peripheral hardware can be identified, wherein mobile device outer is made as mobile device inner or the peripheral hardware of expansion or compound peripheral hardware;

Step 102: display device sends to peripheral hardware by mobile device by the second steering order, so that peripheral hardware operates according to the second steering order.

In embodiment, the peripheral hardware of the inside of mobile device refers to the external unit that mobile device inside carries, and the height carrying as mobile terminal configures camera, speech recognition equipment, blue-tooth device, WIFI device.

The peripheral hardware of mobile device expansion refers to the external device of mobile terminal expansion, as wireless router etc.

The compound peripheral hardware of mobile device refers to that mobile device combines the common peripheral hardware of display device with the processing power of mobile device and the virtual peripheral that provides for display device, this virtual peripheral is not the peripheral hardware of necessary being, but a kind of abstract device with specific peripheral functionality of definition.For example, intelligent television does not have speech recognition equipment, only have audio-frequency module to be used for collecting voice data, under this kind of application scenarios, in order to make intelligent television obtain the peripheral functionality that voice recognition device has, after mobile terminal receives the voice data of audio-frequency module transmission of intelligent television, utilize mobile terminal voice recognition device to carry out identifying processing to this voice data, data message after treatment is offered to intelligent television, that is to say, mobile device provides compound " a speech recognition peripheral hardware " for intelligent television.

In enforcement, display device is as main equipment, and mobile device is as from equipment, and display device is connected by wired or wireless mode with mobile device.

Display device can be intelligent television, and mobile device comprises: smart mobile phone, Intelligent flat computer etc.

For ensureing the information security between display device and mobile device, mobile device is connected to after display device, and display device carries out authentication or encryption by wired or wireless mode, authentication by after can carry out follow-up information interaction.

Such as: display device sends authentication request signaling triggering authentication process by wired or wireless to mobile device, in authentication request signaling, comprise display device id information, random number, key sequence number, whether mobile device points out user to allow to be connected with display device on interface, user starts foundation according to mobile device after the correct random number of prompting input and is connected with display device, send instruction to display device, display device is responded Authentication Response signaling to mobile device, and mobile device judges whether authentication success according to Authentication Response signaling.After authentication success, the key of the two communication based on transmission in early stage is encrypted.

In enforcement, the mobile device being connected with display device can be multiple, selects according to user, determines that a mobile device and display device carry out information interaction.

In enforcement, because user is different to the mode of operation of mobile device and display device, the user interface of mobile device and display device is different, for realizing display device free access mobile device, need to be on mobile device prefabricated special software.This special software can make display device obtain the control of mobile terminal.

Preferably, APK (Application Package file is installed respectively on display device and mobile terminal device, application program APMB package), main frame at the APK of display device programming, in the APK of mobile terminal program arrange be slave, display device and the mobile device data transfer mode to have, for example USB WIFI BT (bluetooth, bluetooth) etc., set up physical connection and carry out information interaction.

Preferably, the APK of display device and the APK of mobile terminal are connected and are carried out information interaction by P2P (Peer-to-Peer, is called for short P2P, realizes point-to-point sharing files technology) point-to-point transmission agreement, and its process is as follows:

1, the APK of display device as main frame by general agreement, as TCP (Transmission Control Protocol, transmission control protocol, a kind of connection-oriented, reliably, IP-based transport layer protocol) UDP (User Datagram Protocol, User Datagram Protoco (UDP), a kind of connectionless transport layer protocol in OSI, simple unreliable information transfer service towards affairs is provided) etc., APK to mobile device sends control command, make the APK of mobile device that the peripheral hardware list of mobile device is transferred to display device.

2, the APK of mobile device collects the information of the peripheral hardware such as audio frequency, video, Input/Output Device of mobile device, the peripheral hardware list of being classified, setting up mobile device; The APK of mobile device is transferred to the peripheral hardware list of mobile device according to the control command of the APK of display device the APK of display device.

3, the APK of display device receives the peripheral hardware list of the mobile device of the APK transmission of mobile device, according to the peripheral hardware list of mobile device, searches and set up corresponding peripheral hardware list in display device.

4, the APK of display device is by general agreement (TCP UDP etc.), and the peripheral hardware list that display device is set up is transferred to the APK of mobile device.

5, after the APK of mobile device receives the peripheral hardware list of display device, send test bandwidth request to the APK of display device, make the APK of display device and the APK of mobile device carry out bandwidth test.

6, the APK of display device, according to bandwidth test result, reconfigures audio sample rate, video resolution etc.

7, the APK of display device and the APK of mobile device point out successfully and connect.

8, the steering order that the APK of mobile device sends according to the APK of display device, packs the information such as the audio frequency of mobile device, video, input-output apparatus, is transferred to the APK of display device by physical data connected mode.

9, the APK of display device according to a preconcerted arrangement mode the packet of receiving is unpacked and is used.

Wherein, P2P point-to-point transmission agreement, is known as again reciprocity internet technique, is a kind of new network, relies on computing power and the bandwidth of participant in network.P2P point to point network does not have the concept of client or server, only has the brother of node of equality, other node on network is served as to client and server simultaneously, this network design model is different from " client-server " model, and in " client-server " model, communication commutes a central server conventionally.

Preferably, the method for a kind of opertaing device that the embodiment of the present invention provides in the manner described above, realizes control and the access of the peripheral hardware of display device to mobile device, and realizes the utilization of the processing power of display device to mobile terminal.

Preferably, before embodiment step 101, also comprise:

Display device according to receive for controlling first steering order of peripheral hardware of mobile device, before generating the second steering order that peripheral hardware can identify, also comprise:

Display device receives the peripheral hardware list of the mobile device of mobile device transmission, and the peripheral hardware list of setting up display device according to the peripheral hardware list of mobile device;

The peripheral hardware that display device is selected according to user, shows the service that corresponding operation interface or running background are corresponding;

Wherein, the peripheral hardware list of display device comprises the peripheral hardware of mobile device and the peripheral hardware of display device.

In enforcement, in the peripheral hardware list of mobile device that display device receives, comprise the relevant information of peripheral hardware or the compound peripheral hardware of the inner or expansion of mobile device, display device is according to the relevant information of the peripheral hardware in the peripheral hardware list of mobile device, can confirm can be shown the peripheral hardware that equipment uses in the peripheral hardware of mobile device.

In enforcement, display device receives the peripheral hardware list of the mobile device of mobile device transmission, and the peripheral hardware list of setting up display device according to the peripheral hardware list of mobile device, in the peripheral hardware of confirmation mobile device, can be shown the peripheral hardware that equipment uses, make display device can expand abundanter peripheral functionality, wherein, this peripheral hardware comprises that mobile terminal carries the peripheral hardware of peripheral hardware or mobile terminal expansion.

The peripheral hardware that display device is selected according to user, shows that the service that corresponding operation interface or running background are corresponding specifically refers to:

In the time that user selects or start the peripheral hardware of the mobile device on the main interface of mobile device, make display device search the peripheral hardware list that comprises mobile device peripheral hardware of setting up before, determine the peripheral hardware of the mobile device that user selects, and at the corresponding operation interface of this peripheral hardware of the main interface display of display device or make display device in the corresponding service of this peripheral hardware of running background.

For example, for speech recognition peripheral hardware, display device detects after user's phonetic order (" increase volume "), should " increase volume " instruction be converted into virtual key event (" V+ "), after the APK of display device confirms this key-press event, indicative audio adjustment module is carried out the operation that increases output volume on backstage.

Display device is set up the peripheral hardware list of display device according to the peripheral hardware list of mobile device, refer to:

Display device is according to the peripheral hardware information in the peripheral hardware list of mobile device (as store path of device identification, device type, device performance parameters, peripheral hardware application program etc.), in display device, search all external units, confirm the information of each external unit of display device, the peripheral hardware list of all peripheral hardwares that foundation comprises display device and the available peripheral hardware of mobile device, also comprises the application information that each peripheral hardware is corresponding in the list of display device peripheral hardware.As the cam device that comprises mobile device in peripheral hardware list, also comprise the information such as application version, application storage path of the cam device of mobile device.

In embodiment step 101, display device according to receive for controlling first steering order of peripheral hardware of mobile device, generate the second steering order that peripheral hardware can be identified, specifically refer to:

User sends the first steering order of the peripheral hardware of controlling mobile device to display device, display device receives the first steering order, display device is searched the peripheral hardware list that display device is set up, read the relevant information of the peripheral hardware of the mobile device in the first steering order, display device is converted into by the first steering order the second steering order that this peripheral hardware can be identified according to the relevant information of this peripheral hardware, so that display device while the second steering order being sent to this peripheral hardware of mobile device by physical channel, makes this peripheral hardware carry out corresponding operation.

Such as: after TV is connected with mobile phone, can in television interfaces, show the main interface of mobile phone, user selects first steering order of " taking a picture " in television interfaces, the first steering order that television reception " is taken a picture ", and the first steering order is changed into " carrying out image acquisition " second steering order that the camera of mobile phone can be identified, so that after mobile phone receives the second steering order, the second steering order is sent to camera, make camera carries out image acquisition instructions.

In embodiment step 102, display device sends to peripheral hardware by mobile device by the second steering order, so that peripheral hardware operates according to the second steering order, specifically comprises:

Display device sends to mobile device by total data transfer mode by the second steering order, makes mobile device the second steering order is transferred to the peripheral hardware of mobile device, makes the peripheral hardware of mobile device carry out the second steering order.

In enforcement, display device sends to the second steering order the peripheral hardware of mobile device, make the peripheral hardware of mobile device carry out the second steering order, promoted the hardware handles ability of display device by mobile device, increase abundant peripheral functionality, not only reduce the cost of display device HardwareUpgring, and can the out-of-date mobile device of effective use, the wasting of resources reduced.

Preferably, after embodiment step 102, also comprise:

Display device receives peripheral hardware by mobile device and operates the data that obtain according to the second steering order, and the data of receiving are processed; Or

Display device reception operates according to the second steering order the data that obtain to peripheral hardware by mobile device and carries out data after treatment.

In embodiment, the configuration of mobile device is higher, the embodiment of the present invention operates according to the second steering order the data that obtain to peripheral hardware by mobile device and processes, utilize the processing power of mobile terminal, comprise the ability of backstage multitasking, the work that partly consumes display device CPU calculation resources can be transferred to mobile device and carry out, avoid a large amount of evaluation works to be placed on display apparatus processes.

Particularly, after the peripheral hardware of mobile device operates according to the second steering order, data transmission after operation is provided to mobile device, mobile device sends to display device by the data after peripheral hardware operation by total data transfer mode, makes display device show according to the data after peripheral hardware operation or transfer to upper strata interactive frame to process the data after peripheral hardware operation; Or

After the peripheral hardware of mobile device operates according to the second steering order, data transmission after operation is provided to mobile device, data after mobile device operates peripheral hardware are processed, send to display device by processing later data, make display device show according to the data after peripheral hardware operation or transfer to upper strata interactive frame to process the data after peripheral hardware operation.

Such as, after the camera of mobile phone carries out image acquisition, the view data of collection is sent to mobile phone, view data is sent to intelligent television by mobile phone, and the view data that intelligent television basis is received shows or intelligent television transfers to upper strata interactive frame to process the view data of receiving; Or

The view data that the view data that mobile phone gathers according to mobile phone camera and the telephotography head of television transmission gather, analyze, the pre-service such as merging, and view data after treatment is sent to intelligent television, the view data that intelligent television basis is received shows or intelligent television transfers to upper strata interactive frame to process the view data of receiving.

Embodiment 2

The method of a kind of expanding peripherals provided by the invention as shown in Figure 2, the method comprises:

Step 201: mobile device receive from display device for controlling second steering order of peripheral hardware of mobile device, wherein mobile device outer is made as mobile device inner or the peripheral hardware of expansion or compound peripheral hardware;

Step 202: the second steering order is sent to corresponding peripheral hardware by mobile device, so that peripheral hardware operates according to the second steering order.

Preferably, APK program is installed respectively on display device and mobile terminal device, main frame at the APK of display device programming, in the APK of mobile terminal program, arranging is slave, display device and mobile device with the data transfer mode that has (such as USB WIFI BT etc.) set up physical connection and carry out information interaction.

Preferably, the APK of display device and the APK of mobile terminal are connected and are carried out information interaction by P2P point-to-point transmission agreement.

In embodiment, before step 201, prefabricated special software (as APK) in mobile device, makes display device obtain the highest control authority of mobile device, specifically comprises:

In mobile device, prefabricated special software, operates by user, obtains the root authority of mobile device, after display device is connected with mobile device, realizes the comprehensive control of display device to mobile device; Or

The built-in special software of mobile device or call mobile terminal software, realizes that display device control mobile device completes voice real-time analysis processing, " coprocessor " work such as real-time " whitening " of taking pictures or making a video recording; Or

Mobile device built-in application, the mode that user can intuitively select by icon, selects the modules such as camera, speech recognition; Or

Optionally, built-in some softwares that aim at intelligent television exploitation of mobile device, make the unnecessary manual downloading application software of display device and drive software.

Preferably, before step 202, also comprise:

Mobile device sends the peripheral hardware list of mobile device to display device, so that display device is set up the peripheral hardware list of display device according to the peripheral hardware list of mobile device;

In enforcement, in the peripheral hardware list of mobile device, comprise the relevant information of peripheral hardware or the compound peripheral hardware of the inner or expansion of mobile device.The peripheral hardware of mobile device inside, the peripheral hardware of mobile device expansion, the definition of the compound peripheral hardware of mobile device defines in the above-described embodiments, is not repeated herein.

Preferably, after step 202, also comprise:

Mobile device operates the data retransmission obtaining to display device by the peripheral hardware of receiving according to the second steering order; Or

Mobile device operates according to the second steering order the data that obtain by the peripheral hardware of receiving and processes, and data after treatment are sent to display device.

In enforcement, display device operates by the peripheral hardware of mobile device, has promoted the hardware handles ability of display device, increase abundant peripheral functionality, not only reduced the cost of display device HardwareUpgring, and can effective use the mobile device of high configuration, reduce the wasting of resources.

Concrete, if what the APK of mobile device received by host-host protocol that display device APK sends make, mobile device forwards the instruction of the data after the operation of mobile device peripheral hardware, and the peripheral hardware that APK of mobile device receives mobile device operates the data that obtain and the APK to display device by this data retransmission according to the second steering order;

If the APK of mobile device receives by host-host protocol the mobile device that makes that display device APK sends the peripheral hardware of mobile device is operated to the instruction that the data that obtain are processed according to the second steering order, the APK of mobile device receives the peripheral hardware of mobile device and operates the data that obtain and these data are processed according to the second steering order, the APK of mobile device by data after treatment by host-host protocol to display device APK transmission processing after data.

Such as, after the camera of mobile phone carries out image acquisition, the view data of collection being sent to mobile phone, the view data of receiving is sent to intelligent television by mobile phone; Or

When mobile phone is received the data of view data that mobile phone camera gathers and the camera collection of TV simultaneously, mobile phone to all view data of receiving analyze, the processing such as merging, and view data after treatment is sent to intelligent television.

According to above-mentioned implementation process, because of the configuration of mobile device higher, the embodiment of the present invention operates according to the second steering order the data that obtain to peripheral hardware by mobile device and processes, utilize the processing power of mobile terminal, comprise the ability of backstage multitasking, not only can make display device expand more peripheral functionality, the work that partly consumes display device CPU calculation resources can also be transferred to mobile device and carry out, avoid a large amount of evaluation works to be placed on display apparatus processes.

In order to make technical matters, the technical scheme that the embodiment of the present invention 1 and embodiment 2 solve and to produce effect clearlyer, be further elaborated in conjunction with several concrete application scenarioss.

Under several application scenarioss, intelligent television and mobile terminal, before carrying out information interaction, also comprise below:

Intelligent television is connected by wired or wireless with mobile terminal, and the APK of display device and the APK of mobile terminal carry out information interaction by P2P point-to-point transmission agreement.Embodiment specifically discusses above, is not repeated herein.

Application scenarios 1:

Use the application scenarios of the speech recognition equipment of mobile terminal to be elaborated for intelligent television below, in application scenarios 1, intelligent television has gathered voice messaging, and voice data transmission is identified to mobile terminal, mobile terminal to voice messaging identification and by the communication after identification to display device, display device is operated according to the information after identification.Concrete steps are as follows:

Step 1: intelligent television obtains the control of the peripheral hardware of mobile terminal and mobile terminal;

Concrete, prefabricated APK special software in intelligent television, it is main frame that intelligent television is set in this special software; Prefabricated APK special software in mobile terminal, it is slave that mobile terminal is set, and makes intelligent television obtain the control of the peripheral hardware of mobile device and mobile terminal.

Step 2: intelligent television is set up peripheral hardware list, peripheral hardware list comprises the peripheral hardware of intelligent television and the peripheral hardware of mobile terminal;

Concrete, intelligent television sends instruction to mobile terminal, makes mobile terminal that the peripheral hardware list of mobile terminal is sent to intelligent television; The peripheral hardware list of intelligent television mobile terminal receive, and search all peripheral hardwares of intelligent television, set up the peripheral hardware list that comprises the peripheral hardware of mobile terminal and the peripheral hardware of intelligent television, wherein, in peripheral hardware list, comprise the speech recognition equipment of mobile terminal.

Step 3: select according to user, intelligent television is determined the speech recognition equipment that uses mobile terminal;

Concrete, the speech recognition equipment that comprises mobile terminal in peripheral hardware list because of intelligent television foundation, in the time that user starts the speech recognition equipment on mobile terminal, intelligent television determines that user has selected the speech recognition equipment of mobile terminal, and the speech recognition equipment of selecting demonstration screen display user at Background control intelligent television.

Step 4: intelligent television sends the first steering order according to user, the second steering order that the speech recognition equipment of generation mobile terminal can be identified, and the second steering order is sent to mobile terminal;

Such as: intelligent television obtains the voice data of " children channel " that user sends, with the maximum bit rate in bandwidth allowed band and sample frequency, voice data is packaged into the packets of audio data that audio frequency of mobile terminal module can be identified, then packets of audio data is sent to mobile terminal.

Preferably, display device adopt following manner by audio data transmission to mobile device:

Intelligent television obtains the voice data in voice-frequency channel by data access function (as audio_read), according to the speech recognition equipment information in the list of intelligent television peripheral hardware, voice data is written to corresponding sound identification module, and mobile terminal obtains this voice data by speech recognition equipment.The speech recognition equipment of intelligent television and the speech recognition equipment of mobile terminal carry out data transmission by wireless or wired interface channel.

Meanwhile, intelligent television is to mobile terminal sending controling instruction, to obtain the information after speech recognition equipment is identified the voice data of reception and change.

Step 5: mobile terminal receive that intelligent television sends for controlling second steering order of speech recognition equipment of mobile terminal, and the second steering order is sent to speech recognition equipment;

Such as: mobile terminal is with the mode of the agreement packets of audio data receiving of decoding, obtain the pcm audio data that comprise " children channel ".

Preferably, mobile device adopts following manner to obtain display device and sends voice data:

Mobile device, according to the instruction of the intelligent television transmission receiving, is searched the sound identification module of mobile device, by data access function (as audio_read), makes the speech recognition equipment of mobile device obtain the voice data that intelligent television sends.

Step 6: the speech recognition equipment of mobile terminal, according to the second steering order, is carried out operation accordingly;

Concrete, the speech recognition equipment of mobile terminal is carried out speech recognition algorithm according to the pcm audio data of " children channel ", " children channel " voice signal is changed into TV discernible " children channel " digital signal, for example channel (22), text data (" children channel " four words) etc.

Step 7: mobile terminal is transferred to intelligent television by the data after speech recognition equipment discriminance analysis by sound identification module, processes the data of intelligent television to speech recognition equipment identification and after changing;

Concrete, " children channel " digital signal after the identification of acquisition for mobile terminal speech recognition equipment, sends to intelligent television by the packing of " children channel " digital signal.

Step 8: the data after speech recognition equipment identification and conversion that intelligent television mobile terminal receive sends, and these data are processed;

Intelligent television obtains by sound identification module " children channel " digital signal that mobile terminal sends.

Concrete, intelligent television receives the packet that comprises " children channel " digital signal, identifies " children channel " digital signal in the mode of arranging, and intelligent television, according to receiving digital signal, switches to children channel by current channel.

Step 9: if intelligent television continues to receive the steering order for controlling speech recognition equipment, return to step 4, continue the operation of execution step four～step 8.

Application scenarios 2:

Intelligent television uses the speech recognition equipment of mobile terminal, in application scenarios 2, gather voice messaging by mobile terminal, and voice messaging is identified and changed, mobile terminal to display device, makes display device operate according to the information after identification the communication after identification.Concrete steps are as follows:

Step 1: intelligent television obtains the control of mobile terminal;

Step 2: intelligent television is set up peripheral hardware list, this peripheral hardware list comprises the peripheral hardware of intelligent television and the peripheral hardware of mobile terminal.

Concrete, when user starts the speech recognition equipment on mobile terminal, the speech recognition equipment that comprises mobile terminal in peripheral hardware list because of intelligent television foundation, intelligent television is determined and the speech recognition equipment of mobile terminal carries out information interaction, on the display screen of intelligent television, can show and be connected with speech recognition equipment.

Step 4: intelligent television sends instruction to mobile terminal, makes the speech recognition equipment Real-time Collection voice of mobile terminal, and the voice messaging gathering is identified and changed.

Step 5: the instruction that the speech recognition equipment of mobile terminal sends according to intelligent television, carry out voice collecting, and the voice analog signal execution speech recognition algorithm of collection is converted to corresponding digital signal, the digital signal obtaining is sent to intelligent television.

For example, user sends the phonetic order of " shutdown ", the speech recognition equipment of mobile phone gathers " shutdown " voice by MIC chip, obtain " shutdown " voice analog signal, then " shutdown " voice analog signal is identified as to corresponding " shutdown " digital signal, and " shutdown " digital signal is packaged into Packet Generation to intelligent television.

Step 6: the digital signal after the speech recognition equipment identification conversion that intelligent television mobile terminal receive sends, and according to the digital signal operation service receiving.

For example: intelligent television receives " shutdown " digital signal data bag, obtains " shutdown " digital signal after decompress(ion), intelligent television is according to " shutdown " digital signal operation power-off operation.

Application scenarios 1 and application scenarios 2 have been realized display device and have been utilized the powerful calculating ability of mobile device to carry out voice real-time analysis processing, have solved original display device and have been limited to algorithm and processor computing power to voice recognition processing problem not accurately.

Application scenarios 3

Use mobile terminal camera device to be elaborated for intelligent television below, the application scenarios of the present embodiment is that intelligent television does not configure cam device, mobile terminal has the cam device of higher configured, intelligent television need to carry out image acquisition and processing by mobile terminal, and concrete steps are as follows:

Before intelligent television and mobile terminal carry out information interaction, comprising:

Step 2: intelligent television is set up peripheral hardware list, this peripheral hardware list comprises the peripheral hardware of intelligent television and the peripheral hardware of mobile terminal;

Step 3: select according to user, intelligent television is determined the mobile terminal camera device that user selects;

Concrete, in the time that user starts mobile terminal camera device, because of the foundation of intelligent television the peripheral hardware list of cam device that comprises mobile terminal, intelligent television is determined the cam device of the mobile terminal that user selects, simultaneously demonstration screen display and the cam device successful connection of intelligent television.

Step 4: intelligent television receives " starting mobile terminal camera device self-timer mode " key command that user sends, and this instruction is generated to the second steering order that mobile terminal can be identified, and the second steering order is sent to mobile terminal;

Preferably, user selects " starting mobile terminal camera device self-timer mode " by remote controller key, obtains the first key assignments (as 0xH1) corresponding to button according to the first key assignments table of the input equipment of intelligent television (telepilot) and user's key command.

The cam device that comprises mobile terminal in the peripheral hardware list that intelligent television is set up and the input equipment of mobile terminal, configured the first key assignments table of input equipment (as telepilot) of intelligent television and the second key assignments table of the input equipment (as cell phone keyboard) of mobile terminal in intelligent television; There is corresponding relation in the first key assignments table and the second key assignments table.Intelligent television is according to making mobile terminal camera device start the first key assignments of self-timer mode, and the corresponding relation of first key assignments and the second key assignments, determine that the mobile terminal camera device that makes that mobile terminal can be identified starts second key assignments (as 0xJ1) of self-timer mode; Intelligent television generates the second steering order that carries the second key assignments.

Wherein, carry the information such as device number, device type of cam device in the second steering order, intelligent television sends to mobile terminal by point-to-point transmission agreement by the second steering order.

Preferably, intelligent television, to mobile terminal sending controling instruction, makes mobile terminal process according to the data after the second steering order executable operations cam device, and data after treatment is sent to intelligent television.

Step 5: mobile terminal receives the second steering order that intelligent television sends, and the second steering order is sent to cam device;

Mobile terminal is according to the second key assignments in the second steering order receiving, determine that the second steering order starts self-timer mode for controlling cam device execution, and according to the information such as device number, device type of the cam device carrying in the second steering order, the second steering order is transmitted to the cam device of mobile terminal.

Mobile terminal receives the transmission instruction of intelligent television, controls mobile terminal the view data of cam device collection is processed.

Step 6: the cam device of mobile terminal is according to the second steering order, the image acquisition of autodyning;

The cam device of mobile terminal, according to the second key assignments in the second steering order, starts self-timer mode and carries out image acquisition, and the auto heterodyne view data collecting is transmitted to mobile terminal.

Step 7: the auto heterodyne view data that mobile terminal collects cam device is processed, and data after treatment are sent to intelligent television;

If the instruction that intelligent television sends to mobile terminal is " the auto heterodyne view data that mobile terminal camera is collected is carried out landscaping treatment ", the auto heterodyne view data that mobile terminal collects according to cam device, controls the image landscaping treatment module of mobile terminal auto heterodyne view data is carried out to landscaping treatment.

Mobile terminal, according to the steering order of intelligent television, becomes Packet Generation to intelligent television the package images of carrying out after landscaping treatment.

This process makes display device promote the hardware handles ability of display device by the processing power of mobile device, mobile device execution is transferred in the work that part is consumed to display device CPU calculation resources, avoid a large amount of evaluation works to be placed on display apparatus processes, alleviated the work load of display device.

Step 8: the data of intelligent television mobile terminal receive after to cam device executable operations are carried out data after treatment, and transfer to upper strata framework to use the data of reception;

Intelligent television receives the packet of the auto heterodyne view data after landscaping treatment, and with agreement mode by its decompress(ion), intelligent television is by the auto heterodyne view data after the landscaping treatment receiving, transfer to upper strata framework to use, such as transferring to intelligent television display to show or transferring to the Online Video chat module use etc. of intelligent television.

Step 9: if intelligent television continues to receive the steering order for controlling cam device, return to step 4, continue the operation of execution step four～step 8.

This application Scene realization display device utilize carrying of mobile device outer if the more high-resolution image acquisition of display device support, make display device expand high-resolution image acquisition peripheral functionality, not only reduce the cost of display device HardwareUpgring, and can the out-of-date mobile device of effective use, reduce the wasting of resources.

Application scenarios 4

Be elaborated for Another Application scene below.The application scenarios of the embodiment of the present invention is that intelligent television does not mate with the use agreement of user's bluetooth earphone, and mobile terminal mates with the use agreement of user's bluetooth earphone, and user the receives intelligent television detailed process of sound by bluetooth earphone is as follows:

Step 1: user arranges and makes bluetooth earphone in open mode and bluetooth earphone is connected with mobile terminal in mobile terminal;

Step 2: intelligent television monitors the bluetooth earphone of the current startup of mobile terminal in open mode, determine user select bluetooth earphone receive can only TV voice data;

Step 3: the voice data of current play content is converted to the voice data that the audio processing modules of mobile terminal can be identified by intelligent television, constantly sends to mobile terminal by the voice data after conversion;

Intelligent television changes voice data send to the detailed process of mobile terminal referring to application scenarios 1.

Step 4: the audio processing modules of mobile terminal is exported the voice data receiving by the blue-tooth device of mobile terminal;

Step 5: the voice data of the blue-tooth device output of the blue-tooth device mobile terminal receive in bluetooth earphone, makes user hear the sound of television channel play content in intelligent television.

By mobile device, display device and bluetooth earphone are interconnected, make display device expand the peripheral functionality of blue-tooth device.

Embodiment 3

The embodiment of the present invention provides a kind of assembly method that display device and mobile device are fixed, as shown in Figure 3.

Fig. 3 is the back side of intelligent television, the embodiment of the present invention provides several assembling modes on display device that mobile device is fixed on as shown in Figure 3, the modes such as profit is screwed, buckle is fixed are fixed on mobile device on display device, mobile device can be fixed on A/B/C/D/ position, if mobile device is panel computer, also can be fixed on E position.The embodiment of the present invention includes, but are not limited to several positions shown in Fig. 3.

In enforcement, fixing reliable in order to make, optionally, for specific mobile terminal is selected exclusive shell, so that mobile terminal is embedded into exclusive shell, exclusive shell is fixed on TV by the reserved assembling mode of display device (as screw is fixed, buckle fixing etc.), forms the situation after display device that mobile terminal is fixed to as shown in Figure 3.

Exclusive shell can also be realized the outward appearance collocation of mobile terminal and TV, shows user personality (as user selects the shell of cartoon profile), further expands the purposes such as intelligent television function (as increased SMART SKIN).Enclosure material can be plastics, metal, rubber etc.

In enforcement, what display device was reserved can be as shown in Figure 3 one for assembling the region of mobile device, can be also multiple.

In this enforcement, in enforcement, the mobile device being connected with display device can be multiple, selects according to user, determines that a mobile device and display device carry out information interaction.

In enforcement, when display device is connected by wired or wireless mode with mobile device, mobile device also can not be fixed with display device, whether fixes according to user's use habit and determines.

In enforcement, display device is connected in wired or wireless mode with mobile device, and preferably mode is to adopt the wired data communication function that completes of USB, also can complete data communication function by wireless modes such as WIFI.

In enforcement, USB interface, except completing data communication function, also realizes by USB interface mobile terminal is charged.Along with the continuous lifting of mobile device processing power and peripheral hardware performance, mobile device self power consumption is increasing, and for avoiding TV cannot meet the situation of energy consumption of mobile equipment demand, the USB port current drive capability of intelligent television is advised more than 1A, recommends 2A.Simultaneously, different mobile devices are also different to the restriction of charging current, if mobile device can meet the needs of proprietary mode of operation (mobile device assist process pattern) by the absorption maximum electric current of USB interface, can turning-off mobile terminal battery, such as, for high definition video recording, electric current is generally 500mA left and right; If mobile terminal can not meet the needs of proprietary mode of operation by the absorption maximum electric current of USB interface, need to keep mobile terminal internal battery, in the case, exist mobile terminal to cause the special case that cannot use for a long time because of self charging restriction.

For realizing mobile terminal power supply, except passing through USB power supply mode, also can be by other means as the modes such as wireless charging, special charging interface, seat fill realize charging.

For said method flow process, the embodiment of the present invention also provides a kind of system, display device and mobile device of expanding peripherals, and the particular content of these systems and equipment can be implemented with reference to said method, does not repeat them here.

Embodiment 4

The system of a kind of expanding peripherals as shown in Figure 4 that the embodiment of the present invention provides, this system comprises:

Display device 41, for according to receive for controlling first steering order of peripheral hardware of mobile device, generate the second steering order that peripheral hardware can be identified, the wherein outer peripheral hardware of mobile device inside or the peripheral hardware of expansion or the compound peripheral hardware of being made as of mobile device; By mobile device, the second steering order is sent to peripheral hardware, so that peripheral hardware operates according to the second steering order.

Mobile device 42, for receive from display device for controlling second steering order of peripheral hardware of mobile device, the wherein outer peripheral hardware of mobile device inside or the peripheral hardware of expansion of being made as of mobile device; The second steering order is sent to corresponding peripheral hardware, so that peripheral hardware operates according to the second steering order.

Embodiment 5

Display device in a kind of expanding peripherals system as shown in Figure 5 that the embodiment of the present invention provides, this display device comprises:

Control signal generation unit 51, for according to receive for controlling first steering order of peripheral hardware of mobile device, generate the second steering order that peripheral hardware can be identified, the wherein outer peripheral hardware of mobile device inside or the peripheral hardware of expansion or the compound peripheral hardware of being made as of mobile device;

Control signal transmitting element 52, for by mobile device, the second steering order being sent to peripheral hardware, so that peripheral hardware operates according to the second steering order.

Preferably, display device also comprises processing unit, and processing unit is used for:

After control signal transmitting element sends to peripheral hardware by mobile device by the second steering order, processing unit receives peripheral hardware by mobile device and operates the data that obtain according to the second steering order, and the data of receiving are processed; Or

After control signal transmitting element 52 sends to peripheral hardware by mobile device by the second steering order, processing unit reception operates according to the second steering order the data that obtain to peripheral hardware by mobile device and carries out data after treatment.

Preferably, display device also comprises that peripheral hardware list sets up unit and performance element,

Before control signal generation unit 51 generates the second steering order that peripheral hardware can identify, the peripheral hardware list of mobile device that unit sends for receiving mobile device is set up in peripheral hardware list, and the peripheral hardware list of setting up display device according to the peripheral hardware list of mobile device; Wherein, the peripheral hardware list of display device comprises the peripheral hardware of mobile device and the peripheral hardware of display device;

Before control signal generation unit 51 generates the second steering order that peripheral hardware can identify, the peripheral hardware of performance element for selecting according to user, shows the service that corresponding operation interface or running background are corresponding.

Embodiment 6

Mobile device in a kind of expanding peripherals system as shown in Figure 6 that the embodiment of the present invention provides, this mobile device comprises:

Receiving element 61, for receive from display device for controlling second steering order of peripheral hardware of mobile device, the wherein outer peripheral hardware of mobile device inside or the peripheral hardware of expansion or the compound peripheral hardware of being made as of mobile device;

Transmitting element 62, for the second steering order is sent to corresponding peripheral hardware, so that peripheral hardware operates according to the second steering order.

Preferably, transmitting element 62 also for:

Before the second steering order is sent to corresponding peripheral hardware by transmitting element 62, transmitting element 62 is also for send the peripheral hardware list of mobile device to display device, so that display device is set up the peripheral hardware list of display device according to the peripheral hardware list of mobile device;

Preferably, mobile device also comprises processing unit, and processing unit is used for:

After the second steering order is sent to corresponding peripheral hardware by transmitting element 62, processing unit operates the data retransmission obtaining to display device by the peripheral hardware of receiving according to the second steering order; Or

After the second steering order is sent to corresponding peripheral hardware by transmitting element 62, processing unit operates according to the second steering order the data that obtain by the peripheral hardware of receiving and processes, and data after treatment are sent to display device.

Those skilled in the art should understand, the application's embodiment can be provided as method, system or computer program.Therefore, the application can adopt complete hardware implementation example, completely implement software example or the form in conjunction with the embodiment of software and hardware aspect.And the application can adopt the form at one or more upper computer programs of implementing of computer-usable storage medium (including but not limited to magnetic disk memory, CD-ROM, optical memory etc.) that wherein include computer usable program code.

The application is with reference to describing according to process flow diagram and/or the block scheme of the method for the embodiment of the present application, equipment (system) and computer program.Should understand can be by the flow process in each flow process in computer program instructions realization flow figure and/or block scheme and/or square frame and process flow diagram and/or block scheme and/or the combination of square frame.Can provide these computer program instructions to the processor of multi-purpose computer, special purpose computer, Embedded Processor or other programmable data processing device to produce a machine, the instruction that makes to carry out by the processor of computing machine or other programmable data processing device produces the device for realizing the function of specifying at flow process of process flow diagram or multiple flow process and/or square frame of block scheme or multiple square frame.

These computer program instructions also can be stored in energy vectoring computer or the computer-readable memory of other programmable data processing device with ad hoc fashion work, the instruction that makes to be stored in this computer-readable memory produces the manufacture that comprises command device, and this command device is realized the function of specifying in flow process of process flow diagram or multiple flow process and/or square frame of block scheme or multiple square frame.

These computer program instructions also can be loaded in computing machine or other programmable data processing device, make to carry out sequence of operations step to produce computer implemented processing on computing machine or other programmable devices, thereby the instruction of carrying out is provided for realizing the step of the function of specifying in flow process of process flow diagram or multiple flow process and/or square frame of block scheme or multiple square frame on computing machine or other programmable devices.

Although described the application's preferred embodiment, once those skilled in the art obtain the basic creative concept of cicada, can make other change and amendment to these embodiment.So claims are intended to be interpreted as comprising preferred embodiment and fall into all changes and the amendment of the application's scope.

Obviously, those skilled in the art can carry out various changes and modification and not depart from the spirit and scope of the present invention the present invention.Like this, if these amendments of the present invention and within modification belongs to the scope of the claims in the present invention and equivalent technologies thereof, the present invention is also intended to comprise these changes and modification interior.

Claims

1. a method for expanding peripherals, is characterized in that, comprising:

Display device according to receive for controlling first steering order of peripheral hardware of mobile device, generate the second steering order that described peripheral hardware can be identified, the outer peripheral hardware of described mobile device inside or the peripheral hardware of expansion or the compound peripheral hardware of being made as of wherein said mobile device;

2. the method for claim 1, is characterized in that, described display device also comprises after described the second steering order being sent to described peripheral hardware by described mobile device:

3. the method for claim 1, is characterized in that, described display device according to receive for controlling first steering order of peripheral hardware of described mobile device, before generating the second steering order that peripheral hardware can identify, also comprise:

4. a method for expanding peripherals, is characterized in that, comprising:

5. method as claimed in claim 4, is characterized in that, described the second steering order is sent to corresponding peripheral hardware by described mobile device, so that before described peripheral hardware operates according to described the second steering order, also comprise:

6. method as claimed in claim 5, is characterized in that, described mobile device also comprises after described the second steering order is sent to corresponding peripheral hardware:

7. a system for expanding peripherals, is characterized in that, comprising:

8. the display device in expanding peripherals system, is characterized in that, comprising:

9. display device as claimed in claim 8, is characterized in that, described display device also comprises processing unit, and described processing unit is used for:

10. the mobile device in expanding peripherals system, is characterized in that, comprising: