CN107168666A - The system and method for USB interface-based audio video transmission and multi-screen mapping - Google Patents

The system and method for USB interface-based audio video transmission and multi-screen mapping Download PDF

Info

Publication number
CN107168666A
CN107168666A CN201710266045.7A CN201710266045A CN107168666A CN 107168666 A CN107168666 A CN 107168666A CN 201710266045 A CN201710266045 A CN 201710266045A CN 107168666 A CN107168666 A CN 107168666A
Authority
CN
China
Prior art keywords
usb
video
audio
equipment
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710266045.7A
Other languages
Chinese (zh)
Other versions
CN107168666B (en
Inventor
陈景雄
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201710266045.7A priority Critical patent/CN107168666B/en
Publication of CN107168666A publication Critical patent/CN107168666A/en
Application granted granted Critical
Publication of CN107168666B publication Critical patent/CN107168666B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/38Information transfer, e.g. on bus
    • G06F13/42Bus transfer protocol, e.g. handshake; Synchronisation

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses the system and method that USB interface-based audio video transmission and multi-screen map, with including from the system of mapping function:Possess USB interface and/or video reads the target end equipment of playing function, to the carrier as screen map, possesses the mapping device of USB Virtual File Systems, it is configured as being connected with the target end equipment by the USB interface of the Mass Storage agreements based on USB standard, the target end equipment obtains the data of dynamic generation by accessing the USB Virtual File Systems.System with receive capabilities includes:Source equipment, possess USB interface and/or video read the target end equipment of playing function, possess USB Virtual File Systems mapping device composition the system with reception/read functions.The system of the present invention overcomes and needs source equipment and target end equipment to be provided simultaneously with same protocol capability present in prior art or need to have the problem of HDMI could carry out screen map and limitation.

Description

The system and method for USB interface-based audio video transmission and multi-screen mapping
Technical field
It is more particularly to USB interface-based the present invention relates to data processing and automotive electronic technology and wireless communication field Audio video transmission and system, the method for multi-screen mapping are such as more using mobile phone, tablet personal computer, PC, TV, projecting apparatus, vehicle-mounted etc. Screen map technology on media termination.
Background technology
The technology of screen map is referred to the screen content shown by a terminal (hereinafter referred to as source equipment), is reflected It is mapped on another terminal (hereinafter referred to as target end equipment) screen.What interior shown by the screen in source equipment was perhaps played Audio, can synchronize display in target end equipment and isochronous audio is played.And specifically, source equipment be often referred to mobile phone, PC, tablet personal computer etc. mini-plant, target end equipment are often referred to vehicle mounted multimedia, TV, giant-screen PC, projecting apparatus, open air The equipment that advertisement screen etc. carries larger screen.
Screen map is divided into duplication screen (also referred to as with screen mapping) and extended screen (also referred to as split screen mapping) again.With screen Mapping refers to that the content that source equipment is shown is identical with the content that target end equipment is shown.Split screen mapping refers to destination end Equipment equivalent to source equipment another screen, so show the interface of some application program on source screen, and target The interface of another application program of the screen display source equipment of end equipment.Application program includes answering for common information displaying With program, also comprising audio/video player etc. application program.
The technology of current screen map, never ipsilateral classified description is as follows:
1) various general common VNC (Virtual Network Console, virtual network controls platform) technologies, specifically For be between the source device and destination end of phase internet intercommunication, to set up data cube computation, pass through various VNC communications protocol, will The information such as screen, sound and the touch-control of source equipment, are mapped in the equipment of destination end, and the equipment of destination end can see source The screen display of equipment, the sound of broadcast source end equipment, and application program touch-control of source equipment etc. can be manipulated.Typical generation Table is Windows Remote desk process, the PC screen operators of Android mobile phone etc..
2) it is used for vehicle-mounted or related television equipment screen map technology, such as, MirrorLinkTMStandard, MiracastTMTechnology, WIDITMTechnology, the Carplay of Apple Apple Inc.TM, the leading Google Auto of Google companiesTM Technology etc., the purpose of these technologies is all to pass through formulated codes and standards, mobile phone can be allowed with in-vehicle multi-media system or TV (abbreviation vehicle device) is interconnected, it is possible to realize the mobile phone and the double-direction control of vehicle device/TV to application specific software, mesh Mark is to make user in vehicle traveling process without the screen that sees the mobile phone, and touches mobile phone screen or operating handset button.Such as, MirrorLink standards combine a variety of prior arts and use situation to meet various possible in-cars, including are transported with virtual network Calculate (VNC) carry out picture show with user instruction input, through UPnP (Universal Plug and Play, UPnPTM) look for corresponding equipment and complete correct setting configuration, with bluetooth (BluetoothTM) and RTP (Real-Time Protocol, RTP) performs audio stream etc., MirrorLinkTMAlso it can support to be commonly used in the car at present Specification include the technologies such as bluetooth HFP and A2DP agreements.Miracast equipment provides to simplify and finds and set, and user can be rapid Video is transmitted in equipment room.Again such as, Miracast user can browse the photograph that smart mobile phone takes on large-size screen monitors TV heartily Piece, by conference room projectors Real-Time Sharing notebook screens, or watches on tablet personal computer the straight of home videos set top box Broadcast program.Miracast passes through Wi-Fi CERTIFIED Wi-Fi DirectTMConnection is formed, therefore any Wi- need not be accessed Fi networks --- possess linkage function inside Miracast authenticating devices.Again such as, WiDi (Intel Wireless Display) full name is WirelessHD technology, and it is the wireless connection that computer and display device are realized by WiFi signal. WiDi realization principle is that notebook sends wireless signal by wireless network card first, and then television has a wireless receiving Device receives WiFi signal, and radio receiver is transferred to signal on display device by HDMI or A/V cables.Again Such as, AirPlaytmIt is a kind of play-back technology of Apple Inc., can be by regarding on iPhone, iPod touch, iPad and Mac Frequency mirror image is sent to support AirplaytmEquipment (such as:Audio amplifier, Apple TV, vehicle device) middle broadcasting.
Again such as, Google AutoTMTechnology be Google companies release be mapped to vehicle device screen for Android mobile phone Scheme.
3) from the point of view of physics external expressive form, the terminal that built-in mapping receives agreement, and external HDMI can be divided into Dongle (also referred to as HDMI rods) mapping reception mode, wherein, built-in mapping receives the target terminal of agreement, before terminal is dispatched from the factory Through the built-in agreement of some above-mentioned screen map, the mapping request to receive the agreement.External HDMI Dongle are then Using the device of above-mentioned a certain agreement, by HDMI display interfaces, target terminal equipment is connected to, to obtain the energy of screen map Power.
Although the mapping needs for meeting various terminal equipment to a certain extent of above prior art.But various agreements are mutual Incompatible, usual target terminal can only receive the mapping request of some source terminal for planting mapped specific agreement.In addition, realizing this The scheme of kind needs a precondition:Target end equipment needs preset this agreement before dispatching from the factory.Some other agreements can't be propped up Audio transmission is held, can only be aided in by way of bluetooth, such as MirrorLink.Above the first two subject matter constrains screen The application of curtain mapping so that the target terminal equipment of most of giant-screen does not possess screen map ability.
As for external HDMI Dongle form, above-mentioned described target terminal is solved to a certain extent dispatching from the factory needs Want it is preset wirelessly map agreement the problem of.But another problem is brought, need target terminal to possess HDMI Ability.But most of existing terminal device, including vehicle device, TV, projection, outdoor advertising etc. do not possess HDMI interface. Therefore, mapping function can not be applied in these occasions.In addition, because HDMI itself does not possess enough power supply energy Power, in addition it is also necessary to which external power supply is powered, allows HDMI application to be restricted.
In the prior art, there are some methods solved, such as the A of patent announcement CN 104142806, vehicle carried mobile phone interconnection System, including intelligent mobile phone terminal and onboard system, the onboard system include:Microprocessor and with the microprocessor Power management module, audio-video collection module, audio frequency and video processing module, bluetooth module, WIFI module and the audio frequency and video of electrical connection Output module, the intelligent mobile phone terminal is connected by bluetooth module or WIFI module with onboard system wireless telecommunications, the sound Video Output Modules electrically connect vehicle headrest liquid crystal display.Intelligent mobile phone terminal and vehicle-mounted system are realized using wireless communication technique Wireless interaction control between system, undistorted, high definition can be synchronized to vehicle headrest by the content of multimedia in intelligent mobile phone terminal Played on liquid crystal display, visual effect can be effectively improved.But have the disadvantage that:The terminal belongs to the end of built-in shadowing agreement Mobile phone, and is attached by end by the way of USB is wired with vehicle-mounted, and is not suitable for the terminal that does not possess built-in shadowing agreement Application scenarios.Again such as, Chinese patent application CN201420476148.8, automobile entertainment audio-visual devices are mutually contacted with mobile phone System, including automobile entertainment audio-visual devices and smart mobile phone, the automobile entertainment audio-visual devices have general-purpose serial bus USB interface Receiving unit, the smart mobile phone has a transmitting element of the USB interface, the receiving unit of the USB interface and described The transmitting element of USB interface is connected by wired mode.The utility model not only realizes two-screen Interactive, can also give smart mobile phone Battery charges, and enhances the endurance of smart mobile phone.But have the disadvantage that:The terminal belongs to the terminal of built-in shadowing agreement, By the way of USB is wired by mobile phone and it is vehicle-mounted be attached, the same terminal for not being suitable for not possessing built-in shadowing agreement Application scenarios.Again such as, the U of patent announcement CN 205657799, a kind of wireless audio and video emitter of USB interface, institute Stating wireless audio and video emitter includes PC ends and dongle ends, and the PC ends are connected to dongle ends by USB interface.It is described PC ends include the video acquisition unit for gathering video information and the audio collection unit for gathering audio-frequency information, described to regard Frequency collecting unit includes capture mouse module, capture screen module, screen scaling processing module and video encoding module, described to regard Frequency collecting unit and audio collection unit are connected to USB interface.The dongle ends include central processing module, the centre Reason module is connected with WiFi module, key-press status detection monitoring modular and LED for launching video information and audio-frequency information Display module.But have the disadvantage that:The terminal belongs to source device terminal, and is gathered by the USB newly increased a Dongle The video and audio of source terminal, belong to and are connected to source dispensing device, but can not be received as the USB for being connected to target terminal Device, in addition this patent need to target end equipment related software will be installed in source equipment, it is pointed out that simultaneously It is not that each target end equipment possesses software installation ability.Patent publication No CN104539707A, vehicle device, mobile phone and PC ends Screen map method and system, vehicle device wirelessly transmits data and control with mobile phone, and vehicle device passes through nothing with server The mode of line transmits data and control, and server is connected with PC ends, but had the disadvantage that:Terminal with built-in shadowing agreement, And by the way of USB is wired by mobile phone and it is vehicle-mounted be attached, the same end for not being suitable for not possessing built-in shadowing agreement The application scenarios at end.
The content of the invention
The technical problem to be solved in the present invention is to provide one kind so that any possess USB interface and USB video playback capabilities Target end equipment possess screen map and broadcast source end equipment audio frequency and video ability USB interface-based audio video transmission and The system of multi-screen mapping, so as to overcome source equipment and target end equipment the need for presence to be in the prior art provided simultaneously with same association View ability or need to have HDMI could carry out screen map or need simultaneously two ends install software the problem of and Limitation.
Above-mentioned technical problem is solved, the invention provides the system that USB interface-based audio video transmission and multi-screen map, Including:
Possess USB interface and/or video reads the target end equipment of playing function, to the carrier as screen map,
Possess the mapping device of USB Virtual File Systems, be configured as by the Mass Storage associations based on USB standard The USB interface of view is connected with the target end equipment, and the target end equipment is obtained by accessing the USB Virtual File Systems The data of dynamic generation.
Present invention also offers the system that USB interface-based audio video transmission and multi-screen map, it is characterised in that bag Include:
Source equipment, to the device as screen map,
Possess USB interface and/or video reads the target end equipment of playing function, to the screen as the source equipment Curtain or the carrier of audio frequency and video mapping,
Possess the mapping device of USB Virtual File Systems, be configured as connecting by USB interface and the target end equipment Connect,
The target end equipment obtains the data of dynamic generation by accessing the USB Virtual File Systems.
Based on above-mentioned, the mapping device in the present invention is specifically included:One virtual USB disk file system module and a sound are regarded Frequency stream synthetic video file format coding module,
The virtual USB disk file system module, for producing a Virtual File System on USB interface,
The audio/video flow synthetic video file format coding module, for being carried for above-mentioned virtual USB disk file system module For the file content asked, when the virtual USB disk file system module accesses the content of file by USB, and by sound Video Composition is the related pattern data flow of Virtual File System, exports and gives virtual USB disk file system module.
Based on above-mentioned, the system in the present invention also includes:Video compressing module, audio compression module, audio/video coding mould Block, default file interface processing module,
The video compressing module, to be stored in audio/video coding module after video original data is compressed,
The audio compression module, to be stored in audio/video coding module after audio raw data is compressed,
The audio/video coding module, audio/video coding is synthesized into setting formatted data stream,
The audio/video coding module is connected with audio/video flow synthetic video file format coding module,
The default file interface processing module, to obtain file directory or data locally or remotely, and is completed Corresponding adaptation is operated.
Based on above-mentioned, the system in the present invention also includes:One touch signal transferring device, to by the target end equipment Touching signals the mapping device is sent to by touching signals forwarding interface, and source equipment is passed back to by mapping device On by call touch-controlling interface complete touch control operation.
Based on above-mentioned, the system in the present invention also includes:One remote control equipment, for the mapping device by bluetooth or Person WI-FI is connected, and carries out touching/the straighforward operation of button.
Further, a player media list is generated in the target end equipment, in each source equipment After registration on the player media list correspondence, produce supporting virtual file and corresponding document data.
Further, the source equipment is wirelessly transferred by WI-FI is connected with mapping device, the mapping device.
Walked the invention provides what USB interface-based audio video transmission and multi-screen mapped from mapping method, including as follows Suddenly:
S1 will be provided with USB interface and/or video and read the target end equipment of playing function as the carrier of screen map,
The mapping device that S2 will be provided with USB Virtual File Systems is configured to by the Mass Storage based on USB standard The USB interface of agreement is connected with the target end equipment, and the target end equipment is obtained by accessing the USB Virtual File Systems Take the data of dynamic generation.
The method that USB interface-based audio video transmission and multi-screen mapping are additionally provided in the present invention, comprises the following steps:
S1 is when mapping device is inserted into the USB interface of target end equipment by USB interface, and mapping device works on power, And wait other source devices to connect, while the USB interface in the mapping device simulates one based on Mass Storage agreements USB Virtual File Systems,
S2 starts an application program in the source equipment, and searches the connectable device of periphery adaptation, passes through the company of authentication Connect mapping device,
S3 is by after the source equipment and the mapping device successful connection, the USB virtual files in the mapping device System will generate corresponding Virtual File System catalogue and listed files structure according to source equipment,
File in the above-mentioned listed files structure of audio and video playing procedure selections of the S4 in target end equipment is played out
Beneficial effects of the present invention:
The substantial amounts of target end equipment based on USB player is caused using the present invention, possessed another source equipment Ability of the screen map in target end equipment, it is achieved thereby that the effect that target end equipment display capabilities are fully used, and Save discarded and transformation the sky high cost of equipment.
Brief description of the drawings
Fig. 1 is the system structure diagram of the present invention (from mapping);
Fig. 2 is the system structure diagram (receive capabilities) of the present invention;
Fig. 3 is the schematic diagram of the mapping device of the USB virtual files of itself mapping;
Fig. 4 is the schematic diagram of the mapping device with receive capabilities USB virtual files;
Fig. 5 is physico connection diagram;
Fig. 6 is a preferred embodiment schematic diagram of mapping device;
Fig. 7 is source apparatus logic schematic diagram;
Fig. 8 is reception device logic flow schematic diagram;
Fig. 9 is destination end apparatus logic and schematic flow sheet;
Figure 10 is player media list schematic diagram in target end equipment.
Embodiment
The principle of the disclosure is described referring now to some example embodiments.It is appreciated that these embodiments are merely for saying It is bright and help it will be understood by those skilled in the art that with the purpose of the embodiment disclosure and describe, rather than advise model of this disclosure Any limitation enclosed.Content of this disclosure described here can be implemented in the various modes outside mode described below.
As described herein, term " comprising " and its various variants are construed as open-ended term, it means that " bag Include but be not limited to ".Term "based" is construed as " being based at least partially on ".Term " one embodiment " it is understood that For " at least one embodiment ".Term " another embodiment " is construed as " at least one other embodiment ".
It refer to the system structure diagram (from map) that Fig. 1 is the present invention, USB interface-based audio video transmission and many Shield the system of mapping, including:Possess USB interface and/or video reads the target end equipment 300 of playing function, to be used as screen The carrier of curtain mapping, possesses the mapping device 200 of USB Virtual File Systems, is configured as by the Mass based on USB standard The USB interface of Storage agreements is connected with the target end equipment, and the target end equipment is virtually literary by accessing the USB Part system obtains the data of dynamic generation.Mapping device 200 in the present embodiment has been running for a set of operating system in itself (such as, Android operation system, in addition, mapping device in itself can be without screen display, can be with screen display), then mapping is filled The interface by USB Virtual File Systems is put, the operation system interface of mapping device in itself is mapped in target end equipment. In the case of there is no screen display, using the remote control (optional) described in the present embodiment, mobile phone or special distant is used Equipment is controlled to operate the operation system interface of mapping device in itself.In the present embodiment, mapping device 200 itself in fact It is also the effect as source equipment.
Refer to Fig. 2 be the present invention system structure diagram (receive capabilities), USB interface-based audio video transmission and The system of multi-screen mapping, including:Source equipment 100, to the device as screen map, possesses USB interface and/or video is read The target end equipment 300 of playing function is taken, the carrier mapped to the screen as the source equipment or audio frequency and video possesses The mapping device 200 of USB Virtual File Systems, is configured as being connected with the target end equipment by USB interface, the target End equipment obtains the data of dynamic generation by accessing the USB Virtual File Systems.Using the present embodiment methods described and dress Put, compared with prior art, achieve the progress that screen map is extended to general-purpose capability so that substantial amounts of only fixing function Target end equipment with giant-screen and USB player possesses the energy by the screen map of another source equipment in this equipment Power, has reached the effect that target end equipment display capabilities are fully used, and saves discarded and transformation the sky high cost of equipment, very To the ability for making these giant-screens possess smart machine.
As shown in fig. 6, system is divided into USB Virtual File Systems software subsystem and audio/video flow processing subsystem, wherein USB Virtual File System software subsystems include virtual USB disk file system module and audio/video flow synthetic video file format Coding module, wherein audio/video flow processing subsystem include video compressing module, audio compression module, audio/video coding module, Alternative document interface processing module.
Above-mentioned related system module composition is as follows:
Virtual USB disk file system module 2002, for producing a Virtual File System on USB interface.See outside Equipment be a USB flash disk equipment, may browse through catalogue and read file.
Audio/video flow synthetic video file format coding module 2001, for providing institute for virtual USB disk file system module The file content of request.When USB accesses the content of some file, the book of audio frequency and video is synthesized to the correlation of Virtual File System Formatted data stream, exports and gives virtual USB disk file system module.
Video compressing module, video original data is compressed, and is reduced transmitting data stream, is used for coding module.
Audio compression module, audio raw data is compressed, and reduces transmitting data stream.Used for coding module.
Audio/video coding module, by audio/video coding synthesize H.264 or MPEG4 etc. form data flow.
Alternative document (default) interface processing module:The catalogue and data of file system locally or remotely are obtained, and Make corresponding adaptation and operate.These data are used for virtual USB disk file system module (026).
Basic skills is described as follows:Display screen data stream is the data flow that shows the need for locally or remotely.Display On-screen data stream can be the data flow for the screen content or video playback being currently displaying.Audio stream is ibid.This A little data flows can be broadcast after video compress and audio compression carry out audiovisual compression, then by the generation of audio/video coding module The video flowing put, then audio/video flow synthetic video file format coding module by these file synthesis be U disk file system in File content, virtual USB disk file system management document directory structure and file read-write operations, please when accessing file content Audio/video flow synthetic video file format coding module is asked to obtain the content of file.
Purpose in the present embodiment is user is mapped to the small screen (or audio-video document) of source equipment 100 Screen shows and audio and video playing are carried out on the giant-screen of target end equipment 300.
Mapping device 200 in the present embodiment is a small-sized equipment, and target end equipment is inserted into by USB interface On 300 USB interface, target end equipment 300 need to possess USB flash disk reading capability and play the ability of USB flash disk audio frequency and video.Source equipment 100 with mapping device 200 by communicating, receive displaying information on screen that mapping device 200 sends source equipment 100 and Audio/video information, synthesizes the audio and video playing file of correlation, and with the USB interface of target end equipment 300, fictionalizing text Part system and audio/video multimedia played file, such target end equipment 300 just can be in the feelings changed without any software and hardware Under condition, the screen message of displaying source equipment 100 or the audio frequency and video of broadcast source end equipment 100.When be operated in itself mapping Situation, mapping device 200 also serves as source equipment 100 using there is provided the data shown needed for its own system screen and sound simultaneously Frequency according to etc..Specific to the implementation method from mapping, following steps are specifically included:
Step S1 will be provided with USB interface and/or video and read the target end equipment of playing function being used as the load of screen map Body,
The mapping device that step S2 will be provided with USB Virtual File Systems is configured to by the Mass based on USB standard The USB interface of Storage agreements is connected with the target end equipment, and the target end equipment is virtually literary by accessing the USB Part system obtains the data of dynamic generation.
From above-mentioned Fig. 1 or Fig. 2, by creating a void on the USB interface on existing device or newly added equipment Intend file system.This file system is not the real file system in the equipment, but the dependency structure in internal memory and Data.Method dynamic generation described by the data this patent of file.Target end equipment is by accessing the text of this virtual file Part, reaches the data for accessing these dynamic generations.Concrete application field is to pass through the data flow and audio stream of screen display Related step is converted into file stream, is conducted interviews for target end equipment by the file system of standard.
It is the schematic diagram of the mapping device with receive capabilities USB virtual files as shown in Figure 4, including:
Source equipment 100, refers to the equipment for needing to carry out screen map, is often referred to mobile phone, tablet personal computer, PC etc. small Type equipment.Needed in source equipment install the present embodiment in source software, using source equipment 100 itself WIFI or USB is communicated with reception device (200).Further, if source equipment 100 compatible can be reflected with the application Agreement is penetrated, can be identified by other shadowing agreement processing modules, then the source software system of this patent need not can also be installed System can also be attached with the mapping device 200 in the present embodiment, and complete the function of screen map and multimedia.
Target end equipment 300, is referred in the equipment that is mapped to the screen and audio frequency and video of source device, typically with larger Display screen.It is often referred to vehicle-mounted multimedia equipment, large-size screen monitors TV, PC computers, projector equipment, outdoor advertisement screen, industrial control equipment Screen etc..If without the passback of touch signal, without being made any change to target end equipment 300 in the present embodiment (including software and hardware), target end equipment 300 keeps original state.Further, if necessary to enter in target end equipment 300 Row touch-control etc. is operated, then can add touch signal transferring device 400.
Mapping device 200, mapping device 200 is attached using USB external interfaces with target end equipment 300, mapping dress It is virtually a USB flash disk (by the Mass Storage agreements of USB standard), target end equipment 300 that 200, which are put, by this USB interface Read according to the form of USB flash disk.The file of USB flash disk is then the video file of the pre-configured resolution ratio of correspondence.In mapping device 200 The reception device software systems in the equipment such as CPU and WIFI/USB and interface, the present embodiment are put by using WIFI or USB etc. Method, is received after the information such as screen/video/audio of source equipment 100, information is converted and synthesized above-mentioned meets USB The video file of Mass Storage protocol interfaces, the multimedia play system of such target end equipment itself just can be according to just Normal multimedia file carries out the broadcasting of audio frequency and video, and is shown on the display screen of destination end, so reach by.Further , if the simply mapping in terms of audio, it is converted into the audio file formats that target end equipment 300 can be recognized, so, mesh Mark end equipment 300 can carry out the transmission of audio by way of playing audio file.Such equipment can have two kinds of systems Implementation, that is, system (see Fig. 3) and conduct reception work(as the USB Virtual File System mapping devices itself mapped The system of the USB Virtual File System mapping devices of energy (see Fig. 4).Further, both systems can have one simultaneously In device, that is, it is provided simultaneously with itself mapping and receives the function of outside mapping.When the situation for being operated in itself mapping, mapping Device 200 also serves as source equipment 100 using there is provided the data shown needed for its own system screen and voice data etc. simultaneously.
As shown in figure 4, in the present embodiment, also being wrapped in the system of USB interface-based audio video transmission and multi-screen mapping Include:One touch signal transferring device 400, the touching signals of the target end equipment to be sent out by touching signals forwarding interface The mapping device is sent to, and is passed back to by mapping device in source equipment by calling touch-controlling interface to complete touch control operation. Touch signal transferring device as can screening device, in general, man-machine interactive operation can be completed in source equipment 100, because For the relation of screen map, destination end can show the result of man-machine interaction.Some situations, if necessary to directly be set in destination end Standby 300 carry out human-machine operation, then by transforming the touching signals that hardware platform is exported in target end equipment 300, are set with destination end Touch signal transferring device between standby 300 touch screen in access the present embodiment.Touch signal transferring device sets destination end Standby 300 touching signals are sent to mapping device 200 by touching signals forwarding interface, and are passed back to by mapping device 200 On source software, and call the operating system touch-controlling interface of source equipment to be called by source software (1011), complete touch-control Operation.Further, if there was only the touch-control on display screen, display screen without man-machine interaction by target end equipment 300 Screen, but needs touch controllable function again, then needs in target end equipment 300, newly increases a Touch Screen, and by touching signals Being connected to the touch signal transferring device of this patent can achieve the goal.
As shown in Fig. 4 or Fig. 3, in the present embodiment, system also includes:One remote control equipment, for the mapping device It is connected by bluetooth or WI-FI, touch/the straighforward operation of button.
The remote control equipment 500, is the optional equipment in the present embodiment.For the behaviour being remotely controlled with mapping device 200 Make.When the inconvenient touch sources end equipment 100 of user, it can be replaced during target end equipment 300 using remote control equipment 500.Especially If being the system in use, do not have simultaneously of the USB Virtual File System mapping devices mapped in mapping device 200 as itself There is the display device of correlation, when being also not desired to increase above-mentioned touch signal transferring device 400, then touch can be used as using this equipment The need for operation and button operation.Software system function on remote control equipment 500, can together with this source Integrated Simulation, The function of remote control equipment 500 is realized on a mobile phone or tablet personal computer.
Alternatively, the target terminal equipment 300 in the present embodiment is changed without any, it is only necessary to inserted in the present embodiment It is the purpose that can reach screen map and audio and video playing to receive mapping device 200.Because further, if user needs Also can be if synchronous touch control operation, it is necessary to the device of this touching signals be added, for forwarding target terminal in target terminal equipment The touch information of equipment.Further, if the key information of target terminal equipment 300 will also be fed back into source equipment In 100 operation.It is also that signal collection and forwarding are carried out by the present apparatus.Concrete implementation mode is, whole by intercepting target The hardware connection signal of main frame and touch-screen in end equipment, this device is transparent for the main frame and touch-screen of target terminal , because the present apparatus is intact to pass to main frame and touch-screen by signal before.Meanwhile, it will pass through after the decoding of signal The newly-increased touch signal transmission interface of this patent, this interface can be serial interface or USB interface, reciprocity to receive dress The touch signal receiving interface for putting 200 is corresponding and dock the transmission of laggard row information.By the touch-control of target end equipment (touch and The information of actuation of keys) pass back to source equipment and handled.
Alternatively, the remote control 500 in the present embodiment, the implementation of remote control can be with a variety of, such as using indigo plant The press key equipment of tooth, by the way that key information is passed into mapping device 200 with device 500, realizes button man-machine interaction.It can also lead to Cross and remote control end software is installed on mobile phone or tablet personal computer, by way of WIFI/ bluetooths, realize long-range man-machine interaction control System.
Deploy description by taking the system as the USB Virtual File System mapping devices of receive capabilities as an example below:
Generally speaking include for example following implementation:
Step S1 is when mapping device is inserted into the USB interface of target end equipment by USB interface, electrician on mapping device Make, and wait other source devices to connect, while the USB interface in the mapping device simulates one based on Mass Storage associations The USB Virtual File Systems of view,
Step S2 starts an application program in the source equipment, and searches the connectable device of periphery adaptation, passes through mirror Power connection mapping device,
Step S3 is by after the source equipment and the mapping device successful connection, and the USB in the mapping device is virtual File system will generate corresponding Virtual File System catalogue and listed files structure according to source equipment,
File in the above-mentioned listed files structure of audio and video playing procedure selections of the step S4 in target end equipment is carried out Play
Specifically,
The first step:When mapping device 200 is inserted into the USB interface of target end equipment 300 by USB interface, mapping dress Put 200 to work on power, and wait the connection of each source device.At the same time, mapping device 200 simulates one in USB interface Meet Mass Storage agreements (note:Mass Storage are the parts in usb protocol, are mass storage or sea Measure the meaning of memory.This protocol development and make that USB flash disk is utilized.This agreement is deferred to, USB Slave can be allowed Equipment (slave unit) is connected in USB Host equipment (main equipment), and is able to carry out the transmission (storage and read-write etc.) of file. General operating system is all integrated with the driving of this agreement, so when the storage device such as USB flash disk is inserted on PC/ target terminals, Just without install drive) U disk file system.Target end equipment 300 can connect as the mode reading USB flash disk to access USB File system on mouth.Further, if at this time also none of source equipment 100 is accessed, but destination end is set Standby 300 have been started up the multimedia file play operation of USB interface, and mapping device 200 can fictionalize the data of video, this number According to that can be one section of advertisement or the operation instruction introduction of one section of this patent etc., until active end equipment 100 is accessed, it will be switched to The screen map of the source equipment 100 or the broadcasting of audio frequency and video.
Second step:Source equipment 100 is started after source software, passes through WIFI P2P Discovey (the point-to-point hairs of WIFI Existing mechanism) to search the WIFI equipment that periphery is adapted to, pass through and authenticate connection mapping device 200.Further, mapping device 200 Upper equipment finds that to device management module related signal message to be connected can be sent, once the successful connection of source equipment 100 Afterwards, equipment is found and device management module has connected management and monitoring that equipment carries out state to these.
3rd step as shown in Figure 9:After source equipment 100 and the successful connection of mapping device 200, the void in mapping device 200 Corresponding Virtual File System catalogue and file will be generated according to the relevant information of source equipment 100 by intending U disk file system module List structure.So, in target end equipment 300, itself possess USB audio/video player, pass through the multimedia text of its own Part reads the catalogue and listed files of interface to read this Virtual File System etc..The manifestation mode of listed files such as Fig. 9 It is shown.Source equipment 100 can have it is multiple be registered on mapping device 200, often register a source equipment 100, just produce one The supporting virtual file and corresponding document of set.First source device is for example have registered, is had in list to that there should be access Device A, its lower second-level directory has the mapping video file of the screen resolution of correlation, e.g., SD format screen mapping (640* 480), its implication is:Screen or video in source equipment 100 is synthesized point of (640*480) by reception device (200) The video file of resolution, is played out in target end equipment 300 with (640*480).Other resolution ratio are similarly.Further, The video and audio of different coded formats can also be synthesized, to meet the audio/video encoding/decoding ability of target end equipment 300.Enter One step, source software can also be by the list of the access device A of source equipment 100 Voice & Videos possessed etc. file It is virtual in this document system, formed " catalogue of access device A media files ", have these listed files under catalogue.Destination end Audio/video player in equipment 300 can be played out.Further, source software can also be by source equipment 100 Alternative document, for example, document files etc. is mapped in the virtual USB disk described in this patent, target end equipment can be opened, repaiied Change, increase and delete etc. operation, effect is inserted into target end equipment 300 just as source equipment 100 is become into a USB flash disk Equivalent effect.
Further, source software can also be related from Network Capture by the network-connectivity of source equipment 100 Audio and video resources, formed multimedia list, can also can so be carried out in the audio/video player in target end equipment 300 The operation such as broadcasting.Further, these files are not limited to multimedia file, and alternative document Format Type can also use this Individual method.
4th step:Audio/video player of the user in target end equipment 300, have selected some text in above-mentioned list The playing process of part is as follows:
First map the video file playing process of (640*480) to describe source with SD format screen below as shown in Figure 10 Cooperating process between end equipment 100, mapping device 200 and target end equipment 300.
User clicks SD format screen mapping (640*480) file in destination end device plays device and played out, mesh The multimedia file marked in end equipment player meeting invocation target end equipment 300 reads interface, passes through the behaviour of target terminal equipment Make the USB Mass Storage agreements of system, access USB interface, and USB interface is connected with mapping device 200 in USB interface Connect, and pass through USB Mass Storage protocols.The corresponding correlation of the virtual USB disk file system module of mapping device 200 File content read requests, take out file content, response target end equipment 300 at video flowing synthetic video said shank module File request.
At the same time, source equipment 100 uses display data on the screen acquisition module, gets the screen of source equipment 100 Display data, while getting the audio played data of source equipment 100 by audio acquisition module, both are respectively through video Compression and audio compression module, enter audio/video coding module and carry out overall audio/video flow coding, audio/video flow Qos modules (note:Qos refers to transmission quality management) for the situation, source equipment 100 and target end equipment 300 according to WIFI wireless networks The quality of the specific encoding stream of capability negotiation, the problem of for solving frame losing and video flowing interim card.Above-mentioned video flowing is further passed through Cross this patent protocol data processing module and be packaged into corresponding packet, be transmitted from WIFI interface.Further, or Person can also carry out wired connection using USB interface, can improve the speed and stability of connection.But sacrificed using USB interface The mobility of source equipment 100.
Mapping device 200 in the present embodiment from by reception device hardware system, operating system and software systems, from WIFI interface receives video stream data produced by above-mentioned source equipment, according to related agreement, is handled.
Processing procedure of the video flowing in mapping device 200 is described below.Protocol data processing module passes through WIFI moulds The cooperation of block and WIFI interface is got after audio and video data streams, and unpacking module into agreement obtains audio/video flow packet, so The coding module of audio/video flow synthetic video file format, from the receiving queue of audio/video flow packet, gets data afterwards, and By the file data that Data Synthesis is virtual file, used when reading file content for virtual USB disk file system module.
Further, if source equipment 100 possesses other shadowing agreements beyond this patent, this patent is reflected by other Penetrate protocol process module to parse the audio, video data bag of the shadowing agreement, then encode synthesis module using video file format It is the file content form required by virtual USB disk file system by audio/video flow Data Synthesis, completes 300 pairs of target end equipment and regard The broadcasting read requests of frequency file content.
Further, if needing the demand of touch-control effect on the display screen of target end equipment 300, believed by touching Number receiving interface is received from the touch data come transmitted by touch signal transferring device 400, warp with touching signals transmission interface Touch-control coding/decoding module is crossed, returning module by touch-control passes back to the data of touch-control at source equipment 100 by WIFI interface, The source software of source equipment 100 is received after signal, carries out the operation of touch-control, and the operation of touch-control, which will react, currently to be mapped In the application program of screen.Operating result by the above-mentioned mapping method of this patent further be shown in target end equipment On 300.
It is and above-mentioned described the same as the situation of the system of the USB Virtual File System mapping devices itself mapped, it is logical " itself mapping " software subsystem is crossed to realize.Itself mapping software subsystem obtains the screen display number of equipment with source software As being according to the function with voice data, what is obtained naturally is that mapping device 200 is locally displayed and audio in the present embodiment Data, because these data are obtained in this patent mapping device 200, are needed not move through above as reception device System so needs the process by WIFI or USB transmission.But enter directly into audio/video flow synthetic video file format Coding module and virtual USB disk file system resume module.So related flow is in addition to above-mentioned difference, other are all identical Or it is similar, no longer it is discussed in detail.
This mapping device 200 is a hardware platform contained and the device or equipment of a whole set of software systems, such as Fig. 7 institutes Show.
The composition of hardware system in the present embodiment mainly includes following several main modulars:CPU central processing modules, it is interior Storing module, memory module, audio/video encoding/decoding module, WIFI hardware modules, USB hardware module, serial ports hardware module.
Wherein cpu central processing unit can use ARMTMThe CPU processor of core, it would however also be possible to employ MIPSTMFramework etc. Other processors are, it is necessary to which the substantially disposal ability met is:>300MHz instruction processing speed.It can be integrated with processor Audio/video encoding/decoding module, integrated processor IC can preferably solve a large amount of calculating of audio/video encoding/decoding, reach optimization meter Calculate and optimize the target of power consumption.Cpu central processing unit is arithmetic core and control core.Its function is mainly parsing and performed Data in instruction and processing computer software, and bus is provided for control data and state, and control input/output (I/O)。
Cpu central processing unit connects memory modules by memory interface and EBI, and memory module constitutes basic operation System.Reception device software systems are stored in memory module, will be read during operation in memory modules, and software is performed by instruction The flow of system.
Cpu central processing unit by peripheral bus connect WIFI hardware modules, USB hardware module serial ports hardware module, and These modules are operated according to corresponding agreement.
WIFI module is made up of WIFI antennas, WIFI BBPs, WIFI protocol processing units and external interface.With In standard defined in WIFI of realizing.Such as 802.11a/b/c/n.Suitable WIFI chips are can select, pass through the antenna of matching And radio frequency parameter, meet the transmission rate of standard defined in above-mentioned WIFI and being wirelessly transferred for WIFI can be achieved.Because this is specially The transmission for the audio frequency and video that profit is related to, so depending on transmission rate is according to the demand of resolution ratio, at least to reach 802.11b's 2Mbit/s speed.The external interface of WIFI module is typically entered using EBIs such as SDIO or USB with cpu central processing unit Row communicates to meet above-mentioned rate requirement.Current many WIFI modules are provided in an integrated fashion, are integrated with antenna and base Band and external interface etc..
USB hardware module needs to realize in USB Slave as defined in usb protocol (USB slave units) function, this sampling device Operating system and software systems can carry out USB interface the operation of Virtual File System.Further, if desired by source Equipment 100 carries out wired connection with this patent reception device, then USB hardware module needs to increase another USB hardware interface newly, And USB Host (USB main equipment) protocol function (also referred to as OTG, On-The-Go) is realized on this interface, for receiving source The USB wired connections request of end equipment 100.
Serial ports hardware module, for being attached and communicating with touching signals transferring device 400 by serial interface, simultaneously Also serve as the debugging interface of this patent reception device.
Further, CPU and total solution need to select the few scheme of power consumption, because this reception device is not extra Power supply power, the power supply capacity provided by USB interface.If USB interface use USB 2.0 interface power supply capacity for 500mA, if being 1A using the power supply capacity of the interfaces of USB 3.0.
As shown in figure 8, the software composition of mapping device 200 is divided into two large divisions, it is that the upper of reception device is run respectively Operating system and reception device software systems:
Operating system is mainly used in CPU scheduling and the management to above-mentioned hardware module, while also needing to include to WIFI The disposal ability of the upper layer application interface of the agreements such as agreement, usb protocol, serial port protocol.Can be using currently a popular embedded (SuSE) Linux OS or Wince etc. operating system, as long as above-mentioned purpose can be reached and can carry soft during this is specially applied The operating system of part system.
The software systems of mapping device 200 be provided based on above-mentioned hardware system and operating system bottom ability, A whole set of application program that interface capability etc. is realized, for realizing the concrete function described in this patent.
The software systems of mapping device 200 include following software module:
Equipment discovery and device management module,
Protocol data processing module,
Agreement unpacks module,
Audio frequency and video synthetic video file format coding module,
Audio/video flow Qos management modules,
Virtual USB disk file system module,
Other shadowing agreement processing modules,
Touch-control coding/decoding module,
Touch-control returns module.
As described above, because software systems are based on some operating system, software systems are in different operations System has different implementation methods, specifically needs interface and corresponding programming language and program according to defined in operating system Framework is realized.
Below by taking the implementation that Linux operates system as an example, illustrate implementing for above-mentioned software module.
Equipment is found and device management module:By calling the interface of WIFI module, achieve a butt joint into mapping device 200 Equipment state and connection be managed, and the notification communication protocol data processing module access device state (as access, Disconnect etc.).WIFI signal is sent by the timing of WIFI module interface in the pre-connection, source equipment 100 can be searched out and reflects Injection device 200, and manage the process of connection.It can be by calling the interface progress pair of WIFI PnP discovery features in Linux Outer broadcast.
Protocol data processing module upon establishment of a connection, carries out the transmission of data, source device end is to transmission Data carry out protocol packing, and the audio frequency and video number that reverse data unpacking process obtains correlation is carried out by communications protocol processing module According to.Communications protocol can be with a kind of self-defined encapsulation of agreement, as long as ensureing that the audio, video data transmitted by source equipment 100 is reached Protocol data processing module can be parsed normally, and take into account corresponding speed.As for specific communication association Discuss form, naturally it is also possible to use a kind of ripe communications protocol, such as RTSP, RTP, VNC, WiDi, Miracast ... etc.. (agreement needed for following touching signals and data is similarly no longer particularly pointed out).
Simultaneous communications protocol data processing module also returns touch-control the touch data progress communications protocol obtained by module Pack, and pass back to source module 100 and handled.
The audio frequency and video Qos management modules:For managing the transmission quality problem in whole transmitting procedure, if for example touched To the weak situation of WIFI signal, it is impossible to allow virtual USB disk file module to read to cause the broadcasting of target terminal equipment 300 less than data Device occur it is abnormal, audio frequency and video Qos management modules can be inserted according to the audio, video data received before simulation and forecast data come Realize.For example, inserting the data of the midway film frame of video to complete;Or lose received by WIFI module be not inconsistent it is qualified Picture frame data of formula etc..
The agreement unpacks module and audio/video flow synthetic video file format coding module:Pass through the conjunction of the two modules Make, the packet that above-mentioned communications protocol is obtained is unpacked again according to audio frequency and video form, and asked according to target end equipment Form carries out being re-encoded as allowing the file format content streams of destination end player plays.This content stream is stored in internal memory Caching in, for virtual USB disk file system module to this caching carry out Linear content reading.
The implementation method of the virtual USB disk file system module, registered in (SuSE) Linux OS file system and Corresponding virtual MTD external equipments (Memory Technology Device, be abbreviated as MTD), that is, be registered as RamFS (internal memories File system) form.File format can use FAT32, the general file system such as eXFAT at present, it is therefore an objective to allow target The file system that terminal device 300 can be recognized.So as to which the multimedia player system built in target terminal can normally be read The data flow of file is taken, is played out.By taking FAT32 as an example, externally provided using vfat file system management model.External The interface of file system meets Mass Storage USB external interface specifications.
In addition, touch-control coding/decoding module and touch-control passback module are optional modules, effect is to receive target terminal institute The touching signals of transformation, and source equipment 100 is transmitted to by protocol data processing module realizes operation.
During as the USB Virtual File System mapping devices itself mapped, screen and touch-control viewing hardware can be carried, Man-machine interaction can be realized by remote control 500 without screen.So mapping device 200 directly can be thought into source Equipment 100, directly passes through the acquisition on-screen data similar with source device systems and audio by the screen display of mapping device 200 The similar flow of data, the source equipment that mapping device 200 is changed into mapping.Without by WIFI/USB etc. it is wireless or Wired data transmission procedure.
Described source equipment 100 in the present embodiment contains polytype, such as mobile phone, tablet personal computer, PC etc. Form.The operating system that these source equipment 100 are used, is following several at present:Android (Android), Windows (Microsoft's Window), IOS (Apple Inc.'s operating system) and several classes of Linux, also have the operating system of higher level in the future.Jointly Point is that the source software that these equipment possess in the ability for installing software, the present embodiment is exactly to operate in these source equipment behaviour Make a whole set of software systems on system.
The implementation of this patent needs to carry out the exploitation and adaptation work of source software for the operating system of each type, It is set to possess each key modules shown in Fig. 7, these modules include:
Display data on the screen acquisition module:The display data on the screen of source equipment is obtained, the method implemented with Exemplified by Android, the FrameBuffer of screen is got using the figure bank interface of Android bottoms, can also be used The feasible modes such as android high-level interface EGL interfaces obtain on-screen data.
Audio acquisition module:The interface of source device operating system is called to obtain the voice data of source equipment.With Exemplified by Android, by the Router (route) of audio, the sound that Android application programs are played is routed to audio and obtained Modulus block, so as to obtain the data of audio.
Video compressing module and audio compression module and audio/video coding module:For why putting together, be because For generally we are using the audio frequency and video number that above-mentioned module is collected is handled using the audio/video coding of standard, these codings are assisted View contains compression and the coding to audio frequency and video.H.264 and MP4 it is typical to represent such as.By taking Android as an example, then use H.264 audio/video coding is carried out.
The Qos management modules of audio frequency and video:The screen that origin end equipment can be obtained with the interface capability of call operation system shows Show ability, such as resolution ratio, color depth key parameter obtain the coding/decoding capability of this source, than such as whether having what hardware was decoded Ability etc..Simultaneously by monitoring the state of WIFI communication passage, the ability of dynamic adjustment coding, to reach the purpose of smoothness. Belong to integrated dispatch adjusting module.Realization on Android, the WIFI Qos abilities that Android can be called to be provided are looked into The relevant interface of inquiry and Android capacity of equipment.
Protocol data processing module in the present embodiment:The related data of audio/video encoding/decoding module output, in communication Protocol data processing module, is carried out package, and data can be carried out data transmission by WIFI or USB.This part The implementation of module can use RTSP or RTP etc. protocol mode.If source terminal possesses known to a certain kind in itself Shadowing agreement (such as Miracast, WIDI etc.), we can also directly invoke the source device and have by way of calling Shadowing agreement, send the packet within away.
Touch-control decoder module and touch-control processing module:Be responsible for from this patent protocol data processing module obtain parse it is tactile Data are controlled, touch data is decoded, then by the relevant interface of touch-control processing module call operation system, reality is performed Touch-control it is actual, the purpose of Application Program Interface will be mapped in voltage input end equipment 100 by reaching.
It should be appreciated that each several part of the present invention can be realized with hardware, software, firmware or combinations thereof.Above-mentioned In embodiment, the software that multiple steps or method can in memory and by suitable instruction execution system be performed with storage Or firmware is realized.If, and in another embodiment, can be with well known in the art for example, realized with hardware Any one of row technology or their combination are realized:With the logic gates for realizing logic function to data-signal Discrete logic, the application specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene Programmable gate array (FPGA) etc..
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show The description of example " or " some examples " etc. means to combine specific features, structure, material or the spy that the embodiment or example are described Point is contained at least one embodiment of the present invention or example.In this manual, to the schematic representation of above-mentioned term not Necessarily refer to identical embodiment or example.Moreover, specific features, structure, material or the feature of description can be any One or more embodiments or example in combine in an appropriate manner.
In general, the various embodiments of the disclosure can be with hardware or special circuit, software, logic or its any combination Implement.Some aspects can be implemented with hardware, and some other aspect can be with firmware or software implementation, and the firmware or software can With by controller, microprocessor or other computing devices.Although the various aspects of the disclosure be shown and described as block diagram, Flow chart is represented using some other drawing, but it is understood that frame described herein, equipment, system, techniques or methods can With in a non limiting manner with hardware, software, firmware, special circuit or logic, common hardware or controller or other calculating Equipment or some of combination are implemented.
In addition, although operation is described with particular order, but this is understood not to require this generic operation with shown suitable Sequence is performed or performed with generic sequence, or requires that all shown operations are performed to realize expected result.In some feelings Under shape, multitask or parallel processing can be favourable.Similarly, although the details of some specific implementations is superincumbent to beg for By comprising but these are not necessarily to be construed as any limitation of scope of this disclosure, but the description of feature is only pin in To specific embodiment.Some features described in some embodiments of separation can also in combination be held in single embodiment OK.Mutually oppose, the various features described in single embodiment can also be implemented separately or to appoint in various embodiments The mode of what suitable sub-portfolio is implemented.

Claims (10)

1. USB interface-based audio video transmission and the system of multi-screen mapping, it is characterised in that including:
Possess USB interface and/or video reads the target end equipment of playing function, to the carrier as screen map,
Possess the mapping device of USB Virtual File Systems, be configured as by the MassStorage agreements based on USB standard USB interface is connected with the target end equipment, and the target end equipment obtains dynamic by accessing the USB Virtual File Systems The data of generation.
2. USB interface-based audio video transmission and the system of multi-screen mapping, it is characterised in that including:
Source equipment, to the device as screen map,
Possess the target end equipment that USB interface and/or video read playing function, to the screen as the source equipment or The carrier of audio frequency and video mapping,
Possess the mapping device of USB Virtual File Systems, be configured as being connected with the target end equipment by USB interface,
The target end equipment obtains the data of dynamic generation by accessing the USB Virtual File Systems.
3. system according to claim 1, it is characterised in that the mapping device is specifically included:One virtual USB disk file system Module of uniting and an audio/video flow synthetic video file format coding module,
The virtual USB disk file system module, for producing a Virtual File System on USB interface,
The audio/video flow synthetic video file format coding module, for providing institute for above-mentioned virtual USB disk file system module The file content of request, when the virtual USB disk file system module accesses the content of file by USB, and by audio frequency and video The related pattern data flow of Virtual File System is synthesized, exports and gives virtual USB disk file system module.
4. system according to claim 3, it is characterised in that also include:Video compressing module, audio compression module, sound Video encoding module, default file interface processing module,
The video compressing module, to be stored in audio/video coding module after video original data is compressed,
The audio compression module, to be stored in audio/video coding module after audio raw data is compressed,
The audio/video coding module, audio/video coding is synthesized into setting formatted data stream,
The audio/video coding module is connected with audio/video flow synthetic video file format coding module,
The default file interface processing module, to obtain file directory or data locally or remotely, and completes corresponding Adaptation or operation.
5. system according to claim 2, it is characterised in that also include:One touch signal transferring device, to by described in The touching signals of target end equipment are sent to the mapping device by touching signals forwarding interface, and are returned by mapping device By calling touch-controlling interface to complete touch control operation on to source equipment.
6. system according to claim 1, it is characterised in that also include:One remote control equipment, for the mapping device It is connected by bluetooth or WI-F I, touch/the straighforward operation of button.
7. system according to claim 2, it is characterised in that generate player media row in the target end equipment Table, to be corresponded to after each source facility registration on the player media list, produce supporting virtual text Part is pressed from both sides and corresponding document data.
8. system according to claim 2, it is characterised in that the source equipment is wirelessly transferred and mapped by WI-F I Device is connected, and the mapping device is connected by USB communication modes with the target end equipment.
9. USB interface-based audio video transmission and multi-screen mapping from mapping method, it is characterised in that comprise the following steps:
S1 will be provided with USB interface and/or video and read the target end equipment of playing function as the carrier of screen map,
The mapping device that S2 will be provided with USB Virtual File Systems is configured to by the Mass Storage agreements based on USB standard USB interface be connected with the target end equipment, the target end equipment obtains dynamic by accessing the USB Virtual File Systems The data of state generation.
10. USB interface-based audio video transmission and the method for multi-screen mapping, it is characterised in that comprise the following steps:
S1 is when mapping device is inserted into the USB interface of target end equipment by USB interface, and mapping device works on power, and waits Other source device connections are treated, while the USB interface in the mapping device simulates a USB based on Mass Storage agreements Virtual File System,
S2 starts an application program in the source equipment, and searches the connectable device of periphery adaptation, is reflected by authenticating connection Injection device,
S3 is by after the source equipment and the mapping device successful connection, the USB Virtual File Systems in the mapping device Corresponding Virtual File System catalogue and listed files structure will be generated according to source equipment,
File in the above-mentioned listed files structure of audio and video playing procedure selections of the S4 in target end equipment is played out.
CN201710266045.7A 2017-04-21 2017-04-21 System and method for audio and video transmission and multi-screen mapping based on USB interface Active CN107168666B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710266045.7A CN107168666B (en) 2017-04-21 2017-04-21 System and method for audio and video transmission and multi-screen mapping based on USB interface

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710266045.7A CN107168666B (en) 2017-04-21 2017-04-21 System and method for audio and video transmission and multi-screen mapping based on USB interface

Publications (2)

Publication Number Publication Date
CN107168666A true CN107168666A (en) 2017-09-15
CN107168666B CN107168666B (en) 2021-01-26

Family

ID=59813385

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710266045.7A Active CN107168666B (en) 2017-04-21 2017-04-21 System and method for audio and video transmission and multi-screen mapping based on USB interface

Country Status (1)

Country Link
CN (1) CN107168666B (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107506494A (en) * 2017-09-27 2017-12-22 广东欧珀移动通信有限公司 Document handling method, mobile terminal and computer-readable recording medium
CN108234673A (en) * 2018-02-14 2018-06-29 上海赫千电子科技有限公司 Vehicle-carrying distribution mapped system and mapping method
CN108710481A (en) * 2018-05-17 2018-10-26 深圳市柏尚科技有限公司 A kind of wired same screen systems of USB
CN109819201A (en) * 2019-03-08 2019-05-28 厦门亿联网络技术股份有限公司 A kind of meeting secondary flow data transmission method, display methods, conference system and peripheral equipment
CN110798644A (en) * 2019-10-30 2020-02-14 深圳市亿联智能有限公司 Wireless screen-casting conference system based on HDMI signal conversion
CN111787394A (en) * 2020-06-19 2020-10-16 深圳市点嘀互联网络有限公司 Method for mapping audio data of mobile phone to car machine through embedded equipment
CN112565609A (en) * 2020-12-08 2021-03-26 浙江合众新能源汽车有限公司 Image processing method and system based on vehicle-mounted machine system and vehicle-mounted robot
CN112672313A (en) * 2020-12-18 2021-04-16 北京百度网讯科技有限公司 Method, device, equipment and storage medium for transmitting data
CN115174537A (en) * 2022-06-30 2022-10-11 重庆长安汽车股份有限公司 Double-screen interaction method and system for vehicle-machine interaction
EP4202911A1 (en) 2021-12-24 2023-06-28 Magic Control Technology Corporation Interface extension device for screen sharing
CN117119615A (en) * 2023-10-25 2023-11-24 吉林藤兴科技有限公司 Screen throwing method for intelligent mobile terminal to control large screen in vehicle
CN117453171A (en) * 2023-12-23 2024-01-26 深圳市一恒科电子科技有限公司 Virtual mapping method and device for android system display and virtual mapping system
CN117453171B (en) * 2023-12-23 2024-10-25 深圳市一恒科电子科技有限公司 Virtual mapping method and device for android system display and virtual mapping system

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201066887Y (en) * 2007-08-01 2008-05-28 青岛海信电器股份有限公司 Wireless communication system and audio/video receiving device with wireless communication function
US8310656B2 (en) * 2006-09-28 2012-11-13 Sony Computer Entertainment America Llc Mapping movements of a hand-held controller to the two-dimensional image plane of a display screen
CN102917261A (en) * 2012-10-08 2013-02-06 清华大学 Storage equipment with streaming media supporting function
EP2648110A1 (en) * 2012-04-05 2013-10-09 BlackBerry Limited Method for sharing an internal storage of a portable electronic device on a host electronic device and an electronic device configured for same
CN103648021A (en) * 2013-12-24 2014-03-19 深圳国微技术有限公司 Method for playing network video files from USB storage device
CN204425453U (en) * 2014-08-22 2015-06-24 荣成华泰汽车有限公司 Automobile entertainment audio-visual devices and mobile phone interconnected systems
CN105045548A (en) * 2015-06-16 2015-11-11 广州视睿电子科技有限公司 Wireless screen transmission method, expansion equipment and wireless screen transmission system
CN106331733A (en) * 2016-09-28 2017-01-11 广东科学技术职业学院 Desktop cloud terminal's audio and video data real-time processing method and system

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8310656B2 (en) * 2006-09-28 2012-11-13 Sony Computer Entertainment America Llc Mapping movements of a hand-held controller to the two-dimensional image plane of a display screen
CN201066887Y (en) * 2007-08-01 2008-05-28 青岛海信电器股份有限公司 Wireless communication system and audio/video receiving device with wireless communication function
EP2648110A1 (en) * 2012-04-05 2013-10-09 BlackBerry Limited Method for sharing an internal storage of a portable electronic device on a host electronic device and an electronic device configured for same
CN102917261A (en) * 2012-10-08 2013-02-06 清华大学 Storage equipment with streaming media supporting function
CN103648021A (en) * 2013-12-24 2014-03-19 深圳国微技术有限公司 Method for playing network video files from USB storage device
CN204425453U (en) * 2014-08-22 2015-06-24 荣成华泰汽车有限公司 Automobile entertainment audio-visual devices and mobile phone interconnected systems
CN105045548A (en) * 2015-06-16 2015-11-11 广州视睿电子科技有限公司 Wireless screen transmission method, expansion equipment and wireless screen transmission system
CN106331733A (en) * 2016-09-28 2017-01-11 广东科学技术职业学院 Desktop cloud terminal's audio and video data real-time processing method and system

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107506494B (en) * 2017-09-27 2019-04-12 Oppo广东移动通信有限公司 Document handling method, mobile terminal and computer readable storage medium
CN107506494A (en) * 2017-09-27 2017-12-22 广东欧珀移动通信有限公司 Document handling method, mobile terminal and computer-readable recording medium
CN108234673A (en) * 2018-02-14 2018-06-29 上海赫千电子科技有限公司 Vehicle-carrying distribution mapped system and mapping method
CN108710481A (en) * 2018-05-17 2018-10-26 深圳市柏尚科技有限公司 A kind of wired same screen systems of USB
CN109819201A (en) * 2019-03-08 2019-05-28 厦门亿联网络技术股份有限公司 A kind of meeting secondary flow data transmission method, display methods, conference system and peripheral equipment
CN110798644A (en) * 2019-10-30 2020-02-14 深圳市亿联智能有限公司 Wireless screen-casting conference system based on HDMI signal conversion
CN111787394A (en) * 2020-06-19 2020-10-16 深圳市点嘀互联网络有限公司 Method for mapping audio data of mobile phone to car machine through embedded equipment
CN112565609B (en) * 2020-12-08 2022-08-12 浙江合众新能源汽车有限公司 Image processing method and system based on vehicle-mounted machine system and vehicle-mounted robot
CN112565609A (en) * 2020-12-08 2021-03-26 浙江合众新能源汽车有限公司 Image processing method and system based on vehicle-mounted machine system and vehicle-mounted robot
CN112672313A (en) * 2020-12-18 2021-04-16 北京百度网讯科技有限公司 Method, device, equipment and storage medium for transmitting data
CN112672313B (en) * 2020-12-18 2023-04-25 阿波罗智联(北京)科技有限公司 Method, apparatus, device and storage medium for transmitting data
EP4202911A1 (en) 2021-12-24 2023-06-28 Magic Control Technology Corporation Interface extension device for screen sharing
TWI811916B (en) * 2021-12-24 2023-08-11 茂傑國際股份有限公司 Interface extension device for screen sharing
CN115174537A (en) * 2022-06-30 2022-10-11 重庆长安汽车股份有限公司 Double-screen interaction method and system for vehicle-machine interaction
CN115174537B (en) * 2022-06-30 2023-07-21 重庆长安汽车股份有限公司 Double-screen interaction method and system for vehicle-computer interaction
CN117119615A (en) * 2023-10-25 2023-11-24 吉林藤兴科技有限公司 Screen throwing method for intelligent mobile terminal to control large screen in vehicle
CN117453171A (en) * 2023-12-23 2024-01-26 深圳市一恒科电子科技有限公司 Virtual mapping method and device for android system display and virtual mapping system
CN117453171B (en) * 2023-12-23 2024-10-25 深圳市一恒科电子科技有限公司 Virtual mapping method and device for android system display and virtual mapping system

Also Published As

Publication number Publication date
CN107168666B (en) 2021-01-26

Similar Documents

Publication Publication Date Title
CN107168666A (en) The system and method for USB interface-based audio video transmission and multi-screen mapping
WO2021109487A1 (en) Control method for audio data stream output and display device
KR102183413B1 (en) Method and system for presenting content using a plurality of electronic devices
US9288534B2 (en) Systems and methods for operating media devices
US20100060572A1 (en) Display device for interfacing with a handheld computer device that dynamically generates a different user environment for the display device
JP2023503679A (en) MULTI-WINDOW DISPLAY METHOD, ELECTRONIC DEVICE AND SYSTEM
CN101755299A (en) Mobile wireless display for accessing data from a host and method for controlling
CN106385621A (en) Intelligent device control method and device
TW200917758A (en) Operation of media interface to provide bidirectional communications
CN103841182A (en) Wireless hotspot device sharing video image
CN112383803B (en) Information processing method and related device
CN103516882B (en) A kind of based on multi-screen interaction scene picture playing method and system
CN203164829U (en) Wireless high definition transmission screen intelligent all-in-one machine
CN104202461A (en) Connected smart phone function synchronizing automotive sound system
CN105025349B (en) The throwing screen of encryption
CN103281580A (en) Television set remote control method for separating user interface and system thereof
CN109819201A (en) A kind of meeting secondary flow data transmission method, display methods, conference system and peripheral equipment
US20160381084A1 (en) Delivery of non-multimedia content via a standardized network architecture
CN103516994A (en) Multi-screen adapter camera configuration method, multi-screen adapter and multi-screen interaction system
WO2018133571A1 (en) Distributed pc system based on mobile intelligent terminal
CN103813122A (en) Image device control system, image device serial connection equipment and image device control method
CN102147566A (en) Multimedia projector with embedded operation system
CN104094603A (en) Systems and methods for integrated metadata insertion in a video encoding system
CN113225838A (en) Microphone control method, audio receiving equipment and audio collecting equipment
CN103391475B (en) Display device and intelligent apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant