CN105827484A - Synchronous test image display method and system - Google Patents
Synchronous test image display method and system Download PDFInfo
- Publication number
- CN105827484A CN105827484A CN201610309727.7A CN201610309727A CN105827484A CN 105827484 A CN105827484 A CN 105827484A CN 201610309727 A CN201610309727 A CN 201610309727A CN 105827484 A CN105827484 A CN 105827484A
- Authority
- CN
- China
- Prior art keywords
- video data
- mobile terminal
- server
- test
- picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/04—Processing captured monitoring data, e.g. for logfile generation
- H04L43/045—Processing captured monitoring data, e.g. for logfile generation for graphical visualisation of monitoring data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/04—Processing captured monitoring data, e.g. for logfile generation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/762—Media network packet handling at the source
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/764—Media network packet handling at the destination
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/765—Media network packet handling intermediate
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a synchronous test image display method and system, wherein the synchronous test image display method is applicable to execution in the synchronous test image display system. The synchronous test image display system comprises multiple mobile terminals, a server and a computing device. The method comprises that mobile terminals record images in a current test process, thus obtaining first video data; the first video data is coded, thus forming second video data; the second video is packaged, thus obtaining third video data; the third video data is uploaded to the server; the server obtains the name parameters of the mobile terminals from the uploaded third video data; the server generates multiple corresponding URL addresses according to the name parameters, wherein the URL addresses correspond to the third video data of the mobile terminals; the computing device accesses the URL addresses in multiple web pages; and the corresponding third video data is decoded and played, thus synchronously displaying the test images of the mobile terminals.
Description
Technical field
The present invention relates to field of mobile terminals, particularly to a kind of test pictures synchronous display method and system.
Background technology
Along with the development of development of Mobile Internet technology, making of the mobile terminal such as smart mobile phone, panel computer
With more and more universal, its attainable function increases the most therewith, various and life, social and leisure joy
The application that pleasure etc. are relevant can be installed on mobile terminals.User to the performance requirement of mobile terminal also by
Gradually promote, then it is tested and also become more and more important.
But, during mobile terminal is tested, often involve the need for checking many simultaneously
The situation of individual running of mobile terminal situation.Now, carrying out due to mobile terminal self as charging measurement,
The test of the types such as automatization's stability test, can cannot use mobile terminal, or cannot real time inspection
The scene of the test case of multiple mobile terminals, the most directly can only be observed each by tester
The state of running of mobile terminal, it is difficult to the effect state of an overall operation is provided, also brings manpower
Waste and the consumption of time.
Summary of the invention
To this end, the present invention provides the scheme of a kind of test pictures simultaneous display, with try hard to solve or at least
Alleviate the problem existed above.
According to an aspect of the present invention, it is provided that a kind of test pictures synchronous display method, be suitable in test
Performing in picture synchronization display system, this test pictures synchronous display system includes multiple mobile terminal, clothes
Business device and the equipment of calculating, the method includes: each mobile terminal carries out record screen to the picture of current test process,
Obtain the first video data；First coding video data is processed, forms the second video data；Will
The 3rd video data obtained after second video data encapsulation uploads onto the server；Server obtains uploads the
The name parameter of each mobile terminal of three video datas；According to name parameter, server generates the most
Individual URL address, URL address corresponds respectively to the 3rd video data of each mobile terminal；Calculating equipment leads to
Crossing and access each URL address in multiple webpages respectively, decoding plays the 3rd corresponding video data to synchronize
Show the test pictures of each mobile terminal.
Alternatively, in the test pictures synchronous display method according to the present invention, the first video data is entered
Row coded treatment, forms the second video data and includes: the first video data takes frame process formation figure
Sheet；Picture is carried out converting video coding, forms the second video data of the first preset format.
Alternatively, in the test pictures synchronous display method according to the present invention, the first video data is entered
Row takes frame process formation picture and includes: obtain the frame per second of the first video data；Take out first according to frame per second to regard
Frequency is according to each two field picture comprised；The each two field picture taken out compression is saved as the picture of the second preset format.
Alternatively, in the test pictures synchronous display method according to the present invention, the first preset format includes
H.264 form.
Alternatively, in the test pictures synchronous display method according to the present invention, the second preset format includes
JPG form.
Alternatively, in the test pictures synchronous display method according to the present invention, by the second video data envelope
Before the 3rd video data obtained after dress uploads onto the server, including: obtain the solution of the second video data
Code information header；Decoded information head and the second video data are packaged, obtain the of the 3rd preset format
Three video datas.
Alternatively, in the test pictures synchronous display method according to the present invention, the 3rd preset format includes
FLV form.
Alternatively, in the test pictures synchronous display method according to the present invention, the equipment that calculates is by many
Accessing each URL address in individual webpage respectively, it is each with simultaneous display that the 3rd corresponding video data is play in decoding
The test pictures of mobile terminal includes: accesses each URL address in multiple webpages respectively and sends to server
Video data is asked；Receive threeth video data corresponding with URL address that server issues；Call solution
3rd video data is decoded playing the test pictures with each mobile terminal of simultaneous display by code plug-in unit.
Alternatively, in the test pictures synchronous display method according to the present invention, each mobile terminal is to currently
The picture of test process carries out record screen, before obtaining the first video data, including performing automatic test foot
This starts test.
According to a further aspect of the invention, it is provided that a kind of test pictures synchronous display system, including multiple
Mobile terminal, server and calculating equipment, wherein, be populated with video process apparatus in mobile terminal, bag
Include: record panel module, be suitable to each mobile terminal and the picture of current test process is carried out record screen, obtain first
Video data；Coding module, is suitable to process the first coding video data, forms the second video counts
According to；Upper transmission module, is suitable to the 3rd video data obtained after the second video data encapsulation is uploaded to service
Device；Server is populated with URL generating means, including acquisition module, is suitable to acquisition and uploads the 3rd and regard
The name parameter of each mobile terminal of frequency evidence；Generation module, is suitable to according to name parameter, generates corresponding
Multiple URL addresses, URL address corresponds respectively to the 3rd video data of each mobile terminal；Calculating sets
Being populated with web page browsing device in Bei, web page browsing device is suitable to by accessing respectively in multiple webpages each
URL address, the 3rd corresponding video data test pictures with each mobile terminal of simultaneous display is play in decoding.
Alternatively, in the test pictures synchronous display system according to the present invention, coding module includes: take
Frame processing unit, is suitable to that the first video data takes frame process and forms picture；Video encoding unit,
Be suitable to picture is carried out converting video coding, form the second video data of the first preset format.
Alternatively, in the test pictures synchronous display system according to the present invention, take frame processing unit and enter one
Step is suitable to: obtain the frame per second of the first video data；Each frame that the first video data comprises is taken out according to frame per second
Image；The each two field picture taken out compression is saved as the picture of the second preset format.
Alternatively, in the test pictures synchronous display system according to the present invention, the first preset format includes
H.264 form.
Alternatively, in the test pictures synchronous display system according to the present invention, the second preset format includes
JPG form.
Alternatively, in the test pictures synchronous display system according to the present invention, video process apparatus also wraps
Including package module, package module includes: the first acquiring unit, is suitable to obtain the decoding of the second video data
Information header；Video encapsulation unit, is suitable to be packaged decoded information head and the second video data, obtains
3rd video data of the 3rd preset format.
Alternatively, in the test pictures synchronous display system according to the present invention, the 3rd preset format includes
FLV form.
Alternatively, in the test pictures synchronous display system according to the present invention, web page browsing device includes:
Request module, is suitable to send video counts to server by accessing each URL address in multiple webpages respectively
According to request；Receiver module, is suitable to receive threeth video data corresponding with URL address that server issues；
Display module, is suitable to call decoding plug-in and is decoded the 3rd video data playing and respectively moves with simultaneous display
The test pictures of dynamic terminal.
Alternatively, in the test pictures synchronous display system according to the present invention, the most resident in mobile terminal
Having test device, including script execution module, script execution module is suitable to performing automatic test script
Start test.
The technical scheme of the test pictures simultaneous display according to the present invention, first current to each mobile terminal
The picture of test process carry out record screen, obtain video data, it is encoded, encapsulate after be uploaded to clothes
Business device, server generates the most multiple according to the name parameter of each mobile terminal of uploaded videos data
URL address, calculating equipment accesses each URL address in multiple webpages respectively, and corresponding regarding is play in decoding
The test pictures of each mobile terminal of frequency simultaneous display according to this.In technique scheme, to each mobile terminal
Test pictures record screen after video data carry out a series of process, finally upload onto the server, by
PC directly accesses in multiple webpages of browser the corresponding with each mobile terminal of server generation
URL address, can on webpage the test pictures situation of this mobile terminal of real time inspection.On the one hand avoid
Check because the reason of test itself cannot use mobile terminal to carry out screen content, on the other hand also realize
Can the test case of real time inspection multiple mobile terminal, it is possible to obtain the effect of an overall operation of test
Really state, has saved manpower and time.
Accompanying drawing explanation
In order to realize above-mentioned and relevant purpose, describe some herein in conjunction with explained below and accompanying drawing and say
Bright property aspect, these aspects indicate can be to put into practice the various modes of principles disclosed herein, and institute
Aspect and equivalence aspect thereof is had to be intended to fall under in the range of theme required for protection.Read by combining accompanying drawing
Reading detailed description below, above-mentioned and other purpose, feature and the advantage of the disclosure will become brighter
Aobvious.Throughout the disclosure, identical reference generally refers to identical parts or element.
Fig. 1 shows showing of test pictures synchronous display system 100 according to an embodiment of the invention
It is intended to；
Fig. 2 shows the structured flowchart of mobile terminal 200 according to an embodiment of the invention；
Fig. 3 shows the schematic diagram of video process apparatus 300 according to an embodiment of the invention；
Fig. 4 shows the application interface signal of video process apparatus 300 according to an embodiment of the invention
Figure；
Fig. 5 shows the schematic diagram of server 500 according to an embodiment of the invention；
Fig. 6 shows the structured flowchart calculating equipment 600 according to an embodiment of the invention；
Fig. 7 shows the schematic diagram of web page browsing device 700 according to an embodiment of the invention；
Fig. 8 shows that the test pictures of web page browsing device 700 according to an embodiment of the invention synchronizes
Display schematic diagram；And
Fig. 9 shows the flow process of test pictures synchronous display method 900 according to an embodiment of the invention
Figure.
Detailed description of the invention
It is more fully described the exemplary embodiment of the disclosure below with reference to accompanying drawings.Although accompanying drawing shows
The exemplary embodiment of the disclosure, it being understood, however, that may be realized in various forms the disclosure and not
Should be limited by embodiments set forth here.On the contrary, it is provided that these embodiments are able to more thoroughly
Understand the disclosure, and complete for the scope of the present disclosure can be conveyed to those skilled in the art.
Fig. 1 shows the signal of test pictures synchronous display system 100 according to an embodiment of the invention
Figure.As it is shown in figure 1, test pictures synchronous display system 100 includes two mobile terminals, it is respectively
Mobile terminal 200 and mobile terminal 400, may each be smart mobile phone, panel computer etc., but be not limited to this,
The quantity of mobile terminal is also not necessarily limited to two.This system 100 also includes a server 500 and one
Calculating equipment 600.Server 500 is streaming media server, and server 500 is RTMP in the present embodiment
Server, calculating equipment 600 is PC.Hereinafter will illustrate as a example by mobile terminal 200.Specifically
For, the video data obtained after the picture record screen to current test process is compiled by mobile terminal 200
Code, uploading onto the server 500 after encapsulation process, server 500 then comes according to the video data received
Generate and upload source, i.e. the URL address of mobile terminal 200 correspondence with it, finally calculate equipment 600 and lead to
Cross above-mentioned URL address and carry out the access of server 500, in order to carry out on a webpage in a browser
The current test pictures of mobile terminal 200 browses.And meanwhile, said process occurs moving too
Dynamic terminal 400, server 500 and calculate on equipment 600, then calculate in the browser of equipment 600 another
The current test pictures that can move terminal 400 on individual webpage browses, thus in the difference of browser
Webpage achieves the simultaneous display of the test pictures of multiple mobile terminal.Synchronized aobvious by this test pictures
Show system 100, not only avoid and look into because the reason of test itself cannot use mobile terminal to carry out screen content
Seeing, also achieving can the test case of the multiple mobile terminal of real time inspection, it is possible to one that obtains test whole
The effect state of running body, has saved manpower and time.
Fig. 2 shows the structured flowchart of mobile terminal 200 according to an embodiment of the invention.Mobile whole
End 200 can include memory interface 202, one or more data processor, image processor and/or
CPU 204, and peripheral interface 206.
Memory interface 202, one or more processor 204 and/or peripheral interface 206 both can be point
Vertical element, it is also possible to be integrated in one or more integrated circuit.In mobile terminal 200, various units
Part can be coupled by one or more communication bus or holding wire.Sensor, equipment and subsystem can
To be coupled to peripheral interface 206, in order to help to realize several functions.
Such as, outside motion sensor 210, light sensor 212 and range sensor 214 are alternatively coupled to
Enclose interface 206, facilitating orientation, illuminate and the function such as range finding.Other sensors 216 are equally with outward
Enclose interface 206 to be connected, such as alignment system (such as GPS), temperature sensor, bioassay
Sensor or other sensor devices, thus can help to implement relevant function.
Camera sub-system 220 and optical pickocff 222 may be used for convenient such as recording photograph and video and cut
The realization of the camera function collected, wherein said camera sub-system and optical pickocff can be such as electric charge couplings
Clutch part (CCD) or complementary metal oxide semiconductors (CMOS) (centimetre OS) optical pickocff.Can be by one
Or multiple radio communication subsystem 224 helps to realize communication function, wherein radio communication subsystem is permissible
Including radio-frequency transmitter and transmitter and/or light (the most infrared) Receiver And Transmitter.Radio communication subsystem
It is one or more that the particular design of system 224 and embodiment can depend on that mobile terminal 200 is supported
Communication network.Such as, mobile terminal 200 can include being designed to supporting LTE, 3G, GSM network,
GPRS network, EDGE network, Wi-Fi or WiMax network and BlueboothTMThe communication of network
Subsystem 224.
Audio subsystem 226 can be coupled with speaker 228 and mike 230, in order to helps real
Execute the function enabling voice, such as speech recognition, speech reproduction, digital record and telephony feature.I/O
System 240 can include touch screen controller 242 and/or other input controllers 244 one or more.
Touch screen controller 242 is alternatively coupled to touch screen 246.For example, this touch screen 246 and touch screen
Controller 242 can use any one of multiple touch-sensing technology to detect the contact carried out therewith
With mobile or time-out, wherein detection technology is including, but not limited to capacitive character, resistive, infrared and table
Face technology of acoustic wave.Other input controllers 244 one or more are alternatively coupled to other input/control devicess
248, the most one or more buttons, rocker switch, thumb wheel, infrared port, USB port and
/ or the pointer device of instruction pen etc.The one or more button (not shown) can include for controlling
Speaker 228 and/or the up/down button of mike 230 volume.
Memory interface 202 can be coupled with memorizer 250.This memorizer 250 can include at a high speed
Random access memory and/or nonvolatile memory, the most one or more disk storage equipment, one
Or multiple optical storage apparatus, and/or flash memories (such as NAND, NOR).Memorizer 250 can
To store the operation system of operating system 272, such as Android, iOS or Windows Phone etc
System.This operating system 272 can include depending on hardware for processing basic system services and execution
The instruction of task.Memorizer 250 can also store application 274.When mobile device is run, can be from storage
Device 250 loads operating system 272, and is performed by processor 104.Application 274 operationally, also
Can load from memorizer 250, and be performed by processor 204.Application 274 operate in operating system it
On, the interface utilizing operating system and bottom hardware to provide realizes the desired function of various user, as i.e.
Shi Tongxin, web page browsing, pictures management etc..Application 274 can be independently of what operating system provided,
Can also be that operating system carries.During it addition, application 274 is installed in mobile terminal 100, also
Can add to operating system and drive module.In above-mentioned various application 274, a kind of application therein is
Video process apparatus 300 according to the present invention.
Fig. 3 shows the schematic diagram of video process apparatus 300 according to an embodiment of the invention.This dress
Put and include: record panel module 310, coding module 320 and upper transmission module 340.This device also includes Encapsulation Moulds
Block 330 (not shown), package module 330 is between coding module 320 and upper transmission module 330.
Record panel module 310 is suitable to each mobile terminal and the picture of current test process carries out record screen, obtains the
One video data.In the present embodiment, in the types of applications 274 of mobile terminal 200, one is also included
Application is the test device (not shown in Fig. 2) according to the present invention, including script execution module, this foot
This execution module is adapted for carrying out automatic test script and starts test.Fig. 4 shows according to the present invention one
The application interface schematic diagram of the video process apparatus 300 of embodiment.As shown in Figure 4, tester clicks on
During " BEGIN " button, real time video collection starts, and record panel module 310 is to presenting in current screen
Test pictures is recorded.By calling adb order, the test process of mobile terminal is carried out record screen,
This adb order is represented by adb shell screenrecord/sdcard/demo.mp4, Qi Zhong
Corresponding parameter setting can be carried out, such as record screen duration, resolution sizes etc. after screenrecord.To above-mentioned
The situation of default parameter, acquiescence recording time is 180 seconds, and the form of the first video data is MP4, name
It is referred to as demo, and is saved under the root of sd card.
Coding module 320 is suitable to process the first coding video data, forms the second video data,
Including taking frame processing unit 322 and video encoding unit 323 (in figure the most not shown).Wherein, take at frame
Reason unit 322 is suitable to take the first video data frame process and forms picture, is further adapted for obtaining the
The frame per second of one video data；Each two field picture that the first video data comprises is taken out according to frame per second；By take out
The compression of each two field picture saves as the picture of the second preset format.Frame per second is for measuring measuring of display frame number,
Weigh with display frame number per second (Frames per Second).The frame per second of the first video data is record screen time shift
The real time screen display frame rate of dynamic terminal, in the present embodiment, frame per second is 60fps.When recording according to acquiescence
Between 180 seconds, then the first video data includes 10800 frames, by these picture frames take out after, by opening
Source images processes storehouse OpenCV and is compressed respectively it processing, and the second preset format is JPG form,
Then finally obtain the picture of 10800 frame JPG forms.After video encoding unit 323 is suitable to taking frame process
The picture obtained carries out converting video coding, forms the second video data of the first preset format.In this reality
Executing in example, the first preset format is H.264 form, utilizes VideoEncoderThread thread dispatching
Tripartite's code database such as FFmpeg realizes converting video coding, thus obtains the second video of H.264 form
Data, and the second video data is transferred in data buffer storage queue DataBufferQueue.
Package module 330 includes the first acquiring unit 331 and video encapsulation unit 332 (the most not shown in figure),
Wherein the first acquiring unit 331 is suitable to obtain the decoded information head of the second video data, video encapsulation unit
332 are suitable to be packaged decoded information head and the second video data, obtain the 3rd of the 3rd preset format and regard
Frequency evidence, after i.e. utilizing RtmpThread thread to take out the second video data from DataBufferQueue,
Utilizing decoded information head to be encapsulated as RTMP Packet, finally giving the 3rd preset format is FLV lattice
3rd video data of formula.
Upper transmission module 340 is suitable to the 3rd video data obtained after the second video data encapsulation is uploaded to clothes
Business device 500.Server 500 is RTMP server, according to the requirement of RTMP agreement, by packaged
The 3rd video data of FLV form upload to RTMP server 500 by RTMP agreement.
Fig. 5 shows the schematic diagram of server 500 according to an embodiment of the invention.As it is shown in figure 5,
Being populated with URL generating means 510 in server, it includes acquisition module 511 and generation module 512.
Wherein, acquisition module 511 is suitable to obtain the name parameter of each mobile terminal uploading the 3rd video data,
Generation module 512 is suitable to according to above-mentioned name parameter, generates corresponding multiple URL address, URL address
Correspond respectively to the 3rd video data of each mobile terminal.In the present embodiment, mobile terminal 200 is logical
Crossing GET mode and ask and send data to server 500, the IP address of current server is
192.168.40.30, name parameter test=" test machine 1 " that now acquisition module 511 receives, according to
This name parameter, it is judged that be the picture data of mobile terminal 200.Generation module 512 then will clothes
Business device address and above-mentioned name parameter combine, and generate the URL address of mobile terminal 200 correspondence, i.e.
For 192.168.40.30/？Test=test machine 1.Mobile terminal 200 in above-mentioned picture synchronization system 100,
Server 500 and calculating equipment 600 are all in Intranet, directly can carry out server visit with IP address
Ask.And when picture synchronization system 100 is in the case of outer net, it is necessary to server ip address is bound
Domain name, then by domain name access, or uses VPN to access Intranet, then inputs IP address and conduct interviews.
Fig. 6 shows the structured flowchart calculating equipment 600 according to an embodiment of the invention.Substantially
Configuration 602 in, calculating equipment 600 typically comprise system storage 606 and one or more at
Reason device 604.Memory bus 608 may be used for leading between processor 604 and system storage 606
Letter.
Depend on that desired configuration, processor 604 can be any kind of process, include but not limited to:
Microprocessor ((μ P), microcontroller (μ C), digital information processor (DSP) or they appoint
What combination.Processor 604 can include such as on-chip cache 610 and second level cache 612 it
The cache of one or more rank of class, processor core 614 and depositor 616.The place of example
Reason device core 614 can include arithmetic and logical unit (ALU), floating-point unit (FPU), numeral letter
Number process core (DSP core) or their any combination.The Memory Controller 618 of example can
To be used together with processor 604, or in some implementations, Memory Controller 618 can be place
One interior section of reason device 604.
Depend on that desired configuration, system storage 606 can be any type of memorizeies, including but
It is not limited to: volatile memory (such as RAM), nonvolatile memory (such as ROM, flash memory
Deng) or their any combination.System storage 606 can include operating system 620, one or
Multiple application 622 and routine data 624.In some embodiments, application 622 may be arranged to
Routine data 624 is utilized to operate in operating system.
Calculating equipment 600 can also include contributing to from various interface equipments (such as, outut device 642,
Peripheral Interface 644 and communication equipment 646) arrive basic configuration 602 via bus/interface controller 630
The interface bus 640 of communication.The outut device 642 of example includes Graphics Processing Unit 648 and Audio Processing
Unit 650.They can be configured to contribute to via one or more A/V port 652 with such as
The various external equipments of display or speaker etc communicate.Example Peripheral Interface 644 can wrap
Include serial interface controller 654 and parallel interface controller 656, they can be configured to contribute to via
(such as, keyboard, mouse, pen, voice are defeated for one or more I/O port 658 and such as input equipment
Enter equipment, touch input device) or other peripheral hardwares (such as printer, scanner etc.) etc outside
Portion's equipment communicates.The communication equipment 646 of example can include network controller 660, and it can be by cloth
It is set to be easy to via one or more COM1 664 and one or more other calculating equipment 662
By the communication of network communication link.
Network communication link can be an example of communication media.Communication media generally can be presented as
Computer-readable instruction in the modulated data signal of such as carrier wave or other transmission mechanisms etc, data
Structure, program module, and any information delivery media can be included." modulated data signal " can be so
Signal, the change of one or more or it in its data set can encode information in the signal
Mode carry out.As nonrestrictive example, communication media can include such as cable network or specially
The wire medium of gauze network etc, and such as sound, radio frequency (RF), microwave, infrared (IR) or
Other wireless medium of person is at interior various wireless mediums.Term computer-readable medium used herein is permissible
Including both storage medium and communication media.
Calculating equipment 600 can be implemented as a part for small size portable (or mobile) electronic equipment,
These electronic equipments can be such as cell phone, personal digital assistant (PDA), individual media broadcasting
Device equipment, wireless network browsing apparatus, individual helmet, application specific equipment or can include
The mixing apparatus of any of the above function.Calculating equipment 600 is also implemented as including desktop computer and pen
Remember the personal computer of this allocation of computer.Application 622 includes the web page browsing device 700 according to the present invention.
In the present embodiment, calculating equipment 600 is PC, and web page browsing device 700 therein can be considered
Conventional browser client.Fig. 7 shows web page browsing device 700 according to an embodiment of the invention
Schematic diagram, this device includes request module 710, receiver module 720 and display module 730.Wherein,
Request module 710 is suitable to send video to server by accessing each URL address in multiple webpages respectively
Request of data.For mobile terminal 200, request module 710 accesses URL address in a webpage
192.168.40.30/？Test=test machine 1 sends video data request to server 500.Receiver module 720
Be suitable to receive threeth video data corresponding with URL address that server issues, i.e. receive server 500
Issue with URL address 192.168.40.30/？3rd video data of test=test machine 1 correspondence.Display
Module 730 is suitable to call decoding plug-in and is decoded the 3rd video data playing with each movement of simultaneous display
The test pictures of terminal, can be considered the web interface display window in browser.Fig. 8 shows according to this
The test pictures simultaneous display schematic diagram of the web page browsing device 700 of one embodiment of invention.By clear
Look at and device accesses the URL address that server 500 generates, i.e. 192.168.40.30/？Test=test machine 1,
And carry out link server 500 is sent request.The request that server 500 receives browser is laggard
Row response, carries out dissection process to this URL address suffix part, uses RTMP agreement from H264Reader
Obtain corresponding video data and issue, and firstly the need of transmission before sending video data
The AVC sequence header comprising important coding information is to play end and being decoded playing.PC
Above-mentioned video data to be decoded is called Flash plug-in unit and is decoded playing by the browser on machine, thus
Show on webpage in the current screen of the mobile terminal 200 corresponding with name parameter test=" test machine 1 "
Test process picture, it is achieved that test pictures simultaneous display.Exemplary codes is as follows:
In the present embodiment, for mobile terminal 400, its name parameter test=" test machine 2 ",
When the URL address of input is 192.168.40.30/？During test=test machine 2, current web page shows right with it
Test process picture in the current screen of the mobile terminal 400 answered, i.e. achieves and divides in multiple webpages
Do not input corresponding URL address and i.e. can play the test pictures of corresponding mobile terminal.To stop above-mentioned survey
Examination picture synchronization shows, then click on " END " button in the application interface of video process apparatus 300, real
Time video acquisition terminate, record panel module 310 quit work.
Fig. 9 shows the flow chart of picture synchronization display packing 900 according to an embodiment of the invention.
As it is shown in figure 9, method 900 starts from step S910.Before step S910, also include performing automatization
Test script starts test.In step S910, the most each mobile terminal picture to current test process
Carry out record screen, obtain the first video data, i.e. come shifting by calling adb shell screenrecord order
The test process of dynamic terminal carries out record screen, it is thus achieved that the first video data that current test pictures is corresponding.
Subsequently, enter step S920, the first coding video data is processed, forms the second video counts
According to.First, obtain the frame per second of the first video data, and take out what the first video data comprised according to frame per second
Each two field picture, the more each two field picture taken out compression is saved as the picture of the second preset format；Secondly, right
Above-mentioned picture carries out converting video coding, forms the second video data of the first preset format.Wherein,
One preset format includes that H.264 form, the second preset format include JPG form.In the present embodiment,
Frame per second is 60fps, and recording time is 180 seconds, then the first video data includes 10800 frames, by these
After picture frame takes out, it is compressed respectively processing to it by the image procossing storehouse OpenCV that increases income, obtains
The picture of 10800 frame JPG forms.Finally call third party's code database such as FFmpeg to realize converting video
Coding, thus obtain the second video data of H.264 form.
Before step S930, obtain the decoded information head of the second video data, and by this decoded information head
It is packaged with the second video data, obtains the 3rd video data of the 3rd preset format.Wherein, the 3rd
Preset format includes FLV form.In step S830, the will obtained after the second video data encapsulation
Three video datas upload onto the server.In the present embodiment, according to the requirement of RTMP agreement, will encapsulation
3rd video data of good FLV form uploads to RTMP server 500 by RTMP agreement.
In step S940, server obtains the name parameter of each mobile terminal uploading the 3rd video data.
In the present embodiment, name parameter test=" test machine 1 " of mobile terminal 200, mobile terminal 300
Name parameter test=" test machine 2 ".In step S950, according to name parameter, server generates
Corresponding multiple URL address, URL address corresponds respectively to the 3rd video data of each mobile terminal.Clothes
Business device 500 address is 192.168.40.30, itself and above-mentioned name parameter is combined, and generates mobile whole
Hold the URL address of 200 correspondences, be 192.168.40.30/？Test=test machine 1.Generate mobile terminal
The URL address of 300 correspondences, is 192.168.40.30/？Test=test machine 2.
Finally, in step S960, calculating equipment is by accessing each URL ground respectively in multiple webpages
Location, the 3rd corresponding video data test pictures with each mobile terminal of simultaneous display is play in decoding.At this
In embodiment, in multiple webpages, first input each URL address respectively send video counts to server 500
According to request, i.e. access URL address 192.168.40.30/？Test=test machine 1 and 192.168.40.30/？Test=
Test machine 2, and receive threeth video data corresponding with URL address that server 500 issues respectively,
Call decoding plug-in such as Flash plug-in unit to be decoded the 3rd video data playing, thus in different web pages
The current test pictures of middle simultaneous display mobile terminal 200 and 400.
About concrete steps and the embodiment of test pictures simultaneous display, in description based on Fig. 1～8
Detailed disclosure, here is omitted.
The technical scheme of the test pictures simultaneous display according to the present invention, the most each mobile terminal is surveyed current
The picture of examination process carry out record screen, obtain video data, it is encoded, encapsulate after be uploaded to service
Device, server generates corresponding multiple URL according to the name parameter of each mobile terminal of uploaded videos data
Address, calculating equipment accesses each URL address in multiple webpages respectively can each mobile terminal of simultaneous display
Test pictures.In technique scheme, on the one hand avoid because the reason of test itself cannot use shifting
On the other hand dynamic terminal carries out screen content and checks, also achieving can the survey of the multiple mobile terminal of real time inspection
Examination situation, it is possible to obtain the effect state of an overall operation of test, saved manpower and time.
B11. the system as described in B10, wherein said coding module includes:
Take frame processing unit, be suitable to that described first video data is taken frame process and form picture；
Video encoding unit, is suitable to described picture is carried out converting video coding, forms the first preset format
The second video data.
B12. the system as described in B11, the wherein said frame processing unit that takes is further adapted for:
Obtain the frame per second of described first video data；
Each two field picture that the first video data comprises is taken out according to described frame per second；
The each two field picture taken out compression is saved as the picture of the second preset format.
B13. the system as described in B11, wherein said first preset format includes H.264 form.
B14. the system as described in B12, wherein said second preset format includes JPG form.
B15. the system as described in B10, wherein said video process apparatus also includes package module, described
Package module includes:
First acquiring unit, is suitable to obtain the decoded information head of the second video data；
Video encapsulation unit, is suitable to be packaged described decoded information head and the second video data, obtains
3rd video data of the 3rd preset format.
B16. the system as described in B15, wherein said 3rd preset format includes FLV form.
B17. the system as described in B10, wherein said web page browsing device includes:
Request module, is suitable to send to server and regard by accessing each URL address in multiple webpages respectively
Frequently request of data；
Receiver module, is suitable to receive threeth video data corresponding with described URL address that server issues；
Display module, is suitable to call decoding plug-in and is decoded described 3rd video data playing to synchronize
Show the test pictures of each mobile terminal.
B18. the system as according to any one of B10-17, is wherein also populated with test dress in mobile terminal
Putting, including script execution module, described script execution module is suitable to start at execution automatic test script
Test.
In description mentioned herein, illustrate a large amount of detail.It is to be appreciated, however, that this
Bright embodiment can be put into practice in the case of not having these details.In some instances, not
It is shown specifically known method, structure and technology, in order to do not obscure the understanding of this description.
Similarly, it will be appreciated that in order to simplify the disclosure help to understand in each inventive aspect one or
Multiple, above in the description of the exemplary embodiment of the present invention, each feature of the present invention sometimes by
It is grouped into together in single embodiment, figure or descriptions thereof.But, should be by the disclosure
Method is construed to reflect an intention that i.e. the present invention for required protection requires that ratio is in each claim
The feature more features being expressly recited.More precisely, as the following claims reflect that
Sample, inventive aspect is all features less than single embodiment disclosed above.Therefore, it then follows concrete
Claims of embodiment are thus expressly incorporated in this detailed description of the invention, the most each claim
Itself is all as the independent embodiment of the present invention.
Those skilled in the art are to be understood that module or the list of the equipment in example disclosed herein
Unit or assembly can be arranged in equipment as depicted in this embodiment, or alternatively can position
In the one or more equipment different from the equipment in this example.Module in aforementioned exemplary can combine
It is a module or is segmented into multiple submodule in addition.
Those skilled in the art are appreciated that and can carry out the module in the equipment in embodiment certainly
Change adaptively and they are arranged in one or more equipment different from this embodiment.Permissible
Module in embodiment or unit or assembly are combined into a module or unit or assembly, and in addition may be used
To put them into multiple submodule or subelement or sub-component.Except such feature and/or process or
Outside at least some in unit excludes each other, can use any combination that (this specification is included companion
With claim, summary and accompanying drawing) disclosed in all features and so disclosed any method or
All processes of person's equipment or unit are combined.Unless expressly stated otherwise, this specification (includes companion
With claim, summary and accompanying drawing) disclosed in each feature can by provide identical, equivalent or phase
Replace like the alternative features of purpose.
Although additionally, it will be appreciated by those of skill in the art that embodiments more described herein include other
Some feature included in embodiment rather than further feature, but the combination of the feature of different embodiment
Mean to be within the scope of the present invention and formed different embodiments.Such as, in following right
In claim, one of arbitrarily can mode using in any combination of embodiment required for protection.
Additionally, some in described embodiment be described as at this can by the processor of computer system or
The method implemented by other device performing described function or the combination of method element.Therefore, have for
The processor of the necessary instruction implementing described method or method element is formed for implementing the method or method unit
The device of element.Additionally, the element described herein of device embodiment is the example of following device: this device
For implementing by the function performed by the element of the purpose in order to implement this invention.
As used in this, unless specifically stated so, use ordinal number " first ", " second ", " the
Three " etc. describe plain objects and be merely representative of the different instances relating to similar object, and be not intended dark
Show the object being so described must have the time upper, spatially, sequence aspect or with arbitrarily other side
Formula to definite sequence.
Although the embodiment according to limited quantity describes the present invention, but benefits from above description, this
In technical field it is clear for the skilled person that in the scope of the present invention thus described, it can be envisaged that other
Embodiment.Additionally, it should be noted that the language used in this specification is primarily to readable and teaching
Purpose and select rather than select to explain or limit subject of the present invention.Therefore,
In the case of without departing from the scope of the appended claims and spirit, for the common skill of the art
For art personnel, many modifications and changes will be apparent from.For the scope of the present invention, to the present invention
The disclosure done is illustrative and not restrictive, and the scope of the present invention is limited by appended claims
Fixed.
Claims (10)
1. a test pictures synchronous display method, is suitable to perform in test pictures synchronous display system,
This test pictures synchronous display system includes multiple mobile terminal, server and calculating equipment, described method
Including:
Each mobile terminal carries out record screen to the picture of current test process, obtains the first video data；
Described first coding video data is processed, forms the second video data；
The 3rd video data obtained after described second video data encapsulation is uploaded onto the server；
Server obtains the name parameter of each mobile terminal uploading described 3rd video data；
According to described name parameter, server generates corresponding multiple URL addresses, described URL address
Correspond respectively to the 3rd video data of each mobile terminal；
Calculating equipment is by accessing each URL address respectively in multiple webpages, and corresponding the 3rd is play in decoding
Video data is with the test pictures of each mobile terminal of simultaneous display.
2. the method for claim 1, wherein processes described first coding video data,
Form the second video data to include:
Described first video data is taken frame process and forms picture；
Described picture is carried out converting video coding, forms the second video data of the first preset format.
3. method as claimed in claim 2, wherein takes frame and processes shape described first video data
Picture is become to include:
Obtain the frame per second of described first video data；
Each two field picture that the first video data comprises is taken out according to described frame per second；
The each two field picture taken out compression is saved as the picture of the second preset format.
4. method as claimed in claim 2, wherein said first preset format includes H.264 form.
5. method as claimed in claim 3, wherein said second preset format includes JPG form.
6. the method for claim 1, the wherein will obtained after described second video data encapsulation
Before three video datas upload onto the server, including:
Obtain the decoded information head of the second video data；
Described decoded information head and the second video data are packaged, obtain the 3rd of the 3rd preset format the
Video data.
7. method as claimed in claim 6, wherein said 3rd preset format includes FLV form.
8. the method for claim 1, the equipment that wherein calculates is by accessing respectively in multiple webpages
Each URL address, the 3rd corresponding video data test picture with each mobile terminal of simultaneous display is play in decoding
Face includes:
In multiple webpages, access each URL address respectively send video data request to server；
Receive threeth video data corresponding with described URL address that server issues；
Call decoding plug-in to be decoded described 3rd video data playing with each mobile terminal of simultaneous display
Test pictures.
9. the method as described in any one of claim 1-8, the most each mobile terminal is to current test process
Picture carry out record screen, before obtaining the first video data, including perform automatic test script start survey
Examination.
10. a test pictures synchronous display system, including multiple mobile terminals, server and calculating equipment,
Wherein,
Mobile terminal is populated with video process apparatus, including:
Record panel module, is suitable to each mobile terminal and the picture of current test process carries out record screen, obtain first
Video data；
Coding module, is suitable to process described first coding video data, forms the second video data；
Upper transmission module, is suitable to be uploaded to the 3rd video data obtained after described second video data encapsulation
Server；
Server is populated with URL generating means, including:
Acquisition module, is suitable to obtain the name parameter of each mobile terminal uploading described 3rd video data；
Generation module, is suitable to according to described name parameter, generates corresponding multiple URL address, described
URL address corresponds respectively to the 3rd video data of each mobile terminal；
Being populated with web page browsing device in calculating equipment, described web page browsing device is suitable to by multiple nets
Accessing each URL address in Ye respectively, decoding plays the 3rd corresponding video data with each movement of simultaneous display
The test pictures of terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610309727.7A CN105827484B (en) | 2016-05-11 | 2016-05-11 | A kind of test pictures synchronous display method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610309727.7A CN105827484B (en) | 2016-05-11 | 2016-05-11 | A kind of test pictures synchronous display method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105827484A true CN105827484A (en) | 2016-08-03 |
| CN105827484B CN105827484B (en) | 2019-10-11 |
Family
ID=56528655
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610309727.7A Active CN105827484B (en) | 2016-05-11 | 2016-05-11 | A kind of test pictures synchronous display method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105827484B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106488161A (en) * | 2016-10-19 | 2017-03-08 | 网易（杭州）网络有限公司 | Electronic equipment screen video data obtains system, method and apparatus |
| CN107704379A (en) * | 2017-06-23 | 2018-02-16 | 上海斐讯数据通信技术有限公司 | A kind of video recording system and application method suitable for automatic test course |
| CN108307021A (en) * | 2018-01-18 | 2018-07-20 | 中国工商银行股份有限公司 | Mobile terminal parallel to follow test equipment, cloud prototype and method |
| CN110008107A (en) * | 2018-01-04 | 2019-07-12 | 北京奇虎科技有限公司 | Test method, device and the computer readable storage medium of application |
| CN110602430A (en) * | 2019-09-16 | 2019-12-20 | 咪咕文化科技有限公司 | Video synchronization method, terminal, color ring platform, system and readable storage medium |
| CN111225222A (en) * | 2018-11-26 | 2020-06-02 | 北京奇虎科技有限公司 | Video stream playing method, device and system based on screen data of RTMP (real time Messaging protocol) |
| CN111225275A (en) * | 2018-11-26 | 2020-06-02 | 北京奇虎科技有限公司 | Screen display method, device and system based on video stream |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101076135A (en) * | 2007-06-09 | 2007-11-21 | 腾讯科技（深圳）有限公司 | Method for recording and replaying multimedium and processing system |
| WO2010148845A1 (en) * | 2009-06-24 | 2010-12-29 | 中兴通讯股份有限公司 | Method and system for sharing audio and video |
| CN102325182A (en) * | 2011-09-09 | 2012-01-18 | 重庆抛物线信息技术有限责任公司 | Audio-video sharing method and system |
| CN102438259A (en) * | 2011-09-09 | 2012-05-02 | 华南农业大学 | Interference-free type remote usability testing system for mobile phone and testing method thereof |
| CN104967904A (en) * | 2014-04-10 | 2015-10-07 | 腾讯科技（深圳）有限公司 | Method for recording and playing back terminal video and apparatus thereof |
-
2016
- 2016-05-11 CN CN201610309727.7A patent/CN105827484B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101076135A (en) * | 2007-06-09 | 2007-11-21 | 腾讯科技（深圳）有限公司 | Method for recording and replaying multimedium and processing system |
| WO2010148845A1 (en) * | 2009-06-24 | 2010-12-29 | 中兴通讯股份有限公司 | Method and system for sharing audio and video |
| CN102325182A (en) * | 2011-09-09 | 2012-01-18 | 重庆抛物线信息技术有限责任公司 | Audio-video sharing method and system |
| CN102438259A (en) * | 2011-09-09 | 2012-05-02 | 华南农业大学 | Interference-free type remote usability testing system for mobile phone and testing method thereof |
| CN104967904A (en) * | 2014-04-10 | 2015-10-07 | 腾讯科技（深圳）有限公司 | Method for recording and playing back terminal video and apparatus thereof |
Non-Patent Citations (1)
| Title |
|---|
| 王卫: ""针对某无线对讲系统中继器的自动测试系统设计与实现"", 《中国优秀硕士学位论文全文数据库（信息科技辑）》 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106488161A (en) * | 2016-10-19 | 2017-03-08 | 网易（杭州）网络有限公司 | Electronic equipment screen video data obtains system, method and apparatus |
| CN107704379A (en) * | 2017-06-23 | 2018-02-16 | 上海斐讯数据通信技术有限公司 | A kind of video recording system and application method suitable for automatic test course |
| CN110008107A (en) * | 2018-01-04 | 2019-07-12 | 北京奇虎科技有限公司 | Test method, device and the computer readable storage medium of application |
| CN108307021A (en) * | 2018-01-18 | 2018-07-20 | 中国工商银行股份有限公司 | Mobile terminal parallel to follow test equipment, cloud prototype and method |
| CN111225222A (en) * | 2018-11-26 | 2020-06-02 | 北京奇虎科技有限公司 | Video stream playing method, device and system based on screen data of RTMP (real time Messaging protocol) |
| CN111225275A (en) * | 2018-11-26 | 2020-06-02 | 北京奇虎科技有限公司 | Screen display method, device and system based on video stream |
| CN110602430A (en) * | 2019-09-16 | 2019-12-20 | 咪咕文化科技有限公司 | Video synchronization method, terminal, color ring platform, system and readable storage medium |
| CN110602430B (en) * | 2019-09-16 | 2021-08-06 | 咪咕文化科技有限公司 | Video synchronization method, terminal, color ring platform, system and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105827484B (en) | 2019-10-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105827484A (en) | Synchronous test image display method and system | |
| TWI674790B (en) | Method of picture data encoding and decoding and apparatus | |
| US10638166B2 (en) | Video sharing method and device, and video playing method and device | |
| US10834424B2 (en) | Method and device for compressing image, and electronic device | |
| KR102058976B1 (en) | Application method and device | |
| CN110365974A (en) | For Video coding and decoded adaptive transmission function | |
| CN104869305B (en) | Method and apparatus for processing image data | |
| EP2477415A2 (en) | Method and system of encoding and decoding media content | |
| CN105075241B (en) | Electronic device and method for processing image | |
| CN109309842B (en) | Live broadcast data processing method and device, computer equipment and storage medium | |
| WO2019218384A1 (en) | Display processing method and device, storage medium and electronic terminal | |
| JP5757592B2 (en) | Method, apparatus and computer program product for generating super-resolution images | |
| WO2017202175A1 (en) | Method and device for video compression and electronic device | |
| US9124548B2 (en) | Method for uploading media file, electronic device using the same, and non-transitory storage medium | |
| WO2013090349A1 (en) | Photo selection for mobile devices | |
| US10701301B2 (en) | Video playing method and device | |
| US10922479B2 (en) | Method and electronic device for creating an electronic signature | |
| KR102424296B1 (en) | Method, storage medium and electronic device for providing a plurality of images | |
| CN112799891B (en) | iOS device testing method, device, system, storage medium and computer device | |
| JP2012133586A (en) | Display device, screen image transfer method and program | |
| CN113936119A (en) | Data rendering method, system and device | |
| CN112328941A (en) | Application screen projection method based on browser and related device | |
| WO2016051906A1 (en) | Information processing device and information processing method | |
| CN107656866A (en) | A kind of method, mobile terminal and computing device tested using fluency | |
| CN104052911A (en) | Information processing method and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |