CN105827484B - A kind of test pictures synchronous display method and system - Google Patents
A kind of test pictures synchronous display method and system Download PDFInfo
- Publication number
- CN105827484B CN105827484B CN201610309727.7A CN201610309727A CN105827484B CN 105827484 B CN105827484 B CN 105827484B CN 201610309727 A CN201610309727 A CN 201610309727A CN 105827484 B CN105827484 B CN 105827484B
- Authority
- CN
- China
- Prior art keywords
- video data
- mobile terminal
- server
- test
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/04—Processing captured monitoring data, e.g. for logfile generation
- H04L43/045—Processing captured monitoring data, e.g. for logfile generation for graphical visualisation of monitoring data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/04—Processing captured monitoring data, e.g. for logfile generation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/762—Media network packet handling at the source
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/764—Media network packet handling at the destination
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/765—Media network packet handling intermediate
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a kind of test pictures synchronous display method and systems, wherein test pictures synchronous display method is suitable for executing in test pictures synchronous display system, the test pictures synchronous display system includes multiple mobile terminals, server and calculating equipment, the described method includes: each mobile terminal carries out record screen to the picture of current test process, the first video data is obtained；Coded treatment is carried out to first video data, forms the second video data；The third video data obtained after second video data encapsulation is uploaded to server；Server obtains the name parameter for uploading each mobile terminal of the third video data；According to the name parameter, server generates corresponding multiple addresses URL, and the address URL respectively corresponds the third video data of each mobile terminal；It calculates equipment and plays corresponding third video data by accessing each address URL, decoding respectively in multiple webpages with the test pictures of each mobile terminal of simultaneous display.
Description
Technical field
The present invention relates to field of mobile terminals, in particular to a kind of test pictures synchronous display method and system.
Background technique
With the continuous development of development of Mobile Internet technology, the mobile terminals such as smart phone, tablet computer using also more next
More universal, achievable function also increases therewith, various to pacify to relevant applications such as life, social and amusement and recreation
Dress is on mobile terminals.User also gradually promotes the performance requirement of mobile terminal, then being tested it also becomes increasingly
It is important.
However, often involving the need for checking simultaneously multiple mobile whole during testing mobile terminal
Hold the situation of operating condition.At this point, since mobile terminal itself is carrying out such as charging measurement, automation stability test class
The test of type, can not be available mobile terminal, or can not the multiple mobile terminals of real time inspection test case scene, can only
The state of each running of mobile terminal is singly directly observed by tester, it is difficult to provide the effect of an overall operation
State also brings the waste of manpower and the consumption of time.
Summary of the invention
For this purpose, the present invention provides a kind of scheme of test pictures simultaneous display, to try hard to solve or at least alleviate above
There are the problem of.
According to an aspect of the present invention, a kind of test pictures synchronous display method is provided, is suitable for synchronous in test pictures
It is executed in display system, which includes multiple mobile terminals, server and calculating equipment, this method
Include: that each mobile terminal carries out record screen to the picture of current test process, obtains the first video data；To the first video data into
Row coded treatment forms the second video data；The third video data obtained after the encapsulation of second video data is uploaded to service
Device；Server obtains the name parameter for uploading each mobile terminal of third video data；According to name parameter, server generates phase
The multiple addresses URL answered, the address URL correspond respectively to the third video data of each mobile terminal；Equipment is calculated to pass through multiple
Each address URL is accessed in webpage respectively, decoding plays corresponding third video data with the test of each mobile terminal of simultaneous display
Picture.
Optionally, in test pictures synchronous display method according to the present invention, the first video data is carried out at coding
Reason, forming the second video data includes: carrying out that frame processing is taken to form picture to the first video data；Converting video is carried out to picture
Coding forms the second video data of the first preset format.
Optionally, in test pictures synchronous display method according to the present invention, the first video data take at frame
It includes: the frame per second for obtaining the first video data that reason, which forms picture,；Each frame image that the first video data includes is taken out according to frame per second；
Each frame compression of images of taking-up is saved as to the picture of the second preset format.
Optionally, in test pictures synchronous display method according to the present invention, the first preset format includes H.264 lattice
Formula.
Optionally, in test pictures synchronous display method according to the present invention, the second preset format includes JPG format.
Optionally, it in test pictures synchronous display method according to the present invention, will be obtained after the encapsulation of the second video data
Third video data be uploaded to before server, comprising: obtain the second video data decoded information head；By decoded information head
It is packaged with the second video data, obtains the third video data of third preset format.
Optionally, in test pictures synchronous display method according to the present invention, third preset format includes FLV format.
Optionally, it in test pictures synchronous display method according to the present invention, calculates equipment and passes through in multiple webpages
Each address URL is accessed respectively, and decoding plays corresponding third video data with the test pictures packet of each mobile terminal of simultaneous display
It includes: accessing each address URL respectively in multiple webpages to server and issue video data request；Receive server issue with
The corresponding third video data in the address URL；Decoding plug-in is called to be decoded broadcasting to third video data each with simultaneous display
The test pictures of mobile terminal.
Optionally, in test pictures synchronous display method according to the present invention, each mobile terminal is to current test process
Picture carry out record screen, before obtaining the first video data, including execute automatic test script start to test.
According to a further aspect of the invention, a kind of test pictures synchronous display system is provided, including multiple mobile terminals,
Server and calculating equipment, wherein video process apparatus is populated in mobile terminal, comprising: record panel module is suitable for each movement eventually
End carries out record screen to the picture of current test process, obtains the first video data；Coding module, be suitable for the first video data into
Row coded treatment forms the second video data；Uploading module, suitable for the third video counts that will be obtained after the encapsulation of the second video data
According to being uploaded to server；URL generating means are populated in server, comprising: obtain module, be suitable for obtaining upload third video counts
According to each mobile terminal name parameter；Generation module is suitable for generating corresponding multiple addresses URL, URL according to name parameter
Address corresponds respectively to the third video data of each mobile terminal；It calculates in equipment and is populated with web page browsing device, web page browsing
Device is suitable for by accessing each address URL respectively in multiple webpages, and it is aobvious to synchronize that decoding plays corresponding third video data
Show the test pictures of each mobile terminal.
Optionally, in test pictures synchronous display system according to the present invention, coding module includes: to take frame processing single
Member takes frame processing to form picture suitable for carrying out to the first video data；Video encoding unit is suitable for carrying out converting video to picture
Coding forms the second video data of the first preset format.
Optionally, it in test pictures synchronous display system according to the present invention, takes frame processing unit to be further adapted for: obtaining
Take the frame per second of the first video data；Each frame image that the first video data includes is taken out according to frame per second；By each frame image of taking-up
Compression saves as the picture of the second preset format.
Optionally, in test pictures synchronous display system according to the present invention, the first preset format includes H.264 lattice
Formula.
Optionally, in test pictures synchronous display system according to the present invention, the second preset format includes JPG format.
Optionally, in test pictures synchronous display system according to the present invention, video process apparatus further includes Encapsulation Moulds
Block, package module include: first acquisition unit, suitable for obtaining the decoded information head of the second video data；Video encapsulation unit is fitted
It is packaged in by decoded information head and the second video data, obtains the third video data of third preset format.
Optionally, in test pictures synchronous display system according to the present invention, third preset format includes FLV format.
Optionally, in test pictures synchronous display system according to the present invention, web page browsing device includes: to ask modulus
Block, suitable for issuing video data request to server by accessing each address URL respectively in multiple webpages；Receiving module is fitted
In the third video data corresponding with the address URL that reception server issues；Display module is suitable for calling decoding plug-in to third
Video data is decoded broadcasting with the test pictures of each mobile terminal of simultaneous display.
Optionally, test dress is also populated in test pictures synchronous display system according to the present invention, in mobile terminal
It sets, including script execution module, script execution module is suitable for starting to test in execution automatic test script.
The technical solution of test pictures simultaneous display according to the present invention, first to the current test process of each mobile terminal
Picture carry out record screen, obtain video data, it is encoded, encapsulate after be uploaded to server, server is regarded according to uploading
The name parameter of each mobile terminal of frequency evidence generates corresponding multiple addresses URL, calculates equipment and visits respectively in multiple webpages
Ask each address URL, decoding plays corresponding video data with the test pictures of each mobile terminal of simultaneous display.Above-mentioned technical proposal
In, a series of processing are carried out to the video data after the test pictures record screen of each mobile terminal, server is finally uploaded to, passes through
The address URL corresponding with each mobile terminal of server generation is directly accessed in multiple webpages of browser in PC machine, i.e.,
Can on webpage the real time inspection mobile terminal test pictures situation.On the one hand it avoids because the reason of testing itself can not make
Screen content is carried out with mobile terminal to check, on the other hand also achieve can the multiple mobile terminals of real time inspection test case,
The effect state that an overall operation of test can be obtained, has saved manpower and time.
Detailed description of the invention
To the accomplishment of the foregoing and related purposes, certain illustrative sides are described herein in conjunction with following description and drawings
Face, these aspects indicate the various modes that can practice principles disclosed herein, and all aspects and its equivalent aspect
It is intended to fall in the range of theme claimed.Read following detailed description in conjunction with the accompanying drawings, the disclosure it is above-mentioned
And other purposes, feature and advantage will be apparent.Throughout the disclosure, identical appended drawing reference generally refers to identical
Component or element.
Fig. 1 shows the schematic diagram of test pictures synchronous display system 100 according to an embodiment of the invention；
Fig. 2 shows the structural block diagrams of mobile terminal 200 according to an embodiment of the invention；
Fig. 3 shows the schematic diagram of video process apparatus 300 according to an embodiment of the invention；
Fig. 4 shows the application interface schematic diagram of video process apparatus 300 according to an embodiment of the invention；
Fig. 5 shows the schematic diagram of server 500 according to an embodiment of the invention；
Fig. 6 shows the structural block diagram according to an embodiment of the invention for calculating equipment 600；
Fig. 7 shows the schematic diagram of web page browsing device 700 according to an embodiment of the invention；
Fig. 8 shows the test pictures simultaneous display signal of web page browsing device 700 according to an embodiment of the invention
Figure；And
Fig. 9 shows the flow chart of test pictures synchronous display method 900 according to an embodiment of the invention.
Specific embodiment
Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
It is fully disclosed to those skilled in the art.
Fig. 1 shows the schematic diagram of test pictures synchronous display system 100 according to an embodiment of the invention.Such as Fig. 1
It is shown, include two mobile terminals in test pictures synchronous display system 100, is mobile terminal 200 and mobile terminal respectively
400, it may each be smart phone, tablet computer etc., but not limited to this, the quantity of mobile terminal is also not necessarily limited to two.The system
It further include a server 500 and a calculating equipment 600 in 100.Server 500 is streaming media server, in the present embodiment
Middle server 500 is RTMP server, and calculating equipment 600 is PC machine.It will be illustrated by taking mobile terminal 200 as an example below.Tool
For body, mobile terminal 200 picture of current test process will be recorded obtained video data after screen encoded, encapsulation process
After be uploaded to server 500, and server 500 is then generated according to the video data received and transmits source thereon, that is, is moved
The corresponding address URL of terminal 200, finally calculate equipment 600 by the above-mentioned address URL progress server 500 access, so as to
The current test pictures browsing of mobile terminal 200 is carried out on a webpage in browser.And at the same time, the above process is also same
Sample occurs in mobile terminal 400, server 500 and calculates in equipment 600, then calculates another net in the browser of equipment 600
The current test pictures browsing that mobile terminal 400 can be carried out on page, to be realized in the different web pages of browser multiple
The simultaneous display of the test pictures of mobile terminal.By this test pictures synchronous display system 100, not only avoid because of test originally
The reason of body be not available mobile terminal carry out screen content check, also achieve can the multiple mobile terminals of real time inspection test
Situation can obtain the effect state of an overall operation of test, save manpower and time.
Fig. 2 shows the structural block diagrams of mobile terminal 200 according to an embodiment of the invention.Mobile terminal 200 can be with
Including memory interface 202, one or more data processors, image processor and/or central processing unit 204, and outside
Enclose interface 206.
Memory interface 202, one or more processors 204 and/or peripheral interface 206 either discrete component,
It can integrate in one or more integrated circuits.In mobile terminal 200, various elements can pass through one or more communication
Bus or signal wire couple.Sensor, equipment and subsystem may be coupled to peripheral interface 206, a variety of to help to realize
Function.
For example, motion sensor 210, light sensor 212 and range sensor 214 may be coupled to peripheral interface 206,
To facilitate the functions such as orientation, illumination and ranging.Other sensors 216 can equally be connected with peripheral interface 206, such as positioning system
System (such as GPS receiver), temperature sensor, biometric sensor or other sensor devices, it is possible thereby to help to implement phase
The function of pass.
Camera sub-system 220 and optical sensor 222 can be used for the camera of convenient such as record photos and video clips
The realization of function, wherein the camera sub-system and optical sensor for example can be charge-coupled device (CCD) or complementary gold
Belong to oxide semiconductor (centimetre OS) optical sensor.Reality can be helped by one or more radio communication subsystems 224
Existing communication function, wherein radio communication subsystem may include that radio-frequency transmitter and transmitter and/or light (such as infrared) receive
Machine and transmitter.The particular design and embodiment of radio communication subsystem 224 can depend on what mobile terminal 200 was supported
One or more communication networks.For example, mobile terminal 200 may include being designed to support LTE, 3G, GSM network, GPRS net
Network, EDGE network, Wi-Fi or WiMax network and BlueboothTMThe communication subsystem 224 of network.
Audio subsystem 226 can be coupled with loudspeaker 228 and microphone 230, to help to implement to enable voice
Function, such as speech recognition, speech reproduction, digital record and telephony feature.I/O subsystem 240 may include touch screen control
Device 242 processed and/or other one or more input controllers 244.Touch screen controller 242 may be coupled to touch screen 246.It lifts
For example, any one of a variety of touch-sensing technologies are can be used to detect in the touch screen 246 and touch screen controller 242
The contact and movement or pause carried out therewith, wherein detection technology includes but is not limited to capacitive character, resistive, infrared and table
Face technology of acoustic wave.Other one or more input controllers 244 may be coupled to other input/control devicess 248, such as one
Or the pointer device of multiple buttons, rocker switch, thumb wheel, infrared port, USB port, and/or stylus etc.It is described
One or more button (not shown)s may include the up/down for controlling 230 volume of loudspeaker 228 and/or microphone
Button.
Memory interface 202 can be coupled with memory 250.The memory 250 may include that high random access is deposited
Reservoir and/or nonvolatile memory, such as one or more disk storage equipments, one or more optical storage apparatus, and/
Or flash memories (such as NAND, NOR).Memory 250 can store an operating system 272, for example, Android, iOS or
The operating system of Windows Phone etc.The operating system 272 may include for handling basic system services and execution
The instruction of task dependent on hardware.Memory 250 can also be stored using 274.It, can be from memory in mobile device operation
Load operating system 272 in 250, and executed by processor 104.At runtime using 274, can also add from memory 250
It carries, and is executed by processor 204.It operates on operating system using 274, is provided using operating system and bottom hardware
Interface realizes the various desired functions of user, such as instant messaging, web page browsing, pictures management.Using 274 can be independently of
What operating system provided, it is also possible to what operating system carried.In addition, when being mounted in mobile terminal 100 using 274,
Drive module can be added to operating system.In above-mentioned various applications 274, one such application is view according to the present invention
Frequency processing device 300.
Fig. 3 shows the schematic diagram of video process apparatus 300 according to an embodiment of the invention.The device includes: record
Panel module 310, coding module 320 and uploading module 340.The device further includes 330 (not shown) of package module, Encapsulation Moulds
Block 330 is between coding module 320 and uploading module 330.
Record panel module 310 is suitable for each mobile terminal and carries out record screen to the picture of current test process, obtains the first video counts
According to.It in the present embodiment, further include a kind of application is test according to the present invention dress in the types of applications 274 of mobile terminal 200
It sets and (is not shown in Fig. 2), including script execution module, which is adapted for carrying out automatic test script and starts to survey
Examination.Fig. 4 shows the application interface schematic diagram of video process apparatus 300 according to an embodiment of the invention.As shown in figure 4,
When tester clicks " BEGIN " button, real time video collection starts, and records test of the panel module 310 to presenting in current screen
Picture is recorded.By calling adb order to carry out record screen come the test process to mobile terminal, which is represented by
Adb shell screenrecord/sdcard/demo.mp4 is set wherein can carry out corresponding parameter after screenrecord
It sets, such as record screen duration, resolution sizes.To the situation of above-mentioned default parameter, defaulting recording time is 180 seconds, the first video
The format of data is MP4, entitled demo, and is stored under the root of sd card.
Coding module 320 is suitable for carrying out coded treatment to the first video data, forms the second video data, including take at frame
Manage unit 322 and video encoding unit 323 (being not shown in figure).Wherein, frame processing unit 322 is taken to be suitable for the first video counts
According to take frame processing to form picture, it is further adapted for obtaining the frame per second of the first video data；The first video is taken out according to frame per second
Each frame image that data include；Each frame compression of images of taking-up is saved as to the picture of the second preset format.Frame per second is for surveying
The measurement of amount display frame number, with display frame number per second (Frames per Second) Lai Hengliang.The frame per second of first video data is
The real time screen display frame rate of mobile terminal when record screen, in the present embodiment, frame per second 60fps.According to default recording time 180
Second, then include 10800 frames in the first video data, after these picture frames are taken out, passes through OpenCV pairs of image procossing library of increasing income
It carries out compression processing respectively, and the second preset format is JPG format, then finally obtains the picture of 10800 frame JPG formats.Video
Coding unit 323 is suitable for carrying out converting video coding to the picture for taking frame to obtain after handling, and forms the second of the first preset format
Video data.In the present embodiment, the first preset format is H.264 format, utilizes VideoEncoderThread thread dispatching
Third party's code database such as FFmpeg realizes that converting video encodes, to obtain the second video data of H.264 format, and second
Video data is transferred in data buffer storage queue DataBufferQueue.
Package module 330 includes first acquisition unit 331 and video encapsulation unit 332 (being not shown in figure), wherein the
One acquiring unit 331 is suitable for obtaining the decoded information head of the second video data, and video encapsulation unit 332 is suitable for decoded information head
Be packaged with the second video data, obtain the third video data of third preset format, i.e., using RtmpThread thread from
After taking out the second video data in DataBufferQueue, it is encapsulated using decoded information head as RTMP Packet, finally
Obtain the third video data that third preset format is FLV format.
Uploading module 340 is suitable for the third video data obtained after the encapsulation of the second video data being uploaded to server 500.
Server 500 is that RTMP server passes through the third video data of packaged FLV format according to the requirement of RTMP agreement
RTMP agreement uploads to RTMP server 500.
Fig. 5 shows the schematic diagram of server 500 according to an embodiment of the invention.As shown in figure 5, being stayed in server
There are URL generating means 510 comprising obtains module 511 and generation module 512.Wherein, module 511 is obtained to be suitable for obtaining
The name parameter of each mobile terminal of third video data is passed, generation module 512 is suitable for generating corresponding according to above-mentioned name parameter
Multiple addresses URL, the address URL corresponds respectively to the third video data of each mobile terminal.In the present embodiment, mobile terminal
200 be to request and send data to server 500 by GET mode, and the IP address of current server is
192.168.40.30, the name parameter test=" test machine 1 " that module 511 receives is obtained at this time, is joined according to this title
Number, judge be mobile terminal 200 picture data.And generation module 512 is then by server address and above-mentioned name parameter knot
Altogether, the corresponding address URL of mobile terminal 200, as 192.168.40.30/ are generated? test=test machine 1.Above-mentioned picture
Mobile terminal 200, server 500 and calculating equipment 600 in synchronization system 100 are located in Intranet, can directly with IP
Location carries out server access.And when picture synchronization system 100 is located in the case of outer net, it is necessary to server ip address binding
Domain name then by domain name access, or using VPN access Intranet, then inputs IP address and accesses.
Fig. 6 shows the structural block diagram according to an embodiment of the invention for calculating equipment 600.In basic configuration 602
In, it calculates equipment 600 and typically comprises system storage 606 and one or more processor 604.Memory bus 608 can
For the communication between processor 604 and system storage 606.
Depending on desired configuration, processor 604 can be any kind of processing, including but not limited to: microprocessor
((μ P), microcontroller (μ C), digital information processor (DSP) or any combination of them.Processor 604 may include all
Cache, processor core such as one or more rank of on-chip cache 610 and second level cache 612 etc
614 and register 616.Exemplary processor core 614 may include arithmetic and logical unit (ALU), floating-point unit (FPU),
Digital signal processing core (DSP core) or any combination of them.Exemplary Memory Controller 618 can be with processor
604 are used together, or in some implementations, and Memory Controller 618 can be an interior section of processor 604.
Depending on desired configuration, system storage 606 can be any type of memory, including but not limited to: easily
The property lost memory (RAM), nonvolatile memory (ROM, flash memory etc.) or any combination of them.System storage
Device 606 may include operating system 620, one or more is using 622 and program data 624.In some embodiments,
It may be arranged to be operated using program data 624 on an operating system using 622.
Calculating equipment 600 can also include facilitating from various interface equipments (for example, output equipment 642, Peripheral Interface
644 and communication equipment 646) to basic configuration 602 via the communication of bus/interface controller 630 interface bus 640.Example
Output equipment 642 include graphics processing unit 648 and audio treatment unit 650.They can be configured as facilitate via
One or more port A/V 652 is communicated with the various external equipments of such as display or loudspeaker etc.Outside example
If interface 644 may include serial interface controller 654 and parallel interface controller 656, they, which can be configured as, facilitates
Via one or more port I/O 658 and such as input equipment (for example, keyboard, mouse, pen, voice-input device, touch
Input equipment) or the external equipment of other peripheral hardwares (such as printer, scanner etc.) etc communicated.Exemplary communication is set
Standby 646 may include network controller 660, can be arranged to convenient for via one or more communication port 664 and one
A or multiple other calculate communication of the equipment 662 by network communication link.
Network communication link can be an example of communication media.Communication media can be usually presented as in such as carrier wave
Or computer readable instructions, data structure, program module in the modulated data signal of other transmission mechanisms etc, and can
To include any information delivery media." modulated data signal " can such signal, one in its data set or more
It is a or it change can the mode of encoded information in the signal carry out.As unrestricted example, communication media can be with
Wired medium including such as cable network or private line network etc, and it is such as sound, radio frequency (RF), microwave, infrared
(IR) the various wireless mediums or including other wireless mediums.Term computer-readable medium used herein may include depositing
Both storage media and communication media.
Calculating equipment 600 can be implemented as a part of portable (or mobile) electronic equipment of small size, these electronics are set
The standby such as cellular phone, personal digital assistant (PDA), personal media player device, wireless network browsing apparatus, a of can be
People's helmet, application specific equipment or may include any of the above function mixing apparatus.Calculating equipment 600 can be with
Be embodied as include desktop computer and notebook computer configuration personal computer.It include net according to the present invention using 622
Page browsing device 700.
In the present embodiment, calculating equipment 600 is PC machine, and web page browsing device 700 therein can be considered conventional browsing
Device client.Fig. 7 shows the schematic diagram of web page browsing device 700 according to an embodiment of the invention, which includes asking
Modulus block 710, receiving module 720 and display module 730.Wherein, request module 710 is suitable for by visiting respectively in multiple webpages
Ask that each address URL issues video data request to server.For mobile terminal 200, request module 710 is in a webpage
Do you access the address URL 192.168.40.30/? test=test machine 1 sends video data request to server 500.Receiving module
720 are suitable for receiving the third video data corresponding with the address URL that server issues, that is, receive server 500 issues and URL
Address 192.168.40.30/? the corresponding third video data of test=test machine 1.Display module 730 is suitable for that decoding is called to insert
Part is decoded broadcasting to third video data with the test pictures of each mobile terminal of simultaneous display, can be considered the net in browser
Page interface display window.The test pictures that Fig. 8 shows web page browsing device 700 according to an embodiment of the invention synchronize aobvious
Show schematic diagram.By accessing the address URL of the generation of server 500, i.e. 192.168.40.30/ in a browser? test=test
Machine 1, and linked to issue server 500 and be requested.Server 500 is responded after receiving the request of browser, right
The URL address suffix part carries out dissection process, obtains corresponding video data from H264Reader using RTMP agreement and incites somebody to action
It is issued, and the AVC sequence before sending video data firstly the need of transmission comprising important encoded information
Header is decoded broadcasting to play end.Browser in PC machine calls Flash to insert above-mentioned video data to be decoded
Part is decoded broadcasting, works as to show on webpage with name parameter test=" test machine 1 " corresponding mobile terminal 200
Test process picture in forth screen, realizes test pictures simultaneous display.Exemplary codes are as follows:
In the present embodiment, for mobile terminal 400, name parameter test=" test machine 2 ", when input
Does is the address URL 192.168.40.30/? when test=test machine 2, current web page shows working as corresponding mobile terminal 400
Test process picture in forth screen realizes and inputs the i.e. playable correspondence in the corresponding address URL respectively in multiple webpages
The test pictures of mobile terminal.To stop above-mentioned test pictures simultaneous display, then that clicks video process apparatus 300 applies boundary
" END " button in face, real time video collection terminate, and record panel module 310 stops working.
Fig. 9 shows the flow chart of picture synchronization display methods 900 according to an embodiment of the invention.As shown in figure 9,
Method 900 starts from step S910.It further include executing automatic test script to start to test before step S910.In step
In S910, mobile terminal each first carries out record screen to the picture of current test process, obtains the first video data, that is, passes through calling
Adb shell screenrecord order carries out record screen come the test process to mobile terminal, and it is corresponding to obtain current test pictures
The first video data.
Then, S920 is entered step, coded treatment is carried out to the first video data, forms the second video data.Firstly, obtaining
It takes the frame per second of the first video data, and each frame image that the first video data includes is taken out according to frame per second, then by each frame of taking-up
Compression of images saves as the picture of the second preset format；Secondly, carrying out converting video coding to above-mentioned picture, it is default to form first
Second video data of format.Wherein, the first preset format includes that H.264 format, the second preset format include JPG format.?
In the present embodiment, frame per second 60fps, recording time is 180 seconds, then includes 10800 frames in the first video data, by these images
After frame takes out, by increasing income, image procossing library OpenCV carries out compression processing to it respectively, obtains the figure of 10800 frame JPG formats
Piece.Third party's code database such as FFmpeg is finally called to realize that converting video encodes, to obtain the second video of H.264 format
Data.
Before step S930, the decoded information head of the second video data is obtained, and the decoded information head and second are regarded
Frequency obtains the third video data of third preset format according to being packaged.Wherein, third preset format includes FLV format.?
In step S830, the third video data obtained after the encapsulation of the second video data is uploaded to server.In the present embodiment, root
According to the requirement of RTMP agreement, the third video data of packaged FLV format is uploaded into RTMP server by RTMP agreement
500。
In step S940, server obtains the name parameter for uploading each mobile terminal of third video data.In this reality
It applies in example, the name parameter test=" test machine 1 " of mobile terminal 200, the name parameter test=" test of mobile terminal 300
Machine 2 ".In step S950, according to name parameter, server generates corresponding multiple addresses URL, and the address URL corresponds respectively to
The third video data of each mobile terminal.500 address of server is 192.168.40.30, by itself and the combination of above-mentioned name parameter
Get up, generate the corresponding address URL of mobile terminal 200, as 192.168.40.30/? test=test machine 1.It generates mobile whole
Hold the 300 corresponding addresses URL, as 192.168.40.30/? test=test machine 2.
Finally, calculating equipment in step S960 and being played by accessing each address URL, decoding respectively in multiple webpages
Corresponding third video data is with the test pictures of each mobile terminal of simultaneous display.In the present embodiment, first in multiple webpages
It is middle to input each address URL respectively to the transmission video data request of server 500, i.e. the access address URL 192.168.40.30/?
Test=test machine 1 and 192.168.40.30/? test=test machine 2, and respectively receive server 500 issue with URL
The corresponding third video data in location calls decoding plug-in such as Flash plug-in unit to be decoded broadcasting to the third video data, thus
The current test pictures of simultaneous display mobile terminal 200 and 400 in different web pages.
About the specific steps and embodiment of test pictures simultaneous display, in the description based on Fig. 1~8 in detail
Open, details are not described herein again.
The technical solution of test pictures simultaneous display according to the present invention, mobile terminal each first is to current test process
Picture carries out record screen, obtains video data, it is encoded, encapsulate after be uploaded to server, server is according to uploaded videos
The name parameter of each mobile terminal of data generates corresponding multiple addresses URL, calculates equipment and accesses respectively in multiple webpages
Each address URL can each mobile terminal of simultaneous display test pictures.In above-mentioned technical proposal, on the one hand avoid because of test originally
The reason of body, is not available mobile terminal progress screen content and checks, on the other hand also achieving can real time inspection multiple mobile end
The test case at end can obtain the effect state of an overall operation of test, save manpower and time.
B11. the system as described in B10, wherein the coding module includes:
Frame processing unit is taken, takes frame processing to form picture suitable for carrying out to first video data；
Video encoding unit is suitable for carrying out converting video coding to the picture, forms the second view of the first preset format
Frequency evidence.
B12. system as described in b11, wherein described take frame processing unit to be further adapted for:
Obtain the frame per second of first video data；
Each frame image that the first video data includes is taken out according to the frame per second；
Each frame compression of images of taking-up is saved as to the picture of the second preset format.
B13. system as described in b11, wherein first preset format includes H.264 format.
B14. system as described in B12, wherein second preset format includes JPG format.
B15. the system as described in B10, wherein the video process apparatus further includes package module, the package module packet
It includes:
First acquisition unit, suitable for obtaining the decoded information head of the second video data；
It is default to obtain third suitable for the decoded information head to be packaged with the second video data for video encapsulation unit
The third video data of format.
B16. the system as described in B15, wherein the third preset format includes FLV format.
B17. the system as described in B10, wherein the web page browsing device includes:
Request module, suitable for being asked by accessing each address URL respectively in multiple webpages to server sending video data
It asks；
Receiving module, the third video data corresponding with the address URL issued suitable for receiving server；
Display module is respectively moved suitable for calling decoding plug-in to be decoded broadcasting to the third video data with simultaneous display
The test pictures of dynamic terminal.
B18. the system as described in any one of B10-17 is wherein also populated with test device, including foot in mobile terminal
This execution module, the script execution module are suitable for starting to test in execution automatic test script.
In the instructions provided here, numerous specific details are set forth.It is to be appreciated, however, that implementation of the invention
Example can be practiced without these specific details.In some instances, well known method, knot is not been shown in detail
Structure and technology, so as not to obscure the understanding of this specification.
Similarly, it should be understood that in order to simplify the disclosure and help to understand one or more of the various inventive aspects,
Above in the description of exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes
In example, figure or descriptions thereof.However, the disclosed method should not be interpreted as reflecting the following intention: i.e. required to protect
Shield the present invention claims than feature more features expressly recited in each claim.More precisely, as following
As claims reflect, inventive aspect is all features less than single embodiment disclosed above.Therefore, it abides by
Thus the claims for following specific embodiment are expressly incorporated in the specific embodiment, wherein each claim itself
As a separate embodiment of the present invention.
Those skilled in the art should understand that the module of the equipment in example disclosed herein or unit or groups
Part can be arranged in equipment as depicted in this embodiment, or alternatively can be positioned at and the equipment in the example
In different one or more equipment.Module in aforementioned exemplary can be combined into a module or furthermore be segmented into multiple
Submodule.
Those skilled in the art will understand that can be carried out adaptively to the module in the equipment in embodiment
Change and they are arranged in one or more devices different from this embodiment.It can be the module or list in embodiment
Member or component are combined into a module or unit or component, and furthermore they can be divided into multiple submodule or subelement or
Sub-component.Other than such feature and/or at least some of process or unit exclude each other, it can use any
Combination is to all features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so disclosed
All process or units of what method or apparatus are combined.Unless expressly stated otherwise, this specification is (including adjoint power
Benefit require, abstract and attached drawing) disclosed in each feature can carry out generation with an alternative feature that provides the same, equivalent, or similar purpose
It replaces.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments
In included certain features rather than other feature, but the combination of the feature of different embodiments mean it is of the invention
Within the scope of and form different embodiments.For example, in the following claims, embodiment claimed is appointed
Meaning one of can in any combination mode come using.
In addition, be described as herein can be by the processor of computer system or by executing by some in the embodiment
The combination of method or method element that other devices of the function are implemented.Therefore, have for implementing the method or method
The processor of the necessary instruction of element forms the device for implementing this method or method element.In addition, Installation practice
Element described in this is the example of following device: the device be used for implement as in order to implement the purpose of the invention element performed by
Function.
As used in this, unless specifically stated, come using ordinal number " first ", " second ", " third " etc.
Description plain objects, which are merely representative of, is related to the different instances of similar object, and is not intended to imply that the object being described in this way must
Must have the time it is upper, spatially, sequence aspect or given sequence in any other manner.
Although the embodiment according to limited quantity describes the present invention, above description, the art are benefited from
It is interior it is clear for the skilled person that in the scope of the present invention thus described, it can be envisaged that other embodiments.Additionally, it should be noted that
Language used in this specification primarily to readable and introduction purpose and select, rather than in order to explain or limit
Determine subject of the present invention and selects.Therefore, without departing from the scope and spirit of the appended claims, for this
Many modifications and changes are obvious for the those of ordinary skill of technical field.For the scope of the present invention, to this
Invent done disclosure be it is illustrative and not restrictive, it is intended that the scope of the present invention be defined by the claims appended hereto.
Claims (14)
1. a kind of test pictures synchronous display method, suitable for executing in test pictures synchronous display system, the test pictures are same
Step display system includes multiple mobile terminals, server and calculating equipment, which comprises
Each mobile terminal execution automatic test script starts to test；
Record panel module in mobile terminal to the test pictures presented in the current screen of mobile terminal in current test process into
Row record screen, obtains the first video data；
Coded treatment is carried out to first video data, forms the second video data；
The third video data obtained after second video data encapsulation is uploaded to server；
Server obtains the name parameter for uploading each mobile terminal of the third video data；
By server address in conjunction with the name parameter, the corresponding multiple addresses URL of each mobile terminal are generated, the URL
Location corresponds respectively to the third video data of each mobile terminal；
It calculates equipment and accesses each address URL respectively in multiple webpages to server sending video data request；
Receive the third video data corresponding with the address URL that server issues；
Decoding plug-in is called to be decoded broadcasting to the third video data with the test pictures of each mobile terminal of simultaneous display.
2. the method as described in claim 1 forms the second video counts wherein carrying out coded treatment to first video data
According to including:
First video data is carried out frame processing is taken to form picture；
Converting video coding is carried out to the picture, forms the second video data of the first preset format.
3. method according to claim 2, wherein first video data is carried out that frame processing is taken to form picture include:
Obtain the frame per second of first video data；
Each frame image that the first video data includes is taken out according to the frame per second；
Each frame compression of images of taking-up is saved as to the picture of the second preset format.
4. method according to claim 2, wherein first preset format includes H.264 format.
5. method as claimed in claim 3, wherein second preset format includes JPG format.
6. the method as described in claim 1, wherein by the third video data obtained after second video data encapsulation
Before reaching server, comprising:
Obtain the decoded information head of the second video data；
The decoded information head is packaged with the second video data, obtains the third video data of third preset format.
7. method as claimed in claim 6, wherein the third preset format includes FLV format.
8. a kind of test pictures synchronous display system, including multiple mobile terminals, server and calculating equipment, wherein
Video process apparatus is populated in mobile terminal, comprising:
Script execution module, the script execution module are suitable for starting to test in execution automatic test script；
Panel module is recorded, record screen is carried out to the test pictures presented in current screen in current test process suitable for each mobile terminal,
Obtain the first video data；
Coding module is suitable for carrying out coded treatment to first video data, forms the second video data；
Uploading module, suitable for the third video data obtained after second video data encapsulation is uploaded to server；
URL generating means are populated in server, comprising:
Module is obtained, suitable for obtaining the name parameter for uploading each mobile terminal of the third video data；
Generation module is suitable for by server address in conjunction with the name parameter, with generating the corresponding multiple URL of each mobile terminal
Location, the address URL correspond respectively to the third video data of each mobile terminal；
It calculates in equipment and is populated with web page browsing device, comprising: request module is suitable for by the way that access is each respectively in multiple webpages
The address URL issues video data request to server, and receiving module is issuing with the address pair URL suitable for receiving server
The third video data answered, display module, suitable for calling decoding plug-in to be decoded broadcasting to the third video data with same
Step shows the test pictures of each mobile terminal.
9. system as claimed in claim 8, wherein the coding module includes:
Frame processing unit is taken, takes frame processing to form picture suitable for carrying out to first video data；
Video encoding unit is suitable for carrying out converting video coding to the picture, forms the second video counts of the first preset format
According to.
10. system as claimed in claim 9, wherein described take frame processing unit to be further adapted for:
Obtain the frame per second of first video data；
Each frame image that the first video data includes is taken out according to the frame per second；
Each frame compression of images of taking-up is saved as to the picture of the second preset format.
11. system as claimed in claim 9, wherein first preset format includes H.264 format.
12. system as claimed in claim 10, wherein second preset format includes JPG format.
13. system as claimed in claim 8, wherein the video process apparatus further includes package module, the package module
Include:
First acquisition unit, suitable for obtaining the decoded information head of the second video data；
Video encapsulation unit obtains third preset format suitable for the decoded information head to be packaged with the second video data
Third video data.
14. system as claimed in claim 13, wherein the third preset format includes FLV format.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610309727.7A CN105827484B (en) | 2016-05-11 | 2016-05-11 | A kind of test pictures synchronous display method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610309727.7A CN105827484B (en) | 2016-05-11 | 2016-05-11 | A kind of test pictures synchronous display method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105827484A CN105827484A (en) | 2016-08-03 |
| CN105827484B true CN105827484B (en) | 2019-10-11 |
Family
ID=56528655
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610309727.7A Active CN105827484B (en) | 2016-05-11 | 2016-05-11 | A kind of test pictures synchronous display method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105827484B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106488161A (en) * | 2016-10-19 | 2017-03-08 | 网易（杭州）网络有限公司 | Electronic equipment screen video data obtains system, method and apparatus |
| CN107704379A (en) * | 2017-06-23 | 2018-02-16 | 上海斐讯数据通信技术有限公司 | A kind of video recording system and application method suitable for automatic test course |
| CN110008107A (en) * | 2018-01-04 | 2019-07-12 | 北京奇虎科技有限公司 | Test method, device and the computer readable storage medium of application |
| CN108307021B (en) * | 2018-01-18 | 2021-03-02 | 中国工商银行股份有限公司 | Parallel following test equipment, cloud real machine and method for mobile terminal |
| CN111225222A (en) * | 2018-11-26 | 2020-06-02 | 北京奇虎科技有限公司 | Video stream playing method, device and system based on screen data of RTMP (real time Messaging protocol) |
| CN111225275A (en) * | 2018-11-26 | 2020-06-02 | 北京奇虎科技有限公司 | Screen display method, device and system based on video stream |
| CN110602430B (en) * | 2019-09-16 | 2021-08-06 | 咪咕文化科技有限公司 | Video synchronization method, terminal, color ring platform, system and readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101076135A (en) * | 2007-06-09 | 2007-11-21 | 腾讯科技（深圳）有限公司 | Method for recording and replaying multimedium and processing system |
| WO2010148845A1 (en) * | 2009-06-24 | 2010-12-29 | 中兴通讯股份有限公司 | Method and system for sharing audio and video |
| CN102325182A (en) * | 2011-09-09 | 2012-01-18 | 重庆抛物线信息技术有限责任公司 | Audio-video sharing method and system |
| CN102438259A (en) * | 2011-09-09 | 2012-05-02 | 华南农业大学 | Interference-free type remote usability testing system for mobile phone and testing method thereof |
| CN104967904A (en) * | 2014-04-10 | 2015-10-07 | 腾讯科技（深圳）有限公司 | Method for recording and playing back terminal video and apparatus thereof |
-
2016
- 2016-05-11 CN CN201610309727.7A patent/CN105827484B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101076135A (en) * | 2007-06-09 | 2007-11-21 | 腾讯科技（深圳）有限公司 | Method for recording and replaying multimedium and processing system |
| WO2010148845A1 (en) * | 2009-06-24 | 2010-12-29 | 中兴通讯股份有限公司 | Method and system for sharing audio and video |
| CN102325182A (en) * | 2011-09-09 | 2012-01-18 | 重庆抛物线信息技术有限责任公司 | Audio-video sharing method and system |
| CN102438259A (en) * | 2011-09-09 | 2012-05-02 | 华南农业大学 | Interference-free type remote usability testing system for mobile phone and testing method thereof |
| CN104967904A (en) * | 2014-04-10 | 2015-10-07 | 腾讯科技（深圳）有限公司 | Method for recording and playing back terminal video and apparatus thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105827484A (en) | 2016-08-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105827484B (en) | A kind of test pictures synchronous display method and system | |
| JP7038021B2 (en) | Adaptive transfer function for video coding and decoding | |
| TWI674790B (en) | Method of picture data encoding and decoding and apparatus | |
| US10659684B2 (en) | Apparatus and method for providing dynamic panorama function | |
| US9124548B2 (en) | Method for uploading media file, electronic device using the same, and non-transitory storage medium | |
| CN102685597B (en) | Device, mobile terminal and method of content reappearing | |
| JP2020526994A5 (en) | ||
| KR102327779B1 (en) | Method for processing image data and apparatus for the same | |
| JP5757592B2 (en) | Method, apparatus and computer program product for generating super-resolution images | |
| KR20180050384A (en) | Application processing method and apparatus | |
| CN104093067A (en) | Device and method for sharing and playing audio and visual fragments in terminal | |
| WO2017202175A1 (en) | Method and device for video compression and electronic device | |
| EP2667629B1 (en) | Method and apparatus for multi-playing videos | |
| WO2017202170A1 (en) | Method and device for video compression and electronic device | |
| CN105447820B (en) | A kind of image processing method, device and mobile terminal | |
| US9483624B2 (en) | Method and apparatus for configuring privacy settings for publishing electronic images | |
| CN109660859A (en) | A kind of animated show method and mobile terminal | |
| CN109672884A (en) | Graphics hardware code processing method and device | |
| CN107656866A (en) | A kind of method, mobile terminal and computing device tested using fluency | |
| WO2016051906A1 (en) | Information processing device and information processing method | |
| KR102187227B1 (en) | Method for creating a content and an electronic device thereof | |
| JP2017068255A (en) | Device and method for processing image | |
| JP2022543165A (en) | Image special effect processing method, device, electronic device and computer readable storage medium | |
| KR20150057707A (en) | Method for sharing file and electronic device thereof | |
| US11368531B2 (en) | Method and apparatus for file management |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |