CN106028060A - Picture check device, system and method - Google Patents
Picture check device, system and method Download PDFInfo
- Publication number
- CN106028060A CN106028060A CN201610355141.4A CN201610355141A CN106028060A CN 106028060 A CN106028060 A CN 106028060A CN 201610355141 A CN201610355141 A CN 201610355141A CN 106028060 A CN106028060 A CN 106028060A
- Authority
- CN
- China
- Prior art keywords
- picture
- video
- terminal
- burst
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 239000012634 fragment Substances 0.000 claims abstract description 103
- 238000007689 inspection Methods 0.000 claims description 24
- 239000000463 material Substances 0.000 claims description 22
- 230000007246 mechanism Effects 0.000 claims description 20
- 238000005516 engineering process Methods 0.000 claims description 15
- 238000013507 mapping Methods 0.000 claims description 10
- 238000005194 fractionation Methods 0.000 claims description 9
- 230000005540 biological transmission Effects 0.000 claims description 8
- 230000000875 corresponding effect Effects 0.000 description 52
- 230000008569 process Effects 0.000 description 22
- 238000004891 communication Methods 0.000 description 17
- 238000003860 storage Methods 0.000 description 14
- 238000010586 diagram Methods 0.000 description 10
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 10
- 241000196324 Embryophyta Species 0.000 description 9
- 230000006870 function Effects 0.000 description 8
- 238000010295 mobile communication Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 8
- 241001269238 Data Species 0.000 description 6
- 230000000694 effects Effects 0.000 description 6
- 238000012163 sequencing technique Methods 0.000 description 6
- 230000005236 sound signal Effects 0.000 description 4
- 238000009826 distribution Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 2
- 230000001276 controlling effect Effects 0.000 description 2
- 238000005520 cutting process Methods 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000005611 electricity Effects 0.000 description 2
- 238000013467 fragmentation Methods 0.000 description 2
- 238000006062 fragmentation reaction Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000002203 pretreatment Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000001629 suppression Effects 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 101150012579 ADSL gene Proteins 0.000 description 1
- 102100020775 Adenylosuccinate lyase Human genes 0.000 description 1
- 108700040193 Adenylosuccinate lyases Proteins 0.000 description 1
- 241000256844 Apis mellifera Species 0.000 description 1
- 241001062009 Indigofera Species 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000005314 correlation function Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 239000009730 ganji Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 239000010409 thin film Substances 0.000 description 1
- 230000002463 transducing effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8455—Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a picture check device. The device comprises a check request module which is used for sending a check instruction for checking appointed picture or videos to an appointed server; a fragment display module which is used for receiving each piece of fragment data of the pictures or videos returned by the server in sequence and displaying the picture contents corresponding to each piece of fragment data in sequence; and a check stop module which is used for sending a stop instruction for stopping downloading the pictures or the videos to the server when a slide operation is detected and the display contents of the pictures or the videos are not displayed in a display screen due to the slide operation before the pictures or the videos are displayed completely. The invention also discloses a picture check system and method. According to the device, the method and the system, when the network pictures or videos are checked at a terminal, the picture fragments are displayed, and the use experience of the user is improved.
Description
Technical field
The present invention relates to communication technical field, particularly relate to a kind of picture and check device, system and method.
Background technology
When user wants to check network picture or video in terminal, generally require picture request checked or video delays
After depositing or downloading to terminal, picture that request could be checked by terminal or video display are to user.But, user's request sometimes is looked into
The picture seen or video are not user's picture of wanting to check or video, and at this time user also can only wait the picture that request is checked
Or after video is shown completely in terminal, just can find oneself in fact this picture or video to be lost interest in, user is come
Saying, not only consuming substantial amounts of data traffic, and the time waited is the longest, the experience of user is poor.
Summary of the invention
Present invention is primarily targeted at a kind of picture of proposition and check device, system and method, it is intended to check network picture
Or during video, realize the burst displaying of picture.
For achieving the above object, the present invention provides a kind of picture to check that device, described picture check that device includes:
Module is checked in request, for send to the server specified check the picture specified or video check instruction；
Burst display module, for receiving described picture or each burst number of video that described server returns successively
According to, and show the picture material that each fragment data is corresponding successively；
Stop checking module, for before described picture or video are shown completely, when slide and described being detected
When the displaying content of picture or video shows the most on a display screen because of described slide, send to described server under stopping
Carry the halt instruction of described picture or video.
Optionally, described burst display module includes:
Receive unit, for receiving described picture or the fragment data of video that described server currently returns；
Drawing unit, for sitting according to the slice images data in the fragment data being currently received and slice images region
Mark, draws, in the region that corresponding coordinate point is constituted on described display screen, the picture material that described slice images data are corresponding.
Optionally, described picture checks that device also includes that transmission module, described upper transmission module include:
Split cells, is split as multiple points for picture or video user selected according to the first preset burst mechanism
Sheet packet；
Uploading unit, uploads to described service for the multiple packet segments using the mode of multitask fractionation to be obtained
Device.
For achieving the above object, the present invention also provides for a kind of picture and checks that system, the described picture system of checking include first
Terminal, the second terminal, server, described first terminal and described second terminal include that device checked by any of the above-described picture, described
Server includes:
Pretreatment module, for after receiving the picture or video that described first terminal uploads, according to described picture or
Original resolution and preset multiple main flow resolution of video carry out pretreatment to described picture or video, main to obtain each
Pretreatment picture that flow point resolution is corresponding or video also store；
Determine module, for receive described second terminal send when checking instruction, check in instruction according to described
Picture or the mark of video, described second terminal resolution, determine and the to be viewed pre-place of described second terminal resolution match
Reason picture or video；
Burst module, for carrying out described pretreatment picture to be viewed or video point according to the second preset burst mechanism
Sheet generates fragment data, and according to the severity level determined, fragment data is returned to described second terminal successively.
Optionally, described burst module includes:
Acquiring unit, for obtaining described pretreatment picture to be viewed or the picture/mb-type of video；
Determine unit, the picture/mb-type got for basis and preset picture/mb-type and divisional type mapping relations,
Determine the severity level of divisional type and divisional type；
Sharding unit, is used for utilizing face recognition technology, to each figure in described pretreatment picture to be viewed or video
Sheet, carries out region burst successively according to the severity level order from high to low of described divisional type；
Dispatching Unit, every for being made up of slice images area coordinate and slice images data that region burst is obtained
The fragment data of individual burst, returns to described second terminal successively.
Additionally, for achieving the above object, the present invention also provides for a kind of picture inspection method, described picture inspection method bag
Include:
Send to the server specified check the picture specified or video check instruction；
Receive described picture or each fragment data of video that described server returns successively, and show each point successively
The picture material that sheet data are corresponding；
Before described picture or video are shown completely, when in displaying slide and described picture or video being detected
Slide described in Rong Yin and when showing the most on a display screen, send to described server and stop downloading described picture or video
Halt instruction.
Optionally, the described described picture receiving the return of described server successively or each fragment data of video, and depend on
The picture material that each fragment data of secondary displaying is corresponding includes:
Receive described picture or the fragment data of video that described server currently returns；
According to the slice images data in the fragment data being currently received and slice images area coordinate, in described display
The picture material that described slice images data are corresponding is drawn in the region that on screen, corresponding coordinate point is constituted.
Optionally, described picture inspection method also includes:
Picture or the video user selected are split as multiple packet segment according to the first preset burst mechanism；
The multiple packet segments using the mode of multitask fractionation to be obtained upload to described server.
For achieving the above object, the present invention also provides for a kind of picture inspection method, and described picture inspection method includes:
Server is after receiving the picture or video that first terminal uploads, according to described picture or original resolution of video
Rate and preset multiple main flow resolution carry out pretreatment to described picture or video, corresponding to obtain each main flow resolution
Pretreatment picture or video also store；
Receive that the second terminal sends when checking instruction, according to described check in instruction picture or the mark of video,
Described second terminal resolution, determines the pretreatment picture to be viewed with described second terminal resolution match or video；
Described pretreatment picture to be viewed or video are carried out burst according to the second preset burst mechanism and generates burst number
According to, and fragment data is returned to described second terminal successively according to the severity level determined.
Optionally, described described pretreatment picture to be viewed or video are carried out burst according to the second preset burst mechanism
Generate fragment data, and fragment data is returned to described second terminal successively according to the severity level determined include:
Obtain described pretreatment picture to be viewed or the picture/mb-type of video；
According to the picture/mb-type got and preset picture/mb-type and divisional type mapping relations, determine divisional type and
The severity level of divisional type；
Utilize face recognition technology, to each picture in described pretreatment picture to be viewed or video, according to described point
The severity level of district's type order from high to low carries out region burst successively；
The burst of each burst being made up of slice images area coordinate and slice images data that region burst is obtained
Data, return to described second terminal successively.
The picture that the present invention proposes checks device, system and method, after receiving the fragment data that server returns successively, and phase
Should show that it asks picture or the picture of video checked by ground burst successively, and ask the picture checked or video to be shown completely
Before, when user slide display screen cause the displaying content of the picture asking to check or video to show the most on a display screen time, to
Server sends and stops picture or the halt instruction of video that the request of downloading is checked, thus is not desired to continue to check that request is looked into user
When the picture seen or video, both saved picture or the flow remaining fragment data of video that user's request of downloading is checked, and
The mode that burst is shown substantially reduces user and checks picture or video time to be waited, improve user check picture or
The experience of video.
Accompanying drawing explanation
Fig. 1 is the hardware architecture diagram realizing each one mobile terminal of embodiment of the present invention；
Fig. 2 is the radio communication device schematic diagram of mobile terminal as shown in Figure 1；
Fig. 3 is the module diagram that device first embodiment checked by picture of the present invention；
Fig. 4 is the module diagram of burst display module in Fig. 3；
Fig. 5 is that the module diagram of upper transmission module in device the second embodiment checked by picture of the present invention；
Fig. 6 is that the module diagram of server in system one embodiment checked by picture of the present invention；
Fig. 7 is the module diagram of burst module in Fig. 6；
Fig. 8 is terminal and the sequential chart of server interaction in picture inspection method first embodiment of the present invention；
Fig. 9 is the schematic flow sheet of the 5th step in picture inspection method first embodiment of the present invention；
Figure 10 is the schematic flow sheet of the 6th step in picture inspection method first embodiment of the present invention；
Application scenarios schematic diagram when Figure 11 is that in the present invention, burst is shown；
Figure 12 is the schematic flow sheet of the first step in picture inspection method the second embodiment of the present invention.
The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, are described further referring to the drawings.
Detailed description of the invention
Should be appreciated that specific embodiment described herein, only in order to explain the present invention, is not intended to limit the present invention.
The mobile terminal realizing each embodiment of the present invention is described referring now to accompanying drawing.In follow-up description, use
For representing the suffix explanation only for the beneficially present invention of such as " module ", " parts " or " unit " of element, itself
Not specific meaning.Therefore, " module " can mixedly use with " parts ".
Mobile terminal can be implemented in a variety of manners.Such as, the terminal described in the present invention can include such as moving
Phone, smart phone, notebook computer, digit broadcasting receiver, PDA (personal digital assistant), PAD (panel computer), PMP
The mobile terminal of (portable media player), guider etc. and consolidating of such as numeral TV, desk computer etc.
Determine terminal.Hereinafter it is assumed that terminal is mobile terminal.However, it will be understood by those skilled in the art that, mobile except being used in particular for
Outside the element of purpose, structure according to the embodiment of the present invention can also apply to the terminal of fixed type.
Fig. 1 is the hardware architecture diagram realizing each one mobile terminal of embodiment of the present invention.
Mobile terminal 100 can include wireless communication unit 110, A/V (audio/video) input block 120, user's input
Unit 130, sensing unit 140, output unit 150, memorizer 160, interface unit 170, controller 180 and power subsystem 190
Etc..Fig. 1 shows the mobile terminal with various assembly, it should be understood that be not required for implementing all groups illustrated
Part.Can alternatively implement more or less of assembly.Will be discussed in more detail below the element of mobile terminal.
Wireless communication unit 110 generally includes one or more assembly, and it allows mobile terminal 100 and radio communication device
Or the radio communication between network.Such as, wireless communication unit can include broadcast reception module 111, mobile communication module
112, at least one in wireless Internet module 113, short range communication module 114 and positional information module 115.
Broadcast reception module 111 receives broadcast singal and/or broadcast via broadcast channel from external broadcasting management server
Relevant information.Broadcast channel can include satellite channel and/or terrestrial channel.Broadcast management server can be to generate and send
Broadcast singal and/or the server of broadcast related information or the broadcast singal generated before receiving and/or broadcast related information
And send it to the server of terminal.Broadcast singal can include that TV broadcast singal, radio signals, data are broadcasted
Signal etc..And, broadcast singal may further include the broadcast singal combined with TV or radio signals.Broadcast phase
Pass information can also provide via mobile communications network, and in this case, broadcast related information can be by mobile communication mould
Block 112 receives.Broadcast singal can exist in a variety of manners, and such as, it can be with the electronics of DMB (DMB)
Program guide (EPG), the form of electronic service guidebooks (ESG) etc. of digital video broadcast-handheld (DVB-H) and exist.Broadcast
Receiver module 111 can be broadcasted by using various types of broadcasters to receive signal.Especially, broadcast reception module 111
Can be by using such as multimedia broadcasting-ground (DMB-T), DMB-satellite (DMB-S), digital video wide
Broadcast-hand-held (DVB-H), the data broadcaster of forward link media (MediaFLO@), received terrestrial digital broadcasting integrated service
Etc. (ISDB-T) digital broadcast apparatus receives digital broadcasting.Broadcast reception module 111 may be constructed such that and is adapted to provide for extensively
Broadcast the various broadcasters of signal and above-mentioned digital broadcast apparatus.Via broadcast reception module 111 receive broadcast singal and/
Or broadcast related information can be stored in memorizer 160 (or other type of storage medium).
Mobile communication module 112 sends radio signals to base station (such as, access point, node B etc.), exterior terminal
And in server at least one and/or receive from it radio signal.Such radio signal can include that voice leads to
Words signal, video calling signal or the various types of data sending according to text and/or Multimedia Message and/or receiving.
Wireless Internet module 113 supports the Wi-Fi (Wireless Internet Access) of mobile terminal.This module can be internally or externally
It is couple to terminal.Wi-Fi (Wireless Internet Access) technology involved by this module can include WLAN (WLAN) (Wi-Fi), Wibro
(WiMAX), Wimax (worldwide interoperability for microwave access), HSDPA (high-speed downlink packet access) etc..
Short range communication module 114 is the module for supporting junction service.Some examples of short-range communication technology include indigo plant
Tooth TM, RF identification (RFID), Infrared Data Association (IrDA), ultra broadband (UWB), purple honeybee TM etc..
Positional information module 115 is the module of positional information for checking or obtain mobile terminal.Positional information module
Typical case be GPS (global pick device).According to current technology, positional information module 115 calculates from three or more
The range information of many satellites and correct time information and for the Information application triangulation calculated, thus according to warp
Degree, latitude and highly accurately calculating three-dimensional current location information.Currently, for calculating the method use of position and temporal information
Three satellites and by using the position and the error of temporal information that other satellite correction calculates.Additionally, position
Information module 115 can calculate velocity information by Continuous plus current location information in real time.
A/V input block 120 is used for receiving audio or video signal.A/V input block 120 can include camera 121 He
Mike 122, the camera 121 static images to being obtained by image capture apparatus in Video Capture pattern or image capture mode
Or the view data of video processes.Picture frame after process may be displayed on display unit 151.Process through camera 121
After picture frame can be stored in memorizer 160 (or other storage medium) or via wireless communication unit 110 carry out send out
Send, two or more cameras 121 can be provided according to the structure of mobile terminal.Mike 122 can be in telephone calling model, note
Record pattern, speech recognition mode etc. operational mode receives sound (voice data) via mike, and can be by so
Acoustic processing be voice data.Audio frequency (voice) data after process can be converted in the case of telephone calling model can
The form output of mobile communication base station it is sent to via mobile communication module 112.Mike 122 can implement various types of making an uproar
Sound eliminates (or suppression) algorithm and with the noise of elimination (or suppression) generation during receiving and send audio signal or does
Disturb.
User input unit 130 can generate key input data to control each of mobile terminal according to the order of user's input
Plant operation.User input unit 130 allows user to input various types of information, and can include keyboard, metal dome, touch
Plate (such as, detection due to touched and cause resistance, pressure, the sensitive component of change of electric capacity etc.), roller, rocking bar etc.
Deng.Especially, when touch pad is superimposed upon on display unit 151 as a layer, touch screen can be formed.
Sensing unit 140 detects the current state of mobile terminal 100, (such as, mobile terminal 100 open or close shape
State), the position of mobile terminal 100, user is for the presence or absence of contact (that is, touch input) of mobile terminal 100, mobile terminal
Orientation, the acceleration of mobile terminal 100 of 100 or speed is moved and direction etc., and generate for controlling mobile terminal 100
The order of operation or signal.Such as, when mobile terminal 100 is embodied as sliding-type mobile phone, sensing unit 140 can sense
This sliding-type phone opens or cuts out.It addition, sensing unit 140 can detect power subsystem 190 whether provide electric power or
Whether person's interface unit 170 couples with external device (ED).
Interface unit 170 is used as at least one external device (ED) and is connected, with mobile terminal 100, the interface that can pass through.Such as,
External device (ED) can include wired or wireless head-band earphone port, external power source (or battery charger) port, wired or nothing
Line FPDP, memory card port, for connect have the port of device of identification module, audio frequency input/output (I/O) end
Mouth, video i/o port, ear port etc..Identification module can be that storage is for verifying that user uses each of mobile terminal 100
Kind of information and subscriber identification module (UIM), client identification module (SIM), Universal Subscriber identification module (USIM) can be included
Etc..It addition, the device (hereinafter referred to as " identification device ") with identification module can be to take the form of smart card, therefore, know
Other device can be connected with mobile terminal 100 via port or other attachment means.Interface unit 170 may be used for receive from
The input (such as, data message, electric power etc.) of external device (ED) and the input received is transferred in mobile terminal 100
One or more elements or may be used between mobile terminal and external device (ED) transmit data.
It addition, when mobile terminal 100 is connected with external base, interface unit 170 can serve as allowing electricity by it
Power provides the path of mobile terminal 100 from base or can serve as allowing from the various command signals of base input by it
It is transferred to the path of mobile terminal.May serve as identifying that mobile terminal is from various command signals or the electric power of base input
The no signal being accurately fitted within base.Output unit 150 is configured to provide defeated with vision, audio frequency and/or tactile manner
Go out signal (such as, audio signal, video signal, alarm signal, vibration signal etc.).Output unit 150 can include display
Unit 151, dio Output Modules 152 etc..
Display unit 151 may be displayed on the information processed in mobile terminal 100.Such as, it is in electricity when mobile terminal 100
During words call mode, display unit 151 can show and call or other (such as, text messaging, multimedia file that communicate
Download etc.) relevant user interface (UI) or graphic user interface (GUI).When mobile terminal 100 is in video calling pattern
Or during image capture mode, display unit 151 can show image and/or the image of reception of capture, illustrate video or figure
UI or GUI of picture and correlation function etc..
Meanwhile, when display unit 151 and touch pad the most superposed on one another with formed touch screen time, display unit
151 can serve as input equipment and output device.Display unit 151 can include liquid crystal display (LCD), thin film transistor (TFT)
In LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible display, three-dimensional (3D) display etc. at least
A kind of.Some in these display may be constructed such that transparence is watched from outside with permission user, and this is properly termed as transparent
Display, typical transparent display can for example, TOLED (transparent organic light emitting diode) display etc..According to specific
The embodiment wanted, mobile terminal 100 can include two or more display units (or other display device), such as, move
Dynamic terminal can include outernal display unit (not shown) and inner display unit (not shown).Touch screen can be used for detection and touches
Input pressure and touch input position and touch input area.
Dio Output Modules 152 can mobile terminal be in call signal receive pattern, call mode, logging mode,
Time under the isotype such as speech recognition mode, broadcast reception mode, that wireless communication unit 110 is received or at memorizer 160
The voice data transducing audio signal of middle storage and be output as sound.And, dio Output Modules 152 can provide with mobile
The audio frequency output (such as, call signal receives sound, message sink sound etc.) that the specific function that terminal 100 performs is relevant.
Dio Output Modules 152 can include pick up, buzzer etc..
Memorizer 160 can store the process performed by controller 180 and the software program controlling operation etc., or can
The data (such as, telephone directory, message, still image, video etc.) that maybe will export have been exported temporarily to store.And
And, memorizer 160 can with storage about when touch be applied to touch screen time the vibration of various modes of output and audio signal
Data.
Memorizer 160 can include that the storage medium of at least one type, described storage medium include flash memory, hard disk, many
Media card, card-type memorizer (such as, SD or DX memorizer etc.), random access storage device (RAM), static random-access store
Device (SRAM), read only memory (ROM), Electrically Erasable Read Only Memory (EEPROM), programmable read only memory
(PROM), magnetic storage, disk, CD etc..And, mobile terminal 100 can be connected execution memorizer with by network
The network storage device cooperation of the storage function of 160.
Controller 180 generally controls the overall operation of mobile terminal.Such as, controller 180 performs and voice call, data
Control that communication, video calling etc. are relevant and process.It addition, controller 180 can include for reproducing (or playback) many matchmakers
The multi-media module 181 of volume data, multi-media module 181 can construct in controller 180, or it is so structured that with control
Device 180 separates.Controller 180 can perform pattern recognition process, with the handwriting input that will perform on the touchscreen or picture
Draw input and be identified as character or image.
Power subsystem 190 receives external power or internal power under the control of controller 180 and provides operation each unit
Suitable electric power needed for part and assembly.
Various embodiment described herein can be to use such as computer software, hardware or its any combination of calculating
Machine computer-readable recording medium is implemented.Implementing for hardware, embodiment described herein can be by using application-specific IC
(ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), scene can
Program gate array (FPGA), processor, controller, microcontroller, microprocessor, be designed to perform function described herein
At least one in electronic unit is implemented, and in some cases, such embodiment can be implemented in controller 180.
Software is implemented, the embodiment of such as process or function can with allow to perform the single of at least one function or operation
Software module is implemented.Software code can be come by the software application (or program) write with any suitable programming language
Implementing, software code can be stored in memorizer 160 and be performed by controller 180.
So far, mobile terminal is described according to its function.Below, for the sake of brevity, will describe such as folded form,
Slide type mobile terminal in various types of mobile terminals of board-type, oscillating-type, slide type mobile terminal etc. is as showing
Example.Therefore, the present invention can be applied to any kind of mobile terminal, and is not limited to slide type mobile terminal.
It should be noted that network picture or video that the mobile terminal shown in Fig. 1 can be also used for checking request enter
Row burst is shown, the virtual functions module that this concrete mobile terminal includes is as follows:
Module 400 is checked in request, for send to the server specified check the picture specified or video check instruction；
Burst display module 500, for receiving this picture or each fragment data of video that this server returns successively,
And show the picture material that each fragment data is corresponding successively；
Stop checking module 600, for before this picture or video are shown completely, when slide and this figure being detected
When the displaying content of sheet or video shows the most on a display screen because of this slide, send to this server and stop downloading this figure
Sheet or the halt instruction of video.
In the mobile terminal shown in Fig. 1, the virtual module that controller comprises i.e. asks to check module 400, to appointment
Server send check the picture specified or video check instruction after, wait the data that this server to be received returns；When this
The virtual module of controller i.e. burst display module 500, receives this picture or each burst of video that this server returns
After data, according to the sequencing of the fragment data returned, show the picture material that each fragment data is corresponding successively, thus real
The network picture now checked request or the burst of video are shown.
At the picture checked of request or video, when also not showing complete on the display unit 151 of mobile terminal, controller
The virtual module comprised i.e. stops checking module 600, at the slide detected in user input unit 130, and this picture
Or the displaying content of video because of this slide not when the display screen display of display unit 151, send to this server
Stop downloading this picture or the halt instruction of video, so that this server stops continuing to send this picture or video to mobile terminal
Residue fragment data.
As shown in Figure 1 mobile terminal 100 may be constructed such that utilize via frame or packet transmission data all if any
Line and radio communication device and satellite-based communicator operate.
The communicator being wherein operable to according to the mobile terminal of the present invention is described referring now to Fig. 2.
Such communicator can use different air interfaces and/or physical layer.Such as, communicator use
Air interface includes such as frequency division multiple access (FDMA), time division multiple acess (TDMA), CDMA (CDMA) and universal mobile communications dress
Put (UMTS) (especially, Long Term Evolution (LTE)), global mobile communication device (GSM) etc..As non-limiting example, under
The description in face relates to cdma communication device, but such teaching is equally applicable to other type of device.
With reference to Fig. 2, cdma wireless communication device can include multiple mobile terminal 100, multiple base station (BS) 270, base station
Controller (BSC) 275 and mobile switching centre (MSC) 280.MSC280 is configured to and Public Switched Telephony Network (PSTN)
290 form interface.MSC280 is also structured to and the BSC275 formation interface that can be couple to base station 270 via back haul link.
If back haul link can construct according to any one in the interface that Ganji knows, described interface includes such as E1/T1, ATM, IP,
PPP, frame relay, HDSL, ADSL or xDSL.It will be appreciated that device as shown in Figure 2 can include multiple BSC275.
Each BS270 can service one or more subregion (or region), by multidirectional antenna or the sky of sensing specific direction
Each subregion that line covers is radially away from BS270.Or, each subregion can be by for two or more of diversity reception
Antenna covers.Each BS270 may be constructed such that support multiple frequencies distribution, and the distribution of each frequency has specific frequency spectrum
(such as, 1.25MHz, 5MHz etc.).
Intersecting that subregion and frequency are distributed can be referred to as CDMA Channel.BS270 can also be referred to as base station transceiver
Device (BTS) or other equivalent terms.In this case, term " base station " may be used for broadly representing single
BSC275 and at least one BS270.Base station can also be referred to as " cellular station ".Or, each subregion of specific BS270 can be claimed
For multiple cellular stations.
As shown in Figure 2, broadcast singal is sent in device the mobile terminal operated by broadcsting transmitter (BT) 295
100.Broadcast reception module 111 is arranged on mobile terminal 100 and sentences the broadcast that reception is sent by BT295 as shown in Figure 1
Signal.In fig. 2 it is shown that several global pick devices (GPS) satellite 300.Satellite 300 helps to position multiple mobile terminals
At least one in 100.
In fig. 2, depict multiple satellite 300, but it is understood that, it is possible to use any number of satellite obtains
Useful location information.Positional information module 115 is generally configured to coordinate with satellite 300 and thinks to obtain as shown in Figure 1
The location information wanted.Substitute GPS tracking technique or outside GPS tracking technique, it is possible to use mobile terminal can be followed the tracks of
Other technology of position.It addition, at least one gps satellite 300 can optionally or additionally process satellite dmb transmission.
As a typical operation of radio communication device, BS270 receives the reverse link from various mobile terminals 100
Signal.Mobile terminal 100 generally participates in call, information receiving and transmitting communicates with other type of.Certain base station 270 receive each instead
Processed in specific BS270 to link signal.The data obtained are forwarded to the BSC275 being correlated with.BSC provides call
Resource distribution and the mobile management function of the coordination of soft switching process included between BS270.The number that BSC275 also will receive
According to being routed to MSC280, it provides the extra route service for forming interface with PSTN290.Similarly, PSTN290 with
MSC280 forms interface, MSC Yu BSC275 forms interface, and BSC275 correspondingly controls BS270 with by forward link signals
It is sent to mobile terminal 100.
Based on above-mentioned mobile terminal hardware configuration, the structure of communicator, propose apparatus of the present invention, system and method each
Individual embodiment.
The present invention further provides a kind of picture and check device, as shown in Figure 3, it is shown that device the checked by picture of the present invention
The module diagram of one embodiment, picture checks that device includes:
Module 400 is checked in request, for send to the server specified check the picture specified or video check instruction；
Picture checks that device may be provided in terminal, and terminal can be above-mentioned mobile terminal.Prestore in terminal and receive it
The reference address of the server checking instruction sent.The picture specified or video can be determined by the mark of picture or video,
The video related in the present invention is made up of according to appointment playing sequence multiframe picture.
After user selectes picture to be viewed or video in terminal, the request of triggering terminal checks that module 400 will comprise
Picture to be viewed or checking of the mark of video that user selectes instruct on the server being sent to specify, and check use with request
Picture to be viewed that family is selected or video.
Burst display module 500, for receiving picture or each fragment data of video that server returns successively, and depends on
The picture material that each fragment data of secondary displaying is corresponding；
After what server reception terminal sent checks instruction, the mark according to checking picture or the video comprised in instruction is looked into
Look for corresponding picture file or video file, then the every frame picture in the picture file found or video file is carried out point
Sheet processes, thus obtains picture or the video fragment data after burst asking to check, and obtains fragment data according to burst
Sequencing, each fragment data is returned to terminal successively.
The burst display module 500 of terminal receives the picture checked of request or the burst number of video that server returns successively
According to, and after receiving a fragment data, show the picture material that this fragment data is corresponding at once, thus reach same figure
The burst of the content of the same frame picture of sheet or video is shown.
Further, with reference to Fig. 4, burst display module 500 specifically includes:
Receive unit 501, for receiving picture or the fragment data of video that server currently returns；
Drawing unit 502, for according to the slice images data in the fragment data being currently received and slice images district
Territory coordinate, draws, in the region that corresponding coordinate point is constituted on a display screen, the picture material that slice images data are corresponding.
Server after processing the fragment data obtaining user's picture of checking of request or video, the burst that will obtain immediately
Data return to terminal.The reception unit 501 of terminal is whenever receiving fragment data, the then drawing unit that server returns
The 502 slice images data comprised according to this fragment data and slice images area coordinates, at the corresponding seat of the display screen of terminal
Draw these slice images data in the region that punctuate is constituted, thus show the picture material that these slice images data are corresponding.
Wherein, the Pixel Information of the image that slice images data comprise in referring to a burst region of picture and each picture
The coordinate points (setting up coordinate system for reference with the picture carrying out burst) that element is corresponding；Slice images area coordinate refers to the one of picture
Coordinate points corresponding to the boundary pixel point in individual burst region (with carry out burst picture for reference to setting up coordinate system) set；Eventually
The corresponding coordinate point of display screen of end refer to the coordinate points identical with each coordinate points comprised in slice images area coordinate (with
Picture to be viewed or the display area of video are for reference to setting up coordinate system).
Burst display module 500, after receiving the fragment data that server returns, comprises according to fragment data immediately
Slice images data and slice images area coordinate, on a display screen corresponding coordinate point constitute region in drafting slice images
The picture material that data are corresponding such that it is able to show same picture successively according to the sequencing of the fragment data of server return
Different images content, reach burst show effect.
Stop checking module 600, for before picture or video are shown completely, when detect slide and picture or
When the displaying content of video shows the most on a display screen because of slide, send to server and stop download pictures or video
Halt instruction.
If the displaying content asking the picture checked or video in terminal is maintained at the display screen display of terminal, then eventually
The burst display module 500 of end will constantly receive the picture checked of request or the fragment data of video that server returns, and
It is illustrated in dividing of the relevant position of viewing area, the effect that formation burst is shown, the picture checked until request or video successively
Sheet data have all received, and the picture checked of request or video display completely till.
If before asking the picture checked or video to be shown completely, terminal detects user's slip on a display screen
Operation, and judge when the displaying content of the picture asking to check or video shows the most on a display screen because of this slide,
The stopping of terminal is checked that module 600 sends to server and is stopped downloading picture or the halt instruction of video that its request is checked, with
Notice server stops continuing to return picture or the residue fragment data of video that its request is checked to terminal.
Device checked by the picture that the present invention proposes, and after receiving the fragment data that server returns successively, divides the most successively
Before sheet shows its picture of checking of request or picture of video, and the picture checked in request or video are shown completely, when with
When family slip display screen causes the displaying content of the picture asking to check or video to show the most on a display screen, send to server
Stop downloading the picture checked of request or the halt instruction of video, thus user be not desired to continue to check picture that request is checked or
During video, both saved the flow that user downloads the residue fragment data of the picture checked of request or video, and burst had been shown
Mode substantially reduces user and checks picture or video time to be waited, improves user and checks the use of picture or video
Experience.
Further, proposing picture of the present invention based on first embodiment and check device the second embodiment, the present embodiment is with upper
Stating picture and check that the difference of device first embodiment is, the present embodiment picture checks that device also includes transmission module 700, reference
Fig. 5, upper transmission module 700 includes:
Split cells 701, is split as many for picture or video user selected according to the first preset burst mechanism
Individual packet segment；
Uploading unit 702, the multiple packet segments for using the mode of multitask fractionation to be obtained upload to service
Device.
First burst mechanism for being split as several fragment datas specifying size by the packet exceeding a certain size
Bag, thus reach this packet is carried out the purpose of batch processing.Picture or the video that user selectes is split at split cells 701
After obtaining multiple packet segment, multiple packet segments that fractionation is obtained by uploading unit 702 use the mode of multitask (i.e.
System can run multiple process simultaneously, and each process also can perform multiple thread simultaneously) upload onto the server.
Device checked by the picture that the present invention proposes, picture that needs are uploaded by the mode using multitask, burst to upload or
Video is sent to server, accelerates uploading speed, decreases period of reservation of number, improves the experience of user.
The present invention also provide for further a kind of picture check system, the picture system of checking include first terminal, the second terminal,
Server, first terminal and the second terminal include that device checked by the picture of any of the above-described embodiment；With reference to Fig. 6, picture of the present invention
Check that in system one embodiment, server includes:
Pretreatment module 800, for after receiving the picture or video that first terminal uploads, according to picture or video
Original resolution and preset multiple main flow resolution carry out pretreatment to picture or video, to obtain each main flow resolution pair
The pretreatment picture answered or video also store；
First terminal is the class in above-mentioned terminal, for representing to server uploading pictures or the mobile terminal of video.
Second terminal is the class in above-mentioned terminal, for represent send to server check the picture specified or video check instruction
Mobile terminal.
Multitask, burst is used to upload picture or the packet of video that mode is uploaded for first terminal, server
Pretreatment module 800, after receiving the packet segment that first terminal is uploaded, first will belong to the fragment data of same packet
Bag is integrated, thus obtains complete picture or video.
Original resolution of picture or video is when first terminal uploading pictures or video, first terminal by this picture or
Some base attribute information of video, such as the mark (such as title or numbering) of picture or the resolution of video, picture or video, figure
Sheet or the data package size of video, picture/mb-type, the width of picture and high, be uploaded to receive picture or the service of video simultaneously
Device.Preset main flow resolution can be configured according to the screen resolution that current main-stream terminal is used, and such as, main flow is differentiated
Rate may be configured as 640 × 480,960 × 540,1280 × 720,1920 × 1080 etc..
The smallest object that the pretreatment module 800 of server carries out pretreatment is picture, the figure received for server
Sheet, pretreatment module 800 directly carries out pretreatment to this picture, and the video received for server, pretreatment module 800 depends on
Frame picture in secondary extraction video, and every frame picture is carried out pretreatment.The pretreatment module 800 of the server figure to receiving
The pretreatment of sheet or video includes:
(1), for each main flow resolution, calculate according to current main flow resolution currently need to process picture (or
The frame picture of video) converted after the height Mh of pretreatment picture (or frame picture of preprocessed video) that obtains, specific as follows:
Main flow resolution being designated as: Sw × Sh, the resolution of picture (or frame picture of video) is: Pw × Ph
The size being calculated Mh is carried out secondary adjustment, specific as follows:
For the picture uploaded, after above-mentioned process, i.e. can get the height Mh that picture needs to be adjusted to；For uploading
Video, owing to width and the height of each frame picture are identical, thus it is the most available only need to calculate a frame picture in video
In this video, every frame picture needs the height Mh being adjusted to.
(2) according to the original wide high proportion of every frame picture of calculated height Mh, picture or video, calculate and height
Width Mw corresponding for Mh；
(3) according to calculated height Mh and width Mw, every frame picture of picture or video is compressed, cutting,
And the pretreatment picture that obtains or preprocessed video are saved in the appointment position of server after processing.
Determine module 900, for receive that the second terminal sends when checking instruction, according to check in instruction picture or
The mark of video, the second terminal resolution, determine the pretreatment picture to be viewed with the second terminal resolution match or video；
After what server received that the second terminal sends checks instruction, determine that module 900 is first according to checking that instruction comprises
Picture or video identifier lookup server on whether stored this picture or video, when on server storage have this picture or
During video, search in this picture or the pretreatment picture of main flow resolution corresponding to video or video, if exist and check finger
The main flow resolution that the second terminal resolution of comprising in order is identical, when there is the main flow resolution identical with the second terminal resolution
During rate, pretreatment picture corresponding for this main flow resolution or video are defined as with the second terminal resolution match is to be viewed pre-
Process picture or video；When there is not the main flow resolution identical with the second terminal resolution, according to above-mentioned pre-treatment step
Picture that computation requests is checked or the Mh of video, the picture then calculated during pretreatment and request checked or video
The pretreatment picture of main flow resolution corresponding for the immediate Mh of Mh or video, be defined as and the second terminal resolution match
Pretreatment picture to be viewed or video.
Burst module 990, for carrying out pretreatment picture to be viewed or video point according to the second preset burst mechanism
Sheet generates fragment data, and according to the severity level determined, fragment data is returned to the second terminal successively.
Second burst mechanism is for being several burst numbers according to certain burst logic by the data fragmentation of same picture
According to, and when burst, different fragment datas is set a severity level according to certain logic.Server is determining
Picture that two terminal request are checked or the pretreatment picture to be viewed of the corresponding terminal resolution match with the second terminal of video
Or after video, pretreatment picture to be viewed or video are carried out burst according to the second burst mechanism and generate some by burst module 990
Individual fragment data, and by fragment data according to burst time the severity level determined return to the second terminal successively.
Further, with reference to Fig. 7, burst module 990 specifically includes:
Acquiring unit 991, for obtaining pretreatment picture to be viewed or the picture/mb-type of video；
The picture/mb-type of pretreatment picture to be viewed or video asks picture or the figure of video checked with corresponding user
Sheet type is identical, and picture or the picture/mb-type of video that user's request is checked are incited somebody to action when being and uploaded this picture or video by first terminal
The base attribute information comprising picture/mb-type is also uploaded onto the server and is stored.Picture/mb-type refers to the class of the picture uploaded
Type after frame picture is sorted out in type, or video, such as personage, landscape, building etc..
Determine unit 992, for mapping pass according to the picture/mb-type got and preset picture/mb-type with divisional type
System, determines the severity level of divisional type and divisional type；
Being previously stored with picture/mb-type and divisional type mapping relations on server, i.e. different picture/mb-type are each self-corresponding
Divisional type and the severity level of each divisional type.Such as, picture/mb-type is landscape, it is determined that unit 992 is according to picture category
Type and divisional type mapping relations, it may be determined that divisional type corresponding to this picture/mb-type be mountain, water, plant, other (except mountain, water,
Exophytic subregion is all classified as other), the severity level of divisional type be followed successively by from high to low mountain, water, plant, other, can be by
Numeral numbering order from small to large represents the severity level of divisional type order from high to low, such as, divisional type mountain
Severity level is 1, and the severity level of divisional type water is 2, and the severity level of divisional type plant is 3, divisional type other
Severity level is 4.
Sharding unit 993, is used for utilizing face recognition technology, to each figure in pretreatment picture to be viewed or video
Sheet, carries out region burst successively according to the severity level order from high to low of divisional type；
Dispatching Unit 994, is made up of slice images area coordinate and slice images data for obtained by region burst
The fragment data of each burst, return to the second terminal successively.
Being as a example by landscape by picture/mb-type, the sharding unit 993 of server utilizes face recognition technology, to pre-place to be viewed
It is that mountain carries out region burst for the first time that each picture in reason picture or video is first according to divisional type, and determines each burst
Slice images area coordinate and slice images data, each point that then first time region burst is obtained by Dispatching Unit 994
Sheet data (slice images area coordinate and slice images data by each burst are constituted) return to the second terminal；District for the first time
After territory burst terminates, it is that water carries out second time region burst that sharding unit 993 continues according to divisional type, and determines each burst
Slice images area coordinate and slice images data, each point that then second time region burst is obtained by Dispatching Unit 994
Sheet data return to the second terminal；After region burst terminates for the second time, it is that plant enters that sharding unit 993 continues according to divisional type
Row third time region burst, and determine slice images area coordinate and the slice images data of each burst, then Dispatching Unit
Each fragment data that third time region burst obtains is returned to the second terminal by 994；After region burst terminates for the third time, burst
It is that other carry out the 4th sub-region burst that unit 993 continues according to divisional type, and determines the slice images region of each burst
Coordinate and slice images data, then each fragment data that the 4th sub-region burst obtains is returned to by Dispatching Unit 994
Two terminals.
Burst module 990, according to pretreatment picture to be viewed or the picture/mb-type of video, utilizes face recognition technology to treat
Check that pretreatment picture or video carry out burst, and return successively according to the severity level (i.e. the sequencing of burst) of divisional type
Return fragment data to the second terminal, allow users to be sequentially received the burst number of picture according to the severity level of divisional type
According to, reach first to show the effect of important slice images content when burst is shown.
System checked by the picture that the present invention proposes, and picture or video that first terminal is uploaded by server are differentiated according to main flow
Rate carries out pretreatment, and preserves pretreatment picture corresponding to each main flow resolution or video, when the second terminal request checks finger
When fixed picture or video, server according to the terminal resolution of the second terminal determine with the second terminal resolution match to be checked
See pretreatment picture or video, then by pretreatment picture to be viewed or video slicing and return to the second terminal successively, make
Two terminals receive and are capable of burst after fragment datas and show, check the speed of download pictures improving user.
Invention further provides picture inspection method first embodiment, as shown in Figure 8, it is shown that picture of the present invention is looked into
See that terminal and the sequential chart of server interaction in method first embodiment, the corresponding above-mentioned picture of the present embodiment check that device first is real
Execute example and system one embodiment checked by above-mentioned picture.Wherein, terminal is divided into first terminal and the second terminal, and picture of the present invention is checked
Method includes:
The first step: first terminal is to the server uploading pictures specified or video；
Second step: server after receiving the picture or video that first terminal uploads, original according to picture or video
Resolution and preset multiple main flow resolution carry out pretreatment to picture or video, corresponding to obtain each main flow resolution
Pretreatment picture or video also store；
First terminal is above-mentioned mobile terminal, for representing to server uploading pictures or a class mobile terminal of video.
Original resolution of picture or video is when first terminal uploading pictures or video, and first terminal is by this picture or the one of video
A little base attribute information, such as the mark (such as title or numbering) of picture or the resolution of video, picture or video, picture or video
Data package size, picture/mb-type, the width of picture and high, be uploaded to receive picture or the server of video simultaneously.Preset
Main flow resolution can be configured according to the screen resolution that current main-stream terminal is used, and such as, main flow resolution can be arranged
It is 640 × 480,960 × 540,1280 × 720,1920 × 1080 etc..
It is picture that server carries out the smallest object of pretreatment, the picture received for server, then directly to this figure
Sheet carries out pretreatment, the video received for server, and server extracts the frame picture in video successively, and to every frame picture
Carry out pretreatment.The pretreatment of the server picture to receiving or video includes:
(1), for each main flow resolution, calculate according to current main flow resolution currently need to process picture (or
The frame picture of video) converted after the height Mh of pretreatment picture (or frame picture of preprocessed video) that obtains, specific as follows:
Main flow resolution being designated as: Sw × Sh, the resolution of picture (or frame picture of video) is: Pw × Ph
The size being calculated Mh is carried out secondary adjustment, specific as follows:
For the picture uploaded, after above-mentioned process, i.e. can get the height Mh that picture needs to be adjusted to；For uploading
Video, owing to width and the height of each frame picture are identical, thus it is the most available only need to calculate a frame picture in video
In this video, every frame picture needs the height Mh being adjusted to.
(2) according to the original wide high proportion of every frame picture of calculated height Mh, picture or video, calculate and height
Width Mw corresponding for Mh；
(3) according to calculated height Mh and width Mw, every frame picture of picture or video is compressed, cutting,
And the pretreatment picture that obtains or preprocessed video are saved in the appointment position of server after processing.
3rd step: the second terminal send to the server specified check the picture specified or video check instruction；
Second terminal is above-mentioned mobile terminal, checks checking of the picture specified or video for representing to send to server
One class mobile terminal of instruction.The reference address receiving its server checking instruction sent is prestored in second terminal.Refer to
Fixed picture or video can be determined by the mark of picture or video, the video related in the present invention by multiframe picture according to appointment
Playing sequence forms.
After user selectes picture to be viewed or video in the second terminal, triggering the second terminal will comprise what user selected
Picture to be viewed or the mark of video check on the server that instruction is sent to specify, check that what user selected treats with request
The picture checked or video.
4th step: server receive that the second terminal sends when checking instruction, according to checking in instruction picture or regarding
The mark of frequency, the second terminal resolution, determine the pretreatment picture to be viewed with the second terminal resolution match or video；
After what server received that the second terminal sends checks instruction, first according to checking the picture that comprises of instruction or video
Identifier lookup server on whether stored this picture or video, when on server storage have this picture or video time, search
In this picture or the pretreatment picture of main flow resolution corresponding to video or video, if exist and check the comprised in instruction
The main flow resolution that two terminal resolution are identical, when there is the main flow resolution identical with the second terminal resolution, this is main
Pretreatment picture that flow point resolution is corresponding or video be defined as the pretreatment picture to be viewed with the second terminal resolution match or
Video；When there is not the main flow resolution identical with the second terminal resolution, look into according to above-mentioned pre-treatment step computation requests
The picture seen or the Mh of video, then the Mh by the picture checked with request calculated during pretreatment or video is closest
The pretreatment picture of main flow resolution corresponding for Mh or video, be defined as and the to be viewed pre-place of the second terminal resolution match
Reason picture or video.
5th step: it is raw that pretreatment picture to be viewed or video are carried out burst according to the second preset burst mechanism by server
Become fragment data, and fragment data is returned to the second terminal successively according to the severity level determined；
Second burst mechanism is for being several burst numbers according to certain burst logic by the data fragmentation of same picture
According to, and when burst, different fragment datas is set a severity level according to certain logic.Server is determining
Picture that two terminal request are checked or the pretreatment picture to be viewed of the corresponding terminal resolution match with the second terminal of video
Or after video, pretreatment picture to be viewed or video are carried out burst according to the second burst mechanism and generates several fragment datas,
And by fragment data according to burst time the severity level determined return to the second terminal successively.
Further, with reference to Fig. 9, above-mentioned 5th step specifically includes:
S51, obtain pretreatment picture to be viewed or the picture/mb-type of video；
The picture/mb-type of pretreatment picture to be viewed or video asks picture or the figure of video checked with corresponding user
Sheet type is identical, and picture or the picture/mb-type of video that user's request is checked are incited somebody to action when being and uploaded this picture or video by first terminal
The base attribute information comprising picture/mb-type is also uploaded onto the server and is stored.Picture/mb-type refers to the class of the picture uploaded
Type after frame picture is sorted out in type, or video, such as personage, landscape, building etc..
S52, according to the picture/mb-type that gets and preset picture/mb-type and divisional type mapping relations, determine subregion class
Type and the severity level of divisional type；
Being previously stored with picture/mb-type and divisional type mapping relations on server, i.e. different picture/mb-type are each self-corresponding
Divisional type and the severity level of each divisional type.Such as, picture/mb-type is landscape, then according to picture/mb-type and divisional type
Mapping relations, it may be determined that divisional type corresponding to this picture/mb-type is mountain, water, plant, other are (except mountain, water, exophytic subregion
All be classified as other), the severity level of divisional type be followed successively by from high to low mountain, water, plant, other, can by numeral number from little
Representing the severity level of divisional type order from high to low to big order, such as, the severity level on divisional type mountain is 1,
The severity level of divisional type water is 2, and the severity level of divisional type plant is 3, and other severity level of divisional type is 4.
S53, utilize face recognition technology, to each picture in pretreatment picture to be viewed or video, according to subregion class
The severity level of type order from high to low carries out region burst successively；
S54, each burst being made up of slice images area coordinate and slice images data that region burst is obtained
Fragment data, returns to the second terminal successively.
Being as a example by landscape by picture/mb-type, server by utilizing face recognition technology, to pretreatment picture to be viewed or video
In each picture to be first according to divisional type be that mountain carries out for the first time region burst, and determine the slice images district of each burst
Territory coordinate and slice images data, each fragment data (burst by each burst then first time region burst obtained
Image-region coordinate and slice images data are constituted) return to the second terminal；After region burst terminates for the first time, continue according to dividing
District's type is that water carries out second time region burst, and determines slice images area coordinate and the slice images data of each burst,
Then each fragment data that second time region burst obtains is returned to the second terminal；After region burst terminates for the second time, continue
Continuous is that plant carries out third time region burst according to divisional type, and determines slice images area coordinate and the burst of each burst
View data, then returns to the second terminal by each fragment data that third time region burst obtains；Region burst for the third time
After end, continuing according to divisional type is that other carry out the 4th sub-region burst, and determines the slice images region of each burst
Coordinate and slice images data, then return to the second terminal by each fragment data that the 4th sub-region burst obtains.
According to pretreatment picture to be viewed or the picture/mb-type of video, utilize face recognition technology to pretreatment figure to be viewed
Sheet or video carry out burst, and return fragment data successively according to the severity level (i.e. the sequencing of burst) of divisional type and arrive
Second terminal, allows users to be sequentially received according to the severity level of divisional type the fragment data of picture, reaches at burst
First the effect of important slice images content is shown during displaying.
6th step: the second terminal receives picture or each fragment data of video that server returns successively, and opens up successively
Show the picture material that each fragment data is corresponding；
Second terminal receives the picture checked of request or the fragment data of video that server returns successively, and is receiving
Show the picture material that this fragment data is corresponding after one fragment data at once, thus reach same picture or video same
The burst of the content of frame picture is shown.
Further, with reference to Figure 10, above-mentioned 6th step specifically includes:
S61, receive the picture that currently returns of server or the fragment data of video；
Slice images data in the fragment data that S62, basis are currently received and slice images area coordinate, in display
The picture material that slice images data are corresponding is drawn in the region that on screen, corresponding coordinate point is constituted.
Server after processing the fragment data obtaining user's picture of checking of request or video, the burst that will obtain immediately
Data return to the second terminal.Second terminal is whenever receiving the fragment data that server returns, then according to this burst number
According to the slice images data comprised and slice images area coordinate, the district that the corresponding coordinate point at the display screen of the second terminal is constituted
Draw these slice images data in territory, thus show the picture material that these slice images data are corresponding.
Wherein, the Pixel Information of the image that slice images data comprise in referring to a burst region of picture and each picture
The coordinate points (setting up coordinate system for reference with the picture carrying out burst) that element is corresponding；Slice images area coordinate refers to the one of picture
Coordinate points corresponding to the boundary pixel point in individual burst region (with carry out burst picture for reference to setting up coordinate system) set；The
The corresponding coordinate point of the display screen of two terminals refers to the coordinate identical with each coordinate points comprised in slice images area coordinate
Point (sets up coordinate system with the display area of picture to be viewed or video for reference).
Second terminal whenever receive server return fragment data after, the burst figure comprised according to fragment data immediately
As data and slice images area coordinate, in the region that corresponding coordinate point is constituted on the display screen of the second terminal, draw burst figure
As the picture material that data are corresponding such that it is able to show same figure successively according to the sequencing of the fragment data of server return
The different images content of sheet, reaches the effect that burst is shown, application scenarios when burst is shown is as shown in figure 11.
7th step: before picture or video are shown completely, in detecting the displaying of slide and picture or video
When appearance shows the most on a display screen because of slide, the second terminal to server sends and stops download pictures or the stopping of video
Instruction；
If the displaying content asking picture or the video checked in the second terminal is maintained on the display screen of the second terminal
Display, then the second terminal will constantly receive the picture checked of request or the fragment data of video that server returns, and successively
It is illustrated in the relevant position of viewing area, forms the effect that burst is shown, until asking picture or the burst number of video checked
According to all having received, and the picture checked of request or video display completely till.
If before the picture checked of request or video are shown completely, the second terminal detects that user is on a display screen
Slide, and judge that the displaying content of the picture asking to check or video shows the most on a display screen because of this slide
Time, the second terminal to server sends and stops downloading picture or the halt instruction of video that its request is checked, to notify server
Stop continuing to return picture or the residue fragment data of video that its request is checked to the second terminal.
8th step: server stopping processes remaining fragment data in picture or video.
The picture inspection method that the present invention proposes, after the second terminal receives the fragment data that server returns successively, accordingly
Ground burst successively shows that it asks picture or the picture of video checked, and is asking the picture checked or video to show it completely
Before, when user slide display screen cause the displaying content of the picture asking to check or video to show the most on a display screen time, to clothes
Business device sends and stops picture or the halt instruction of video that the request of downloading is checked, thus is not desired to continue to check that request is checked user
Picture or during video, both saved the flow of the residue fragment data of picture that user's request of downloading checks or video, and point
The mode that sheet is shown substantially reduces user and checks picture or video time to be waited, improves user and checks picture or regard
The experience of frequency.
Further, propose picture inspection method second of the present invention based on above-mentioned picture inspection method first embodiment to implement
Example, the corresponding above-mentioned picture of the present embodiment checks that device the second embodiment, the present embodiment are implemented with above-mentioned picture inspection method first
The difference of example is, first terminal uses the mode uploading pictures or video that multitask, burst upload in the present embodiment.Reference
Figure 12, picture inspection method also includes:
Picture or video that user is selected by S11, first terminal are split as multiple points according to the first preset burst mechanism
Sheet packet；
S12, the multiple packet segments using the mode of multitask fractionation to be obtained are uploaded onto the server.
First burst mechanism for being split as several fragment datas specifying size by the packet exceeding a certain size
Bag, thus reach this packet is carried out the purpose of batch processing.After fractionation completes, it is multiple that fractionation is obtained by first terminal
(i.e. system can run multiple process to the mode of packet segment employing multitask simultaneously, and each process also can perform multiple simultaneously
Thread) upload onto the server.Multitask, burst is used to upload picture or the data of video that mode is uploaded for first terminal
Bag, the packet segment belonging to same packet, after receiving the packet segment that first terminal is uploaded, is first entered by server
Row is integrated, thus obtains complete picture or video.
The picture inspection method that the present invention proposes, needs are uploaded by the mode that first terminal uses multitask, burst to upload
Picture or video be sent to server, accelerate uploading speed, decrease period of reservation of number, improve the use body of user
Test.
Through the above description of the embodiments, those skilled in the art is it can be understood that arrive above-described embodiment side
Method can add the mode of required general hardware platform by software and realize, naturally it is also possible to by hardware, but a lot of in the case of
The former is more preferably embodiment.Based on such understanding, prior art is done by technical scheme the most in other words
The part going out contribution can embody with the form of software product, and this computer software product is stored in a storage medium
In (such as ROM/RAM, magnetic disc, CD), including some instructions with so that a station terminal equipment (can be mobile phone, computer, take
Business device, air-conditioner, or the network equipment etc.) perform the method described in each embodiment of the present invention.
These are only the preferred embodiments of the present invention, not thereby limit the scope of the claims of the present invention, every utilize this
Equivalent structure or equivalence flow process that bright description and accompanying drawing content are made convert, or are directly or indirectly used in other relevant skills
Art field, is the most in like manner included in the scope of patent protection of the present invention.
Claims (10)
1. device checked by a picture, it is characterised in that described picture checks that device includes:
Module is checked in request, for send to the server specified check the picture specified or video check instruction；
Burst display module, for receiving described picture or each fragment data of video that described server returns successively, and
Show the picture material that each fragment data is corresponding successively；
Stop checking module, for before described picture or video are shown completely, when slide and described picture being detected
Or the displaying content of video is when showing the most on a display screen because of described slide, sends to described server and stop downloading institute
State the halt instruction of picture or video.
2. device checked by picture as claimed in claim 1, it is characterised in that described burst display module includes:
Receive unit, for receiving described picture or the fragment data of video that described server currently returns；
Drawing unit, the slice images data in the fragment data that basis is currently received and slice images area coordinate,
Draw, in the region that corresponding coordinate point is constituted on described display screen, the picture material that described slice images data are corresponding.
3. device checked by picture as claimed in claim 1 or 2, it is characterised in that described picture checks that device also includes uploading
Module, described upper transmission module includes:
Split cells, is split as multiple burst number for picture or video user selected according to the first preset burst mechanism
According to bag；
Uploading unit, uploads to described server for the multiple packet segments using the mode of multitask fractionation to be obtained.
4. system checked by a picture, it is characterised in that the described picture system of checking includes first terminal, the second terminal, service
Device, described first terminal and described second terminal include that the picture as described in any one of claim 1-3 checks device, described clothes
Business device includes:
Pretreatment module, for after receiving the picture or video that described first terminal uploads, according to described picture or video
Original resolution and preset multiple main flow resolution described picture or video are carried out pretreatment, divide obtaining each main flow
Pretreatment picture that resolution is corresponding or video also store；
Determine module, for receive described second terminal send when checking instruction, check picture in instruction according to described
Or the mark of video, described second terminal resolution, determine and the pretreatment figure to be viewed of described second terminal resolution match
Sheet or video；
Burst module, raw for described pretreatment picture to be viewed or video are carried out burst according to the second preset burst mechanism
Become fragment data, and fragment data is returned to described second terminal successively according to the severity level determined.
5. system checked by picture as claimed in claim 4, it is characterised in that described burst module includes:
Acquiring unit, for obtaining described pretreatment picture to be viewed or the picture/mb-type of video；
Determine unit, for according to the picture/mb-type got and preset picture/mb-type and divisional type mapping relations, determining
Divisional type and the severity level of divisional type；
Sharding unit, is used for utilizing face recognition technology, to each picture in described pretreatment picture to be viewed or video, presses
Severity level order from high to low according to described divisional type carries out region burst successively；
Dispatching Unit, for each point be made up of slice images area coordinate and slice images data obtained by region burst
The fragment data of sheet, returns to described second terminal successively.
6. a picture inspection method, it is characterised in that described picture inspection method includes:
Send to the server specified check the picture specified or video check instruction；
Receive described picture or each fragment data of video that described server returns successively, and show each burst number successively
According to corresponding picture material；
Before described picture or video are shown completely, when detect the displaying content of slide and described picture or video because of
Described slide and when showing the most on a display screen, send to described server and stop downloading described picture or the stopping of video
Instruction.
7. picture inspection method as claimed in claim 6, it is characterised in that the described institute receiving the return of described server successively
State each fragment data of picture or video, and show that the picture material that each fragment data is corresponding includes successively:
Receive described picture or the fragment data of video that described server currently returns；
According to the slice images data in the fragment data being currently received and slice images area coordinate, on described display screen
The picture material that described slice images data are corresponding is drawn in the region that corresponding coordinate point is constituted.
Picture inspection method the most as claimed in claims 6 or 7, it is characterised in that described picture inspection method also includes:
Picture or the video user selected are split as multiple packet segment according to the first preset burst mechanism；
The multiple packet segments using the mode of multitask fractionation to be obtained upload to described server.
9. a picture inspection method, it is characterised in that described picture inspection method includes:
Server after receiving the picture or video that first terminal uploads, according to original resolution of described picture or video and
Preset multiple main flow resolution carry out pretreatment to described picture or video, the pre-place corresponding to obtain each main flow resolution
Manage picture or video and store；
Receive that the second terminal sends when checking instruction, according to described picture or the mark of video, described of checking in instruction
Second terminal resolution, determines the pretreatment picture to be viewed with described second terminal resolution match or video；
Described pretreatment picture to be viewed or video are carried out burst according to the second preset burst mechanism and generates fragment data, and
Fragment data is returned to described second terminal successively according to the severity level determined.
10. picture inspection method as claimed in claim 9, it is characterised in that described by described pretreatment picture to be viewed or
Video carries out burst according to the second preset burst mechanism and generates fragment data, and by fragment data according to the importance level determined
Return to described second terminal the most successively include:
Obtain described pretreatment picture to be viewed or the picture/mb-type of video；
According to the picture/mb-type got and preset picture/mb-type and divisional type mapping relations, determine divisional type and subregion
The severity level of type；
Utilize face recognition technology, to each picture in described pretreatment picture to be viewed or video, according to described subregion class
The severity level of type order from high to low carries out region burst successively；
The fragment data of each burst being made up of slice images area coordinate and slice images data that region burst is obtained,
Return to described second terminal successively.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610355141.4A CN106028060A (en) | 2016-05-25 | 2016-05-25 | Picture check device, system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610355141.4A CN106028060A (en) | 2016-05-25 | 2016-05-25 | Picture check device, system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106028060A true CN106028060A (en) | 2016-10-12 |
Family
ID=57093849
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610355141.4A Pending CN106028060A (en) | 2016-05-25 | 2016-05-25 | Picture check device, system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106028060A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108881773A (en) * | 2017-12-29 | 2018-11-23 | 北京视联动力国际信息技术有限公司 | A kind of method and apparatus of video communication |
| CN111158619A (en) * | 2019-12-25 | 2020-05-15 | 珠海格力电器股份有限公司 | Picture processing method and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103902575A (en) * | 2012-12-27 | 2014-07-02 | 腾讯科技（深圳）有限公司 | Pictorial information loading method and related device |
| CN104391890A (en) * | 2014-11-10 | 2015-03-04 | 广东欧珀移动通信有限公司 | Image loading method and system |
| WO2015143905A1 (en) * | 2014-03-26 | 2015-10-01 | 北京奇虎科技有限公司 | Picture loading device and method |
| CN105306963A (en) * | 2015-10-20 | 2016-02-03 | 努比亚技术有限公司 | Video processing system, device and method self-adapting to mobile terminal resolution |
-
2016
- 2016-05-25 CN CN201610355141.4A patent/CN106028060A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103902575A (en) * | 2012-12-27 | 2014-07-02 | 腾讯科技（深圳）有限公司 | Pictorial information loading method and related device |
| WO2015143905A1 (en) * | 2014-03-26 | 2015-10-01 | 北京奇虎科技有限公司 | Picture loading device and method |
| CN104391890A (en) * | 2014-11-10 | 2015-03-04 | 广东欧珀移动通信有限公司 | Image loading method and system |
| CN105306963A (en) * | 2015-10-20 | 2016-02-03 | 努比亚技术有限公司 | Video processing system, device and method self-adapting to mobile terminal resolution |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108881773A (en) * | 2017-12-29 | 2018-11-23 | 北京视联动力国际信息技术有限公司 | A kind of method and apparatus of video communication |
| CN111158619A (en) * | 2019-12-25 | 2020-05-15 | 珠海格力电器股份有限公司 | Picture processing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104902075B (en) | Multi-screen interaction method and system | |
| CN104731507B (en) | The application changing method of mobile terminal and mobile terminal | |
| CN104808944B (en) | Touch operation inducing method and device | |
| CN104735255B (en) | Multi-screen display method and system | |
| CN106453538A (en) | Screen sharing apparatus and method | |
| CN106130734A (en) | The control method of mobile terminal and control device | |
| CN106201395A (en) | A kind of display packing and mobile terminal | |
| CN106101423A (en) | Split screen area size adjusting apparatus and method | |
| CN106157970A (en) | A kind of audio identification methods and terminal | |
| CN106249989A (en) | Social networking application program icon aligning method during a kind of sharing contents and mobile terminal | |
| CN106850941A (en) | Method, photo taking and device | |
| CN106873936A (en) | Electronic equipment and information processing method | |
| CN106909681A (en) | A kind of information processing method and its device | |
| CN106101455A (en) | Page jump management method, device and terminal | |
| CN106250081A (en) | A kind of display packing based on double screen terminal and device | |
| CN106406737A (en) | A screen operating method and device and a mobile terminal | |
| CN106959816A (en) | Video intercepting method and mobile terminal | |
| CN106873887A (en) | It is a kind of that the system and method for application function is controlled based on gesture | |
| CN106231095A (en) | Picture synthesizer and method | |
| CN106383707A (en) | Picture display method and system | |
| CN106131327A (en) | Terminal and image-pickup method | |
| CN106095464A (en) | A kind of method and device of the seamless operation of application program | |
| CN105183830B (en) | picture browsing method and device | |
| CN104731484B (en) | The method and device that picture is checked | |
| CN106484534A (en) | Control method for the mobile terminal of displaying and control device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161012 |