CN105191291B - Information processing unit and video output system - Google Patents
Information processing unit and video output system Download PDFInfo
- Publication number
- CN105191291B CN105191291B CN201480013104.4A CN201480013104A CN105191291B CN 105191291 B CN105191291 B CN 105191291B CN 201480013104 A CN201480013104 A CN 201480013104A CN 105191291 B CN105191291 B CN 105191291B
- Authority
- CN
- China
- Prior art keywords
- screen
- resolution
- unit
- video output
- output device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 22
- 230000005540 biological transmission Effects 0.000 claims abstract description 71
- 230000008859 change Effects 0.000 claims abstract description 55
- 238000004891 communication Methods 0.000 claims abstract description 23
- 238000012544 monitoring process Methods 0.000 claims description 14
- 230000004044 response Effects 0.000 claims description 7
- 238000001514 detection method Methods 0.000 claims 2
- 238000012545 processing Methods 0.000 description 77
- 238000000034 method Methods 0.000 description 52
- 230000008569 process Effects 0.000 description 42
- 238000010586 diagram Methods 0.000 description 38
- 238000012986 modification Methods 0.000 description 29
- 230000004048 modification Effects 0.000 description 29
- 230000006870 function Effects 0.000 description 10
- 230000001965 increasing effect Effects 0.000 description 10
- 230000003068 static effect Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- 238000009877 rendering Methods 0.000 description 3
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 230000002708 enhancing effect Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000003252 repetitive effect Effects 0.000 description 2
- 239000000758 substrate Substances 0.000 description 2
- 241000406668 Loxodonta cyclotis Species 0.000 description 1
- 238000003705 background correction Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000000205 computational method Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000010008 shearing Methods 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
- H04N9/3188—Scale or resolution adjustment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3191—Testing thereof
- H04N9/3194—Testing thereof including sensor feedback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/04—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
- G09G2370/042—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller for monitor identification
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/16—Use of wireless transmission of display information
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Controls And Circuits For Display Device (AREA)
- Transforming Electric Information Into Light Information (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
A kind of information processing unit communicated with video output device via cordless communication network, including：Screen display unit, on the display apparatus output screen；Screen data acquiring unit obtains the screen data of the screen；The screen data is sent to the video output device by screen data transmission unit via the cordless communication network；Device capability acquiring unit inquires the device capability of the video output device, and obtains described device ability from the video output device；And resolution changing unit or acquisition range change one in unit, the resolution changing unit changes the screen resolution of the screen exported by the screen display unit according to described device ability, and the range that obtains changes the part that the range obtained by the screen data acquiring unit is changed into the screen data according to described device ability by unit.
Description
Technical field
The present invention relates to the information processing units communicated with video output device via cordless communication network.
Background technology
In a pattern using projecting apparatus, personal computer (PC) will be in the screen data of the display screen display of PC
Projecting apparatus is sent to be projected to screen data.Traditionally, video signal cable or network cable is used to make PC and projection
Instrument carries out wired connection.However, recently, via radio net so that PC is wirelessly connected with projecting apparatus.
However, in this case, there are hardware between PC screen resolutions and the screen resolution of projector
Limitation.Usually, the high resolution of PC is in the resolution ratio of projecting apparatus.Therefore, it is receiving with higher than projecting apparatus specification
When the screen data of the resolution ratio of resolution ratio, projecting apparatus has to carry out image procossing (reduction processing).In addition, although if not frequently
Numerous transmission screen data, then projecting apparatus can have sufficient time to complete required image procossing, but if more frequently
Screen data is sent, then increases the processing load of projecting apparatus.As a result, in fact it could happen that such phenomenon, i.e. projecting apparatus into
Capable image procossing is delayed by, all figures for becoming to jump to the image of such as projector, and not being sent from PC
As that can be projected (hereinafter this phenomenon is referred to as " delay phenomenon ").
To address this problem, it is known that such technology, wherein increase when the screen delay between PC and projecting apparatus or
When projecting apparatus swimmingly can not show image, and all screen data of non-transmission but only transmit and wherein detect change
Partial screen data (for example, see patent document 1).
Invention content
The problem to be solved in the present invention
However, if detecting that the range of the part of the change of such as mobile image etc is larger, it may still be difficult to list
Solely loaded using all technologies as described in patent document 1 fully to reduce the processing of projecting apparatus.
The present invention is proposed in view of the above problems, and the present invention can provide the image procossing dress that can reduce delay phenomenon
It sets.
Solution to the problems described above
According to an aspect of the present invention, a kind of information communicated with video output device via cordless communication network
Processing unit includes：Screen display unit, on the display apparatus output screen；Screen data acquiring unit obtains the screen
Screen data；The screen data is sent to the video by screen data transmission unit via the cordless communication network
Output device；Device capability acquiring unit inquires the device capability of the video output device, and exports and fill from the video
It sets and obtains described device ability；And resolution changing unit or acquisition range change one in unit, the resolution ratio changes
Become the screen resolution that unit changes the screen exported by the screen display unit according to described device ability, it is described to obtain
It takes range to change unit and the range obtained by the screen data acquiring unit is changed by the screen according to described device ability
A part for curtain data.
The effect of the present invention
It is an object of the present invention to provide a kind of image processing apparatus that can reduce delay phenomenon.
Description of the drawings
Fig. 1 illustrates the illustrative configured in one piece of video output system；
Fig. 2 illustrates the illustrative hardware configuration of video output device；
Fig. 3 is the illustrative block diagram of video output device；
Fig. 4 illustrates the illustrative hardware configuration of client terminal device；
Fig. 5 illustrates the illustrative block diagram of video output system；
Fig. 6 illustrates application operating corresponding with the resolution ratio of the resolution ratio of video output device and client terminal device；
Fig. 7 A and 7B show the example in the application screen of the display screen display of client terminal device；
Fig. 8 is the illustrative sequence diagram of the operating process of client terminal device and video output device；
Fig. 9 is for determining whether that resolution changing is needed to determine that part changes the illustrative flow of the process of resolution ratio
Figure；
Figure 10 illustrates the illustrative block diagram (second embodiment) of video output system；
Figure 11 A and 11B illustrate to be used to determine whether to need resolution changing to determine that part changes point of client terminal device
The illustrative list (second embodiment) of the standard of resolution；
Figure 12 is the illustrative sequence diagram (second embodiment) of the operating process of client terminal device and video output device；
Figure 13 is for determining whether that resolution changing is needed to determine that part changes the illustrative stream of the process of resolution ratio
Journey figure (second embodiment)；
Figure 14 illustrates the illustrative block diagram (3rd embodiment) of video output system；
Figure 15 A and 15B schematically illustrate the exemplary determination for determining excision extension；
Figure 16 A and 16B schematically illustrate the exemplary determination for determining excision extension；
Figure 17 is the illustrative sequence diagram (3rd embodiment) of the operating process of client terminal device and video output device；
Figure 18 is for determining whether that resolution changing is needed to determine that part changes the illustrative stream of the process of resolution ratio
Journey figure (3rd embodiment)；
Figure 19 illustrates the illustrative block diagram (fourth embodiment) of video output system；
Figure 20 A to 20D schematically illustrate the computational methods for calculating screen knots modification；
Figure 21 is by the exemplary process diagram of the process of PC screen knots modification monitoring section monitor screen knots modifications；
Figure 22 illustrates the example of corresponding with the resolution ratio of client terminal device application operating and reference value；
Figure 23 is the illustrative sequence diagram (fourth embodiment) of the operating process of client terminal device and video output device；
Figure 24 is for determining whether that resolution changing is needed to determine that part changes the illustrative stream of the process of resolution ratio
Journey figure (fourth embodiment)；
Figure 25 illustrates the illustrative block diagram (the 5th embodiment) of video output system；
Figure 26 illustrates the example of the application operating in response to processing time；
Figure 27 is the illustrative sequence diagram (the 5th embodiment) of the operating process of client terminal device and video output device；
Figure 28 is for determining whether that resolution changing is needed to determine that part changes the illustrative stream of the process of resolution ratio
Cheng Tu；
Figure 29 illustrates the illustrative block diagram (sixth embodiment) of video output system；
Figure 30 is for determining whether that resolution changing is needed to determine that part changes the illustrative stream of the process of resolution ratio
Journey figure (sixth embodiment)；
Figure 31 is for determining whether that resolution changing is needed to determine that part changes the illustrative stream of the process of resolution ratio
Journey figure (the 7th embodiment)；
Figure 32 illustrates the illustrative block diagram (the 8th embodiment) of video output system；
Figure 33 is the illustrative sequence diagram (the 8th embodiment) of the operating process of client terminal device and video output device；
Figure 34 is for determining whether that resolution changing is needed to determine that part changes the illustrative stream of the process of resolution ratio
Journey figure (the 8th embodiment)；
Figure 35 illustrates the illustrative block diagram (the 9th embodiment) of video output system；
Figure 36 illustrates the illustrative reproduction list handled by video output system；
Figure 37 is the illustrative sequence diagram (the 8th embodiment) of the operating process of client terminal device and video output device；
Figure 38 is that resolution changing determines the process that data transmission setting is determined in step S4 and S7 of the part in Figure 37
Illustrative flow chart；
Figure 39 A and 39B illustrate the example of multiple reproduction lists；
Figure 40 is that resolution changing determines and determines the illustrative flow chart of the process of data transmission setting in part (the tenth is real
Apply example)；
Figure 41 is that resolution changing determines that part determines the illustrative flow chart the (the 11st of the process of data transmission setting
Embodiment)；And
Figure 42 is that resolution changing determines that part determines the illustrative flow chart the (the 12nd of the process of data transmission setting
Embodiment).
Specific implementation mode
Hereinafter, the embodiment of the present invention is described with reference to the accompanying drawings.But it should be noted that the technical scope of the present invention
It is not limited to these examples.
First embodiment
Fig. 1 is the illustrative block diagram of video output system.Client terminal device 21 and video output device 11 are via network
15 communicate with each other.Client terminal device 21 refers to information processing unit in broad sense, such as personal computer, intelligence electricity
Words, tablet terminal, cellular phone and personal digital assistant (PDA).In addition, when it has the function of information processing unit, visitor
Family end device 21 can also refer to MFP, digital camera and video camera.
Video output device 11 refers to the projecting apparatus for example by image projection in the planar body of such as screen etc.Depending on
Frequency output device 11 can also refer to show screen display image without the device that projects image at it.Video exports
Device 11 exports the screen data sent from client terminal device 21.
In general, network 15 refers to LAN.Network can also refer to WAN, and the WAN includes being connected to each other using router etc.
Multiple LAN.Network 15 includes that wherein using at least part wirelessly communicated, (network 15 is wireless communication claimed
The example of network).In addition, even if client terminal device 21 and video output device 11 ifs, have when network 15 is cable network
The function of communicating with each other.In addition, in the case of LAN, client terminal device 21 and video output device 11 can be via connecing
Access point or direct (self-organizing mode (ad hoc mode)) are communicated with each other.In addition, network 15 is not limited to LAN.For example,
Network 15 can use bluetooth (Bluetooh, registered trademark) or Zigbee (registered trademark) to be communicated.
Fig. 2 illustrates the illustrative hardware configuration of video output device 11.Video output device includes via internal total
CPU 101, RAM 102, ROM 103 and the interface 109 that line 108 is connected to each other.Interface 109 is connected to network interface 105, operation
Part 106 and video cables interface 107.ROM 103 stores program, to which CPU 101 executes the program stored in ROM 103
To control entire video output device.RAM 102 is used as the working storage of CPU 101, and stores from client terminal device 21
The screen data of transmission.Interface 109 for example can be peripheral bus controller, DMA controller (DMAC) and total
Lane controller, to arrive the data storage received via network interface 105, operation part 106 and video cables interface 107
In RAM 102.Moreover, interface 109 outputs data to network interface 105, operation part 106 and video cables interface 107.
Network interface 105 can for example be attached to Ethernet (Ethernet, the registered trademark) card of LAN.Arrange branch
Hold multiple network interfaces 105 of wired lan (IEEE802.3x) and Wireless LAN (IEEE802.11).
Operation part 106 receives the operation of user.Operation part 106 is the hardkey arranged on video output device 11.
Operation part 106 can receive the setting of various operations, such as such as ratio enlargement, brightness and emphasis correcting value etc.In addition,
Operation part 106 can also include infrared light receiving part, the operation for receiving remote controllers.Video output device can be with
Projection operation's menu determines (return) key to which participant can be moved cursor and be pressed by using hardkey or remote controllers
To input desired setting.Video cables interface 107 is the interface for receiving video data from analog or digital video cables.
Fig. 3 illustrates the illustrative block diagram of video output device 11.Block in dotted line frame indicates the work(by software realization
Energy.As described above, video cables interface 107 is connected to the RGB line cable 39 for sending analog signal and sends the HDMI of digital signal
Cable.However, these cables and signal are merely exemplary.Network interface 105 outputs and inputs cable data 41 and without line number
According to 42.
According to the specification of video output device 11, projection lens 38 can be tight shot or zoom lens, and have
The function of such as focal length, brightness and visual angle etc.Light engine 37 is for example projected by using the DLP methods of micromirror
Video.Other than DLP methods, such as there is also the 3LCD methods for using transmission liquid crystal and the LCOS for using reflection type liquid crystal
Method is as the projecting method projected to projected image.In embodiment, any projecting method can be used.
Light engine control section 36 controls light engine 37, and be more specifically in response to the colour wheel of light engine 37
Rotation angle controls the angle (direction) of the mirror part of digital mirror device (DMV).When colour wheel generates red, green and blue light,
Light engine control section 36 controls the angle of mirror part according to red, green and blue image data respectively.
Vision signal input control part 32 is according to transmission resolution ratio by the Image data reconstruction as video signal transmission
For video data.That is, vision signal input control part 32 generates the image data of a frame.In addition, vision signal input control
Part 32 includes for example by enhancing resolution ratio to the conversion of progressive scan (P) and doubled in density processing from interlacing scan (I)
Function.
Network data processing part 35 is executed based on the communication data received by network interface 105 according to communication protocol
Processing is to obtain the screen data of each frame.For example, network data processing part 35 executes TCP/IP (UDP/IP) and application layer
Under agreement processing.There are some agreements in application layer, it includes but not limited to such as HTTP, FTP in the present embodiment
With Simple Network Management Protocol (SNMP).
Image processing section 34 executes image procossing to image data.As image procossing, exist reduce image procossing with
It is adapted to resolution ratio and the emphasis correction process of video projection, is for video output device 11 as described above
Preferably.In addition, image processing section 34 executes general image processing, such as γ corrections, shading correction, noise reduction and edge
Enhancing.
The powering mode of 31 Switch Video output device 11 of powering mode switching control part.Video output device 11 is normal
It is operated to be projected to video under scale formula, and is operated with the energy saver mode for reducing energy-output ratio.It is saving
Under energy pattern, stop the circuit supply electric energy into substrate and substrate, and reduce operational clock frequency.Detect for example with
When family does not carry out operation to operation part 106 in predetermined time period or does not receive image data in predetermined time period,
Powering mode is changed into energy saver mode by powering mode switching control part 31 from normal mode.In addition, detect for example with
When family is operated to operation part 106 or receives image data, powering mode switching control part 31 by powering mode from
Energy saver mode changes into normal mode.
The operation switching that input channel switching control part 33 is automatically, or based on user will be projected by video output device 11
Image input channel.Input channel refers to the channel of the vision signal for inputting RGB line cable, via video interface 107
The channel of the vision signal of HDMI cable is inputted, the channel of cable data 41 is inputted via network interface 105 and is inputted without line number
According to 42 channel.
Fig. 4 illustrates the illustrative hardware configuration of client terminal device 21.Client terminal device 21 includes CPU301, ROM
302, RAM 303, HDD 304, the figure board 305 being connect with display screen 320, keyboard/mouse 306, media drive 307 and
Network communication part 308, above-mentioned items are connected to each other via bus.CPU 301 adds the program 310 stored in HDD 304
Be downloaded in RAM 303, and execute program 310 come control each section output and input data and execute data processing.
ROM 302 stores start program to read BIOS and OS, to load them into RAM 203.
HDD 304 is nonvolatile memory, such as solid state drive (SSD).It 304 storage device drivers of HDD and carries
For the program 310 of function as described below.As OS, there is OS, LINUX for example based on form (Windows, registered trademark)
(registered trademark), UNIX (registered trademark), Android (Android, registered trademark), MAC X (registered trademark) and iOS (registrars
Mark).Display screen 320 shows that GUI screen, the GUI screen are based on program instruction and are generated by figure board 305.
Keyboard/mouse 306 is to receive the input equipment of the operation of user.Media drive 307 is read from/to optical media
It is, for example, compact disc, DVD and bluetooth (registered trademark) disk to take/be written data, the optical media.Media drive 307 can be with
From/to memory card reading/writing data such as flash memory.
Network communication part 308 can for example be attached to the Ethernet (Ethernet, registered trademark) of such as LAN.By
OS or program 310 execute the processing of the agreement of TCP/IP (UDP/IP) and application layer.At least the agreement of application layer corresponds to and regards
The agreement that frequency output device 11 has.
It is recorded in computer readable recording medium storing program for performing and distributing programs 310 with that can install with the format of executable file.This
Outside, the program 310 as the file that can install format and executable format is distributed from server (not shown).
Fig. 5 is the illustrative block diagram of video output system 100.Based on the work for having been developed to video output device 11
The application (part for program 310) of tool or utility program provides the function of client terminal device 21.Described in being executed as CPU 301
Using when realize these functions, can be communicated with video output device 11 to send screen number to client terminal device 21
According to, and user can wirelessly execute setting and operation.
Resolution inquiry part 61 obtains the resolution of video output device 11 based on the communication with video output device 11
Rate.The resolution ratio (maximum resolution based on specification) of acquisition is sent to resolution changing determining section by resolution inquiry part 61
Divide 62.
Resolution changing determine part 62 based on obtained by resolution inquiry part 61 resolution ratio, client terminal device 21
Screen resolution and picture quality set by the user setting, it is determined whether need to change the resolution ratio of client terminal device 21.When
Determine that resolution changing determines that part 62 changes the screen resolution of client terminal device 21 when needing.Later, resolution changing is true
Determine part 62 and is already prepared to screen transmission to the notice of screen transmitting portion 63.Resolution changing determines that part 62 includes：Figure
As quality settings fetching portion 64, the picture quality for obtaining user setting is arranged；Determine part 65, it is determined whether needs change
Become the screen resolution of client terminal device 21；And resolution changing part 66, for changing the screen point of client terminal device 21
Resolution.
Resolution ratio of the screen resolution of client terminal device 21 based on the screen generated by figure board 305, to scheme
Change in the specification limit of shape board 305.Hereinafter, the screen resolution of client terminal device 21 can be referred to as " client
The resolution ratio of device (21) ".In addition, resolution changing part 66 changes screen resolution by transmitting the request to OS.
Screen transmitting portion 63 obtain client terminal device 21 screen screen data, adjust the format of screen data so as to
Such as sent via network by increasing head, and adjusted screen data is sent to video output device
11.Screen transmitting portion 63 includes screen fetching portion 67 to obtain screen data.Screen fetching portion 67 uses the shearing of OS
Plate or API obtain (capture) screen data.If the icon of mouse is not acquired in screen data, refer to from OS acquisitions
The image data of the data and mouse of showing the position of mouse is to be combined in screen data.By doing so, obtain including
The screen data of mouse.Screen data is encoded to such as jpeg image by screen fetching portion 67.
In response to inquiring resolution ratio from client terminal device 11, the resolution ratio report section 81 of video output device 11 is by video
The resolution ratio (maximum resolution in specification) of output device 11 is reported to client terminal device 11.Resolution ratio report section 81 is wrapped
It includes in the network data processing part 55 of Fig. 3.
Screen receiving portion 82 receives the screen data sent from client terminal device 21, and the screen data is sent
To projection section 83.Screen receiving portion 82 is included in the image processing section 34 of Fig. 3.
The screen data for the format that projection section 83 will be sent via network is converted to the data for projection, and controls
Make the light engine 37.For example, screen data is separated into each color component (RGB) by projection section 83, and by screen
Each color of data is converted to data to control DVD.Projection section 83 is included in light engine control section 36.
Fig. 6 illustrates client corresponding with the resolution ratio of the resolution ratio of video output device 11 and client terminal device 21
The illustrative operation of device 21.When the resolution ratio of video output device 11 is XGA (1024 × 768) and client terminal device 21
When current resolution is (1280 × 800) WXGA, the resolution ratio of client terminal device 21 is equal to regard by client terminal device 21
The resolution ratio of frequency output device 11.
When the resolution ratio of video output device 11 is WXGA (1280 × 800) and the current resolution of client terminal device 21 is
When (1280 × 800) WXGA, client terminal device 21 is operated not for resolution changing.
In addition, the resolution ratio of the client 21 after resolution changing can be less than the resolution of video output device 11
Rate.By reducing the resolution ratio of client terminal device 21, the processing load of client terminal device 21 can be reduced.
Fig. 7 A and 7B show the illustrative screen shown on the display screen 320 of client terminal device 21.Fig. 7 A explanations
Projection starts screen 501.It includes that projecting apparatus specifies row 511, projection button 512, setting button 513 that projection, which starts screen 501,
With details button 514.In projecting apparatus specifies row 511, the screen data of user's given client end device 21 will be sent to
Video output device.User can carry out designated output by using such as cognizance code, projector designation or IP address
Device.
Projecting apparatus button 512 is used to send screen data since receiving user.Be arranged button 513 for receive instruction with
Show the setting screen of Fig. 7 B.Details button 5514 is used to receive the instruction to show that the details of video output device 11 are arranged.
Fig. 7 B illustrate setting screen 502.Setting screen 502 is for receiving basic setup and details setting.As basic
Whether (claimed to the picture quality priority frame 521 of the setting of picture quality placement priority there is receiving in setting
The example of quality settings) and receive whether send voice data setting voice send frame 522.It (is opened when user chooses
Open) picture quality priority frame 521 when, current resolution of the client terminal device 21 based on client terminal device 21 sends screen number
According to.When user does not choose (shutdown) picture quality priority frame 521, client terminal device 21 reduces the resolution of screen data
Rate so that the resolution ratio reduced is less than or equal to the resolution ratio of video output device 11, and then sends screen data.
That is, picture quality priority frame 521 receives the figure for whether allowing to reduce the screen data to be sent to video output device 11
The setting of image quality amount.
Voice sends frame 522 receives whether to send the setting of voice data.When having chosen voice transmission frame 522, client
End device 21 sends speech data to video output device 11, to export voice from client terminal device 21.
When having chosen picture quality priority frame 521, it is preferential that the setting of fetching portion 64 picture quality is arranged in picture quality
Grade mark, and store the mark.In addition, when eliminating to picture quality Priority flag when choosing, picture quality setting
Fetching portion 64 removes picture quality Priority flag.Accordingly, it is possible to by referring to picture quality Priority flag, know be
It is no that priority is provided with to picture quality.
The details setting being arranged in screen 502 is to open the accept button of details setting screen, wherein can for example be arranged
The image that ratio enlargement is projected.
Fig. 8 is the illustrative sequence diagram of the sequential of the operating process of client terminal device 21 and video output device 11.
Step S1：User presses projection button 512.
Step S2：When user presses projection button 512, client terminal device 21 sends screen data.Therefore, resolution ratio is looked into
It askes part 61 and inquires resolution ratio from resolution ratio report section 81.
Step S3：Resolution inquiry part 61 determines that part 62 notifies resolution ratio to resolution changing.
Step S4：Resolution changing determines that part 62 determines the need for changing resolution ratio.It is described below in step S4
Processing.
Step S5：Resolution changing determines that part 62 will be ready to complete notice and be sent to screen transmitting portion 63.
Step S6：Screen transmitting portion 63 obtains screen data, and the screen data is sent to screen receiving part
Divide 82.
Step S7：The projection section 83 of video output device 11 projects the screen data from light engine 37.
Fig. 9 is for determining whether that resolution changing is needed to determine that part 62 changes the resolution ratio in the step S4 of Fig. 8
The illustrative flow chart of process.
The resolution ratio of video output device 11 is reported to resolution changing and determines part 62 (step S1-1).
Determine that part 65 determines whether the resolution ratio of client terminal device 21 is higher than the resolution ratio (step of video output device 11
S1-2).Determine that part 65 obtains the current resolution of client terminal device 21 from such as OS.The resolution ratio refers to point when display screen
The resolution ratio of display screen when resolution is identical to the resolution ratio of figure board 305.Otherwise, that is to say, that when the resolution of display screen
When rate is different from the resolution ratio of figure board 305, which refers to the resolution when the screen being currently generated by figure board 305
Rate.
(it is in step S1-2 when the resolution ratio of client terminal device 21 is not above the resolution ratio of video output device 11
"No"), it no longer needs to reduce resolution ratio.Therefore, resolution changing determines that part 62 is ready to complete notice by what screen data was sent
It is sent to screen transmitting portion 63 (step S1-5).
When resolution ratio of the high resolution of client terminal device 21 in video output device 11 (being "Yes" in step S1-2),
65 reference image quality priority mark of part is determined to determine whether that picture quality priority is arranged in client terminal device 21
(step S1-3).
When determining provided with picture quality priority (being "Yes" in step S1-3), resolution ratio should will not be lowered.
Therefore, resolution changing determines that the notice that is ready to complete that screen data is sent is sent to (the step of screen transmitting portion 63 by part 62
Rapid S1-5).
When determining not setting picture quality priority (being "No" in step S1-3), resolution ratio can be reduced.Therefore,
Resolution changing part 66 changes the resolution ratio (step S1-4) of client terminal device 21.That is, resolution changing part 66 is for example logical
The resolution ratio to OS designateds output device 11 is crossed to change resolution ratio.Resolution changing part 66, which is stored in, is changed it
Preceding resolution ratio, to restore the resolution ratio before being changed.
The resolution ratio after changing is maintained, until user chooses picture quality priority frame 521.In addition, working as user
When by directly using the user interface (UI) of OS to change resolution ratio, application recovery original resolution.By doing so, can change
Kind operability, because user need not restore resolution ratio.
As described above, in the video projection system according to the present embodiment, only when not choosing picture quality priority frame
When 521, the resolution ratio of client terminal device 21 is just reduced.Therefore, only when user allows, just change resolution ratio.Therefore, it is possible to subtract
Small delay phenomenon and leave user alone.
In addition, this embodiment is not limit the scope of the invention.In this regard, video output device can be from client
Device inquires resolution ratio, and when resolution ratio of the high resolution of client terminal device in video output device, can send and change
The request of variable resolution.In addition, video output device can have the button for receiving picture quality priority, to the behaviour of user
Work can be sent to client terminal device.In addition, the quantity of client terminal device is more than one, and any client terminal device can have
There is such function.
Second embodiment
In the present embodiment, such client terminal device 21 is described, which is based on client terminal device 21
Specification change client terminal device 21 screen resolution.By doing so, even if choosing picture quality priority frame in user
In the case of 521, if having used the client terminal device 21 with relatively low specification (resolution ratio), the resolution of client terminal device 21
Rate is changed.It is thereby possible to reduce load of the delay phenomenon without increasing video output device 11.
In addition, in the present embodiment, with unit of the unit in first embodiment with same reference numerals with
The similar function of function in one embodiment.Therefore, the formant in the present embodiment is only described.
Figure 10 is the illustrative block diagram of video output system 100.Different from first embodiment, client terminal device 21 wraps
Include PC specifications fetching portion 68.PC specifications fetching portion 68 obtains the specification of client terminal device 21.For example, PC specification fetching portions
68 obtain CPU titles, operating clock, physical storage capacity and message transmission rate and wireless data on such as mainboard
Transmission rate.These data are managed by OS, to which PC specifications fetching portion 68 can inquire data (specification) from OS.PC specifications obtain
It takes part 68 that specification is sent to resolution changing and determines part 62.
Then, if specification value is less than threshold value, resolution changing determines part 62 by the resolution ratio of client terminal device 21
Be adapted to below or equal to video output device 11 resolution ratio.
Figure 11 A illustrate that resolution changing determines whether part 62 determines the standard for the resolution ratio for changing client terminal device 21
Sample list.In this standard list, the minimum gauge of CPU standards and memory standards is registered.For example, CPU standards are
Finger includes the CPU specifications of CPU manufacturer title, model number and operating clock.Memory standards refer to physical storage capacity.
For CPU standards, if the specification of all acquisitions is less than specification (CPU standards), resolution changing those of in standard list
Determine that part 62 determines that the specification of client terminal device 21 is relatively low.For memory standards, if the physical storage capacity obtained
Less than the physical storage capacity (memory standards) in standard list, then resolution changing determines that part 62 determines client dress
Set 21 specification it is relatively low.In this case, it is determined to be based on CPU standards, resolution changing determines that part 62 has
Table include issue date corresponding with CPU manufacturer title and model number.
Figure 11 B illustrate the example of client terminal device corresponding with specific CPU specifications and physical storage capacity 21
Property operation.If such as the specification of CPU is " Intel Core 2Duo 1.8GHz (registered trademark) " and physical storage holds
Amount is " 2 gigabytes ", it is determined that specification is less than the specification of standard list.Therefore, resolution changing determines part 62 by client
The resolution changing of end device 21 is the resolution ratio equal to video output device 11.On the other hand, if the specification of such as CPU is
" Intel Core i5 1.6GHz (registered trademark) " and physical storage capacity are " 4 gigabytes ", it is determined that with a high standard
In or equal to standard list specification.Therefore, resolution changing determines that part 62 does not carry out any operation (i.e. simultaneously to resolution ratio
Do not change resolution ratio).
Figure 12 illustrates the illustrative sequence diagram in the time sequential routine of client terminal device 21 and video output device 11.Under
Wen Zhong, the description step different from the step in first embodiment.
Step S3：Resolution ratio is reported in resolution inquiry part 61 determines part 62 to resolution changing.
Step S3-1：Resolution changing determines that part 62 transmits the request to PC specifications fetching portion 68 to obtain specification.
PC specifications fetching portion 68 obtains specification from OS, and specification is sent to resolution changing and determines part 62.
Step S4：Resolution changing determines that part 62 determines the need for changing resolution ratio.It is described below in step S4
Processing.
Step S5：Resolution changing determines that part 62 will be ready to complete notice and be sent to screen transmitting portion 63.Later, locate
Reason is similar to the processing in first embodiment.
Figure 13 is for determining whether that resolution changing is needed to determine that part 62 changes the illustrative of the process of resolution ratio
Flow chart.Compared with Fig. 9, step S2-1 is increased.
Resolution changing determine part 62 determine CPU specifications whether higher than described in standard CPU specifications and physics deposit
Whether reservoir capacity is more than the capacity (step S2-1) described in standard.
When determining that CPU specifications are not above CPU specifications described in standard or physical storage capacity and not larger than mark
When capacity described in standard (being "No" in step S2-1), resolution changing determines that part 62 changes the resolution of client terminal device 21
Rate (step S1-4).
When determining that CPU specifications are more than higher than the CPU specifications described in standard and physical storage capacity described in standard
Capacity when (in step S2-1 be "Yes"), resolution changing determines that part 62 does not change the resolution ratio of client terminal device 21.
That is, it is lower in processing capacity, even if when user chooses picture quality priority frame 521, client
The resolution ratio of device 21 is also set to less than the resolution ratio in current setting.When user uses the client with relatively low specification
Change resolution ratio when device 21, to which client terminal device 21 can send screen data in the case of no delay.Therefore, may be used
To reduce delay phenomenon without increasing the load on video output device 11.
3rd embodiment
In the first embodiment, resolution changing client terminal device 21 of the client terminal device 21 based on video output device 11
Resolution ratio.In the present embodiment, such video output system 100, in the video output system 100, visitor are described
The range of resolution changing of the family end device 21 based on video output device 11 screen data to be acquired.By doing so,
Resolution ratio of the delay phenomenon without changing client terminal device 21 can be reduced.
Figure 14 is the illustrative block diagram of video output system 100.Client terminal device 21 determines part including excision extension
69, to replace the resolution changing part 66 in first embodiment.Excision extension determines that the determination of part 69 will be by screen acquisition unit
Divide the excision extension of 67 screen data obtained.Specifically, excision extension determines that the determination of part 69 is defeated less than or equal to video
Go out the excision extension of the resolution ratio of device 11.Screen fetching portion 67 obtains screen data based on identified range.
Figure 15 A and 15B illustrate schematically how to determine the example of excision extension.Figure 15 A instructions are in client terminal device
The screen data shown on 21 display screen 320.The resolution ratio of screen data is 1440 × 900.When video output device 11
When resolution ratio is 1024 × 768, the resolution ratio higher of client terminal device 21.Accordingly, it is determined that part 65 transmits the request to excision
Range determining part 69 is to determine excision extension.
It is desirable that, excision extension corresponds to the range of user's concern.For this purpose, excision extension determines that part 69 determines have
The range of 1024 × 768 sizes as excision extension, wherein by mouse be directed toward position (mouse position) centered on.It can be with
Mouse position is obtained by inquiring OS.When mouse position is described as (X, Y), excision extension is provided as follows：
X-direction：X-512 to X+512；
Y-direction：Y-384 to Y+384.
Figure 15 B illustrate the screen data obtained by screen fetching portion 67.Include that part is determined by excision extension
The screen data of 69 excision extensions determined.
If mouse position is located at the adjacent edges of display screen 320, to cut off in the horizontal direction from left to right edge
Closer to mouse position any 1024 pixels and excision in vertical direction from up or down edge closer to mouse position
The mode for any 768 pixels set, determines excision extension, to form excision extension.
In addition, as illustrated in figure 16b, independent of mouse position, can alternatively obtain the screen number of scheduled event window
According to.Here, active window refers to the window (region) for the target for being arranged to user's operation.It can be identified by inquiring OS
Active window.When the size of active window is more than resolution ratio, the center with 1024 × 768 sizes and active window is made
Centered on screen data can as excision extension be removed.When the size of active window be less than resolution ratio when, have be more than
1024 × 768 sizes of active window size and the screen data centered on the center of active window, which can be used as, to be cut off
Range is removed.
Figure 17 is the illustrative sequence diagram of the operating process of client terminal device 21 and video output device 11.Below
In, the description step different from the step in first embodiment.
Step S3：Resolution ratio is reported in resolution inquiry part 61 determines part 62 to resolution changing.
Step S4：Resolution changing determines that part 62 determines the need for changing resolution ratio.It is described below in step S4
Processing.
Step S4-1：Resolution changing determines that the excision extension of part 62 determines that part 69 determines excision extension.
Step S4-2：Excision extension determines the excision extension that part 69 is arranged in screen transmitting portion 63.
Step S5：Resolution changing determines that part 62 will be ready to complete notice and be sent to screen transmitting portion 63.Later, locate
Reason is similar to the processing in first embodiment.
Figure 18 is that wherein resolution changing determines that part 62 determines the need for changing the illustrative of the process of resolution ratio
Flow chart.In this process, the step S1-4 in Fig. 9 is replaced using step S3-1.
In step S1-3, when picture quality priority is not arranged (being "No" in step S1-3), excision extension is true
Determine the excision extension (step S3-1) that part 69 is arranged in screen transmitting portion 63.By doing so, to be sent defeated to video
The resolution ratio for going out the screen data of device 11 is set equal to the resolution ratio of video output device 11.Accordingly it is possible to prevent increasing
The processing of video output device is added to load.
According to the present embodiment, by changing the screen number obtained according to the resolution ratio of video output device by client terminal device
According to range, can reduce delay phenomenon without change resolution ratio.
Fourth embodiment
In the present embodiment, such video output system 100 is described to be based in the video output system 100
The knots modification of the screen of client terminal device 21 changes the resolution ratio of client terminal device 21.When the screen of client terminal device 21 changes
When variable so makes load increase greatly, changes resolution ratio and postponed with preventing (reduction) from sending.By doing so, can control
Delay phenomenon is without increasing the load on video output device 11.
Figure 19 is the illustrative block diagram of video output system 100.Client terminal device 21 further includes PC screen knots modifications prison
Depending on part 71.The screen knots modification of client 21 is compared by PC screen knots modifications monitoring section 71 with reference value, and really
Determine knots modification to be big or small.
Figure 20 A and 20B illustrate the example of screen knots modification.As obvious between Figure 20 A and 20B,
Change (difference) to be only to move mouse position.In this case, screen knots modification is before the movement with reference to diagonal line
Mouse position and mouse position after movement between the rectangular area of line that connects.PC screen knots modifications monitoring section 71
Screen knots modification is calculated based on following methods.
Figure 20 C and 20D schematically illustrate another example of screen knots modification.Figure 20 C and 20D are shown entire
The screen display of mobile picture is shown in screen.Although since monochrome printing may be difficult to identify picture, word has been changed
The brightness of symbol.In this case, be compared between Figure 20 C and 20D, then be directed to almost whole region (such as 1440 ×
900) it is able to detect that change.
Figure 21 is the illustrative flow chart of the process of 71 monitor screen knots modification of PC screen knots modifications monitoring section.
PC screen knots modifications monitoring section 71 obtains the newest screen data (step sent by screen transmitting portion 63
S10)。
PC screen knots modifications monitoring section 71 compares acquired newest screen data with screen data before
Compared with, and determine the range (step for the pixel that the range (being laterally multiplied by longitudinal direction) after changing is had been changed into storing pixel values
Rapid S20).
PC screen knots modifications monitoring section 71 calculates the average value of pixel coverage, wherein for past special time period
Change is arrived after testing.For example, when special time period is 10 seconds and if screen fetching portion 67 obtains 30 times per second
Screen, screen fetching portion 67 calculate the average value of the range of the change of 300 times (10 × 30=300).By obtaining past tense
Between average value in range, can be changed based on the transient state in screen to reduce time for the resolution ratio for changing client terminal device 21
Number.Here, the range of change or averagely change range be range information claimed example.
The update of PC screen knots modifications monitoring section 71 institute is calculated averagely to change range, the average change model of the computer
Enclose is averagely to change range (step using calculated newest averagely change range is calculated in step S20
S30)。
PC screen knots modifications monitoring section 71 is replaced just stored with the newest screen data obtained in step slo
Screen data (step S40) before.
PC screen knots modifications monitoring section 71 reports average change range determines 62 (step of part to resolution changing
S50).By doing so, resolution changing determines that part 62 may determine whether resolution ratio to be changed.
Figure 22 illustrates the example of the operation and reference value of client corresponding with resolution ratio 21.When point of client 21
When resolution is 1280 × 800, reference value is, for example, 640 × 400 (examples of first threshold claimed).When average change
When range is more than reference value, resolution changing determines that part 62 is determined and is arranged lower by resolution ratio；And it ought averagely change model
When enclosing less than or equal to reference value, resolution changing determines that part 62 determines and higher is arranged to obtain in resolution ratio.
Similarly, when the resolution ratio of client 21 is 1024 × 768, reference value is, for example, 512 × 384.Change when averagely
When becoming range more than reference value, resolution changing determines that part 62 is determined and is arranged lower by resolution ratio；And ought averagely it change
When range is less than or equal to reference value, resolution changing determines that part 62 determines and higher is arranged to obtain in resolution ratio.
When screen change is very big, the processing load of client terminal device 21 correspondingly increases.Therefore, when client terminal device 21
Processing heavier loads when, video output device 11 image can be projected without increase load.
Figure 23 is the illustrative sequence diagram of the operating process of client terminal device 21 and video output device 11.Below
In, the description step different from the step in first embodiment.
Step S5：Resolution changing determines that part 62 will be ready to complete notice and be sent to screen transmitting portion 63.Later, with
First embodiment is similar, and screen transmitting portion 63 obtains screen data, and the screen data is sent to screen receiving part
Divide 82.Projection section 83 projects the screen data from light engine 37.
Step S8：Newest screen data is sent to PC screen knots modifications monitoring section 71 by screen transmitting portion 63.
Step S9：PC screen knots modifications monitoring section 71 execute Figure 21 processing, and will averagely change range report to
Resolution changing determines part 62.
Step S4：Resolution changing determines that part 62 determines the need for changing resolution ratio.It is described below in step S4
Processing.Later, the processing from step S5 is repeated.
Figure 24 is for determining whether that resolution changing is needed to determine that part 62 changes the illustrative of the process of resolution ratio
Flow chart.Increase step S4-1 to S4-5 after the step S1-5 of Fig. 9.
When resolution changing determines that the notice that is ready to complete that screen data is sent is sent to screen transmitting portion by part 62
When 63 (step S1-5), resolution changing determines that part 62 waits for the average change model from PC screen knots modifications monitoring section 71
The report (step S4-1) enclosed.
When and it is unreported averagely change range when (being "No" in step S4-2), if not receiving projection completion notice
(being "No" in step S4-3), resolution changing determines that part 62 still waits for.
When reporting average change range (being "Yes" in step S4-2), it is average that resolution changing determines that part 62 determines
Change whether range is more than reference value (step S4-4).
When average change range is more than reference value (being "Yes" in step S4-4), screen knots modification is larger.Therefore, it differentiates
Rate changes the resolution ratio (step S1-4) for determining that part 62 changes client terminal device 21.
When average change range and (being "No" in step S4-4) when being less than reference value, screen knots modification is smaller.Therefore,
Resolution changing determines resolution ratio of the part 62 by resolution changing to be arranged before the resolution ratio for changing client terminal device 21
(step S4-5).By doing so, the resolution ratio of client terminal device 21 can be changed according to screen knots modification.
As described above, in the video output system according to the present embodiment, when the screen knots modification of client terminal device is larger
When so that resolution ratio is reduced to be loaded with the processing for reducing client terminal device 21.By doing so, during data transmission can be reduced
Delay and video output device 11 delay phenomenon.
5th embodiment
In the present embodiment, such video output system 100, in the video output system 100, client are described
End device 21 projects the period that a frame screen data needs based on video output device 11, changes the resolution of client terminal device 21
Rate.During projecting the period needed for a frame screen image data, processing load is higher.Therefore, when the place of client terminal device
When reason load is higher, change resolution ratio.
Figure 25 is the illustrative block diagram of video output system 100.Video output device 11 includes image processing time report
Accuse part 84.Video output device 11 is shown the period needed for a frame image (under by image processing time report section 84
Can referred to as " processing time " in text) (report) is sent to client terminal device 21.That is, processing time refers to (in projection one
Between image moment and projection next image moment) time interval of frame data projection.
When being greater than or equal to threshold value between when treated, resolution changing determines that part 62 determines the resolution ratio of client terminal
It will be arranged to the resolution ratio of video output device 11.When being less than threshold value between when treated, resolution changing determines that part 62 is true
Original resolution (that is, resolution ratio before changing) will be arranged to by determining the resolution ratio of client terminal.For example, it is preferable to it is per second more
The video of new 30 frame, and it is therefore assumed that video output device 11 is capable of the image of 30 frames of projection per second.In such case
Under, threshold value (example of second threshold claimed) is 33 milliseconds (1000 milliseconds/30).When the period being more than threshold value,
It is assumed that processing load again is applied to video output device 11.
Therefore, the resolution ratio of client terminal device 21 can be changed based on the comparison between processing time and threshold value.That is, can
It is loaded with the processing based on video output device 11 to change the resolution ratio of client terminal device 21.
Figure 26 is the illustrative operation based on processing time of client terminal device 21.When the place needed for processing video data
When the reason time is 30 milliseconds, processing time is less than 33 milliseconds of threshold value.Therefore, client terminal device 21 not for resolution ratio into
Any operation of row.When it is 60 milliseconds to handle the processing time needed for video data, processing time is greater than or equal to 33 milliseconds
Threshold value.Therefore, the resolution changing of client terminal device 21 is the resolution equal to video output device 11 by client terminal device 21
Rate.
Figure 27 is the illustrative sequence diagram of the operating process of client terminal device 21 and video output device 11.Below
In, the description step different from the step in first embodiment.
Step S6：Screen transmitting portion 63 obtains screen data, and the screen data is sent to screen receiving part
Divide 82.
Step S7：The projection section 83 of video output device 11 projects the screen data from light engine 37.
Step S7-1：The updating record for the image that projection section 83 will be projected gives image processing time report section
84。
Step S7-2：The 84 measurement processing time of image processing time report section, and will report to resolution processing time
Rate, which changes, determines part 62.
Step S4：Resolution changing determines that part 62 determines the need for changing resolution ratio.It is described below in step S4
Processing.
Figure 28 is for determining whether that resolution changing is needed to determine that part 62 changes the illustrative of the process of resolution ratio
Flow chart.Increase step S5-1 to S5-4 after the step S1-5 of Fig. 9.
When resolution changing determines that the notice that is ready to complete that screen data is sent is output to screen transmitting portion by part 62
When 63 (step S1-5), resolution changing determines that part 62 waits for the processing time from image processing time report section 84
It reports (step S5-1).
When receiving the report of processing time (being "Yes" in step S5-1), resolution changing determines at 62 determination of part
Manage whether the time is less than threshold value (step S5-2).
When being not less than threshold value between when treated (in step S5-2 be "No"), project time needed for a frame image compared with
It is long.Therefore, resolution ratio (step S1-3 and S1-4) is changed based on the setting of picture quality priority frame 521.
When being less than threshold value between when treated (being "Yes" in step S5-2), video output device 11 has sufficient processing energy
Power.Accordingly, it is determined whether the resolution ratio (step S5-3) provided with the resolution ratio before changing less than resolution changing part 66.
When determining the resolution ratio that resolution ratio is less than before resolution changing part 66 changes (being "Yes" in step S5-3),
Resolution changing determines that part 62 determines and sets the resolution ratio of client terminal device 21 to original resolution (step S5-4).It
Afterwards, processing returns to step S1-5, to which resolution changing part 66 repeats to determine whether to change based on processing time to differentiate
Rate.
As described above, in the video output system 100 according to the present embodiment, it can be based on the figure of video output device 11
The processing load of the renewal time estimation video output device 11 of picture, and the resolution ratio of client terminal device 21 can be changed.Cause
This, the resolution ratio that can send has is less than or equal to the screen data of the resolution ratio of video output device 11, is regarded to reduce
Processing load on frequency output device 11.
Sixth embodiment
In the present embodiment, the video output system 100 including multiple video output devices 11 is described.
Figure 29 is the illustrative block diagram of video output system 100.Two video output devices 11 can lead to via network 15
It is connected to client terminal device 21 to letter.Identical screen data can be sent to video output device 11 by client terminal device 21.
In order to which screen data is sent to video output device 11, the processing load of client terminal device 21 more likely increases.For example,
In the case that TCP/IP is sent, transmission process becomes more sophisticated, this is because client terminal device 21 is in response to (dividing in packet
) screen data and receive ACK, and then send next screen data.Therefore, the processing load of client terminal device 21
More likely increase.
In the present embodiment, when screen data is sent to multiple video output devices 11 by client terminal device, client
The resolution ratio of device 21 be set to less than or equal to video output device 11 resolution ratio.
The block diagram of video output system 100 is omitted, this is because the block diagram is similar to the frame of Fig. 5 in first embodiment
Figure.Moreover, the sequence diagram of video output system 100 is similar to the sequence diagram in Fig. 8.
Figure 30 is for determining whether that resolution changing is needed to determine that part 62 changes the illustrative of the process of resolution ratio
Flow chart.New step S6-1 is increased in the flowchart of fig. 9.
When resolution ratio of the high resolution of client terminal device 21 in video output device 11, resolution changing determines part
62 determine whether the quantity of the screen data video output device 21 to be sent arrived is more than one (step S6-1).
The projecting apparatus for starting screen 501 in projection specifies the specified screen data video output to be sent arrived in row 511
Device 11.Therefore, the screen data of client terminal device 21 it is to be sent to the quantity of video output device 11 be apparent.And
And by inquiring OS or protocol stack, the response for the TCP connection that instruction is currently established can be obtained.Hence, it can be determined that screen number
Whether it is more than one according to the quantity of the video output device 21 to be sent arrived.
When determine screen data it is to be sent to video output device 21 quantity be more than for the moment (be in step S6-1
"Yes"), resolution changing determines part 62 by the resolution changing of client terminal device 21 for less than or equal to video output device
11 resolution ratio (step S1-4).The resolution ratio of video output device can be different from each other.Such case will be in the 7th embodiment
Middle discussion.
It is similar with the situation in Fig. 9, when determining that the quantity of the screen data video output device 21 to be sent arrived is little
In for the moment (in step S6-1 be "No"), resolution changing determine part 62 according to the setting of picture quality priority frame 521 come
The resolution ratio of client terminal device 21 is set.
Therefore, according to the present embodiment, determine screen data it is to be sent to the quantity of video output device 21 be more than
In the case of one so that the processing load of client terminal device 21 is increased, the resolution ratio of client terminal device 21 is set below or waits
In the resolution ratio of video output device 11.By doing so, far less likely to occur transmission delay, to reduce delay phenomenon.
7th embodiment
In the present embodiment, such video output system 100, in the video output system 100, video are described
The quantity of output device 11 is more than one, and the resolution ratio of video output device is different from each other, and the resolution ratio of client terminal device 21
It is set equal to resolution ratio minimum in each video output device 11.
Figure 31 is for determining whether that resolution changing is needed to determine that part 62 changes the illustrative of the process of resolution ratio
Flow chart.New step S7-1 is increased in the flow chart of Figure 30.
The resolution ratio of video output device 11 is reported to resolution changing and determines part 62 (step S1-1).That is, report
The resolution ratio of the screen data all video output devices 11 to be sent arrived.
It is minimum in each video output device 11 to determine that part 65 determines whether the resolution ratio of client terminal device 21 is more than
Resolution ratio (step S1-2).
(the step when the resolution ratio of client terminal device 21 is not larger than resolution ratio minimum in each video output device 11
It is "No" in S1-2), it no longer needs to reduce resolution ratio.Therefore, resolution changing determines the preparation that part 62 sends screen data
Completion notice is sent to screen transmitting portion 63 (step S1-5).
(the step S1-2 when the resolution ratio of client terminal device 21 is more than resolution ratio minimum in each video output device 11
In be "Yes"), resolution changing determine part 62 determine screen data it is to be sent to the quantity of video output device 11 be
It is no to be more than one (step S6-1).
When determine the screen data video output device 11 to be sent arrived quantity be not larger than for the moment (in step S6-1
For "No"), 65 reference image quality priority mark of part is determined to determine whether that image matter is arranged in client terminal device 21
Measure priority (step S1-3).
When determine screen data it is to be sent to video output device 11 quantity be more than for the moment (be in step S6-1
"Yes"), resolution changing part 66 determines and sets in each video output device 11 most the resolution ratio of client terminal device 21 to
Low resolution ratio (step S7-1).By doing so, the video output device 11 with lowest resolution can no longer be needed to change
Become its resolution ratio, increases to prevent the processing of all video output devices 11 communicated from loading.
Resolution changing determines that the notice that is ready to complete that screen data is sent is sent to screen transmitting portion 63 by part 62
(step S1-5).
Therefore, in the video output system 100 according to the present embodiment, processing load can be prevented to be applied only to (tool
Have not highest resolution) situation of particular video frequency output device 11.Therefore, it is existing to occur delay in video output device 11
The possibility of elephant reduces, to video output system 100 can between each video output device 11 synchronously projection screen.
8th embodiment
In the present embodiment, such video output system 100 is described, wherein the video output system 100 includes
Multiple video output devices 11, client terminal device 21 is communicated with one or more video output devices 11, and client
The resolution ratio of device 21 is set equal to resolution ratio minimum in each video output device 11.By dynamically checking resolution
Rate can optimally maintain the resolution ratio of the screen data sent and received in video output system 100, while maintain video
The synchronization for the screen that output device 11 projects.
Figure 32 is the illustrative block diagram of video output system 100.It wraps the resolution changing part 66 of client terminal device 21
It includes cut-out and determines part 72.Cut-out determines that TCP connection state is periodically inquired in part 72 from such as OS or protocol stack.Cut-out is true
Part 72 is determined by storing the sending destination for the screen data for establishing connection in newest inquiry and when by newest inquiry
Sending destination and after newest inquiry (being essentially the newest inquiry compared at time point) obtain sending destination into
Row compares, and any connection is had been switched off recently to determine whether there is.When determining in the presence of cut-out sending destination, cut-out
Determine that the identification information (for example, authentication code, projector designation and IP address) for cutting off video output device 11 is reported in part 72
It accuses to resolution inquiry part 61.
The identification information of resolution inquiry part 61 and video output device 11 storage resolution data in association.It differentiates
Rate query portion 61 deletes the identification information of reported video output device 11 and associated resolution ratio, and will be remaining
Minimum resolution ratio is reported in resolution ratio determines part 62 to resolution changing.By doing so, resolution changing determines part
62 can set the resolution ratio of client terminal device 21 to the resolution ratio with the video output device 11 of lowest resolution.
Figure 33 is the illustrative sequence diagram of the operating process of client terminal device 21 and video output device 11.Below
In, the description step different from the step in first embodiment.
S5：Resolution changing determines that part 62 will be ready to complete notice and be sent to screen transmitting portion 63.
S8：Cut-out determines that part 72 periodically determines whether any communication for having with video output device 11.
S9：When determining that the communication with video output device 11 is cut off, cuts off and determine that part 72 sends cut-out notice
To resolution inquiry part 61.Cut-out notice includes the identification information of video output device 11.
S10：Resolution inquiry part 61 is by minimum point in each video output device 11 for communicating and being not switched off
Resolution and quantity change notice report to resolution changing part 66.
S4：Resolution changing determines that part 62 determines the need for changing resolution ratio.The processing in step S4 is described below.
S5：Resolution changing determines that part 62 will be ready to complete notice and be sent to screen transmitting portion 63.Later, class is handled
The processing being similar in first embodiment.
Figure 34 is for determining whether that resolution changing is needed to determine that part 62 changes the illustrative of the process of resolution ratio
Flow chart.New step S8-1 and S8-2 are increased in the flow chart of Figure 31.
In step S1-5, when resolution changing determines that the notice that is ready to complete that screen data is sent is sent to by part 62
When screen transmitting portion 63 (step S1-5), resolution changing part 66 waits for received quantity to change notice (step S8-1).
Quantity may not be received under some cases changes notice.Therefore, when not receiving quantity change notice, resolution ratio changes
Become part 66 and does not carry out any operation.
When receiving change notice (step S8-2), resolution changing determines that part 62 changes point of client terminal device 21
Resolution so that it, which is equal to, changes resolution ratio minimum in each video output device 11 that notice includes.
As described above, in video output system 100, when the case where being projected simultaneously using multiple video output devices 11
When the open close letter of incision, change resolution ratio setting.By doing so, the resolution ratio of screen data can be optimized always.
9th embodiment
In the first to the 8th embodiment, when provided with picture quality priority, send with client terminal device 21
The screen of resolution ratio.However, in this case, when client terminal device 21 continues to send still image or sends video data
When, required processing capacity can exceed that the reproduction of video output device 11, to which video output device 11 may nothing
Method suitably (smoothly) rendered screen.
In the present embodiment, such video output system 100 is described, wherein in transmitting video data or continuous quiet
Only when image data (hereinafter referred to as " Still image data "), client terminal device 21 based on video output device 11 again
Existing ability sends screen data.
Here, the case where suitably can not (smoothly) reproducing image, is not limited to the feelings provided with picture quality priority
Condition.Therefore, independent of whether describing the present embodiment provided with picture quality priority.
Figure 35 is the illustrative block diagram according to the video output system 100 of the present embodiment.Client terminal device 21 includes energy
Power query portion 75.Reproduction is inquired in capability query part 75 from video output device 11.It has been described " reproduction ".
Reproduction is reported to resolution changing and determines part 62.
Resolution changing in the present embodiment determines that part 62 includes that data send setting unit.Data send setting unit
The data for limiting screen transmitting portion 63 send setting, to make it be less than or equal to the reproduction reported from video output device 11
Ability.It includes data resolution, maximum data rate and maximum frame per second that data, which send setting,.The case where sending Still image data
Under, do not include maximum data rate.
In addition, video output device 11 includes content rendering capabilities report section 85.Content rendering capabilities report section 85
In response to the inquiry from capability query part 75, the reproduction of video output device 11 is reported.
Figure 36 illustrates the example of the reproduction list of video output device 11.As the reproduction of video data,
It is specified " data resolution ", " maximum data rate [mbit] " and " maximum frame per second [fps] " for each " reproducible format ".
Data resolution：Data resolution refers to the resolution ratio of screen data, while data resolution also refers to first to
The maximum resolution of the specification based on video output device 11 in eight embodiments.
Maximum data rate：It refers to peak data transfer rate per unit time.
Maximum frame per second：It refers to maximum transmitted number of frames per unit time.The data volume of every image data depends on
Compression ratio and it is different.Therefore, between maximum frame per second and maximum data rate and be not present proportional relationship.Such as it even if ought be most
When big data rate is relatively low, if compression ratio is higher, maximum frame per second is also higher.
As the reproduction of Still image data, specified for each " reproducible format " " data resolution " and " maximum
Frame per second [fps] ".As the illustrative state of Still image data continuously transmitted, the sequentially perspective view of client terminal device 21
As data, such as lantern slide play.
Format described in " reproducible format " is merely exemplary.For example, MPEG2 and MPEG4 can be included as
" reproducible format " of video data.And for example, PNG, GIF and BMP can be included as Still image data " can be again
Existing format ".
In the present embodiment, the setting on the setting screen based on Fig. 7 B, which obtains instruction user, is provided with to video data
Priority is still provided with Still image data the data of priority.In the setting screen of Fig. 7 B, it is excellent that there are picture qualities
First grade frame 521 and voice send frame 522.Whether picture quality priority frame 521 receives to set picture quality setting priority
It sets, and voice sends frame 522 receives whether to send the setting of voice data.When choosing picture quality priority frame 521, recognize
Determine user and priority is provided with to picture quality.In this regard, resolution changing determines part 62 as follows according to picture quality priority
The setting of frame 5210 determines that data send setting.
Picture quality priority frame=unlatching：The data resolution in reproduction list is based only upon to determine reproduction energy
Power.
Picture quality priority frame=shutdown：From " data resolution ", " maximum data rate " and " largest frames of reproduction
The reproduction for being best suited for video data transmission is determined in the combination of rate ".
For example, continuing by client terminal device in " picture quality priority frame=unlatching " and JPEG (Still image data)
In the case that 21 are sent, resolution changing determines that part 62 sends the screen data of 1920 × 1080 data resolutions.Phase
Ying Di, maximum frame per second are 10fps.
It is sent by client terminal device 21 in " picture quality priority frame=unlatching " and H.264 (video data)
In the case of, resolution changing determines that part 62 sends the screen data of 1920 × 1080 data resolutions.Correspondingly, maximum data
Rate is 20 mbits, and maximum frame per second is 24fps.
In the case of " picture quality priority frame=shutdown ", resolution changing determines that part 62 is based on being provided with it
The maximum data rate of priority or maximum frame per second determine data resolution.For example, can determine that data are differentiated based on maximum frame per second
Rate.
" picture quality priority frame=shutdown " and JPEG (Still image data) continue by client terminal device 21 into
In the case that row is sent, resolution changing determines that the selection of part 62 wherein frame per second is less than or equal to the static figure of client terminal device 21
As the maximum data resolution ratio of the frame per second of data.For example, in " frame per second=15 of Still image data " of client terminal device 21
In the case of, select data resolution 1920 × 1080.Feelings in " frame per second=20 of Still image data " of client terminal device 21
Under condition, data resolution 1280 × 720 is selected.
Continue to be sent out by client terminal device 21 in " picture quality priority frame=shutdown " and H.264 (video data)
In the case of sending, resolution changing determines that the selection of part 62 wherein frame per second is less than or equal to the video data of client terminal device 21
The maximum data resolution ratio of frame per second.For example, in the case of " frame per second=24 " of client terminal device 21, data resolution is selected
1920×1080.In the case of " frame per second=40 " of client terminal device 21, data resolution 640 × 360 is selected.
By doing so, reproduction appropriate and static image and video data when can select user setting
Transmission, and limit the data transmission rate of client terminal device 21.
Furthermore, it is possible to select maximum frame per second or the resolution ratio of maximum data rate independent of the frame per second of client terminal device 21.
In the case, the resolution ratio 1280 × 720 or video data of maximum frame per second=30 in the transmission of Still image data are selected
Transmission in maximum frame per second=60 resolution ratio 640 × 3600.
Figure 37 is the illustrative sequence diagram of the operating process of client terminal device 21 and video output device 11.
S1：User presses projection button 512.
S2：When user presses projection button 512, in order to which client terminal device 21 can send screen data, resolution ratio is looked into
It askes part 61 and inquires resolution ratio from resolution ratio report section 81.
S3：Resolution ratio is reported in resolution inquiry part 61 determines part 62 to resolution changing.
S4：Resolution changing determines that part 62 determines the need for changing resolution ratio.
S5：Resolution changing determines that part 62 transmits the request to capability query part 75 to obtain reproduction.
S6：Reproduction is inquired in capability query part 75 from content rendering capabilities report section 85.In step S5, it can obtain
Take reproduction and resolution ratio.By doing so, can be with removal step S2.In the case, in the reproduction list of Figure 36
In, " resolution ratio " can be stored together with " reproducible format ", " data resolution ", " maximum data rate " and " maximum frame per second ".
S7：When obtaining reproduction, resolution changing determines that part 62 limits data transmission setting.Step is described below
Processing in rapid S6.
S8：Resolution changing determines that part 62 will be ready to complete notice and be sent to screen transmitting portion 63.
S9：Screen transmitting portion 63 obtains screen data, and the screen data is sent to screen receiving portion 82.
S10：The projection section 82 of video output device 11 projects the screen data from light engine 37.
Figure 38 is that resolution changing determines that step S4 and S7 of the part 62 in Figure 37 determine the process of data transmission setting
Illustrative flow chart.The processing of step S1-1 to S1-4 is similar to the processing in the first embodiment in Fig. 9, and omits
It is described.
Next, whether being provided with picture quality priority independent of in step S1-3, capability query part 75 is from interior
Hold reproduction report section 85 and obtains reproduction list (step S9-1).
Data send setting unit and are based on picture quality priority frame 521, and data transmission setting is limited to be equal to or small
In the upper limit (step S9-2) of reproduction.
Next, resolution changing determines that the notice that is ready to complete that screen data is sent is sent to screen transmission by part 62
Part 63 (step S9-3).
As described above, the upper limit of reproduction of the client terminal device 21 based on video output device 11, limits data transmission
Setting.Therefore, in the transmission of video data and Still image data, video output device 11 can suitably (smoothly) again
Existing screen.
Tenth embodiment
In the present embodiment, such client terminal device 21 is described, when video data or Still image data will be sent out
When being sent to multiple projecting apparatus, which determines number
It is arranged according to transmission.As shown in Figure 30, video output system 100 may include multiple video output devices 11.In the present embodiment
In, client terminal device 21 is based on the video output device with the minimum reproduction ability for reproducing video data and Still image data
11 reproduction, limitation data transmission setting.By doing so, all video output devices 11 can be suitably (smooth
Ground) reproduce video data or Still image data.
Figure 39 A illustrate the reproduction list of video output device 1, and Figure 39 B illustrate video output device 2 again
Existing capabilities list.The resolution ratio of video output device 1 is 2560 × 1600, and the resolution ratio of video output device 2 is 1920
×1080.In addition, the maximum data resolution ratio of the Still image data of video output device 1 is 3840 × 2160, and video
The maximum data resolution ratio of the Still image data of output device 2 is 1920 × 1080.In addition, the video of video output device 1
The maximum data rate of the data resolution " 640 × 360 " of data and maximum frame per second are " 30 " and " 40 " respectively, and video exports
The maximum data rate of the data resolution " 640 × 360 " of the video data of device 2 and maximum frame per second resolution are " 40 " and " 50 ".
Figure 40 is that resolution changing determines that part 62 determines the illustrative flow chart of the process of data transmission setting.Step
The processing of S1-1 to S7-1 is similar to the processing in the 7th embodiment in Figure 31.Therefore, wherein repetitive description is omitted.
When the resolution ratio of client terminal device be set below or equal to video output device lowest resolution when, differentiate
Rate changing section 66 obtains the reproduction list (step 10-1) inquired by capability query part 75.It is exported from each video
Device 11 sends reproduction list.
Next, minimum reproduction of the resolution changing part 66 based on the setting depending on picture quality priority frame 521
Ability come determine data transmission be arranged (step S10-2).In the example of Figure 39, data transmission setting is determined as described above.
In picture quality priority frame=unlatching and in the case of transmit JPEG (Still image data)：When comparing two
When the data resolution of the JPEG (Still image data) of reproduction list, maximum data resolution ratio both corresponds to 1280 ×
720.In this case, two video output devices 11 all have data resolution 1280 × 720.Therefore, largest frames are paid close attention to
Rate.Maximum frame per second corresponding with the data resolution 1280 × 720 of video output device 1 and 2 is respectively " 30 " and " 15 ".Cause
This, the maximum frame per second of video output device 2 is less than the maximum frame per second of video output device 1.Therefore, it is based on video output device 2
Reproduction come limit data transmission setting.
In the case of picture quality priority frame=unlatching and transmission H.264 (video data)：When comparing two again
When the H.264 data resolution of (video data) of existing capabilities list, maximum data resolution ratio both corresponds to 1280 × 720.This
Outside, maximum frame per second both corresponds to " 30 " in this maximum data resolution ratio.Therefore, the reproduction based on video output device 1
To limit data transmission setting.
In picture quality priority frame=shutdown and in the case of transmit JPEG (Still image data)：In picture quality
Similar with the 9th embodiment in the case of priority frame=shutdown, resolution changing part 66 selects maximum data rate and maximum
One of priority is provided with to it in frame per second.In the case, it is assumed that priority is provided with to maximum frame per second.In static image
The maximum value of maximum frame per second corresponds to " 15 " in the case of data.In addition, in the case of maximum frame per second=" 15 ", video output
The data resolution of device 1 is 1920 × 1080, and the data resolution of video output device 2 is lower 1280 × 720.Cause
This, data transmission setting is limited based on the reproduction of video output device 2.
In the case of picture quality priority frame=shutdown and transmission H.264 (video data)：In this video data
In corresponding maximum frame per second be " 40 ".In addition, in the case of maximum frame per second=" 40 ", the data point of video output device 1
Resolution is 640 × 360, and the data resolution of video output device 2 is higher 1280 × 720.Therefore, video is based on to export
The reproduction of device 1 is arranged to limit data transmission.
Next, resolution changing determines that the notice that is ready to complete that screen data is sent is sent to screen transmission by part 62
Part 63 (step S10-3).
As described above, video counts of the client terminal device 21 based on the video output device 11 in multiple video output devices 11
According to or Still image data minimum reproduction ability, limitation data transmission setting.By doing so, all video output devices
11 suitably can (swimmingly) reproduce video data or Still image data.
11st embodiment
In the present embodiment, such client terminal device 21 is described, which is included in multiple
In the video output system of projecting apparatus, wherein the video output device 11 with highest reproduction has been selected, to be based on institute
The reproduction of the video output device 11 of selection is arranged to limit data transmission.Client terminal device 21 only sends screen data
To video output device 11.By doing so, only the video output device 11 with highest reproduction can swimmingly reproduce
Video data or Still image data.
Figure 41 is to illustrate that wherein resolution changing determines that part 62 determines the illustrative of the process of data transmission setting
Flow chart.The processing of step S1-7 to S7-1 is similar to the processing in the 7th embodiment in Figure 31, and omits and wherein repeat
Description.In addition, it is as described below, it in the present embodiment, can be based on point of the video output device with highest reproduction
The resolution ratio of client terminal device is arranged in resolution.
In step S7-1, when the resolution ratio of client terminal device is set below or minimum equal to video output device
When resolution ratio, resolution changing part 66 obtains the reproduction list (step 11-1) inquired by capability query part 75.From
Corresponding video output device 11 sends reproduction list.
Next, setting of the resolution changing part 66 based on picture quality priority frame 521, determining, there is highest to reproduce
The video output device of ability, and based on the reproduction of identified video output device, determine data transmission setting (step
Rapid S11-2).In the example of Figure 39, it is determined based on following.
In picture quality priority frame=unlatching and in the case of transmit JPEG (Still image data)：In such case
Under, when checking the data resolution of JPEG (Still image data) of two reproduction lists, in video output device 1
Maximum data resolution ratio is 3840 × 2160.Therefore, it is set based on the reproduction of video output device 1 to limit data transmission
It sets.
In the case of picture quality priority frame=unlatching and transmission H.264 (video data)：In this case,
When checking the H.264 data resolution of (video data) of two reproduction lists, the maximum number in video output device 1
It is 1920 × 1080 according to resolution ratio.Therefore, data transmission setting is limited based on the reproduction of video output device 1.
In picture quality priority frame=shutdown and in the case of transmit JPEG (Still image data)：For example, in visitor
In family end device 21 in the case of " frame per second=15 of Still image data ", the maximum data in video output device 1 and 2 is differentiated
Rate is 1920 × 1080 and 1280 × 720 respectively.Therefore, data transmission is limited based on the reproduction of video output device 1
Setting.Furthermore, it is possible to only focus on the maximum frame per second of the JPEG (Still image data) of two reproduction lists.Video exports
The maximum value of maximum frame per second in device 1 is " 30 ".Therefore, it is passed based on the reproduction of video output device 1 to limit data
Defeated setting.
In the case of picture quality priority frame=shutdown and transmission H.264 (video data)：For example, in client
In device 21 in the case of " frame per second=15 of Still image data ", the maximum data resolution ratio point in video output device 1 and 2
It is not 640 × 360 and 1280 × 720.Therefore, data transmission setting is limited based on the reproduction of video output device 2.This
Outside, the maximum frame per second of H.264 (video data) in two reproduction lists can be only focused on.In video output device 2
Maximum frame per second maximum value be " 50 ".Therefore, data transmission setting is limited based on the reproduction of video output device 2.
Next, resolution changing determines that the notice that is ready to complete that screen data is sent is sent to screen transmission by part 62
Part 63 (step S11-3).
As described above, client terminal device 21 is based on having video data or static image number in multiple video output devices 11
According to highest reproduction video output device reproduction, limitation data transmission setting.By doing so, having highest
The video output device of reproduction suitably can (swimmingly) reproduce video data or Still image data.
12nd embodiment
In the present embodiment, such client terminal device 21 is described, the client terminal device 21 is included in more
In the video output system of a projecting apparatus.Client terminal device 21 can generate screen number appropriate according to the reproduction of projecting apparatus
According to.By doing so, video output device 11 can be according to the reproduction of each video output device 11, by utmostly
Ground uses each video output device, to reproduce video data or Still image data.
Figure 42 is that wherein resolution changing determines that part 62 determines the illustrative flow chart of the process of data transmission setting.
The processing of step S1-1 to S7-1 is similar to the processing in the 7th embodiment in Figure 31, and omits wherein repetitive description.
In step S7-1, the resolution ratio due to changing client terminal device, which makes it be less than or equal to, has lowest resolution
Video output device 11 resolution ratio when, resolution changing part 66 obtains the reproduction inquired by capability query part 75
List (step 12-1).Reproduction list is sent from corresponding video output device 11.
Next, data transmission setting is limited to less than or equal to video output device 11 by resolution changing part 66
Corresponding reproduction (step S12-2).Determine data transmission setting respectively for each video output device 11.Determine number
It is identical to the method in the 9th embodiment according to the method for transmission setting.
Resolution changing determines that the notice that is ready to complete that screen data is sent is sent to screen transmitting portion 63 by part 62
(step S12-3).
Then, projection section 83 is set by changing the data transmission of each video output device 11 of transmission destination
It sets, to be sent (step S12-4).
Therefore, client terminal device 21 can be according to each in the reproduction of video output device 11, and it is appropriate to generate
Screen data, so as to by farthest reproducing video counts using the corresponding reproducing ability of video output device 11
According to or Still image data.
Although being directed to specific embodiment for complete and clear disclosed purpose describes the present invention, appended right
It is required that and be not so limited, but should be interpreted to embody to fairly fall in those skilled in the art and explain herein
The all modifications and alternative constructions in basic teaching stated.
The application based on and require the Japanese patent application No.2013-050872 that is submitted on March 13rd, 2013 and in
The priority for the Japanese patent application No.2013-272835 that on December 27th, 2013 submits, the full content of above-mentioned application pass through
Way of reference is incorporated into herein.
The description of reference numeral
11：Video output device
21：Client terminal device
34：Image processing section
35：Network data processing part
61：Resolution inquiry part
62：Resolution changing determines part
63：Screen transmitting portion
81：Resolution ratio report section
82：Screen receiving portion
83：Projection section
100：Video output system
Existing technical literature
[patent document 1] Japanese Patent Laid-Open No.2005-339256
Claims (12)
1. a kind of information processing unit, described information processing unit is carried out via cordless communication network and multiple video output devices
Communication, described information processing unit include：
Screen display unit, for output screen on the display apparatus；
Screen data acquiring unit, the screen data for obtaining the screen；
Screen data transmission unit, for the screen data to be sent to the multiple video via the cordless communication network
Output device；
Device capability acquiring unit, the device capability for inquiring the multiple video output device, and regarded from the multiple
Frequency output device obtains described device ability, and described device ability refers to the resolution ratio of the multiple video output device；
Resolution changing unit or acquisition range change one in unit, and the resolution changing unit is used for according to the dress
The screen resolution that ability changes the screen exported by the screen display unit is set, the acquisition range changes unit and uses
In the range obtained by the screen data acquiring unit to be changed into one of the screen data according to described device ability
Point；And
The quality of quality settings receiving unit, the screen data for receiving to be sent by the screen data transmission unit is set
It sets,
The wherein described resolution changing unit is used for when the quality settings allow to reduce the quality of the screen data, according to
The screen resolution for the screen that the resolution changing is exported by the screen display unit, and
The wherein described acquisition range changes unit and is used for according to the resolution ratio, by what is obtained by the screen data acquiring unit
Range changes into a part for the screen data.
2. information processing unit as described in claim 1,
The wherein described resolution changing unit is used for：
The renewal time interval of the image projected by the multiple video output device is obtained,
When the renewal time interval is greater than or equal to second threshold, and and if only if the quality settings allow to reduce the screen
When the quality of curtain data, the screen of the screen just exported by the screen display unit according to the resolution changing is differentiated
Rate, and
When the renewal time interval is less than the second threshold, by the screen exported by the screen display unit
Screen resolution changes into the screen resolution being arranged before the resolution changing unit is changed.
3. information processing unit as described in claim 1, further includes：
Specification acquiring unit, the specification for obtaining described information processing unit,
The wherein described resolution changing unit is used for, even if when the quality settings do not allow for reducing the matter of the screen data
When amount and when the specification is not above reference value, exported by the screen display unit according to the resolution changing
The screen resolution of the screen.
4. information processing unit as described in claim 1, further includes：
Range information generation unit for monitoring the screen, and generates the range information for the range for wherein detecting change,
The quality for reducing the screen data, the resolution changing unit wherein whether is allowed to use independent of the quality settings
In：
It is defeated by the screen display unit according to the resolution changing when the range information is greater than or equal to first threshold
The screen resolution of the screen gone out, and
When the range information is less than the first threshold, by the screen of the screen exported by the screen display unit
Resolution changing is the screen resolution being arranged before the resolution changing unit is changed.
5. information processing unit as described in claim 1,
Wherein, when the screen data is sent to multiple regard by the screen data transmission unit via the cordless communication network
When frequency output device, the quality for reducing the screen data, the resolution changing whether are allowed independent of the quality settings
Unit is used to change according to described device ability the screen resolution of the screen exported by the screen display unit.
6. information processing unit as claimed in claim 5,
Wherein described device ability acquiring unit is used to inquire the device capability of the multiple video output device, and from described
Multiple video output devices obtain described device ability, and
The wherein described resolution changing unit according to device capability minimum in the multiple video output device for changing
It is sent out by the screen data transmission unit by the screen resolution for the screen that the screen display unit exports, or limitation
Send the transmitting capacity of the screen data.
7. such as information processing unit described in claim 5 or 6, further include：
Communication cut-out detection unit, for detecting and one or more of the multiple video output device video output device
Communication cut-out,
Wherein when communication cut-out detection unit detects the cut-out of the communication, the resolution changing unit is used for root
According to resolution minimum in the one or more resolution ratio sent by the one or more video output devices for communicating and being not switched off
Rate changes the screen resolution of the screen exported by the screen display unit.
8. information processing unit as claimed in claim 6,
The wherein described resolution changing unit is used to, according to resolution ratio minimum in the multiple video output device, change by institute
State the screen resolution of the screen of screen display unit output.
9. information processing unit as claimed in claim 6,
The wherein described resolution changing unit is used to that the transmission of the screen data will to be sent by the screen data transmission unit
Ability is limited to less than or equal to display capabilities minimum in the multiple video output device.
10. information processing unit as claimed in claim 5,
The wherein described resolution changing unit is used to determine regarding with highest display capabilities in the multiple video output device
Frequency output device, and the transmitting capacity for sending the screen data by the screen data transmission unit is limited to less than or
Equal to the display capabilities of identified video output device.
11. information processing unit as claimed in claim 5,
The wherein described resolution changing unit will be sent the transmitting capacity of the screen data by the screen data transmission unit
Be limited to less than or equal to corresponding video output device in the multiple video output device display capabilities, and
The wherein described screen data transmission unit is used for based on corresponding video output device in the multiple video output device
Limited transmitting capacity, send the screen data.
12. a kind of video output system, including：
Multiple video output devices；And
Information processing unit is communicated via cordless communication network with the multiple video output device,
Wherein described information processing unit includes：
Screen display unit, for output screen on the display apparatus；
Screen data acquiring unit, the screen data for obtaining the screen；
Screen data transmission unit, for the screen data to be sent to the multiple video via the cordless communication network
Output device；
Device capability acquiring unit, the device capability for inquiring the multiple video output device, and regarded from the multiple
Frequency output device obtains described device ability, and wherein described device ability refers to the resolution ratio of the multiple video output device；
The quality of quality settings receiving unit, the screen data for receiving to be sent by the screen data transmission unit is set
It sets；And
Resolution changing unit or acquisition range change one in unit, and the resolution changing unit is used for according to the dress
The screen resolution that ability changes the screen exported by the screen display unit is set, the acquisition range changes unit and uses
In the range obtained by the screen data acquiring unit to be changed into one of the screen data according to described device ability
Point,
The wherein described resolution changing unit is used for when the quality settings allow to reduce the quality of the screen data, according to
The screen resolution for the screen that the resolution changing is exported by the screen display unit, and
The wherein described acquisition range changes unit and is used for according to the resolution ratio, by what is obtained by the screen data acquiring unit
Range changes into a part for the screen data, and
The video output device includes：
Resolution ratio reporting unit, in response to the inquiry from described device ability acquiring unit, reporting described device ability；
Screen data receiving unit, for receiving the screen data；And
Output unit, for exporting the screen data.
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2013050872 | 2013-03-13 | ||
| JP2013-050872 | 2013-03-13 | ||
| JP2013-272835 | 2013-12-27 | ||
| JP2013272835A JP6507467B2 (en) | 2013-03-13 | 2013-12-27 | Information processing device |
| PCT/JP2014/057425 WO2014142341A1 (en) | 2013-03-13 | 2014-03-12 | Information processing apparatus, program, and video output system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105191291A CN105191291A (en) | 2015-12-23 |
| CN105191291B true CN105191291B (en) | 2018-09-14 |
Family
ID=51536986
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201480013104.4A Active CN105191291B (en) | 2013-03-13 | 2014-03-12 | Information processing unit and video output system |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US9749687B2 (en) |
| EP (1) | EP2974284A4 (en) |
| JP (1) | JP6507467B2 (en) |
| CN (1) | CN105191291B (en) |
| WO (1) | WO2014142341A1 (en) |
Families Citing this family (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6766914B2 (en) * | 2013-03-13 | 2020-10-14 | 株式会社リコー | Video output system |
| US10484249B1 (en) * | 2015-09-18 | 2019-11-19 | Amazon Technologies, Inc. | Dynamic distribution of simulation load |
| US10911535B1 (en) | 2015-09-18 | 2021-02-02 | Amazon Technologies, Inc. | Object ownership migration |
| US10298679B1 (en) | 2015-09-18 | 2019-05-21 | Amazon Technologies, Inc. | Object ownership migration |
| US10230583B1 (en) | 2015-09-18 | 2019-03-12 | Amazon Technologies, Inc. | Multi-node object simulation |
| US10104173B1 (en) | 2015-09-18 | 2018-10-16 | Amazon Technologies, Inc. | Object subscription rule propagation |
| US10506031B1 (en) | 2015-09-18 | 2019-12-10 | Amazon Technologies, Inc. | Scalable network for processing virtual environments |
| WO2017052001A1 (en) * | 2015-09-23 | 2017-03-30 | Lg Electronics Inc. | Mobile terminal and controlling method thereof |
| JP6661940B2 (en) | 2015-09-29 | 2020-03-11 | 株式会社リコー | Communication terminal, communication system, control method, and program |
| CN106407868A (en) * | 2016-08-26 | 2017-02-15 | 乐视控股（北京）有限公司 | Two-dimensional scanning processing method and mobile terminal |
| US10743043B2 (en) * | 2016-11-11 | 2020-08-11 | Sony Corporation | Management device and management method |
| KR102646030B1 (en) * | 2016-12-15 | 2024-03-12 | 삼성전자주식회사 | Image providing apparatus, controlling method thereof and image providing system |
| JP6801539B2 (en) | 2017-03-17 | 2020-12-16 | 株式会社リコー | Information processing system, information processing device, information processing program and information processing method |
| CN107147887B (en) * | 2017-05-04 | 2018-08-21 | 大连理工大学 | Wireless display method and device |
| CN109584766B (en) * | 2017-09-28 | 2022-02-25 | 广东美晨通讯有限公司 | Display method, display device and device with storage function |
| TW201946443A (en) * | 2018-04-30 | 2019-12-01 | 圓剛科技股份有限公司 | Method for intelligently adjusting video |
| CN112399157A (en) * | 2019-08-15 | 2021-02-23 | 中强光电股份有限公司 | Projector and projection method |
| CN111405370B (en) * | 2019-11-13 | 2022-04-05 | 杭州海康威视系统技术有限公司 | Video playback method and device |
| CN112367462B (en) * | 2020-10-29 | 2022-04-22 | 北京达佳互联信息技术有限公司 | Shooting method, shooting device, electronic equipment and storage medium |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004004565A (en) * | 2002-04-04 | 2004-01-08 | Canon Inc | Image processor and image processing method, and program |
| JP2004194026A (en) * | 2002-12-12 | 2004-07-08 | Toshiba Corp | Moving image converter and moving image storage device |
| JP2005039515A (en) * | 2003-07-14 | 2005-02-10 | Fuji Xerox Co Ltd | Network system |
| US7551175B2 (en) * | 2004-03-10 | 2009-06-23 | Panasonic Corporation | Image transmission system and image transmission method |
| JP4205634B2 (en) | 2004-05-27 | 2009-01-07 | Ｎｅｃディスプレイソリューションズ株式会社 | Method and program used in image transmission apparatus |
| JP4904678B2 (en) * | 2004-09-24 | 2012-03-28 | 株式会社ニコン | Projector system, mobile phone, camera |
| JP4123212B2 (en) * | 2004-10-01 | 2008-07-23 | 松下電器産業株式会社 | Projector projection system with network function |
| JP5353308B2 (en) | 2009-03-04 | 2013-11-27 | 株式会社リコー | Image forming apparatus and image transmission method |
| JP5625300B2 (en) * | 2009-09-30 | 2014-11-19 | 日本電気株式会社 | Client device, display setting method, display setting program, and server client system |
| US8789131B2 (en) * | 2010-05-14 | 2014-07-22 | Lg Electronics Inc. | Electronic device and method of sharing contents thereof with other devices |
| JP2012221085A (en) * | 2011-04-06 | 2012-11-12 | Seiko Epson Corp | Image supply device, display system, image supply method, and program |
-
2013
- 2013-12-27 JP JP2013272835A patent/JP6507467B2/en not_active Expired - Fee Related
-
2014
- 2014-03-12 US US14/769,842 patent/US9749687B2/en not_active Expired - Fee Related
- 2014-03-12 WO PCT/JP2014/057425 patent/WO2014142341A1/en active Application Filing
- 2014-03-12 EP EP14765707.6A patent/EP2974284A4/en not_active Withdrawn
- 2014-03-12 CN CN201480013104.4A patent/CN105191291B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| EP2974284A4 (en) | 2016-06-15 |
| JP2014200061A (en) | 2014-10-23 |
| US20150382059A1 (en) | 2015-12-31 |
| JP6507467B2 (en) | 2019-05-08 |
| WO2014142341A1 (en) | 2014-09-18 |
| US9749687B2 (en) | 2017-08-29 |
| EP2974284A1 (en) | 2016-01-20 |
| CN105191291A (en) | 2015-12-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105191291B (en) | Information processing unit and video output system | |
| JP6430653B2 (en) | Image synchronous display method and apparatus | |
| US20070182728A1 (en) | Image display system, image display method, image display program, recording medium, data processing apparatus, and image display apparatus | |
| KR102087987B1 (en) | Master device, client device, and method for screen mirroring thereof | |
| CN109640116B (en) | Cloud mobile phone network video coding method and server | |
| CN103607564B (en) | The method and device that a kind of video acquisition based on photographic head realizes | |
| CN108810622A (en) | Extracting method, device, computer-readable medium and the electronic equipment of video frame | |
| US8223209B2 (en) | Parameter configuration apparatus and method | |
| WO2014187043A1 (en) | Application display processing method and apparatus | |
| US20140184848A1 (en) | Imaging apparatus and method for controlling the same | |
| WO2016026245A1 (en) | Method and system for switching video playback resolution | |
| US8511829B2 (en) | Image processing apparatus, projection display apparatus, video display system, image processing method, and computer readable storage medium | |
| US11711608B2 (en) | Information processing apparatus, information processing method, program, and information processing system for changing a correspondence relationship | |
| CN109889895A (en) | Video broadcasting method, device, storage medium and electronic device | |
| JPH10164533A (en) | Image communication method and its device | |
| US9137657B2 (en) | Method and system for remote controlling and viewing mobile phones | |
| EP4171046A1 (en) | Video processing method, and device, storage medium and program product | |
| WO2016165374A1 (en) | Method and device for enabling multi-screen displaying | |
| JP6766914B2 (en) | Video output system | |
| US8233002B2 (en) | Image transfer apparatus and image transfer method | |
| CN109672906A (en) | Background Generation Method, device and computer readable storage medium | |
| JP2013207706A (en) | Video signal transmission system, video signal transmission control device, video signal transmission method, and program | |
| KR20140019218A (en) | Display apparatus, image post-processing apparatus and method for image post-processing of contents | |
| JP6037694B2 (en) | Server system, image processing system, program, and image processing method | |
| Liu et al. | Arithmetic Analysis and Realization of Real-Time Video Screen Capture |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |