CN106101610B - Image display system, information processing equipment and image display method - Google Patents
Image display system, information processing equipment and image display method Download PDFInfo
- Publication number
- CN106101610B CN106101610B CN201610270077.XA CN201610270077A CN106101610B CN 106101610 B CN106101610 B CN 106101610B CN 201610270077 A CN201610270077 A CN 201610270077A CN 106101610 B CN106101610 B CN 106101610B
- Authority
- CN
- China
- Prior art keywords
- region
- image
- unit
- wide angle
- picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Abstract
A kind of image display system is provided, which includes information processing equipment and receive the terminal device of wide angle picture from the information processing equipment.The information processing equipment includes the area determination unit in the region watched more less than other regions of the wide angle picture in the determining wide angle picture, delete the reduction unit that reduced wide angle picture is generated by the less region watched that the area determination unit determines from the wide angle picture, and the wide angle picture of the reduction that is generated by the reduction unit of transmission is to the first transmission unit of the terminal device.The terminal device includes the receiving unit that the wide angle picture of the reduction is received from the information processing equipment, and shows the image-display units of the wide angle picture of the reduction on the display apparatus.The invention also includes image display methods.
Description
Technical field
The present invention relates to image display system, information processing equipment and image display method.
Background technique
Known so-called spherical surface image or panoramic picture are the image (hereinafter referred to as " panorama sketch of 360 degree of panoramas of scenery
Picture ").By using the dedicated imaging device with special optical system, user can once focus and take panorama sketch
Picture.The normal imaging equipment that shooting rectangular image also can be used in user obtains panoramic picture by splicing multiple images.Such as
Upper described, panoramic picture is the 360 degree of images that there is no dead angle, and user can be in the aobvious of the upper selectivity such as display
Show/watch the given area (angle) of panoramic picture.
Agree to, if internet etc. provide panoramic picture, user can be used for example PC (personal computer) downloading and
Watch panoramic picture.However, the data volume of panoramic picture is often sizable, because of its visual field for shooting 360 degree.Therefore,
Such as when user wishes to watch panoramic picture by internet, a period of time perhaps to be spent to download panoramic picture, so that
The waiting time for showing that panoramic picture needs is often very long.
The technology of the known download time for down scaling image data downloading is related to that server is allowed to transmit progressive image
To terminal etc. (for example, Japanese Unexamined Patent Publication 2008-022488 bulletin).More specifically, Japanese Unexamined Patent Publication 2008-022488
The server of number bulletin description is started by the image of the small data quantity of transmission low resolution, then gradually transmits larger data
The image of the high-resolution of amount.
However, in the technology for the image for being related to making server transport progressive, the image that user initially shows on PC is
Low-resolution image, before showing high-definition picture appropriate, user must not be still not to wait for for a long time.Thus, for example,
Because being initially presented to the user low-resolution image, user may not form good opinion to the website of downloading image, or
User may be that low-quality misunderstanding is influenced by the picture quality for the real image that website provides.
Summary of the invention
An aspect of of the present present invention provides the image display system the time required to capable of reducing transmitting wide angle picture.
According to one embodiment of present invention, the image display system being provided includes information processing equipment and from information
Manage the terminal device that equipment receives wide angle picture.Information processing equipment includes, it is determining with other wide angle picture regions than seldom by
The area determination unit in the wide angle picture region of viewing is deleted from wide angle picture and is seldom seen by what area determination unit determined
The region seen generates the reduction unit of reduced wide angle picture, and the wide angle picture of reduction that is generated by reduction unit of transmission to
First transmission unit of terminal device.Terminal device includes the reception list that reduced wide angle picture is received from information processing equipment
Member, and the image-display units of reduced wide angle picture are shown on the display apparatus.
Detailed description of the invention
Fig. 1 is to be schematically illustrated to realize image processing process by image display system 100 according to embodiments of the present invention
Example figure；
Fig. 2 is the figure for schematically illustrating the operational instances that content registration people 8 registers panoramic picture；
Fig. 3 is the figure for schematically illustrating the exemplary configuration of the image display system 100 according to the present embodiment；
Fig. 4 is the block diagram for showing the example of hardware configuration of image processing server 10；
Fig. 5 is the block diagram for showing the hardware configuration example of graphic display terminal 30；
Fig. 6 is the block diagram for showing the functional configuration example of image processing server 10 and graphic display terminal 30；
Fig. 7 is the timing diagram for showing the operating process example of image display system 100；
Fig. 8 A-8C is the table for schematically illustrating the number that each cell of panoramic picture has been watched；
Fig. 9 A and 9B are to show the example procedure that the cell to be deleted of determination that determination unit 14 is realized is deleted by data
Flow chart；
Figure 10 is the example for showing the content for Cell display after deleted realized by graphic display terminal 30
The flow chart of process；
Figure 11 is the function of showing image processing server and graphic display terminal in accordance with another embodiment of the present invention
Profile instance block diagram；
Figure 12 is the figure for showing the example that presumptive area is deleted from panoramic picture；
Figure 13 is to show that deleting the slave panoramic picture that determination unit is realized by data deletes sky areas and ground region
Process instance flow chart；
Figure 14 is the figure for schematically showing the multiple images camera site of panoramic picture；
Figure 15 is the figure of the example for the rear range for showing that the moving direction for deleting panoramic picture is opposite；
Figure 16 is to show that deleting determination unit by data realizes the opposite rear model of the moving direction for deleting panoramic picture
The process instance flow chart enclosed；
Figure 17 is the figure for showing the example of area of visual field of panoramic picture；
Figure 18 is to show that deleting determination unit by data realizes from panoramic picture deletion area of visual field with the mistake of exterior domain
The flow chart of journey example；
Figure 19 is the figure of the example of the arrangement for showing imaging device and the layout of building；
The example that Figure 20 shows the viewing screen that user shows on graphic display terminal；
Figure 21 is to show to realize that registration has been watched about the cell of each time slot by image processing server
The flow chart of the process instance for the number crossed；
Figure 22 is to show that deleting determination unit realization by data determines about the cell to be deleted of each time slot
Process instance flow chart；
Figure 23 is the figure for showing the example for being able to use the user interface that any viewing areas is specified at family；
Figure 24 A and 24B are to show to delete the determination of determination unit realization about the list to be deleted of each user by data
The flow chart of the program example of first lattice；With
Figure 25 A-25C is to be depicted schematically in viewing areas management database to correspond to viewing areas or any viewing area
The figure of the example of the cell in domain.
Specific embodiment
Hereinafter, embodiments of the present invention will be described by referring to the drawings.
[first embodiment]
<passing through the image procossing of image display system>
Fig. 1 is schematically illustrated at the image image according to an embodiment of the present invention realized by image display system 100
The example of reason process.Image display system 100 includes the image processing server 10 and graphic display terminal connected via network N
30.It is the schematic diagram description according to the transmitting processing for transmitting panoramic picture of the present embodiment below.
(1) user 2 for operating graphic display terminal 30 downloads whole panoramic pictures from image processing server 10, and shows
User wishes the region (this region hereinafter referred to as " viewing areas " or " display area ") of the panoramic picture of viewing.In Fig. 1, user
The viewing areas 5 of panoramic picture is just being shown on graphic display terminal 30.
(2) graphic display terminal 30 transmits viewing areas information to image processing server 10, which refers to
Surely the viewing areas 5 being viewed by a user.
(3) in image processing server 10, panoramic picture is divided into cell in advance.Note that each cell is left
The number that upper angle indicates represents the cell number of respective cells.Whenever viewing areas information is transferred to image processing services
The watched time stored about each cell being viewed by a user is just added 1 by device 10, image processing server 10.Figure
In 1 panoramic picture, viewing areas 5 includes cell 2,3,6 and 7, thus, the viewing stored about cell 2,3,6 and 7
Number adds 1.When panoramic picture is by least several user 2 (or by least several times) viewings and viewing areas information is whenever quilt
When being transferred to image processing server 10, image processing server 10 can recognize that the cell seldom watched.
(4) image processing server 10 retain compared with other cells often watched cell (that is, watched time compared with
More cells), and leave out the image data for the cell (the less cell of watched time) seldom watched.In Fig. 1
Example in, cell 2-8 be retained and the image data of other cells be deleted.Note that deleted cell
It is indicated in Fig. 1 with oblique line.Then, when user sends the request for panoramic picture next time, image processing server 10 is only
The image data of transmission unit lattice 2-8 is to graphic display terminal 30.In this way, in the image quality for not having to reduce panoramic picture
In the case of, the time required for downloading panoramic picture can be reduced.
<term>
Hereinafter, certain terms that this specification uses are defined.
" content " refers to an at least width panoramic picture.Content equally may include the ground for for example showing panoramic picture and being taken
The map of point.In addition, content may include the image-capturing place for for example indicating panoramic picture when panoramic picture is video image
Map on route.Also, content may include the audio data for example collected in image-capturing place.
" panoramic picture " is the image for shooting the substantially 360 degree visuals field.However, it is noted that panoramic picture needs not be complete shooting
The image in 360 degree of visuals field, as long as the image in the substantially 360 degree visuals field of shooting.That is, panoramic picture have it is at least more wider than normal picture
Visual angle.Panoramic picture also includes the image being spliced together by such as fish-eye wide-angle lens shooting.Note that
The embodiment of the present invention is equally applicable to the image in such as 180 degree visual field.That is, panoramic picture be can for example be divided into it is more
A kind of form of a subregion and the wide angle picture partly transmitted.
<registration of the panoramic picture in image processing server>
Still image and video image can be registered in image processing server 10.It is infused in image processing server 10
In the case that the user (hereinafter referred to as " content registration people 8 ") of volume content is registering static image, content registration people 8 can will be
The panoramic picture of locality shooting is transferred to image processing server 10.Panoramic picture has additional location information, image
Processing server 10 can identify the image-capturing positions of panoramic picture based on this location information.
Content registration people 8 can also for example register video image in the following manner.Note that in the following description, for convenience of solving
It releases, the people of content registration people 8 and photographing panorama picture is assumed the same person.However, content registration people 8 can with pan
The people of image is different.
Fig. 2 is the figure for schematically illustrating the operational instances that content registration people 8 registers panoramic picture.
(1) imaging device 7 for capableing of photographing panorama picture is held while 8 walking of content registration people.Imaging device 7 can match
It is set to for example at regular intervals or fixed distance interval shooting image, and stores the panoramic picture being taken and phase
The image-capturing positions of pass.In this way, it can get the image being taken along the route that content registration people 8 follows.Note that
The case where application of the present embodiment is not limited to content registration 8 walking of people.In other instances, imaging device 7 can be put into machine
In motor-car, with the video image etc. for shooting travel route.
(2) once content registration people 8 reach desired destination and shoot the full-view video image of route operation it is complete
At, content registration people 8 just via wireless station device 9, such as base station or access point, the full-view video image of shooting is transmitted to image
Processing server 10.
(3) image processing server 10 generates content and stores the content of generation, which is abided by using content registration people 8
Follow the map and full-view video image of route.Note that being set from imaging in the imaging device 7 not situation of communication function
Standby 7 receive the device of full-view video image, such as smart phone, full-view video image can be transferred to image processing server
10.Similarly, in imaging device 7 not for obtaining the position detecting function of the location information of image-capturing positions, such as GPS
It, for example can be attached by the location information that the GPS receiver of the device of such as smart phone obtains in the situation of (Global Navigation System)
It is added on full-view video image.
In addition, as described above with Fig. 2 in relevant example, it is assumed that imaging device 7 being capable of photographing panorama picture.However,
In other instances, normal imaging device can be used for the image for shooting rectangular area.In this case, for example, content registration
People 8 can be by generating panoramic picture together for the image mosaic of multiple rectangular areas.
<system configuration>
Fig. 3 shows the exemplary configuration schematic diagram of the image display system 100 according to the present embodiment.Image display system 100
Including image processing server 10 and at least one graphic display terminal 30, they can be communicated with each other via network N.
Network N for example can by LAN in the facility of company where graphic display terminal 30 etc., by LAN be connected to because
The provider network of the supplier of spy's net and it is configured by the telephone wire etc. that telecommunications operator provides.Network N may include because
Special net.Network N can be configured for example, by the combination of wired or wireless network or wired and wireless network.And, it is noted that
Graphic display terminal 30 is directly connected in the situation of telephone wire or mobile telephone network, and graphic display terminal can be connected not
Provider network is connected in the case where being connected to LAN.
Image processing server 10 is the letter of the processing for the data volume that can be transported panoramic picture and reduce panoramic picture
Cease processing equipment.Note that in some embodiments, such as it can provide individual server for transmitting panoramic picture, and image
Processing server 10 can be substantially carried out the processing for reducing the data volume of panoramic picture.
Graphic display terminal 30 is the information processing equipment that user uses, which, which is used as, is used to download and watch panorama sketch
The terminal device of picture.More precisely, for example, graphic display terminal 30 can be PC (personal computer), smart phone, plate
Equipment, cellular phone, car navigation terminal, wearable computer (for example, head-mounted display, smartwatch), camera, number are white
Plate, projector, game machine, MFP (multi-function peripheral), etc..
<<hardware configuration>>
The example that Fig. 4 shows the hardware configuration of image processing server 10.Note that image processing server shown in Fig. 4
10 hardware configuration is not necessarily meant to be arranged in the single shell of individual equipment.In some embodiments, such as in order to be based on
Load etc. suitably distributes resource, and the configuration of image processing server 10 can be determined by cloud computing.
In Fig. 4, image processing server 10 includes being connected to the CPU (central processing unit) 301 of bus 310, ROM (only
Read memory) 302, RAM (random access memory) 303, HDD (hard disk drive) 305, display 308, network I/F (connect
Mouthful) 309, keyboard 311, mouse 312, media drive 307 and CD-ROM driver 314.The execution of CPU 301 is stored in HD (hard disk)
Image image processing program in 304, and control the overall operation of image processing server 10.ROM 302 stores program, such as
It is used to the IPL (initial program importing) of driving CPU 301.RAM 303 is main storage means, the workspace as CPU 301.
HD 304 is the storage device for including nonvolatile memory.
HDD 305 controls reading or writing for various data relevant to HD 304 under the control of CPU 301.Display
(display device) 308 shows various items of information, such as cursor, menu, window, text and/or image.Network I/F 309 be with
The interface of network N.
Keyboard 311 and mouse 312 are input/output devices.Keyboard 311 includes alphabetical, digital and/or various for inputting
Multiple keys of instruction, and receive to pass through the various inputs of these keys.Mouse 312 for example receives the selection of process object, various fingers
The selection and execution of order and the movement of mouse pointer.
Media drive 307 controls medium 306, such as flash memory, relevant data read or write (storage).CD-ROM drive
Dynamic device 314 controls removable recording medium, such as CD (CD) 313, and relevant various data read or write.
Note that image image processing program is for example stored in calculating as the file of mountable format or executable format
In machine readable medium recording program performing, such as in medium 306 or CD 313, and it is assigned with this state.In addition, image image procossing journey
Sequence can be for example downloaded from any kind of information processing equipment as server.
Fig. 5 shows the hardware configuration example of graphic display terminal 30.Note that although Fig. 5 shows graphic display terminal 30
The example realized by smart phone or tablet device, but the hardware configuration of graphic display terminal 30 is not limited to this example.
In Fig. 5, graphic display terminal 30 is deposited including being connected to CPU 201, ROM 202, RAM 203, the flash of bus 210
Reservoir 204, CMOS (complementary metal oxide semiconductor) sensor 205, acceleration/direction sensor 206, media drive
208, audio input unit 211, audio output unit 212, communication device 213, GPS receiver 214, display 215, touch panel
216.Bus 210 is, for example, the address bus or data/address bus for being electrically connected said units.
CPU 201 controls the totality of graphic display terminal 30 by executing the program being stored in flash memory 204
Operation.ROM 202 stores IPL or basic input/output procedure.RAM 203 is main memory, is used as CPU 201 and executes program
When workspace.Flash memory 204 is non-volatile memory device, the journey to be executed for storing graphic display terminal 30
Sequence and various data.For example, flash memory 204 can storage program area and the terminal journey to be executed of graphic display terminal 30
Sequence.
Cmos sensor 205 is image-forming component, obtains image by the image of reference object under the control of CPU 201
Data.Note that in some embodiments, ccd sensor can replace cmos sensor 205 to be used.Acceleration/direction sensor
206 for example comprising gyro-magnetic compass function, gyro sensor and the acceleration transducer for detecting earth magnetism.Media drive
208 controls data relevant to the recording medium 207 of such as flash memory read or write (storage).Recording medium 207 is to move
Dynamic storage device, can read the data that (retrieval) records thereon from recording medium 207, or media drive 208 control it
Under, (storage) new data can be written in recording medium 207.
Audio input unit 211 is the microphone converted the audio into as audio signal.Audio output unit 212 is by audio
Signal is converted to the loudspeaker of audio.Antenna 213a can be used to exchange channel radio with nearest wireless station device 9 for communication device 213
Believe signal.In addition, communication device 213 may include the LAN card for being connected to LAN.GPS receiver 214 uses GPS satellite or as room
The IMES (indoor hair message system) of interior GPS detects and calculates location information (latitude, longitude and the height of graphic display terminal 30
Degree).
Display (display equipment) 215 shows various images and object under the control of CPU 201.For example, display 215
It can show panoramic picture and/or allow users to the various menus and icon of operation graphic display terminal 30.Touch panel 216 for example may be used
It integrally overlaps on display 215, and detects the touch location (coordinate) of finger or stylus on display 215.
Terminal program for example can be browsing software or the application software with similar functions.Terminal program is for example as can
The file of installation format or executable format is stored in computer readable recording medium, such as in recording medium 207, and with
This state is assigned.In addition, terminal program for example can be from any kind of information processing equipment as server by under
It carries.
<functional configuration>
Hereinafter, the functional configuration of image processing server 10 and graphic display terminal 30 is described with reference to Fig. 6.Fig. 6 is
Show the block diagram of the functional configuration example of image processing server 10 and graphic display terminal 30.Note that in Fig. 6, for convenience of solving
It releases and illustrates only a graphic display terminal 30.
<<image processing server 10>>
Image processing server 10 include communication unit 11, panoramic picture provide unit 12, viewing areas administrative unit 13,
Data delete determination unit 14, image editing unit 15 and read/write cell 19.
Note that the function element of image processing server 10 can for example pass through image processing server shown in Fig. 4
10 one or more hardware elements realize that these elements are operated based on the instruction from CPU 301, and CPU 301 is held
Row is loaded into the image image processing program 1100 of RAM 303 from HD 304.
Image processing server 10 equally includes can be by least one of the HD 304, ROM 302 and RAM 303 of Fig. 4
The storage unit 1000 of configuration.Storage unit 1000 stores image image processing program 1100.In the following, it is described that being stored in
Database (DB) in storage unit 1000.
| Content ID | Content name | URI | Location information |
| C001 | Content ABC | ftp://xxx.co.jp/picture/ABC.jpg | (X, Y, Z) |
| C002 | Content DEF | ftp://xxx.co.jp/picture/DEF.jpg | (X, Y, Z) |
| … | … | … | … |
[table 1] panoramic picture manages table
Storage unit 1000 stores panoramic picture and manages DB 1001, can manage table by panoramic picture as listed in Table 1
To configure.In the panoramic picture management table that table 1 represents, have registered and the associated content name of content ID, URI (unified resource
Identifier) and location information.Content ID is the identification letter for the content being registered in image processing server 10 for unique identification
Breath.In order to which user can identify, content, content name may include character, symbol and/or number.Note that content name is not
The unique name being necessary in image processing server 10.URI indicates the storage location that content is stored or managed.Location information
Representative includes the image-capturing positions of the panoramic picture in content.Note that although location information is really according to included in figure
As the data format of the image data in file is described in image file, but for convenience of describing, location information is shown in table 1
In.And, it is noted that holding inside includes in the situation of video image, and location information is attached to each frame of composition video image
On.
Quantity=15 of content ID=C001 viewer
| Cell number | Coordinate information | Watched time |
| 1 | (X, Y) (X, Y) | 0 |
| 2 | (X, Y) (X, Y) | 2 |
| 3 | (X, Y) (X, Y) | 1 |
| 4 | (X, Y) (X, Y) | 2 |
| … | … | … |
[table 2] viewing areas manages table
The equally storage viewing areas of storage unit 1000 manages DB 1002, can the viewing area as shown in for example above table 2
Domain management table configures.In the viewing areas management table that table 2 represents, for each content of the content containing panoramic picture
ID, cell number, coordinate information and watched time it is interrelated be registered in table.Also, viewing areas manages table note
Up to the present record has already viewed the quantity of the viewer of content.Cell number is to be divided into multiple cells for identification
The identification information of each separated region (cell) of the panoramic picture in region.Coordinate information is for example by the cell upper left corner
Coordinate and the coordinate in the lower right corner carry out designating unit lattice.Watched time is, for example, the list since when panoramic picture becomes may be viewed by
The number that first lattice have been watched.Note that in some embodiments, cell is in past predetermined period (for example, 1 week, 1 month
Or 1 year) in the number that has been watched can be registered as watched time.In this case, the quantity of viewer can also be in the past
The quantity of the viewer of content is had already viewed in predetermined period.
The size of cell is not particularly limited, and can do optimal design based on application program.For example, cell can
It is designed to VGA (Video Graphics Array: half 480 × 640) to 1/10th.Note that when cell very little, because
Adjustable minimum unit is smaller, so becoming easier to the viewing area for accurately reflecting user by the deletion of cell
Domain.On the other hand, when cell is too small, the processing load of image processing server 10 increases.Therefore, cell can be based on figure
As the processing capacity etc. of processing server 10 is designed.
(image processing server function)
The communication unit 11 of image processing server 10 can for example be sent out by network I/F 309 and CPU shown in Fig. 4 301
Order out is realized.Communication unit 11 is transmitted to graphic display terminal 30 via network N or is received from graphic display terminal 30
Various types of data.
Panoramic picture provides unit 12 and provides the content being stored in panoramic picture management DB 1001 to image display eventually
End 30.Graphic display terminal 30 can for example enter web in response to user's operation, and when user select website on button or
When image, for example, by image processing server 10 send HTTP request, graphic display terminal 30 can hyperlink request to select
Button or image content.
Viewing areas administrative unit 13 can for example be realized by the order that CPU 301 shown in Fig. 4 is issued.Viewing areas
Administrative unit 13 obtains viewing areas information from graphic display terminal 30, and updates storage the viewing in viewing areas management table
Number.Namely based on viewing areas information, viewing areas administrative unit 13 determines the sight for constituting the panoramic picture being just viewed by a user
Cell number that see region, one or more cells, increases the watched time with respective cells number associated storage.
Note that viewing areas information will be described below.
Data are deleted determination unit 14 and can for example be realized by the order from CPU 301 shown in Fig. 4.Data, which are deleted, to be determined
Unit 14 manages table referring to viewing areas, and determines the cell for deleting the panoramic picture seldom watched.As retouched in detailed below
It states, when multiple users watch identical panoramic picture, certain cells may more often be watched compared with other cells,
Other cells certain simultaneously may less be watched compared with other cells, to generate cell by watched time
Difference.Therefore, data delete determination unit 14 and can determine to delete the cell that watched time is less than predetermined threshold.
Image editing unit 15 can be realized for example by the order from CPU 301 shown in Fig. 4.Image editing unit 15
It deletes and deletes the cell that 14 determination of determination unit will be deleted from panoramic picture by data.Note that original panoramic picture
Copy can be created before deleting one or more cells, the original panoramic images being deleted without any cell
It is also stored in image processing server 10.
Read/write cell 19 can for example be realized by HDD 305 with the order from CPU 301 shown in Fig. 4.Read/write cell
19 store various data in storage unit 1000, and read the various data being stored in storage unit 1000.
<<graphic display terminal 30>>
Graphic display terminal 30 includes communication unit 31, image-display units 32, operation input receiving unit 33, image rotation
Turn unit 34, viewing areas recording unit 35 and read/write cell 39.
Note that the function element of graphic display terminal 30 can for example pass through graphic display terminal shown in fig. 5
One or more hardware elements realize that these function element are operated based on the order from CPU 201, and CPU 201 is held
The terminal program 3100 that row is loaded into RAM 203 from flash memory 204.Also, one or more function elements can
With by the webpage transmitted from image processing server 10 (for example, html data, XML data and with JavaScript (registrar
Mark) program write) it is implemented, rather than terminal program 3100.
Graphic display terminal 30 equally includes storage unit 3000, which can be stored by the flash in Fig. 5
At least one of device 204, ROM 202 and RAM 203 configuration.Storage unit 3000 stores terminal program 3100.Below
In, various databases of the description configuration in storage unit 3000.
Still image
[table 3A] viewing areas record sheet (still image)
Video
[table 3B] viewing areas record sheet (video image)
[table 3C] viewing areas record sheet (video image)
Storage unit 3000 stores viewing areas and records DB 3001, and viewing areas record DB 3001 can for example pass through such as table
Viewing areas record sheet shown in 3A-3C is configured.Table 3A shows the viewing areas note to contain the content of panoramic picture
The example for recording table, which is still image.It includes present image display terminal that content ID shown in table 3A, which corresponds to,
The content ID of the content of the panoramic picture of 30 displays.Also, the specified viewing areas watched by user two groups of coordinates (for example,
The upper left corner of viewing areas and the coordinate in the lower right corner) it is recorded in table 3A.Note that although three viewing areas are recorded in table
In 3A, but may be without record viewing areas in viewing areas record sheet, or have recorded the viewing area of two, four or more
Domain.Also, two groups of coordinates of viewing areas in this example, is specified to correspond to viewing areas information (display region information).Note
Meaning, however, viewing areas information can be any information of specified specific region.Thus, for example, viewing areas information may include
The quantity or viewing areas information for the pixel that the coordinate and viewing areas at the center of viewing areas include can be viewing areas certainly
The image of body.
Table 3B and table 3C shows the example of the viewing areas record sheet to contain the content of panoramic picture, the panorama sketch
It seem video image.In the situation that content includes full-view video image, two different method (hereinafter referred to as " continuous records
Method " and " recording method frame by frame ") one of can be used for recording the viewing areas of content.Continuous recording method is similar to note
The method for recording the viewing areas of still image, and be related to recording and at least show (viewing) primary area when video image is played
Domain (table 3B).That is, creating a viewing areas record sheet regardless of the quantity for the frame for including in video image for the video image.
Recording method is related to recording the viewing areas (table 3C) for being shown (viewing) about each frame of composition video image frame by frame.
That is, table 3C includes the multiple viewing areas record sheets for being assigned frame number, the viewing areas for being shown (viewing) is closed
It is recorded in each frame.
(graphic display terminal function)
The communication unit 31 of graphic display terminal 30 for example by communication device 213 and can come from CPU 201 shown in fig. 5
Order realize.Communication unit 31 is transmitted to image processing server 10 via network N or is received from image processing server 10
Various types of data.
Image-display units 32 can for example be realized by the order from CPU 201 shown in fig. 5.Image-display units 32
Panoramic picture is shown on display 215, which is included in from the content that image processing server 10 is downloaded.
Operation input receiving unit 33 can for example be realized by touch panel 216 with the order from CPU 201 shown in fig. 5.
Operation input receiving unit 33 receives the various user's operations that user is input to graphic display terminal 30.For example, operation input connects
It can be received the operation of the viewing areas for changing panoramic picture from user by unit 33.Also, if full-view video image is just
It is viewed by a user, then in addition to receiving the operation for changing viewing areas, operation input receiving unit 33 for example equally can be with
Receive the operation for freezing (pause), playing and/or select frame (image-capturing positions).
Image rotation unit 34 can for example be realized by the order from CPU 201 shown in fig. 5.Image rotation unit 34
The panoramic picture shown by display 215 is rotated in response to user's operation, and the complete of user's selection is shown on display 215
The viewing areas of scape image.
Viewing areas recording unit 35 can for example be realized by the order from CPU 201 shown in fig. 5.In still image
In the case where, from image rotation unit 34 terminate rotating panoramic image after predetermined period, viewing areas record
Member 35 can for example register the coordinate of the viewing areas currently shown on display 215 in viewing areas record DB 3001.Note
Meaning, viewing areas are not necessarily meant to exactly match with the region shown on display 215.That is, for example can provide surplus, so that seeing
See that region can be according to requiring to be slightly exaggerated or reduce.
In the situation that video image is shown (viewing) and realizes continuous recording method, whenever image rotation unit 34
Change viewing areas, the coordinate of viewing areas is just recorded.Note that in this case, the viewing areas as recorded still image
Situation, viewing areas can be recorded after predetermined period from image rotation unit 34 terminates rotating panoramic image
Get off.In the situation of the realization viewing areas that recording method carrys out record video image frame by frame, whenever frame is switched to another
When frame, the coordinate of the viewing areas shown on display 215 is recorded.Note that viewing areas recording unit 35 is by specified note
The coordinate for recording the viewing areas in viewing areas record sheet is sent to image processing server 10.
Read/write cell 39 can for example be realized by flash memory 204 with the order from CPU 201 shown in Fig. 5.Read/
R/w cell 39 stores various types of data in storage unit 3000, and reads (retrieval) and be stored in storage unit 3000
Various data.
<operating process>
Fig. 7 is the timing diagram for showing the operating process example of image display system 100.The operation of Fig. 7 is shown eventually by image
End 30 sends content requests to image processing server 10 and starts.
In step S1, the read/write cell 19 of image processing server 10 reads (inspection from panoramic picture management DB 1001
Rope) request content, and send content to communication unit 11.
In step S2, the communication unit of 11 transferring content of communication unit of image processing server 10 to graphic display terminal 30
Member 31.In this way, graphic display terminal 30 obtains content.
In step S3, the communication unit 31 for having received the graphic display terminal 30 of content sends the content to image and shows
Unit 32.In this way, image-display units 32 show to include panoramic picture in content on display 215.
In step S4, user is by operating graphic display terminal 30 come rotating panoramic image, to show on display 215
Desired viewing areas.Then, image rotation unit 34 is rotated in the panoramic picture shown on display 215.
In step S5, while panoramic picture is displayed on display 215, viewing areas recording unit 35 monitoring from
34 rotating panoramic image of image rotation unit starts whether to have already passed through at least predetermined period (for example, 3 seconds).That is, viewing area
Domain recording unit 35 determines whether viewing areas has at least continuously displayed predetermined period on display 215.Once determining to see
See that region has at least continuously displayed predetermined period, viewing areas recording unit 35 is recorded in viewing areas record DB3001 and seen
See region.Note that the processing of step S5 is repeated progress (S5 ') while user watches content.
In step S6, when user terminates to show panoramic picture, closes browser or clearly defeated to graphic display terminal 30
Enter operation come when stopping watching panoramic picture, image-display units 32 (or operation input receiving unit 33), which send display, terminates letter
Number arrive communication unit 31.
In step S7, communication unit 31 will read the viewing areas information of (retrieval) from viewing areas record DB 3001
It is transferred to image processing server 10.
Step S8, the communication unit 11 of image processing server 10 receive viewing areas information and send viewing areas information
To viewing areas administrative unit 13.
In step S9, the viewing areas information of specified viewing areas is for example converted to composition by viewing areas administrative unit 13
One or more cells of one or more cells of viewing areas are numbered, and will be managed in DB 1002 with viewing areas
The watched time of corresponding unit lattice number associated storage add one.Also, pair in viewing areas management DB 1002 will be recorded in
Add one in the quantity of content viewers.Note that the information in the quantity about viewer is transmitted from graphic display terminal 30
In situation, for example, corresponding quantity can be added to the quantity for the viewer being recorded in viewing areas management DB 1002.
In step S10, data delete determination unit 14 and read (retrieval) for each from viewing areas management DB 1002
The watched time of cell number and the quantity of viewer, with determination cell to be deleted.Note that with reference to Fig. 8 A-9B, with
It is lower to specifically describe the processing for determining cell to be deleted.
In step S11, data delete the transmission of determination unit 14 and determine that the cell of cell to be deleted is numbered to figure
As edit cell 15.
In step S12, image editing unit 15 deletes cell to be deleted from panoramic picture, and in panoramic picture
Panoramic picture (panoramic picture of reduction) as a result has been edited in storage in management DB 1001.
As described above, whenever user watches panoramic picture, image processing server 10 can determine list to be deleted
First lattice simultaneously delete this cell from panoramic picture, in this way, image processing server 10 can be transmitted only in panoramic picture often
The region watched.In this approach, the waiting time needed for user downloads panoramic picture can be reduced.Note that from panorama
The deletion opportunity of Delete Cells is not necessarily whenever user watches panoramic picture or whenever image processing server in image
When 10 reception viewing areas information.For example, can after the user of certain quantity has already viewed panoramic picture, with such as daily
Primary fixed time interval or response external processing request and execute deletion.
<<determination of cell to be deleted>>
(being determined based on the deletion of watched time and the ratio of the quantity of viewer)
It hereinafter, will quilt by the determination that data deletion determination unit 14 carries out in the step S10 of Fig. 7 with reference to Fig. 8 A description
The processing of the cell of deletion.Note that although for determining that the processing of cell to be deleted can be with still image and video
Image is all substantially the same, but for convenience of explanation, hereafter determines processing for describe to carry out about still image first.
Fig. 8 is the table for schematically illustrating the number that each cell of panoramic picture is watched.In Fig. 8 A, distribute to
The value of cell integer, the integer successively adds one from cell upper left corner the to the lower right corner.These integers correspond to the list of cell
First lattice number.Also, the number in the bracket indicated beside the cell of cell number corresponds to cell and has been seen
The number (watched time) seen.Note that Fig. 8 A corresponds to viewing areas management represented by the mode different from the above table 2
Table.
Fig. 9 A is the flow chart of the example procedure for the cell for showing that the determination realized by deletion determination unit 14 to be deleted.
In step S21, data delete determination unit 14 and read (retrieval) viewer's from viewing areas management DB 1002
The watched time of quantity and each cell.
Then, in step S22, data delete determination unit 14 and calculate watched time and viewer for each cell
Quantity ratio.Note that because the quantity of viewer will add whenever receiving viewing areas information from graphic display terminal 30
One, therefore equally can viewing quantity based on each cell and the number (viewing area of received viewing areas information
The received quantity of domain information) calculate above-mentioned ratio.
Then, in step S23, data delete determination unit 14 and determine to delete above-mentioned calculated ratio lower than threshold value
Cell.Threshold value can be pre-set predetermined value.For example, in the situation that threshold value is arranged to 50%, because in Fig. 8 A
The quantity of middle viewer is 15, so data, which delete determination unit 14, can determine to delete the unit that viewing quantity is less than or equal to 7
Lattice.In this situation, as shown in Figure 8 B, other cells other than cell number 13-24 can be deleted.
Note that in above-mentioned delet method, the quantity of deleted cell is not fixed, and the threshold according to setting
The viewing of value and viewer are inclined to and are changed.In other words, if threshold value be set ground high or the cell often watched and
There is very big difference between the cell seldom watched, then a large amount of cell may be deleted.On the other hand, if
The difference that the watched time of low or each cell is set in threshold value is relatively small, then a large amount of cell may be retained.
Note that threshold value is not necessarily fixed, and can be for example arranged by content registration people.Also, correspond to sky or
The region on ground can for example be handled by associated picture and be detected, and can change threshold value based on the area in the region detected.
In addition, in some embodiments, content registration people etc. can preassign the cell that do not delete.For example, user
The region of the panoramic picture shown over the display transmitted from image processing server 10 is initially wanted to be determined in advance.So
At least part of cell including the region had better not be deleted.Therefore, for example can be used as cannot for such cell
Deleted cell is registered in viewing areas management DB 1002.Equally, the cell for shooting the image of important information can
It is registered as the cell that cannot be deleted.Further, in some embodiments, viewing areas recording unit 35 is configurable
To record the viewing areas initially shown on display 215, whether continuously displayed but regardless of the viewing areas.In this way, can
Prevent from indicating that one or more cells of initially shown viewing areas are deleted.
Hereinafter, description is when panoramic picture is video image, the processing of the cell to be deleted of determination.It is using
In the situation for the viewing areas that continuous recording method has recorded video image, the processing of the cell to be deleted of determination substantially and
The processing carried out about still image is similar.Note that in this case, data delete the list to be deleted of 14 determination of determination unit
First lattice, and the image editing unit 15 of image processing server 10 to be deleted from all frames for constituting panoramic picture
Cell.The above method is suitble to realize in the case where the variation of video image is relatively small, so that most of user less may be used
Viewing areas can be changed.In this way, processing load of the graphic display terminal 30 in Delete Cells can reduce.
In the situation for the viewing areas that recording method carrys out record video image frame by frame, the cell to be deleted of determination
Processing it is also substantially similar with the processing carried out about still image.However, in this case, data delete determination unit
14 for constitute panoramic picture each cell to be deleted of frame determination.Then, the picture editting of image processing server 10
The each frame deletion cell to be deleted of the unit 15 for composition panoramic picture.Note that if video image includes essence
Variation, then the viewing areas of multiple users viewing may be for example change from frame to frame.Therefore, the above method can be provided for user by
The full-view video image of frame suitably Delete Cells.
(reservation of the cell of fixed quantity and the deletion of other cells)
In some embodiments, such as by executing process as shown in Figure 9 B, data are deleted determination unit 14 and be can determine
The cell of fixed quantity to be deleted.Pay attention to the step S31 and S32 of Fig. 9 B processing respectively with the step S21 of Fig. 9 A and
The processing of S22 is identical.However, as described below, the processing of the step S33 of Fig. 9 B is different from the step S23 of Fig. 9 A.
In the example of Fig. 9 B, data delete determination unit 14 and are previously determined the quantity of cell to be deleted.Example
Such as, data, which delete determination unit 14, can be set to the half that the quantity of cell is reduced to cell sum.It is such
Words, in step S33, data delete determination unit 14 can determine to retain ratio within the scope of the upper half half cell (for example,
15 cells in the example of Fig. 8 A in 30 cells), and determine to delete other half cell.Note that above-mentioned
In example, cell to be deleted can be determined in the case where not having to for each cell calculating ratio.That is, can pass through
It determines and retains half cell of the watched time in the range of the upper half to obtain identical result.
Cell sum half will from the situation that the panoramic picture of Fig. 8 A is deleted, for example, data delete it is true
Order member 14 can determine that stick unit lattice number is the cell of 13-24,11,27 and 28, and determine to delete other cells, such as
Shown in Fig. 8 C.So it is to be understood that the quantity of cell to be deleted is predetermined in the example of Fig. 9 B, and
And similarly, the cell of fixed quantity can be retained always.Also, by the way that the quantity of cell to be deleted is set
It is set to relatively large number, it is possible to reduce when image processing server 10 transmits needed for panoramic picture to graphic display terminal 30
Between.Equally, by setting relatively small number for the quantity of cell to be deleted, image processing server 10 can will be wrapped
The panoramic picture for being possible to the greater number cell of viewing containing user is transferred to graphic display terminal 30.
(deletion based on contents attribute)
Equally, in some embodiments, if the attribute of the registration content in viewing areas management table of content registration people 8,
The quantity of threshold value or cell to be deleted can be then adjusted based on attribute.The example of contents attribute includes whether content corresponds to
Whether the image or content that shoot outdoors correspond to the image shot indoors.Usually, the image district on sky and road surface is represented
Domain occupies the major part of the panoramic picture of photographing outdoors, and the region on these skies and road surface is less likely to be watched.Cause
This, in the panoramic picture from photographing outdoors in the case where Delete Cells, for example, threshold value (is lower than this threshold value for deleting
Cell) quantity that can be set relatively high or to be deleted cell can be arranged to relatively large quantity.
On the other hand, for indoors, the inside in such as apartment, the panoramic picture of shooting, some users may want to see
See the structure or landscape outside window in room, and some users may want to the shape and color on viewing ceiling or floor.Therefore,
In the panoramic picture from indoor shot in the case where Delete Cells, such as threshold value (for deleting the cell for being lower than threshold value)
The quantity that relatively low or to be deleted cell can be set can be arranged to relatively small quantity.
In this way, data are deleted determination unit 14 and can be controlled according to the type of the scenery shot in panoramic picture
With the quantity for adjusting cell to be deleted.Equally, in some embodiments, content registration people 8 can be for being registered in viewing
Every content in district management table is arranged the quantity of threshold value or cell to be deleted.Because content registration people 8 can be with
Which cell of precognition panoramic picture may be watched, so content registration people 8 can be for example arranged for each panoramic picture
The quantity appropriate of threshold value appropriate or cell to be deleted.
(deletion based on bandwidth)
Equally, in some embodiments, data are deleted determination unit 14 and can be shown based on image processing server 10 and image
Show that the bandwidth between terminal 30 carrys out the quantity of threshold value or cell to be deleted.That is, if image processing server 10
Guarantee there are enough bandwidth between graphic display terminal 30, then image processing server 10 can be transmitted greatly with small delay
The cell of amount.Therefore, in the case, such as threshold value can be configured to relatively lower, or by cell to be deleted
Quantity is set as relatively small quantity.On the other hand, if band between image processing server 10 and graphic display terminal 30
It is wide insufficient, then image processing server 10 should be arranged to transmit a small amount of cell.It therefore, in the case, such as can
Threshold value is configured higher or sets bigger quantity for the quantity of cell to be deleted.Note that for example can be by allowing
Image processing server 10 transmits scheduled data volume to measure between image processing server 10 and graphic display terminal 30
Bandwidth.Equally, in some embodiments, data delete determination unit 14 and for example can be configured to obtain from graphic display terminal 30
The network information (for example, information that mobile network or wired lan whether are used about graphic display terminal 30).Data are deleted true
Order member 14 can use this network information with the mode similar to bandwidth information.That is, data delete determination unit 14 for example
The type for the network that can be used based on graphic display terminal 30 adjusts the quantity of threshold value or cell to be deleted.
Note that the watched time of cell is arranged to when being watched cell in the example shown in Fig. 8 A-8C
It is increased.However, in other instances, for example, when not being comprised in the viewing areas of content cell, cell quilt
The number for excluding (not watched) can be increased.In this case, image processing server 10 can be excluded with computing unit lattice
The ratio of the quantity of the viewer of the number and content of (not watched), and for example, if calculate after ratio be greater than or
Equal to threshold value, then the cell is deleted.Equally, in the case where retaining the cell of fixed quantity, data delete determination unit
14 can for example determine the cell for being excluded the fixed quantity of minimum number, and determine to retain these units.
<content after viewing Delete Cells>
Figure 10 show by graphic display terminal 30 realize for show delete one or more cells content (
Undergo cell delete processing content) example procedure flow chart.The processing of Figure 10 can be received in graphic display terminal 30
Start when content to be shown.Note that graphic display terminal can for example connect by the processing of step S1 and S2 similar to Fig. 7
Receive content.
(still image)
Hereinafter, for the sake of explaining conveniently, description shows that panoramic picture is the processing of still image first.
When 31 reception content of communication unit of graphic display terminal 30, image-display units 32 are shown on display 215
Show to include panoramic picture (step S41) in content.
Secondly, operation input receiving unit 33 determines that the image rotation for rotating image (changing currently viewing region) is grasped
Whether (step S42) is had been entered.If having been entered (no in step S42), panorama sketch without image rotation operation
The display of picture continues.
If image rotation operation has been entered (in S42 be), image-display units 32 determine the rotation of panoramic picture
Whether the image data for turning target area is available (step S43).Because image-display units 32 can identify rotation to be shown
Target area (that is, response image rotation process, the viewing areas to be shown on display 215), so image-display units
32 can be determined that whether all images data in rolling target region are comprised in from the received panorama of image processing server 10
In image.
If the image data in rolling target region is judged as that (no in step S43), image-display units can be used
32 show the corresponding image data (step in the rolling target region retrieved from storage unit 3000 on display 215
S46)。
If the image data in rolling target region is judged as unavailable (in step S43 be), operation input is connect
Determined whether user has been carried out specific operation (step S44) by unit 33.Specific operation refers to that user inputs behaviour
Explicitly indicate that user it is expected to watch one or more cells being deleted.Note that may know in advance will by user
The specific operation of progress or the specific operation that will be carried out may be by quilts in a manner of the display (viewing) for not interfering panoramic picture
It is shown on display 215.For example, specific operation can be related to carrying out the image rotation of at least certain number within certain period
It operates (for example, 3 times or more within one second).
If user has been carried out specific operation (in step S44 be), image-display units 32 will be used for panorama
The request of the residual image data of image is sent to image processing server 10 (step S45).That is, image-display units 32 are requested
Image processing server 10 sends the cell being deleted from panoramic picture.Note that in some situations, it only can be from
User is requested to attempt the cell watched in deleted cell, and in other cases, all be deleted can be requested
Cell.In any situation, image processing server 10 transmission with user attempt watch region image data and
Information.In this way, graphic display terminal 30 can promptly show the region for the panoramic picture that user will watch.Because
Image processing server 10 can clearly identify the cell being deleted, so image processing server 10 can be from storage
Retrieval in original panoramic images (the complete panoramic picture being deleted without any cell) in image processing server 10
Deleted cell, and the deleted cell that has retrieved is transmitted to graphic display terminal 30.Then, image display is single
The cell received from image processing server 10 and the panoramic picture received in advance are combined by member 32, Lai Chongjian
Single panoramic picture, and show on display 215 user by specific operation the specified area as desirable viewing area
The image in domain.Note that in some embodiments, image-display units 32 can be sent completely with requested image processing server 10
Panoramic picture.
In this way, even if when graphic display terminal 30 receives the deleted panoramic picture of one or more cells,
User still is able to show any region of panoramic picture on display 215.
And pay attention to, the viewing areas to be watched of the user shown on display 215 is as viewing areas information quilt
It is transferred to image processing server 10.In this way, such as the viewing that is recorded in viewing areas management table time can be updated
Number, and deleted by cell as described above and determine processing to determine new cell to be deleted.
(video image)
In the following, it is described that display panoramic picture is the processing of video image.The place of this processing and display still image
The similar place of reason is that graphic display terminal 30 detects specific operation (for example, user carries out at least centainly within certain period
The image rotation of number operates) as the one or more cells being deleted display request note that using continuously remembering
It is identical about each frame for constituting full-view video image in situation of the recording method to record the viewing areas of full-view video image
Cell be deleted, likewise, detection specific operation processing can be substantially similar to about still image progress processing.
On the other hand, it in the situation of viewing areas for recording full-view video image using recording method frame by frame, is deleted
The cell removed changes according to each frame.Thus, for example, to specific operation (for example, being carried out within certain period a certain number of
Image rotation operation) when being detected, graphic display terminal 30 may play next frame of (display) video image.Cause
This, in this case, for example, image-display units 32 can with and in step S42 first image rotation operation it is tested
The frame shown when measuring, to determine whether the image data in rolling target region can be used.In this way, it can accurately determine
Requested image data (be equivalent to user and attempt the region watched).Also, it in some embodiments, can be based on specific
Operation is detected the frame shown when (for example, after the image rotation for having carried out certain number within certain period operates),
Identify over several frames having been displayed, and image-display units 32 can be determined that rolling target region image data whether
It is all unavailable to even one in several frames.If image data is all unavailable to even one in identified frame,
Image-display units 32 can be arranged to receive the cell deleted from image processing server 10.It is such to arrange for display
It is ideal for video image.That is, because video playback is related to continuously showing frame one by one, if rolling target region
Image data in several frames even one it is all unavailable, then this be likely to damage user viewing experience.
Note that regardless of using continuous recording method still recording method frame by frame, such as graphic display terminal 30 can be arranged to ask
Panoramic image frame after asking image processing server 10 to be sent in currently shown frame (has only been deleted cell or has not had
The complete panoramic image frame for having any cell deleted).In this way, user can with substantially with viewing panorama it is static
The identical mode of image watches full-view video image.
As described above, in the image display system 100 according to the present embodiment, based on the viewing that is shown by multiple users
The related statistical information in region (display area) deletes the cell most unlikely watched.It in this way, may be by user
The a part of of the panoramic picture of viewing can be transferred to graphic display terminal 30.Therefore, it is possible to reduce transmit panoramic picture
Transmission time, and user is less likely to experience downloading panoramic picture and has used the long time.
[second embodiment]
In the following, it is described that the image display system 100 of second embodiment according to the present invention.According to second embodiment
Image processing system 100 in, when content includes full-view video image, pass through and delete corresponding with sky and ground image
The data volume of full-view video image is reduced in region, so that the download time of full-view video image is reduced.
Figure 11 is to show to be shown eventually according to the image processing server 10 and image of the image display system 100 of the present embodiment
The block diagram of the functional configuration example at end 30.Note that shown in Figure 11 substantially with those identical features and element shown in Fig. 6
It is given identical reference number symbol, and their explanation can be omitted.Below explanation relate generally to the present embodiment with it is upper
State the different feature of first embodiment.
In the present embodiment, image processing server 10 does not record the sight for the panoramic picture watched by multiple users
See region.It therefore, need not be comprising being watched with record according to the image processing server of the present embodiment 10 and graphic display terminal 30
The related function in region.It is deleted in addition, deleting determination unit 14 according to the data of the present embodiment and having with the data of first embodiment
Except the different functional character of determination unit 14.
<data, which are deleted, to be determined>
Determination unit 14 is deleted from the panorama sketch being stored in panoramic picture management DB 1001 according to the data of the present embodiment
The video image shot when identification content registration people 8 moves in the direction of movement as in.Correspond in panoramic picture on the move
In the situation of the video image of shooting, indicate that the region of the image on sky and ground is unlikely to cause the interest of viewer, because
This will delete image-region (hereinafter referred to as " sky areas " and " ground area of corresponding sky and ground in the present embodiment
Domain ").Note that the video image shot in mobile can constitute the position of the frame of video image by tracking according to the sequence of frame
Information (for example, longitude and latitude) is detected.That is, for example, the if the location information indicate that image-capturing positions of video image
Gradually with linear or curve movement, then video image can recognize to shoot on the move.
Figure 12 is to explain that data delete the figure of range.In Figure 12, it is shown that three continuous frames.Imaging device 7 includes inspection
Survey inclined acceleration transducer of the imaging device 7 relative to ground.Imaging device 7 is by slant correction, so that being taken
The vertical direction of panoramic picture can be perpendicular to ground.Therefore it is presumed that X-direction indicates the horizontal direction of panoramic picture, Y in Figure 12
Direction indicates the vertical direction of panoramic picture, shoots sky in the small region of Y-coordinate value, and in the big region of Y-coordinate value
Shoot ground.Thus, for example, sky areas 51 may occupy the 10- of the height of the panoramic picture since Y-coordinate value is zero
15%, and ground region 52 may occupy the 10-15% of the height of the panoramic picture since Y-coordinate value is its maximum value.
Note that the width of sky areas 51 and ground region 52 is not to be necessarily constant, likewise it is possible to by image
Reason is to detect sky areas 51 and ground region 52.For example, sky areas 51 may be sky color (pale blue, blue, grey,
White etc.), and include seldom sharpened edge.Thus, for example, can be by detecting the color of each intended pixel block and inciting somebody to action
Block of pixels in continuous sky color is identified as the candidate of sky areas 51, to detect sky areas 51.Also, pass through detection
It is higher than the sharpened edge of predetermined value in each block of pixels, and the contiguous pixels block by marginal density lower than predetermined value is identified as sky
The candidate in region 51 can calculate the marginal density of each intended pixel block.Then, two candidates based on sky areas 51,
Two candidate intersections or set can be identified as sky areas 51.
Note that for example, the ground region 52 for taking road surface for detection can carry out similar image procossing.However,
In the situation of detection road image, for example, can detecte road color (grey, brown etc.), rather than sky color.On the same day
Empty situation is the same, and road generally includes seldom sharpened edge.However, road for example may include white line or kerb.?
This respect, for example, in the candidate of detection ground region 52, even if detecting edge in block of pixels, when determining this edge
When being straight line, this may also indicate a line or kerb on road, and similarly, which still can be considered as ground area
The candidate in domain 52.Note that using technology appropriate, such as Hough transformation, it can detecte out straight line,.
In this way, for example, as shown in figure 12, the part of 10% height of top of panoramic picture can be identified as day
Empty region 51, and the part of 15% height of bottom of panoramic picture can be identified as ground region 52.Therefore, data are deleted true
Order member 14 can determine to delete the sky areas 51 being identified and ground region 52 from panoramic picture.
Figure 13 is to show to delete determination unit 14 from panoramic picture deletion 51 He of sky areas according to the data of the present embodiment
The flow chart of the example procedure of ground region 52.Note that the processing of Figure 13 can delete really in the data of step S10 shown in Fig. 7
Start when fixed processing starting.
In step S51, it includes panoramic picture that read/write cell 19, which reads (retrieval) from panoramic picture management DB 1001,
Content.
Then, in step S52, data delete determination unit 14 and determine whether the panoramic picture retrieved is video figure
Picture.Note that for example, if whether instruction panoramic picture is that the information of video image or still image is attached to and is stored in panorama
In the content of image management DB 1001, then read-write cell 19 contents of the retrieval containing video image can be arranged.If panorama sketch
As not being video image, then processing terminate.
If panoramic picture is video image (in step S52 be), processing proceeds to step S53, deletes in this data
Except determination unit 14 determines whether the panoramic picture takes on the move.If panoramic picture is not yet clapped on the move
It takes the photograph, then processing terminate.
If panoramic picture is photographed (in step S53 be) on the move, processing proceeds to step S54,
The sky areas 51 of this data deletion detection of determination unit 14 panoramic picture and ground region 52 are simultaneously determined from panoramic picture
Delete the sky areas 51 detected and ground region 52.
As described above, in the image display system 100 according to the present embodiment, when panoramic picture is shot on the move
It is less likely the sky areas 51 watched when video image, in panoramic picture and ground region 52 is deleted, and is more likely to
The panoramic picture watched is having the preferentially transmitted.
[3rd embodiment]
In the following, it is described that the image display system 100 of third embodiment according to the present invention.According to the present embodiment
It is opposite with moving direction by deleting when content includes the full-view video image shot in mobile in image processing system 100
Region reduce the data volume of full-view video image, to reduce the download time of full-view video image.
Note that according to the image processing server 10 and graphic display terminal 30 of the image display system 100 of the present embodiment
Functional configuration it is substantially identical as in second embodiment shown in Figure 11.However, in the present embodiment, data are deleted true
Order member 14 has the functional character different from the data of second embodiment deletion determination unit 14.
Hereinafter, the functional character that determination unit 14 is deleted according to the data of the present embodiment is described with reference to Figure 14.Figure 14
It is the figure for schematically showing the image-capturing positions of multiple panoramic picture 41-43.For example, in 41,42 and 43 or more panoramic picture
It states and enumerates in the situation that sequence is taken, can detecte in Figure 14 such as the moving direction 44 of arrow instruction.Note that for example, side
Position information (such as north, south, east and west) can be affixed to panoramic picture, and can detecte movement based on this azimuth information
Direction 44.Hereinafter, for the sake of explaining conveniently, the direction that north is directed toward on the plane of reference for be parallel to ground is arranged to 0 degree
Moving direction 44 is indicated as reference direction, and from the positive-angle of reference direction measured clockwise.
By taking panoramic picture 41 as an example, the moving direction 44 of panoramic picture 41 is about 315 degree, and relative to moving direction 44
Opposite direction be about 135 degree.Therefore.Data delete determination unit 14 can will be in the predetermined angular from 135 degree
Angular range is determined as the rear range 45 of panoramic picture 41.For example, if predetermined angular is 45 degree, rear range 45 can be with
It is 90 degree of angular ranges between 180 degree.Then data are deleted determination unit 14 and are determined after deleting this from panoramic picture 41
Square range 45.Note that the rear range 45 of panoramic picture 42 and 43 can be deleted in a similar manner.
Figure 15 shows the example that the rear range 45 opposite with moving direction 44 is deleted from panoramic picture.Three are shown in Figure 15
A successive frame.Above with reference to described in Figure 14, the rear range 45 that identifies of determination unit 14 is deleted from each of three frames by data
It is deleted in a.Note that the rear range 45 to delete from each frame is identical in the example of Figure 15.As at this
In a example, when moving direction 44 in the range that can be considered as substantially the same (for example, the variation of moving direction 44 is 10
Within degree) when, rear range 45 to be deleted can keep identical.
Figure 16 is to show to be deleted in the slave panoramic picture that determination unit 14 is realized by data to delete relative to moving direction
The flow chart of the process instance of rear range 45 in 44 opposite direction.Note that the processing of the step S61-S63 of Figure 16 is basic
It is upper identical as the processing of step S51-S53 of Figure 13.Therefore, the processing of step S64 is described below.
In step S64, data delete determination unit 14 and determine to delete on the opposite direction relative to moving direction 44
Rear range 45.
As described above, in the image display system 100 according to the present embodiment, when panoramic picture is shot on the move
When video image, the rear range 45 that can not be watched in panoramic picture is deleted, and the panorama around moving direction 44
Image is having the preferentially transmitted.
Note that for example, the present embodiment can also combine realization with second embodiment.That is, for example, being deleted from panoramic picture
After rear range 45, sky areas 51 and ground region 52 can also be deleted from resulting panoramic picture.With this
The data volume of method, panoramic picture graphic display terminal 30 is transferred to from image processing server 10 can be further
It reduces on ground.
[fourth embodiment]
In the following, it is described that the image display system 100 of fourth embodiment according to the present invention.According to the present embodiment
In image processing system 100, in the situation that content includes the full-view video image shot in mobile, by deleting with panorama sketch
The data volume of panoramic picture is reduced in the region except the region the visual field (FOV) around centered on the moving direction of picture, thus
Reduce the download time of panoramic picture.
Note that according to the image processing server 10 and graphic display terminal 30 of the image display system 100 of the present embodiment
Functional configuration it is substantially identical as second embodiment shown in Figure 11.However, in the present embodiment, data, which are deleted, determines list
Member 14 has the functional character different from the data of second embodiment and 3rd embodiment deletion determination unit 14.As above about
Three embodiments are described in reference diagram 14, and data, which delete determination unit 14, can determine that the content registration people 8 of photographing panorama picture (uses
Family) moving direction 44.It is deleted after determination unit 14 determines moving direction 44 in data, data delete determination unit 14 will be with
Some region around centered on moving direction 44 is (for example, -30 degree and+30 are spent from moving direction 44 in longitudinal
Between range and on latitude direction from the plane of reference of moving direction 44-30 degree+30 degree between range) identification conduct
Region the visual field (FOV) of user (content registration people 8).In the example of Figure 14, from the center for the sphere for indicating panoramic picture 41
Start 315 degree of direction and is confirmed as moving direction 44.This direction corresponds to longitudinal direction, and the region FOV is on latitude direction
It can be in the range between -30 degree the moving direction 44 from 315 degree and+30 are spent.Also, on latitude direction, the region FOV can be
Range from the road surface (plane of reference) in 315 degree of moving direction 44 between -30 degree and+30 degree is (that is, perpendicular to the side on road surface
To).In the present embodiment, data delete determination unit 14 and identify this region FOV, and determine and delete in panoramic picture in addition to
Region except the region FOV of identification.
The example that Figure 17 shows the region FOV 53 of panoramic picture.In Figure 17, three continuous frames are shown.Data are deleted true
Order member 14 can identify the region FOV 53 of each frame, and determine to be deleted from panoramic picture other than the region FOV 53
The region removed.
Figure 18 is to show to delete in the slave panoramic picture that determination unit 14 is realized by data to delete in addition to area of visual field 53
Except region process instance flow chart.Note that the processing of the step S71-S73 of Figure 18 can be substantially and the step of Figure 13
The processing of S51-S53 is identical.Hereinafter, the processing of the step S74 of Figure 18 is described.
In step S74, data delete determination unit 14 identify the region FOV 53, and determine from panoramic picture delete in addition to
Region other than the region FOV 53.
Therefore, according to the field of vision for being only possible to be watched in the image display system of the present embodiment 100, in panoramic picture
Domain is retained, and panoramic picture is efficiently transmitted.
[the 5th embodiment]
In the following, it is described that the image display system 100 of fifth embodiment according to the present invention.According to the figure of the present embodiment
It, should as display system 100 allows users to monitor or the panoramic picture that is shot by imaging device 7 of viewing over time
Imaging device 7 is fixed on place appropriate at least certain period.Use the imaging device for being fixed on place appropriate
Observation method is referred to as " fixed point observation ".Although imaging device 7 can generally be held by a user photographing panorama picture, imaging device
7 also for example are used as being mounted between floors or outdoor fixed point video camera.
The example that Figure 19 shows arrangement of the building layout together with imaging device 7.For example, by being arranged in as shown in figure 19
As device 7, imaging device 7 can be used for the behavioural analysis of consumer in the enterprise of shop or other types.For example, installation
Imaging device 7 in shop/enterprise can regular photographing panorama picture, and the panoramic picture taken is stored in image procossing
Server 10.In this way, the user (for example, store manager) for implementing behavioural analysis can be from image processing server 10
Receive the panoramic picture as time series data.Therefore, how the consumer that user can analyze access shop, which buys, (or is not purchased
Buy) article, how office worker to look after consumer, etc..User then such as can use development and sale plan in analysis knot
Fruit.
It uses in the situation of the panoramic picture of the time series of fixed point shooting, to divide in the user of such as store manager
The viewing point of analysis is limited.In addition, also there is the demand that can be analyzed fixed viewing point.In this respect, for example, can lead to
It crosses the watched time for as above recording each cell of panoramic picture in conjunction with described in first embodiment and to store watched time more
Cell, can be realized the analysis of fixed point.
On the other hand, the viewing to be analyzed point for example can be according to the duty of the store manager (user) of analysis panoramic picture
Position type and/or responsibility and change.In this respect, for example, in order to provided based on his/her position and responsibility shooting with it is every
The relevant panoramic picture for watching point range of a user, image processing server 10 can be configured to each user's phase of storage and management
The viewing areas of pass manages table.
In addition, the viewing to be analyzed point can for example change according to time slot, before the e.g. business of time slot,
During business, after closing, during rush hour and during the off-peak hours.In this respect, for example, it is each in order to analyze
Time slot, image processing server 10 can be configured to storage and management viewing areas letter related with each time slot
Breath.
Note that according to the image processing server 10 and graphic display terminal 30 of the image display system 100 of the present embodiment
Functional configuration can be substantially identical as those of first embodiment shown in Fig. 6.Also, it is aobvious according to the image of the present embodiment
Show that the overall operation process of system 100 is substantially similar with operating process shown in fig. 7.
<the viewing areas management for different time gap>
Hereinafter, with reference to Figure 20, description includes the viewing of user's viewing in the panoramic picture that imaging device 7 is shot
Region 5.The example that Figure 20 shows the viewing screen 501 that user shows on graphic display terminal 30.Viewing screen 501 includes layout neck
Domain 502 and video field 503.The layout field 502 of Figure 20 shows and is laid out shown in Figure 19, and allows users to selection and clapped
Take the photograph the imaging device 7 for the panoramic picture that user to be watched.Note that for example, the imaging device 7 being easily selected by a user can be by arrow
502a instruction.Video field 503 shows the panoramic picture that the imaging device 7 selected is shot.More specifically, video field
The viewing areas 5 of 503 display panoramic pictures.
As shown in figure 20, the viewing areas 5 that user watched is identified by XY coordinate.Change viewing areas when user inputs
When 5 operation, operation input receiving unit 33 receives this user's operation, then 34 rotating panoramic image of image rotation unit.
Viewing areas recording unit 35 records the viewing areas 5 at least having continuously displayed the panoramic picture of certain period.
Note that in the present embodiment, the image capturing time information of panoramic picture is attached to panoramic picture.Therefore, example
Such as, it is based on image capturing time information, the viewing areas recording unit 35 of graphic display terminal 30 can be with every 30 minutes time
The viewing areas information of gap record viewing areas 5.Then the viewing areas information in different time gap is transferred at image
Manage server 10.In this way, such as the viewing time of each cell of storage and management can be carried out for each time slot
Number.
Note that in the present embodiment, image processing server 10 may be implemented substantially with realized in first embodiment
That identical data, which is deleted, determines processing.However, in the present embodiment, data delete determination unit 14 between each time
Gap determines data to be deleted.
<<record watched time>>
Figure 21 is the viewing for recording each cell time for showing image processing server 10 through this embodiment and realizing
The flow chart of several process instances.Note that each imaging device 7 can be performed the processing of Figure 21.Also, whenever viewing area
Domain information executes the processing of Figure 21 when being transferred to image processing server 10.
For example, the viewing areas information in content ID and different time gap can be transferred to image by graphic display terminal 30
Processing server 10.Then, in step S81, the communication unit 11 of image processing server 10 receives viewing areas information.Note
Meaning, if content includes still image, the viewing areas recording unit 35 of graphic display terminal 30 can be based on static map
The image capturing time information of picture determines the allocated time slot of viewing areas information.Additionally, graphic display terminal 30 can
To transmit image capturing time information and viewing areas information to image processing server 10.Note that the implementation described in front
In example, continuous recording method or frame by frame recording method are the viewing areas for record video image.In the present embodiment, at least
For each time slot, the watched time of each cell is recorded.For example, the viewing areas record of graphic display terminal 30
Member 35 can determine the allocated time slot for constituting each frame of video image based on the image capturing time information of each frame,
And the viewing areas information and time slot information of transmitting video image.
Then, in step S82, the viewing areas administrative unit 13 of image processing server 10 is between the different time
Gap calculates each cell watched time.Namely based on the viewing areas information in different time gap, viewing areas administrative unit 13
The viewing areas information of the viewing areas 5 of each time slot, which is converted to, indicates that the cell of the cell of viewing areas 5 is compiled
Number.
Then in step S83, viewing areas administrative unit 13 will be recorded in viewing areas pipe for each time slot
The watched time of correlation unit lattice number in reason database 1002 adds one.Viewing areas administrative unit 13 will equally be recorded in sight
The quantity of the viewer seen in district management database 1002 adds one.In this way, relative to each time slot, Mei Gedan
The watched time of first lattice can be recorded.
<<viewing areas management table>>
In the following, it is described that according to the viewing area of storage and management in viewing areas management DB 1002 of the present embodiment
The example of domain management table.
[table 4A] viewing areas manages table
The example that above-mentioned table 4A schematically illustrates the viewing areas management table according to the present embodiment.Note that shown in table 4A
Viewing areas management table is for the creation of each imaging device 7.And, it is noted that the viewing areas for relating generally to table 4A is described below
Manage the table feature different from table 2.In the present embodiment, viewing areas management table for example can for each 30 minutes when
Between gap (time interval) and be created.Note that time slot can also be divided into one hour, a few houres or even one section longer
Time.Also, such as the distinctive time slot in shop can be limited, such as a few hours, a few hours after business, noon before business
Meal time, certain evening hours and a few hours after closing.
Also, the viewing areas administrative unit 13 of image processing server 10 for example can calendar based on panoramic picture and day
Phase/temporal information determines panoramic picture that day imaging device 7 shoot at.It in this way, can be right as shown in table 4B
The daily creation viewing areas of Yu Yizhou manages table.
[table 4B] viewing areas manages table
The example that above-mentioned table 4B is shown as one week viewing areas management table created daily.Based on above- mentioned information, for example,
Wish in the situation what day monitors different zones according in user, image processing server 10 can suitably determination will quilt
The cell of deletion.
In addition, for example, table 4A and table 4B can be applied in combination to create for storing the every of each time slot and one week
It viewing areas manages table.In addition, viewing areas management table for example can be according to different weather conditions (for example, sunny, more
Cloud, rainfall, snowfall, etc.) it is created.
<<cell, which is deleted, to be determined>>
Figure 22 is to show data through this embodiment to delete determination that determination unit 14 is realized cell to be deleted
Process instance flow chart.Processing step different from the processing step of Fig. 9 A in Figure 22 is related generally to note that being described below.
And, it is noted that for each imaging device 7, the processing of Figure 22 is all carried out.
In step S91, the data of the present embodiment delete determination unit 14 and read (inspection from viewing areas management DB 1002
Rope) different time gap each cell viewer quantity and watched time.Note that the processing of step S92 can be basic
It is upper identical as the processing of the step 22 of Fig. 9 A.
Then, in step S93, data delete determination unit 14 for each time slot identification watched time and viewing
The ratio of person's quantity is lower than the cell of threshold value, and determines to delete this cell from panoramic picture.Image editing unit 15
The image capturing time information of reference panorama image determines relevant time slot, and step S93 is deleted from panoramic picture
The cell of middle identification.In this way, it is for instance possible to obtain being deleted for different time gap in the video of different units lattice
Hold.That is, in the present embodiment, for example, difference can be deleted from a video content according to the image capturing time to framing
Cell.In the situation of still image, cell to be deleted can the image capturing time based on still image come really
It is fixed.
Note that although having described the processing of Figure 22 with reference to Fig. 9 A, the tool for being related to retaining fixed quantity as shown in Figure 9 B
Having the cell of the cell of more height ratio than other cells to delete the method for determination for example can be applied to the present embodiment.
By deleting different cells for each time slot as described above, can be subtracted based on allocated time slot
The size of panoramic picture (still image or video image) with big data quantity less, so that the often quilt in allocated time slot
The region of viewing can be transferred to graphic display terminal 30.In this way, user can be complete almost without lingeringly viewing
Desired region in scape image.
And, it is noted that viewing areas management table is created even for each time slot, data delete determination unit 14
Such as the viewing areas management table in different time gap can also be assembled, to determine one or more cells to be deleted.
In this way, if user is interesting to given area, even if given area is not viewed by a user in given time gap,
It can prevent the deletion of the cell corresponding to the region.In order to realize this processing, user can for example operate image and show
Terminal 30, to send association requests to image processing server 10.
<the viewing areas management for different user>
As described above, the region being interested in panoramic picture can often change according to each user.For example, if user
The desired region in panoramic picture is allowed to select as viewing areas, then can create the specific viewing areas management of user
Table.
The user interface that Figure 23 shows to allow users to the desired region in specified panoramic picture as viewing areas
Example.The user interface of Figure 23 includes viewing screen 501 ', the base shown in the 501 ' display of viewing screen and the viewing screen 501 of Figure 20
Similar information in sheet.501 ' display layout field 502 ' of viewing screen, video field 503 ', registration button 505 and cancel button
506.For example, the display of video field 503 includes the content for the panoramic picture that user obtains from image processing server 10.It operates defeated
Enter the user's operation that receiving unit 33 receives user's input via touch panel 216.In this way, user can operate, all
Such as rotation, amplification, and/or the panoramic picture for reducing the display in video field 503 '.Also, user can be via touch panel 216
Any desired region (for example, region that user wishes monitoring) in specified panoramic picture, to create arbitrary viewing areas
504.When arbitrary viewing areas 504 is displayed on video field 503 ' and user presses registration button 505, including see
See that the arbitrary viewing areas information of the coordinate information in region 504 and the User ID of user can be transferred to image processing services
Device 10.User ID is the customer identification information of unique identification user.Note that User ID is referred to as " user information " or " uses
The specific information in family ", and can be any kind of information that can identify user.The specific example of this information include but
It is not limited to, employee number, name, e-mail address, etc..
Image processing server 10 for example can identify User ID by requiring user to log in front of watching panoramic picture.
Additionally, user can only key in his/her User ID in graphic display terminal 30, and then graphic display terminal 30 can be with
User ID and any viewing areas information are transmitted to image processing server 10.
As described above, user can register any desired region via user interface, such as user wishes the area of monitoring
Domain, as arbitrary viewing areas 504.It is arbitrarily designated because arbitrary viewing areas 504 is clear by user, user
Interesting image data can be easily identified, and can be then deleted to user's unessential image data of getting on very well.
Note that in this example, creating viewing areas for each user and managing table.And, it is noted that when any viewing of registration
When region 504, the cell that one or more corresponds to any viewing areas 504 will be considered in image processing server 10
It has already viewed once, and the watched time of corresponding cell may be recorded in viewing areas management DB 1002.In addition,
When user registers identical or different any viewing areas 504 again and any viewing areas 504 of earlier registration overlapping
The watched time of cell is added one.
When the viewing areas management table of panoramic picture has been created, image editing unit 15 can edit panoramic picture
(that is, Delete Cells).However, the panoramic picture feelings after having been subjected to the reduction of cell delete processing for each user creation
In shape, it may be required that a large amount of memory spaces of storage unit 1000.Therefore, it is required when from the reception viewing of graphic display terminal 30
When, editable panoramic picture.For example, when user provides User ID request viewing content-data to image processing server 10,
Image editing unit 15 can manage table, the Delete Cells from content-data based on the viewing areas of this user.With this
Method, graphic display terminal 30 can receive and show the region that this specific user may watch.
In the example of Figure 23 described above, the desired regional registration of panoramic picture can be any viewing by user
Region 504, and any viewing areas information of any viewing areas 504 of the image processing server 10 based on user's registration,
Viewing areas, which is created, for each user manages table.However, image processing server 10 for example can be based on the sight that user watched
It sees the viewing areas information in region 5, similarly creates viewing areas for each user and manage table, as having above with first embodiment
As the description of pass.That is, by making graphic display terminal 30 that the ID of user is transferred to image together with viewing areas information
Processing server 10, image processing server 10 can register any viewing areas 504 via user interface to be similar to user
Mode creates viewing areas for each user and manages table.
<<cell, which is deleted, to be determined>>
Figure 24 A be show by data delete determination unit 14 realize determination about each user determine will be from panorama
The flow chart of the process instance for the cell deleted in image.The processing of Figure 24 A is to be registered based on user via user interface
Any viewing areas 504 any viewing areas information and be that each user creates in the case where viewing areas management table by reality
Existing.
In step S101, the data of the present embodiment are deleted the identification of determination unit 14 and are come from the transmission of graphic display terminal 30
The associated viewing areas of User ID manages table.
Then, in step S102, data delete determination unit 14 determine delete watched time less than one cell (that is,
The cell that watched time is zero).That is, as described above, when user transmits any sight that (registration) specifies any viewing areas 504
When seeing area information, in the viewing areas management table for this user, the sight of the cell of any viewing areas 504 is indicated
It sees and is at least arranged to one.Any viewing areas 504 that user specifies will be continuously this user and show, similarly, data are deleted
Except determination unit 14 can determine to delete other cells (that is, cell that watched time is zero) of watched time less than one.
Figure 24 B is the viewing areas information shown in the viewing areas 5 watched based on user, creates viewing for each user
In the case where district management table, pass through the process instance of the determination of the data deletion realization of determination unit 14 cell to be deleted
Flow chart.
Note that the step S111 processing of Figure 24 B is identical as the step S101 of Figure 24 A, and the place of step S112 and S113
It manages identical as the step S22 and S23 of Fig. 9 A respectively.Note that however, being used for the quantity of the viewer of calculating ratio in step 112
It is equivalent to the number that same subscriber watched identical content.
As described above, by by the viewing areas information or any viewing areas 504 of the specific viewing areas 5 of each user
Any viewing areas information be transferred to image processing server 10, graphic display terminal 30 for example can be according to his/her duty
Position and responsibility show the region of panoramic picture related with each specific user.
Note that in some embodiments, the unit that determination will be deleted from the panoramic picture that some imaging device 7 is shot
When lattice, such as the data deletion determination unit 14 of image processing server 10 may be arranged to be based upon in addition to corresponding and current
User except the user of viewer creates viewing areas and manages table, to determine one or more cells to be deleted.That is,
Such as when user is transferred to new shop etc., the viewing previous based on user of determination unit 14 can be deleted with arrangement data
History carrys out Delete Cells.In this way, such as it can simplify adapter tube operation, and personnel change and can smoothly realize.
Also, such as in order to efficiently use this viewing areas management table for each specific user's storage and management, image display system
The administrator of system 100 can identify that another user's is another for changing into the given associated User ID of viewing areas management table
A User ID (for example, example of shop successor described above).
<content after viewing cell deletion>
It is such as described above with reference to Figure 10, in the situation for deleting one or more cells from panoramic picture (content)
In, the cell deleted from panoramic picture can by specific operation that detection user carries out (for example, in a specified time into
Image rotation operates row several times) and be resumed.Hereinafter, this specific operation will be described in further detail.
The panorama sketch registered in the viewing areas management table that Figure 25 A-25C is stored in viewing areas management DB 1002
The schematic top plan view of the viewing areas of picture or any viewing areas.Note that (being seen in Figure 25 A-25C by the watched time registered
See in district management table) the viewing areas A and B of registration are represented as more than or equal to the region of the cell formation of threshold value.
That is, the cell other than the cell of the region A and B that correspond to registration is deleted.Note that image editing unit 15 can be with
Using a Delete Cells from panoramic picture in two methods, two methods are known as method I and method II, following institute
It states.
Method I is related to cell of the practical elimination other than corresponding to the cell of the viewing areas A and B that register.This
If sample, panoramic picture can be divided and sign up to view region A and B is respectively displayed in image as individual images show
In terminal 30.Figure 25 B is depicted schematically in how the viewing areas A and B registered in this case is displayed on image display eventually
On end 30.That is, screen can be immediately switched to show when user's Rotation screen while sign up to view region A is shown
Sign up to view region B.Similarly, when user's Rotation screen while sign up to view region B is shown, screen can be immediately
It is switched to display sign up to view region A.In other words, deleted cell is completely eliminated.
Method II is related to the cell other than the cell of the viewing areas A and B of registration replacing with black picture element
Etc..In this case, panoramic picture and black picture element including sign up to view region A and B may be displayed on graphic display terminal
On 30.Figure 25 C is depicted schematically in how sign up to view region A and B in this case is displayed on graphic display terminal 30.
More specifically, it in Figure 25 C, is displayed on graphic display terminal 30 in the region of the panoramic picture in box 510.When with
Family when Rotation screen, can show sign up to view area after black picture element is shown while sign up to view region A is shown
Domain B.Identical mode is suitable for switching display sign up to view region A from sign up to view region B.That is, user cannot not show
Sign up to view region A and B is alternately displayed in the case where black picture element.
In the case where application method I, although sign up to view region A and B can be shown immediately, user is determined
The place of sign up to view region A and B might have difficulty in panoramic picture.In the case where application method II, user can hold
When changing places the place of sign up to view region A and B in determining panoramic picture, but being switched between sign up to view region A and B
Inevitably show black picture element.In view of the advantage and disadvantage of the above method I and 2 II, user, which is preferably allowed to select, to be used
Cell delet method.
Note that requesting the specific operation for the cell being deleted may in the situation of I Delete Cells of application method
It is, for example, at least alternately displaying the operation of sign up to view region A and B several times within given one section of time limit.In application method II
In the situation of Delete Cells, specific operation may be at least alternately displayed several times in one section of time limit sign up to view region A (or
Sign up to view region B) and black picture element operation.Also, in the situation of application method II, specific operation may be user one
The operation of black region (black picture element) is continuously displayed in specified time.
Also, in the present embodiment, graphic display terminal 30 for example can be configured to only obtain from deleted cell
Take the corresponding cell in region or the 30 deleted list of available whole of graphic display terminal that viewing is wished with user
First lattice.Equally, graphic display terminal 30 can send complete panoramic picture with requested image processing server 10.For example, in quotient
In the situation that shop layout has substantially been altered, graphic display terminal 30 can be sent completely with requested image processing server 11
Panoramic picture.In this case, graphic display terminal 30 can also delete the viewing of panoramic picture with requested image processing server 10
District management table.In this way, image processing server 10 can for example create the viewing area of the layout new suitable for shop
Domain manages table.
As described above, according to the one side of the present embodiment, when imaging device 7 is used to ocean weather station observation, it is possible to specify complete
The region that user is interested in scape image, so that when panoramic picture is transferred to graphic display terminal 30, graphic display terminal
30 can promptly show this region.Also, graphic display terminal 30 can for example be shown suitably according to time and/or user
Region.
Note that for example, imaging device is not limited to be mounted in building etc., and open air can also be installed in.
Equally, other than being mounted in shop, imaging device 7 can be installed in office, corridor, channel, public organizations
Foreground, shopping centre, crossroad, station, etc..
<others application>
Although the embodiment of reference describes the present invention above, the present invention be not limited to these embodiments and
Numerous modifications and replacement in scope.
For example, first embodiment, the panoramic picture that the transmission of image processing server 10 has been subjected to cell delete processing is arrived
Graphic display terminal 30.However, image processing server 10, which also can be configured as display, is stored in panoramic picture management DB
Panoramic picture in 1001.Also, panoramic picture management in some embodiments, can be provided in graphic display terminal 30
DB1001, and graphic display terminal 30 can be configured to manage from panoramic picture and read (retrieval) panoramic picture in DB 1001,
Then the panoramic picture retrieved is shown on display 215.
Also, image processing server 10 and the functional configuration of graphic display terminal 30 etc. as shown in Figure 6 are only to be
The illustrated example for being easy to understand the processing of image processing server 10 and graphic display terminal 30 and providing.For example, some
In embodiment, multiple images processing server 10 can be configured to the processing that the embodiment of the present invention as described above is realized in cooperation.Figure
As the storage unit 1000 of processing server 10 is not necessarily placed in image processing server 10, as long as image processing services
Device 10 is able to access that storage unit 1000, to read data/data are written in storage unit 1000 from storage unit 1000.
Also, although the functional character of image processing server 10 and graphic display terminal 30 is above by being divided into
Several processing units are described, but the present invention is not limited to the arrangement and division of above-mentioned processing unit.For example, image processing services
One or more processing units of device 10 and/or graphic display terminal 30 can further be divided into processing unit, or
Such as two or more processing units can be combined into single processing unit.
Note that image editing unit 15 as described above is the example for reducing unit, communication unit 31 be receiving unit and
The example of second transmission unit, operation input receiving unit 33 are the example of operation acceptance unit, viewing areas administrative unit 13
It is the example of counting unit, image-display units 32 are the examples of image-display units, and viewing areas recording unit 35 is display
The example of regional record unit, communication unit 11 are the examples of the first transmission unit, and it is that region is true that data, which delete determination unit 14,
The example of order member.Also, the treatment process executed by the image display system 100 according to above-described embodiment of aforementioned present invention
It is the example of image display method according to the present invention.
The present invention be based on and require the 2015-094225 Japanese patent application submitted on May 1st, 2015 and
The equity of the priority of 2 months 2016-026816 Japanese patent applications submitted on the 16th in 2016, entire contents are by drawing
With being bonded to here.
Claims (16)
1. a kind of image display system, characterized by comprising:
Information processing equipment；With
The terminal device of wide angle picture is received from the information processing equipment；
Wherein, the information processing equipment includes
Division unit, the division unit is for being divided into multiple division regions for the wide angle picture in advance；
Counting unit, the counting unit are configured to identify pair based on from the received display region information of the terminal device
Should be in a division region in the multiple division region of display area, and increase and identified division region associated storage
Watched time；
Area determination unit, the area determination unit are configured to determine based on the watched time than the wide angle picture
The region of the less wide angle picture watched in other regions；
Unit is reduced, the unit that reduces is configured to what the deletion from the wide angle picture was determined by the area determination unit
The region of less viewing, to generate reduced wide angle picture；
Storage unit, the storage unit are configured to store the wide angle picture of the reduction；With
First transmission unit, first transmission unit are configured to the wide-angle of the reduction generated by the reduction unit
Image transmitting is to the terminal device；And
Wherein, the terminal device includes
Display area recording unit, the display area recording unit are configured to record the display area；
Second transmission unit, second transmission unit is configured to will be by the specified institute of the display area recording unit records
The display region information for stating display area is transferred to the information processing equipment；
Receiving unit, the receiving unit are configured to receive the wide angle picture of the reduction from the information processing equipment；With
Image-display units, described image display unit are configured to show the wide-angle figure of the reduction on said display means
Picture.
2. image display system as described in claim 1, which is characterized in that
The area determination unit divides region for each the multiple for dividing region, calculates watched time and shows with described
Show the ratio of the receive number of information, and the ratio of calculating is determined as to the institute of the wide angle picture lower than the division region of threshold value
State the region of less viewing.
3. image display system as described in claim 1, which is characterized in that
The area determination unit identifies the division region of specified quantity from the multiple division region, and by identified institute
The division region for stating specified quantity is determined as the region of the less viewing in the wide angle picture, and the specified quantity is drawn
Subregion has the ratio of watched time or watched time and the receive number for showing information more than other division regions
Rate is higher than other division regions.
4. image display system as described in claim 1, which is characterized in that
Second transmission unit of the terminal device is by the display region information together with related to the user of the terminal device
User information be transferred to the information processing equipment together；
The area determination unit of the information processing equipment is based on believing from the received display area of the terminal device
Breath and the user information determine the region of the less viewing of the wide angle picture about each user；With
The reduction unit deletes the institute about each user determined by the area determination unit from the wide angle picture
The region of the less viewing of wide angle picture is stated, to generate the wide angle picture of the reduction about each user.
5. image display system as claimed in claim 4, which is characterized in that
The area determination unit is based on via the different use other than the viewing user for watching the wide angle picture
Family transmission the display region information, come determine the wide angle picture the less viewing region.
6. image display system according to any one of claims 1 to 5, which is characterized in that
The terminal device further includes
Operation acceptance unit, the operation acceptance unit are configured to receive for showing that the display device by the reduction
The operation in the region that unit is deleted from the wide angle picture；And
When the operation acceptance unit receives the operation, described image display unit requests the information processing equipment at least
Transmit the region deleted from the wide angle picture.
7. image display system as claimed in claim 6, which is characterized in that
The display device is set to show that the operation in the region deleted from the wide angle picture includes controlling the display dress
It sets and at least continuously shows the reduction corresponding with the region deleted from the wide angle picture in predetermined period
The region of wide area image.
8. image display system as claimed in claim 6, which is characterized in that
The display device is set to show that the operation in the region deleted from the wide angle picture includes controlling the display dress
Set the wide-angle for alternately showing the reduction by the region segmentation of the deletion at least scheduled number in scheduled time slot
The one of a plurality of areas region of image.
9. image display system as claimed in claim 8, which is characterized in that
The operation acceptance unit receives specified operation, the specified operation is specified show on said display means it is described wide
The region of angle image,
Information relevant to the specified region is transferred to the information processing equipment by second transmission unit, by the behaviour
Receive the specified specified region of the specified operation as receiving unit；With
The reduction unit of the information processing equipment is based on the information related with the specified region, from the wide-angle
The specified region is deleted in image.
10. image display system as claimed in claim 3, which is characterized in that
The area determination unit is based on the bandwidth between the information processing equipment and the terminal device, to change the rule
Fixed number amount.
11. image display system as described in claim 1, which is characterized in that
The wide angle picture is panoramic picture；
The area determination unit determine the panoramic picture whether be taken while changing image-capturing positions it is more
A panoramic picture in a panoramic picture；With
When the panoramic picture is a panoramic picture in multiple panoramic pictures,
The area determination unit by the sky areas of the panoramic picture and ground region, the panoramic picture with the figure
As leaving described image camera site in the opposite rear range of the moving direction of camera site or the panoramic picture
The region other than area of visual field in the moving direction preset range is determined as the area to be deleted from the panoramic picture
Domain；With
The reduction unit deletes the region to be deleted determined by the area determination unit from the panoramic picture.
12. image display system as described in claim 1, which is characterized in that
Display area recording unit records image capturing time letter related with the image capturing time of the wide angle picture
The display area on said display means is shown in breath and the wide angle picture；
Second transmission unit will be by the described image shooting time information of the display area recording unit records and described
Display region information is transferred to the information processing equipment；
The area determination unit of the information processing equipment from the described image shooting time of the wide angle picture by believing
Breath determines relevant time slot in belonging multiple time slots, about between each time in the multiple time slot
Gap determines the region of the less viewing of the wide angle picture；With
The reduction unit deletes the area of the determining less viewing about each time slot from the wide angle picture
Domain.
13. image display system as claimed in claim 12, which is characterized in that
The area determination unit aggregation and the associated institute in more than two different time gaps in the multiple time slot
Display region information is stated, and determines based on the display region information of aggregation the area of the less viewing of the wide angle picture
Domain.
14. image display system as described in claim 1, which is characterized in that
The display area recording unit records and the wide angle picture are taken day related what day information and described wide
The display area on said display means is shown in the image of angle；
Second transmission unit transmission what day information as described in the display area recording unit records and the display
Area information is to the information processing equipment；
The area determination unit of the information processing equipment be based on from second transmission unit it is received it is described what day
Information is taken day by the determination wide angle picture, for determine every day in one week described in the wide angle picture compared with
The region watched less；With
The reduction unit deletes the area of the determining less viewing for every day in one week from the wide angle picture
Domain.
15. a kind of information processing equipment, characterized by comprising:
Reading unit, the reading unit are configured to retrieve wide angle picture from the storage device of storage wide angle picture；
Division unit, the division unit is for being divided into multiple division regions for the wide angle picture in advance；
Counting unit, the counting unit are configured to correspond to based on from the received display region information of terminal device to identify
One division region in the multiple division region of display area, and increase and the identified sight for dividing region associated storage
See number；
Area determination unit, the area determination unit, which is configured to determine in the wide angle picture based on the watched time, to be compared
The less region watched in other regions；With
Unit is reduced, the unit that reduces is configured to what the deletion from the wide angle picture was determined by the area determination unit
The region of less viewing to generate reduced wide angle picture, and stores the wide angle picture of the reduction in the storage device；
Wherein, the reading unit retrieves the wide-angle figure of the reduction generated by the reduction unit from the storage device
Picture.
16. a kind of image display method realized by information processing system, the information processing system includes information processing equipment
And terminal device, which is characterized in that described image display methods includes:
The partiting step realized by the information processing equipment, for wide angle picture to be divided into multiple division regions in advance；
The counting step realized by the information processing equipment, for being based on from the received display region information of the terminal device
To identify a division region in the multiple division region corresponding to display area, and increase and identified division region
The watched time of associated storage；
The determination step realized by the information processing equipment, for being determined in wide angle picture based on the watched time than described
The less region watched in other regions of wide angle picture；
The reduction step realized by the information processing equipment, for from deleting quilt in the wide angle picture in the wide angle picture
It is determined as the less region watched, to generate reduced wide angle picture；
The storing step realized by the information processing equipment, for storing the wide angle picture of the reduction；
The transmitting step realized by the information processing equipment is set for the wide angle picture of the reduction to be transferred to the terminal
It is standby；
The display area recording step realized by the terminal device, for recording the display area；
The transmitting step realized by the terminal device, the display region information for specifying the display area for that will record pass
It is defeated to arrive the information processing equipment；
The receiving step realized by the terminal device, for receiving the wide of the reduction transmitted from the information processing equipment
Angle image；With
The display step realized by the terminal device, for showing the wide angle picture of the reduction on said display means.
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2015094225 | 2015-05-01 | ||
| JP2015-094225 | 2015-05-01 | ||
| JP2016-026816 | 2016-02-16 | ||
| JP2016026816A JP2016213810A (en) | 2015-05-01 | 2016-02-16 | Image display system, information processing apparatus, program, and image display method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106101610A CN106101610A (en) | 2016-11-09 |
| CN106101610B true CN106101610B (en) | 2019-09-13 |
Family
ID=57549867
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610270077.XA Active CN106101610B (en) | 2015-05-01 | 2016-04-27 | Image display system, information processing equipment and image display method |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JP2016213810A (en) |
| CN (1) | CN106101610B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106791886B (en) * | 2016-11-16 | 2020-03-17 | 深圳市梦网百科信息技术有限公司 | Panoramic video distribution method and system based on visual characteristics |
| CN106878611B (en) * | 2016-12-29 | 2020-02-11 | 北京空间机电研究所 | Intelligent reconnaissance monitoring photoelectric system |
| JPWO2018128097A1 (en) * | 2017-01-06 | 2019-11-07 | ソニー株式会社 | Information processing apparatus and information processing method |
| CN106851212B (en) * | 2017-03-03 | 2020-03-17 | 深圳市梦网百科信息技术有限公司 | Panoramic video distribution method and system based on user characteristics |
| US11025993B2 (en) | 2017-06-02 | 2021-06-01 | Vid Scale, Inc. | 360-degree video delivery over next generation network |
| EP3649790A4 (en) * | 2017-07-06 | 2021-01-06 | Sharp Kabushiki Kaisha | Systems and methods for signaling view information for virtual reality applications |
| JP7200493B2 (en) * | 2018-03-29 | 2023-01-10 | 京セラドキュメントソリューションズ株式会社 | Monitoring system |
| JP2020035086A (en) * | 2018-08-28 | 2020-03-05 | 富士ゼロックス株式会社 | Information processing system, information processing apparatus and program |
| JP6718937B2 (en) * | 2018-09-26 | 2020-07-08 | 株式会社コロプラ | Program, information processing apparatus, and method |
| CN112307393A (en) * | 2019-09-04 | 2021-02-02 | 福建皮皮跳动科技有限公司 | Information issuing method and device and electronic equipment |
| CN116916050B (en) * | 2022-12-20 | 2024-03-19 | 哈尔滨商业大学 | Method and device for transmitting road monitoring image to terminal |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102186065A (en) * | 2011-06-01 | 2011-09-14 | 广州市晶华光学电子有限公司 | Monitoring camera with 360-degree field angle |
| CN102985789A (en) * | 2010-07-07 | 2013-03-20 | 莱卡地球系统公开股份有限公司 | Target point recognition method and surveying instrument |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6124517B2 (en) * | 2012-06-01 | 2017-05-10 | 任天堂株式会社 | Information processing program, information processing apparatus, information processing system, and panoramic video display method |
-
2016
- 2016-02-16 JP JP2016026816A patent/JP2016213810A/en active Pending
- 2016-04-27 CN CN201610270077.XA patent/CN106101610B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102985789A (en) * | 2010-07-07 | 2013-03-20 | 莱卡地球系统公开股份有限公司 | Target point recognition method and surveying instrument |
| CN102186065A (en) * | 2011-06-01 | 2011-09-14 | 广州市晶华光学电子有限公司 | Monitoring camera with 360-degree field angle |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2016213810A (en) | 2016-12-15 |
| CN106101610A (en) | 2016-11-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106101610B (en) | Image display system, information processing equipment and image display method | |
| US9996895B2 (en) | Image display system, information processing apparatus, and image display method | |
| US20200349774A1 (en) | Media Tags - Location-Anchored Digital Media for Augmented Reality and Virtual Reality Environments | |
| JP7192923B2 (en) | Apparatus, method, program, system | |
| US8254727B2 (en) | Method and apparatus for providing picture file | |
| US10586365B2 (en) | Server, user terminal, and service providing method, and control method thereof | |
| EP2777021B1 (en) | Hands-free augmented reality for wireless communication devices | |
| CN101854560B (en) | Capture and display of digital images based on related metadata | |
| US10191635B1 (en) | System and method of generating a view for a point of interest | |
| CN101910936B (en) | Guided photography based on image capturing device rendered user recommendations | |
| US20190253627A1 (en) | Service system, information processing apparatus, and service providing method | |
| US20120019513A1 (en) | 3d layering of map metadata | |
| US20150153933A1 (en) | Navigating Discrete Photos and Panoramas | |
| US20100149399A1 (en) | Image capturing apparatus, additional information providing server, and additional information filtering system | |
| US8281256B2 (en) | System and method for attracting, surveying, and marketing to consumers | |
| US20090064014A1 (en) | System and method of attracting, surveying, and marketing to consumers | |
| CN103226729A (en) | Virtual reality-based reservation method and system | |
| JP6555026B2 (en) | Information provision system | |
| JP6046874B1 (en) | Information processing apparatus, information processing method, and program | |
| US20150254694A1 (en) | System and Method for Providing Redeemable Commercial Objects in Conjunction with Geographic Imagery | |
| JP6617547B2 (en) | Image management system, image management method, and program | |
| US10986394B2 (en) | Camera system | |
| KR20090000107A (en) | Representation method on map for video image taken by mobile camera | |
| US9165339B2 (en) | Blending map data with additional imagery | |
| US11967029B2 (en) | Media tags—location-anchored digital media for augmented reality and virtual reality environments |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |