CN106101610A - Image display system, messaging device and method for displaying image - Google Patents

Image display system, messaging device and method for displaying image Download PDF

Info

Publication number
CN106101610A
CN106101610A CN201610270077.XA CN201610270077A CN106101610A CN 106101610 A CN106101610 A CN 106101610A CN 201610270077 A CN201610270077 A CN 201610270077A CN 106101610 A CN106101610 A CN 106101610A
Authority
CN
China
Prior art keywords
unit
region
image
wide angle
angle picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610270077.XA
Other languages
Chinese (zh)
Other versions
CN106101610B (en
Inventor
藤田阳平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ricoh Co Ltd
Original Assignee
Ricoh Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ricoh Co Ltd filed Critical Ricoh Co Ltd
Publication of CN106101610A publication Critical patent/CN106101610A/en
Application granted granted Critical
Publication of CN106101610B publication Critical patent/CN106101610B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

Thering is provided a kind of image display system, this image display system includes messaging device and receives the terminal unit of wide angle picture from described messaging device.Described messaging device includes determining the area determination unit in the region watched more less than other region of described wide angle picture in described wide angle picture, from described wide angle picture, delete the minimizing unit of the wide angle picture that the less described region watched determined by described area determination unit is reduced with generation, and transmission is by the first transmission unit of the wide angle picture of the described minimizing of described minimizing unit generation to described terminal unit.Described terminal unit includes the reception unit receiving the wide angle picture of described minimizing from described messaging device, and shows the image-display units of the wide angle picture of described minimizing on the display apparatus.Present invention additionally comprises method for displaying image.

Description

Image display system, messaging device and method for displaying image
Technical field
The present invention relates to image display system, messaging device, and method for displaying image.
Background technology
Known so-called spherical diagram picture or panoramic picture are the image (hereinafter referred to as " panorama sketch of 360 degree of panoramas of scenery Picture ").Had the special imaging device of special optical system by use, user can once focus and photograph panorama sketch Picture.User can also use the normal imaging equipment of shooting rectangular image to obtain panoramic picture by splicing multiple images.As Upper described, panoramic picture is the 360 degree of images that there is no dead angle, and user optionally can show on display etc. Show/watch the given area (angle) of panoramic picture.
Agree to, if the Internet etc. provide panoramic picture, user such as can use PC (personal computer) download and Viewing panoramic picture.But, the data volume of panoramic picture is the most sizable, because the visual field of its shooting 360 degree.Therefore, Such as when user wishes by the Internet viewing panoramic picture, a period of time to be spent downloads panoramic picture so that The waiting time that display panoramic picture needs is the longest.
The known technology for the download time that down scaling image data is downloaded relates to the image making server transmission progressive To terminal etc. (such as, Japanese Unexamined Patent Publication 2008-022488 publication).More specifically, Japanese Unexamined Patent Publication 2008-022488 The server that number publication describes is started by the image of the small data quantity of transmission low resolution, the most gradually transmits larger data The image of the high-resolution of amount.
But, in the technology of the image relating to making server transport progressive, user initially on PC the image of display be Low-resolution image, before the high-definition picture that display is suitable, user still has to wait for a long time.It is therefoie, for example, Because initially presenting to user's low-resolution image, so user may form good opinion to the website downloading image, or User may be that low-quality misunderstanding is affected by the picture quality of the real image that website provides.
Summary of the invention
An aspect of of the present present invention provides the image display system that can reduce transmission wide angle picture required time.
According to one embodiment of present invention, the image display system being provided includes messaging device and at information Reason equipment receives the terminal unit of wide angle picture.Messaging device includes, determine with other wide angle picture region than seldom by The area determination unit in the wide angle picture region of viewing, is deleted from wide angle picture and is seldom seen by what area determination unit determined The region seen to generate the minimizing unit of the wide angle picture of minimizing, and transmission by reduce unit generate minimizing wide angle picture to First transmission unit of terminal unit.Terminal unit includes the reception list receiving the wide angle picture reduced from messaging device Unit, and show the image-display units of the wide angle picture of minimizing on the display apparatus.
Accompanying drawing explanation
Fig. 1 is to be schematically illustrated to realize image processing process by image display system 100 according to embodiments of the present invention The figure of example;
Fig. 2 is the figure schematically illustrating the operational instances that content registration people 8 registers panoramic picture;
Fig. 3 is the figure of the exemplary configuration schematically illustrating the image display system 100 according to the present embodiment;
Fig. 4 is the block diagram of the example of the hardware configuration illustrating image processing server 10;
Fig. 5 is the block diagram of the hardware configuration example illustrating graphic display terminal 30;
Fig. 6 is the block diagram of the functional configuration example of display image processing server 10 and graphic display terminal 30;
Fig. 7 is the sequential chart of the operating process example showing image display system 100;
Fig. 8 A-8C is the form schematically illustrating the number of times that each cell of panoramic picture has been watched;
Fig. 9 A and 9B is the example procedure showing and being determined determination that unit 14 realizes cell to be deleted by data deletion Flow chart;
Figure 10 is the example showing the content after Cell display is deleted realized by graphic display terminal 30 The flow chart of process;
Figure 11 is to illustrate image processing server and the function of graphic display terminal in accordance with another embodiment of the present invention Profile instance block diagram;
Figure 12 is the figure showing the example deleting presumptive area from panoramic picture;
Figure 13 is to show to determine that what unit realized deletes sky areas and ground region from panoramic picture by data deletion Process instance flow chart;
Figure 14 is the figure of the multiple image-capturing positions schematically showing panoramic picture;
Figure 15 is the figure of the example of the rear scope that the moving direction showing and deleting panoramic picture is contrary;
Figure 16 is to show to determine that unit realizes deleting the contrary rear model of moving direction of panoramic picture by data deletion The process instance flow chart enclosed;
Figure 17 is the figure of the example of the area of visual field showing panoramic picture;
Figure 18 is to show that determining unit to realize from panoramic picture by data deletion deletes the area of visual field mistake with exterior domain The flow chart of journey example;
Figure 19 is the figure of the example of the layout showing the layout of imaging device and building;
Figure 20 shows the example of the viewing screen that user shows on graphic display terminal;
Figure 21 is to show that realizing registering the cell about each time slot by image processing server is watched The flow chart of the process instance of the number of times crossed;
Figure 22 is to show to determine that unit realizes determining the cell to be deleted about each time slot by data deletion The flow chart of process instance;
Figure 23 is the figure showing the example that can make user interface that user specifies any viewing areas;
Figure 24 A and 24B is to show to determine that determination that unit realizes is about each user list to be deleted by data deletion The flow chart of the program example of unit's lattice;With
Figure 25 A-25C is to be depicted schematically in viewing areas management data base corresponding to viewing areas or any viewing area The figure of the example of the cell in territory.
Detailed description of the invention
Hereinafter, embodiments of the present invention will be described by referring to the drawings.
[first embodiment]
<by the image procossing of image display system>
Fig. 1 is schematically illustrated at the image graph picture realized by image display system 100 according to embodiments of the present invention The example of reason process.Image display system 100 includes image processing server 10 and the graphic display terminal connected via network N 30.The following is the schematic diagram processed for transmitting the transmission of panoramic picture according to the present embodiment to describe.
(1) user 2 of operation graphic display terminal 30 downloads whole panoramic picture from image processing server 10, and shows User wishes the region (this region hereinafter referred to as " viewing areas " or " viewing area ") of the panoramic picture of viewing.In Fig. 1, user On graphic display terminal 30, just showing the viewing areas 5 of panoramic picture.
(2) graphic display terminal 30 transmits viewing areas information to image processing server 10, and this viewing areas information refers to Surely the viewing areas 5 being viewed by a user.
(3) in image processing server 10, panoramic picture is divided into cell in advance.Noting, each cell is left The cell numbering of the digitized representation respective cells that upper angle represents.Whenever viewing areas information is transferred to image processing services Device 10, the viewing number of times stored about each cell being viewed by a user just is added 1 by image processing server 10.Figure In the panoramic picture of 1, viewing areas 5 includes cell 2,3,6 and 7, thus, the viewing stored about cell 2,3,6 and 7 Number of times adds 1.When panoramic picture by the most some users 2 (or by the most several times) viewing and viewing areas information whenever quilt When being transferred to image processing server 10, image processing server 10 can recognize that the cell seldom watched.
(4) image processing server 10 reservation is compared the cell often watched and (that is, is watched number of times relatively with other cells Many cells), and leave out the view data of the cell (the viewing less cell of number of times) seldom watched.At Fig. 1 Example in, cell 2-8 is retained and the view data of other cells is deleted.Note, the cell being deleted Represent with oblique line in FIG.Then, when user sends the request for panoramic picture next time, image processing server 10 is only The view data of transmission unit lattice 2-8 is to graphic display terminal 30.In this way, the image quality of panoramic picture need not reduced In the case of, the time downloaded required for panoramic picture can be reduced.
<term>
Hereinafter, some term that this specification uses is defined.
" content " refers at least one width panoramic picture.Content can comprise the ground such as illustrating that panoramic picture is taken equally The map of point.Additionally, when panoramic picture is video image, content can comprise the image-capturing place such as representing panoramic picture Map on route.Further, content can comprise the voice data such as collected at image-capturing place.
" panoramic picture " is the image shooting substantially 360 degree of visuals field.Shoot completely however, it is noted that panoramic picture needs not to be The image in 360 degree of visuals field, if the image in shooting substantially 360 degree of visuals field.That is, panoramic picture has at least wider than normal picture Visual angle.Panoramic picture also includes the image being spliced together by the shooting of the most fish-eye wide-angle lens.Note, Embodiments of the invention are equally applicable to the image in such as 180 degree of visuals field.That is, panoramic picture be such as can be divided into many Individual subregion a kind of form of wide angle picture partly transmitted.
<registration of the panoramic picture in image processing server>
Still image and video image can be registered in image processing server 10.Image processing server 10 is noted Volume content user (hereinafter referred to as " content registration people 8 ") register rest image in the case of, content registration people 8 can by The panoramic picture of locality shooting is transferred to image processing server 10.Panoramic picture has additional positional information, image Processing server 10 can identify the image-capturing positions of panoramic picture based on this positional information.
Content registration people 8 also can register video image the most in the following manner.Note, in the following description, for convenience of solving Releasing, the people of content registration people 8 and photographing panorama picture is assumed same person.But, content registration people 8 can with pan The people of image is different.
Fig. 2 is the figure schematically illustrating the operational instances that content registration people 8 registers panoramic picture.
(1) hand-held while content registration people 8 walking can the imaging device 7 of photographing panorama picture.Imaging device 7 can be joined The distance interval shooting image being set to the most at regular intervals or fix, and store the panoramic picture and phase being taken The image-capturing positions closed.In this way, the image that the route followed along content registration people 8 is taken can be obtained.Note, The application of the present embodiment is not limited to the situation of content registration people 8 walking.In other instances, imaging device 7 can put into machine In motor-car, with video image shooting travel route etc..
(2) once content registration people 8 to reach the operation of desired destination and the full-view video image that shoots route complete Becoming, content registration people 8 is just via wireless station device 9, and such as base station or access point, the full-view video image of transmission shooting is to image Processing server 10.
(3) image processing server 10 generates content and stores the content of generation, and this content uses content registration people 8 to be abided by Follow map and the full-view video image of route.Note not having, in the situation of communication function, to set from imaging at imaging device 7 Standby 7 devices receiving full-view video image, such as smart mobile phone, full-view video image can be transferred to image processing server 10.Similarly, at imaging device 7 not used for obtaining the position detecting function of positional information of image-capturing positions, such as GPS In the situation of (Global Navigation System), the GPS of the device of such as smart mobile phone the positional information obtained such as can be attached It is added on full-view video image.
Additionally, in the example being correlated with Fig. 2 as mentioned above, it is assumed that imaging device 7 can photographing panorama picture.But, In other instances, normal imaging device can be used for shooting the image of rectangular area.Like this, such as, content registration People 8 can be by generating panoramic picture by the image mosaic of multiple rectangular areas together.
<system configuration>
Fig. 3 illustrates the exemplary configuration schematic diagram of the image display system 100 according to the present embodiment.Image display system 100 Including image processing server 10 and at least one graphic display terminal 30, they can be via network N intercommunication.
Network N such as can by the LAN in the facility of the company etc. at graphic display terminal 30 place, LAN is connected to because of The provider network of the supplier of special net and the telephone wire that provided by telecommunications operator etc. are configured.Network N can comprise because of Special net.Network N can pass through the most wired or wireless network, or wired and wireless network combination is configured.And, it is noted that Graphic display terminal 30 is directly connected in the situation of telephone wire or mobile telephone network, and graphic display terminal can not connected It is connected to provider network in the case of receiving LAN.
Image processing server 10 is the letter of the process of the data volume that can be transported panoramic picture and minimizing panoramic picture Breath processing equipment.Note, in certain embodiments, such as can provide single server for transmitting panoramic picture, and image Processing server 10 can be substantially carried out reducing the process of the data volume of panoramic picture.
Graphic display terminal 30 is the messaging device that user uses, and this equipment is as being used for downloading and watching panorama sketch The terminal unit of picture.More precisely, such as, graphic display terminal 30 can be PC (personal computer), smart mobile phone, flat board Equipment, cell phone, car navigation terminal, wearable computer (such as, head-mounted display, intelligent watch), camera, numeral are white Plate, projector, game machine, MFP (multi-function peripheral), etc..
<<hardware configuration>>
Fig. 4 illustrates the example of the hardware configuration of image processing server 10.Note, the image processing server shown in Fig. 4 The hardware configuration of 10 is not necessarily meant to be arranged in the single shell of individual equipment.In certain embodiments, such as in order to based on The suitably Resources allocation such as load, the configuration of image processing server 10 can be determined by cloud computing.
In Fig. 4, image processing server 10 includes (being only connected to CPU (CPU) 301, the ROM of bus 310 Read memorizer) 302, RAM (random access memory) 303, HDD (hard disk drive) 305, display 308, network I/F (connect Mouthful) 309, keyboard 311, mouse 312, media drive 307 and CD-ROM driver 314.CPU 301 performs to be stored in HD (hard disk) Image image processing program in 304, and control the overall operation of image processing server 10.ROM 302 stores program, such as It is used to drive the IPL (initial program importing) of CPU 301.RAM 303 is main storage means, as the working area of CPU 301. HD 304 is the storage device including nonvolatile memory.
HDD 305, under the control of CPU 301, controls reading or writing of the various data relevant to HD 304.Display (display device) 308 display various items of information, such as cursor, menu, window, text and/or image.Network I/F 309 be with The interface of network N.
Keyboard 311 and mouse 312 are input/output devices.Keyboard 311 includes for inputting letter, digital and/or various Multiple keys of instruction, and accept the various inputs by these keys.Mouse 312 such as acceptance processes the selection of object, various fingers The selection of order and execution, and the movement of mouse pointer.
Media drive 307 controls medium 306, such as flash memory, relevant data read or write (storage).CD-ROM drive Dynamic device 314 controls removable record medium, such as CD (CD) 313, reading or writing of relevant various data.
Noting, image image processing program is such as stored in calculating as the file that can install form or executable format In machine readable medium recording program performing, such as in medium 306 or CD 313, and it is allocated with this state.It addition, image image procossing journey Sequence such as can be downloaded from as any kind of messaging device of server.
Fig. 5 illustrates the hardware configuration example of graphic display terminal 30.Note, although Fig. 5 shows graphic display terminal 30 The example realized by smart mobile phone or tablet device, but the hardware configuration of graphic display terminal 30 is not limited to this example.
In Fig. 5, graphic display terminal 30 includes being connected to the CPU 201 of bus 210, ROM 202, RAM 203, flash are deposited Reservoir 204, CMOS (complementary metal oxide semiconductors (CMOS)) sensor 205, acceleration/direction sensor 206, media drive 208, audio input unit 211, audio output unit 212, communicator 213, GPS 214, display 215, touch panel 216.Bus 210 is e.g. for electrically connecting address bus or the data/address bus of said units.
CPU 201 controls the overall of graphic display terminal 30 by the program that execution is stored in flash memory 204 Operation.ROM 202 stores IPL or basic input/output procedure.RAM 203 is main storage, performs program as CPU 201 Time working area.Flash memory 204 is non-volatile memory device, for storing the journey that graphic display terminal 30 is to be performed Sequence and various data.Such as, flash memory 204 can store operating system and graphic display terminal 30 terminal journey to be performed Sequence.
Cmos sensor 205 is image-forming component, and it obtains image by the image of reference object under CPU 201 control Data.Noting, in certain embodiments, ccd sensor can replace cmos sensor 205 to be used.Acceleration/direction sensor 206 such as comprise gyro-magnetic compass function, gyro sensor and acceleration transducer for detecting earth magnetism.Media drive 208 control with such as flash memory record the relevant data of medium 207 read or write (storage).Record medium 207 is to move Dynamic storage device, can read, from record medium 207, the data that (retrieval) records it, or media drive 208 control it Under, (storage) new data can be write on record medium 207.
Audio input unit 211 is to convert the audio into the mike into audio signal.Audio output unit 212 is by audio frequency Signal is converted to the speaker of audio frequency.Communicator 213 can use antenna 213a and nearest wireless station device 9 to exchange channel radio Letter signal.It addition, communicator 213 can comprise the LAN card being connected to LAN.GPS 214 uses gps satellite or as room The IMES (indoor messaging system) of interior GPS detects and calculates positional information (latitude, longitude and the height of graphic display terminal 30 Degree).
Display (display device) 215 shows various image and object under CPU 201 controls.Such as, display 215 Panoramic picture can be shown and/or allow users to operate various menus and the icon of graphic display terminal 30.Touch panel 216 such as may be used Integrally overlap on display 215, and detect finger or the pointer touch location (coordinate) on display 215.
Terminal program can be such as to browse software or have the application software of similar functions.Such as conduct can for terminal program The file installing form or executable format is stored in computer readable recording medium storing program for performing, such as in record medium 207, and with This state is allocated.It addition, terminal program such as can from as any kind of messaging device of server by under Carry.
<functional configuration>
Hereinafter, with reference to Fig. 6, image processing server 10 and the functional configuration of graphic display terminal 30 are described.Fig. 6 is The block diagram of the functional configuration example of display image processing server 10 and graphic display terminal 30.Note, in Fig. 6, for convenience of solving Release and illustrate only a graphic display terminal 30.
<<image processing server 10>>
Image processing server 10 include communication unit 11, panoramic picture provide unit 12, viewing areas administrative unit 13, Data deletion determines unit 14, image editing unit 15 and read/write cell 19.
Noting, the function element of image processing server 10 such as can pass through the image processing server shown in Fig. 4 One or more hardware elements of 10 realize, and these elements operate based on the instruction from CPU 301, and CPU 301 holds Row is loaded into the image image processing program 1100 of RAM 303 from HD 304.
Image processing server 10 includes equally can be by least one in the HD 304 of Fig. 4, ROM 302 and RAM 303 The memory element 1000 of configuration.Memory element 1000 stores image image processing program 1100.In the following, it is described that be stored in Data base (DB) in storage unit 1000.
Content ID Content name URI Positional information
C001 Content ABC ftp://xxx.co.jp/picture/ABC.jpg (X, Y, Z)
C002 Content DEF ftp://xxx.co.jp/picture/DEF.jpg (X, Y, Z)
[table 1] panoramic picture management table
Memory element 1000 stores panoramic picture management DB 1001, and it can be by panoramic picture management table as listed in Table 1 Configure.In the panoramic picture management table that table 1 represents, have registered content name, the URI (unified resource associated with content ID Identifier) and positional information.Content ID is for uniquely identifying that the identification of the content being registered in image processing server 10 is believed Breath.In order to allow user be capable of identify that content, content name can comprise character, symbol and/or numeral.Noting, content name is not It is necessary for the unique name in image processing server 10.URI represents the storage location that content is stored or manages.Positional information Represent the image-capturing positions of the panoramic picture being included in content.Note, although positional information is really according to being included in figure As the data form of the view data in file is described in image file, but for convenience of describing, positional information shows at table 1 In.And, it is noted that in content includes the situation of video image, positional information is attached to form each frame of video image On.
Quantity=15 of content ID=C001 beholder
Cell is numbered Coordinate information Viewing number of times
1 (X, Y) (X, Y) 0
2 (X, Y) (X, Y) 2
3 (X, Y) (X, Y) 1
4 (X, Y) (X, Y) 2
[table 2] viewing areas management table
Memory element 1000 stores viewing areas management DB 1002 equally, and it can be by the viewing area shown in above table 2 Territory management table configures.In the viewing areas management table that table 2 represents, for each content of the content containing panoramic picture ID, cell numbering, coordinate information and viewing number of times are registered in table interrelatedly.Further, viewing areas management token Up to the present record has already viewed by the quantity of the beholder of content.Cell numbering is to be divided into multiple cell for identification The identification information of each separated region (cell) of the panoramic picture in region.Coordinate information is such as by the cell upper left corner Coordinate and the coordinate in the lower right corner carry out designating unit lattice.Viewing number of times is e.g. when panoramic picture becomes may be viewed by, single The number of times that unit's lattice have been watched.Noting, in certain embodiments, cell was past predetermined period (such as, 1 week, 1 month Or 1 year) in the number of times that has been watched can be registered as watching number of times.Like this, the quantity of beholder may also be in the past The quantity of the beholder of content is had already viewed by predetermined period.
The size of cell has no particular limits, and can do optimal design based on application program.Such as, cell can It is designed to 1st/10 to ten/2nds of VGA (Video Graphics Array: 480 × 640).Note, when cell is the least, because Adjustable least unit is less, so by the deletion of cell, becoming easier to reflect exactly the viewing area of user Territory.On the other hand, when cell is the least, the process load of image processing server 10 increases.Therefore, cell can be based on figure Disposal ability as processing server 10 etc. is designed.
(image processing server function)
The communication unit 11 of image processing server 10 such as can pass through the CPU shown in network I/F 309 and Fig. 4 301 The order gone out realizes.Communication unit 11 transmits to graphic display terminal 30 via network N or receives from graphic display terminal 30 Various types of data.
The content that panoramic picture provides unit 12 to will be stored in panoramic picture management DB 1001 provides image display eventually End 30.Graphic display terminal 30 such as can respond user operation and enter web, and when user select the button on website or During image, such as by sending HTTP request to image processing server 10, graphic display terminal 30 can hyperlink request to selection Button or the content of image.
Viewing areas administrative unit 13 such as can be realized by the order that the CPU 301 shown in Fig. 4 sends.Viewing areas Administrative unit 13 obtains viewing areas information from graphic display terminal 30, and is more newly stored in the viewing in viewing areas management table Number of times.Namely be based on viewing areas information, viewing areas administrative unit 13 determines the sight constituting the panoramic picture being just viewed by a user See that region, one or more cells cell is numbered, increase the viewing number of times associating storage with respective cells numbering. Note, will be described below viewing areas information.
Data deletion determines that unit 14 such as can be realized by the order from CPU 301 shown in Fig. 4.Data deletion determines Unit 14 manages table with reference to viewing areas, and determines the cell deleting the panoramic picture seldom watched.As retouched in detailed below Stating, when multiple users watch identical panoramic picture, some cell more often may be watched compared with other cells, Some other cell less may be watched compared with other cell simultaneously, thus generation unit lattice are watched number of times Difference.Therefore, data deletion determines that unit 14 can determine the cell deleting viewing number of times less than predetermined threshold.
Image editing unit 15 can such as be realized by the order from the CPU 301 shown in Fig. 4.Image editing unit 15 Delete and determined that unit 14 determines the cell to delete from panoramic picture by data deletion.Note, original panoramic picture Copy can be created deleting before one or more cells, and there is no the original panoramic images that any cell is deleted It is also stored in image processing server 10.
Read/write cell 19 such as can realize in the order by HDD 305 with from CPU 301 shown in Fig. 4.Read/write cell 19 store various data in memory element 1000, and read the various data being stored in memory element 1000.
<<graphic display terminal 30>>
Graphic display terminal 30 includes communication unit 31, image-display units 32, operation input receiving unit 33, image rotation Turn unit 34, viewing areas record unit 35 and read/write cell 39.
Noting, the function element of graphic display terminal 30 such as can be by the graphic display terminal shown in Fig. 5 One or more hardware elements realize, and these function element operate based on the order from CPU 201, and CPU 201 holds The terminal program 3100 that row is loaded into RAM 203 from flash memory 204.Further, one or more function elements can With webpage (such as, html data, the XML data and by JavaScript (registrar by transmitting from image processing server 10 Mark) program write) it is implemented rather than terminal program 3100.
Graphic display terminal 30 includes memory element 3000 equally, and this memory element 3000 can be stored by the flash in Fig. 5 At least one configuration in device 204, ROM 202 and RAM 203.Memory element 3000 stores terminal program 3100.Below In, the various data bases being arranged in memory element 3000 are described.
Still image
[table 3A] viewing areas log (still image)
Video
[table 3B] viewing areas log (video image)
[table 3C] viewing areas log (video image)
Memory element 3000 stores viewing areas record DB 3001, viewing areas record DB 3001 such as can be by such as table Viewing areas log shown in 3A-3C is configured.Table 3A shows the viewing areas note of the content for comprising panoramic picture The example of record table, this panoramic picture is still image.Content ID shown in table 3A is corresponding to including present image display terminal Content ID of the content of the panoramic picture of 30 displays.And, it is intended that two groups of coordinates of the viewing areas watched by user are (such as, The upper left corner of viewing areas and the coordinate in the lower right corner) it is recorded in table 3A.Note, although three viewing areas are recorded in table In 3A, but viewing areas log is likely not to have record viewing areas, or have recorded two, four or more viewing area Territory.Further, in this example, it is intended that two groups of coordinates of viewing areas correspond to viewing areas information (display region information).Note Meaning, but, viewing areas information may refer to determine any information of specific region.It is therefoie, for example, viewing areas information can comprise The quantity of the pixel that the coordinate at the center of viewing areas and viewing areas comprise, or viewing areas information can be viewing areas from The image of body.
Table 3B and table 3C shows the example of the viewing areas log of the content for comprising panoramic picture, this panorama sketch It seem video image.In content comprises the situation of full-view video image, two kinds of different methods (hereinafter referred to as " continuous records Method " and " recording method frame by frame ") in a kind of viewing areas that may be used for recorded content.Recording method is similar to note continuously The method of viewing areas of record still image, and relate to record and at least show (viewing) district once when video image is played Territory (table 3B).The quantity of the frame i.e., no matter comprised in video image, creates a viewing areas log for this video image. Recording method relates to the viewing areas (table 3C) recording each frame about composition video image shown (viewing) frame by frame. That is, table 3C includes the multiple viewing areas logs being assigned frame number so that the viewing areas of shown (viewing) can close It is recorded in each frame.
(graphic display terminal function)
The communication unit 31 of graphic display terminal 30 such as can be by communicator 213 with from the CPU 201 shown in Fig. 5 Order realize.Communication unit 31 transmits to image processing server 10 via network N or receives from image processing server 10 Various types of data.
Image-display units 32 such as can be realized by the order from the CPU 201 shown in Fig. 5.Image-display units 32 Showing panoramic picture on display 215, this panoramic picture is included in from the content that image processing server 10 is downloaded.
Operation input receiving unit 33 such as can realize in the order by touch panel 216 with from the CPU 201 shown in Fig. 5. Operation input receiving unit 33 accepts user and is input to the various user operations of graphic display terminal 30.Such as, operation input connects Can be from user's acceptance for changing operating of the viewing areas of panoramic picture by unit 33.Further, if full-view video image just It is viewed by a user, then except accepting the operation for changing viewing areas, operation input receiving unit 33 is the most equally Accept to be used for freezing (time-out), play and/or select the operation of frame (image-capturing positions).
Image rotation unit 34 such as can be realized by the order from the CPU 201 shown in Fig. 5.Image rotation unit 34 The panoramic picture that response user operation and rotating is shown by display 215, and it is complete to show that on display 215 user selects The viewing areas of scape image.
Viewing areas record unit 35 such as can be realized by the order from the CPU 201 shown in Fig. 5.At still image In the case of, terminate rotating panoramic image from image rotation unit 34 after predetermined period, viewing areas label Unit 35 such as can register the current coordinate of the viewing areas of display on display 215 in viewing areas record DB 3001.Note Meaning, viewing areas is not necessarily meant to mate completely with the region of display on display 215.I.e., such as can provide surplus so that see See that region can be slightly exaggerated or reduce according to requiring.
In the situation that video image is shown (viewing) and realizes continuous recording method, whenever image rotation unit 34 Changing viewing areas, the coordinate of viewing areas is just recorded.Note, like this, as recorded the viewing areas of still image Situation, viewing areas can be recorded terminating rotating panoramic image from image rotation unit 34 after predetermined period Get off.In the situation realizing the viewing areas that recording method frame by frame carrys out record video image, whenever frame is switched to another During frame, on display 215, the coordinate of the viewing areas of display is recorded.Noting, appointment is remembered by viewing areas record unit 35 The coordinate of record viewing areas in viewing areas log is sent to image processing server 10.
Read/write cell 39 such as can realize in the order by flash memory 204 with from CPU 201 shown in Fig. 5.Read/ R/w cell 39 stores various types of data in memory element 3000, and reads (retrieval) and be stored in memory element 3000 Various data.
<operating process>
Fig. 7 is the sequential chart of the operating process example showing image display system 100.The operation of Fig. 7 is by image display eventually End 30 sends content requests to image processing server 10 to start.
In step S1, the read/write cell 19 of image processing server 10 reads (inspection from panoramic picture management DB 1001 Rope) content asked, and send content to communication unit 11.
In step S2, the communication unit of communication unit 11 transferring content of image processing server 10 to graphic display terminal 30 Unit 31.In this way, graphic display terminal 30 obtains content.
In step S3, the communication unit 31 of the graphic display terminal 30 having been received by content sends the content to image and shows Unit 32.In this way, image-display units 32 shows the panoramic picture being included in content on display 215.
In step S4, user carrys out rotating panoramic image by operation graphic display terminal 30, to show on display 215 Desired viewing areas.Subsequently, image rotation unit 34 is rotated on display 215 panoramic picture of display.
In step S5, while panoramic picture is displayed on display 215, viewing areas record unit 35 monitor from Image rotation unit 34 rotating panoramic image starts whether to pass through at least predetermined period (such as, 3 seconds).That is, viewing area Territory record unit 35 judges that viewing areas has at least continuously displayed predetermined period the most on display 215.Once judge to see Seeing that region has the most at least continuously displayed predetermined period, viewing areas record unit 35 records sight in viewing areas record DB3001 See region.Noting, while user watches content, the process of step S5 is repeated (S5 ').
In step S6, when user terminates to show panoramic picture, close browser or defeated to graphic display terminal 30 clearly Entering operation when stopping watching panoramic picture, image-display units 32 (or operation input receiving unit 33) sends display and terminates letter Number to communication unit 31.
In step S7, communication unit 31 will read the viewing areas information of (retrieval) from viewing areas record DB 3001 It is transferred to image processing server 10.
Step S8, the communication unit 11 of image processing server 10 receives viewing areas information and sends viewing areas information To viewing areas administrative unit 13.
In step S9, the viewing areas information specifying viewing areas such as is converted to constitute by viewing areas administrative unit 13 One or more cells numbering of one or more cells of viewing areas, and will manage in DB 1002 with viewing areas Corresponding unit lattice numbering association storage viewing number of times add one.Further, by record viewing areas management DB 1002 in right Quantity in content viewers adds one.Noting, the information in the quantity about beholder is transmitted from graphic display terminal 30 In situation, such as, corresponding quantity can be added to record the quantity of the beholder in viewing areas management DB 1002.
In step S10, data deletion determines that unit 14 reads (retrieval) for each from viewing areas management DB 1002 The viewing number of times of cell numbering and the quantity of beholder, to determine cell to be deleted.Note, reference Fig. 8 A-9B, with Lower specific descriptions determine the process of cell to be deleted.
In step S11, data deletion determines that unit 14 sends and determines that the cell of cell to be deleted numbers figure As edit cell 15.
In step S12, image editing unit 15 deletes cell to be deleted from panoramic picture, and at panoramic picture In management DB 1001, the panoramic picture (panoramic picture of minimizing) as result has been edited in storage.
As described above, whenever user watches panoramic picture, and image processing server 10 can determine that list to be deleted Unit's lattice also delete this cell from panoramic picture, and so, image processing server 10 can only transmit in panoramic picture frequent The region watched.In this approach, the waiting time needed for user downloads panoramic picture can be reduced.Note, from panorama In image, deletion opportunity of Delete Cells is not necessarily for watching panoramic picture or whenever image processing server whenever user The when of 10 reception viewing areas information.Such as, can be after the user of some quantity has already viewed by panoramic picture, with such as every day Fixed time interval or response external once process request and perform deletion.
<<determination of cell to be deleted>>
(deletion based on viewing number of times with the ratio of the quantity of beholder determines)
Hereinafter, reference Fig. 8 A is described in step S10 of Fig. 7 and is determined that the determination that unit 14 is carried out will quilt by data deletion The process of the cell deleted.Note, although for determining that the process of cell to be deleted can be with still image and video Image is the most substantially the same, but for convenience of explanation, hereafter processes first describing the determination carried out about still image.
Fig. 8 is the form schematically illustrating the number of times that each cell of panoramic picture is watched.In Fig. 8 A, distribute to Cell integer, the value of this integer adds one from cell upper left corner the to the lower right corner successively.These integers are corresponding to the list of cell Unit's lattice numbering.Further, the numeral in the bracket that the cell numbering side of cell represents is seen corresponding to cell The number of times (viewing number of times) seen.Noting, Fig. 8 A is corresponding to viewing areas mode represented by the management different from above table 2 Table.
Fig. 9 A is the flow chart showing the example procedure being determined determination that unit 14 realizes cell to be deleted by deletion.
In step S21, data deletion determines that unit 14 reads (retrieval) beholder's from viewing areas management DB 1002 The viewing number of times of quantity and each cell.
Then, in step S22, data deletion determines that unit 14 calculates viewing number of times and beholder for each cell The ratio of quantity.Note, because whenever receiving viewing areas information from graphic display terminal 30, the quantity of beholder will add One, equally based on each cell viewing quantity and the number of times (viewing area of viewing areas information being received The quantity of the reception of domain information) calculate above-mentioned ratio.
Then, in step S23, data deletion determines that unit 14 determines to delete the above-mentioned ratio calculated less than threshold value Cell.Threshold value can be the predetermined value pre-set.Such as, in threshold value is arranged to the situation of 50%, because at Fig. 8 A The quantity of middle beholder is 15, so data deletion determines that unit 14 can determine the unit deleting viewing quantity less than or equal to 7 Lattice.In this situation, as shown in Figure 8 B, other the cell in addition to cell numbering 13-24 can be deleted.
Noting, in above-mentioned delet method, the quantity of the cell being deleted is not fixing, and according to the threshold set The viewing of value and beholder is inclined to and is changed.In other words, if threshold value is set that ground is high or the cell often watched and There is the biggest difference between the cell seldom watched, the most substantial amounts of cell may be deleted.On the other hand, if The difference of the viewing number of times that threshold value is set low or each cell is relatively small, and the most substantial amounts of cell may be retained.
Noting, threshold value is not necessarily fixing, and such as can be arranged by content registration people.Further, corresponding to sky or The region on ground such as can be processed by associated picture and be detected, and can change threshold value based on the area in the region detected.
It addition, in certain embodiments, content registration people etc. can preassign the cell do not deleted.Such as, user The region from the panoramic picture of image processing server 10 transmission initially shown over the display is determined in advance.So, At least one of cell including this region had better not be deleted.Therefore, such cell such as can be as can not The cell being deleted is registered in viewing areas management DB 1002.Equally, the cell of the image of shooting important information can It is registered as the cell that can not be deleted.Further, in certain embodiments, viewing areas record unit 35 can configure Whether the viewing areas initially shown on display 215 for record, continuously displayed regardless of this viewing areas.So, may be used Prevent from representing that one or more cells of the most shown viewing areas are deleted.
Hereinafter, describe when panoramic picture is video image, determine the process of cell to be deleted.Using Continuously in the situation of the viewing areas that recording method have recorded video image, determine the process of cell to be deleted substantially and The process carried out about still image is similar to.Noting, in this case, data deletion determines that unit 14 determines list to be deleted Unit's lattice, and the deletion from all frames constituting panoramic picture of the image editing unit 15 of image processing server 10 is to be deleted Cell.Said method is suitable in the case of the change of video image is relatively small realizing, so that major part user less may be used Viewing areas can be changed.So, the graphic display terminal 30 process load when Delete Cells can reduce.
In the situation of the viewing areas carrying out record video image in recording method the most frame by frame, determine cell to be deleted Process substantially similar with the process carried out about still image.But, in this case, data deletion determines unit 14 determine cell to be deleted for constituting each frame of panoramic picture.Then, the picture editting of image processing server 10 Unit 15 is for constituting each frame deletion cell to be deleted of panoramic picture.Note, if video image comprises essence Change, then the viewing areas of multiple users viewing such as may be change from frame to frame.Therefore, said method can provide the user by The full-view video image of frame suitably Delete Cells.
(retaining and the deletion of other cell of the cell of fixed qty)
In certain embodiments, such as by performing process as shown in Figure 9 B, data deletion determines that unit 14 can determine that The cell of fixed qty to be deleted.Note the process of step S31 of Fig. 9 B and S32 respectively with step S21 of Fig. 9 A and The process of S22 is identical.But, as described below, the process of step S33 of Fig. 9 B is different from step S23 of Fig. 9 A.
In the example of Fig. 9 B, data deletion determines that unit 14 is previously determined the quantity of cell to be deleted.Example As, data deletion determines unit 14 to can be configured so that the quantity of cell to be reduced to the half of cell sum.Such Words, in step S33, data deletion determines that unit 14 can determine to retain ratio half cell in the range of the first half (such as, 15 cells in 30 cells in the example of Fig. 8 A), and determine to delete other half cell.Note, above-mentioned In example, cell to be deleted can be determined in the case of need not be for each cell calculating ratio.That is, can pass through Determine and retain viewing number of times half cell in first half scope to obtain identical result.
Half at the sum of cell will be from the situation that the panoramic picture of Fig. 8 A is deleted, and such as, data deletion is true Cell 14 can determine the cell of stick unit lattice numbered 13-24,11,27 and 28, and determines to delete other cells, as Shown in Fig. 8 C.So it is to be understood that in the example of Fig. 9 B, the quantity of cell to be deleted is predetermined, and And similarly, the cell of fixed qty can be retained when all the time.Further, by the quantity of cell to be deleted is set Be set to relatively large number, it is possible to reduce image processing server 10 transmit panoramic picture to needed for graphic display terminal 30 time Between.Equally, by the quantity of cell to be deleted is set to relatively small number, image processing server 10 can will wrap The panoramic picture of the greater number cell likely watched containing user is transferred to graphic display terminal 30.
(deletion based on contents attribute)
Equally, in certain embodiments, if content registration people 8 attribute of registration content in viewing areas management table, Then can adjust threshold value or the quantity of cell to be deleted based on attribute.The example of contents attribute includes that content is the most corresponding The image shot out of doors or the most corresponding image in indoor shot of content.Usually, the image district on sky and road surface is represented Territory occupies the major part of the panoramic picture of photographing outdoors, and the region on these skies and road surface is unlikely watched.Cause This, in the case of Delete Cells from the panoramic picture of photographing outdoors, such as, threshold value is (for deleting less than this threshold value Cell) quantity that the quantity of relatively high or to be deleted cell can be arranged to relatively large can be set.
On the other hand, in indoor, the inside in such as apartment, the panoramic picture of shooting, some users may want to see See structure or the landscape outside window in room, and some users may want to watch ceiling or the shape on floor and color.Therefore, In the case of Delete Cells from the panoramic picture of indoor shot, such as threshold value (for deleting the cell less than threshold value) Can be set relatively low, or the quantity of cell to be deleted can be arranged to relatively small quantity.
In this way, data deletion determines that unit 14 can control according to the type of the scenery of shooting in panoramic picture With the quantity adjusting cell to be deleted.Equally, in certain embodiments, content registration people 8 can be for being registered in viewing Every content in district management table arranges threshold value or the quantity of cell to be deleted.Because content registration people 8 is permissible Which cell of precognition panoramic picture may be watched, and arranges so content registration people 8 can be such as each panoramic picture Suitable threshold value or the suitable quantity of cell to be deleted.
(deletion based on bandwidth)
Equally, in certain embodiments, data deletion determines that unit 14 can show based on image processing server 10 and image Show that the bandwidth between terminal 30 is to determine threshold value or the quantity of cell to be deleted.If that is, image processing server 10 And ensureing there are enough bandwidth between graphic display terminal 30, then image processing server 10 can be big with small delay transmission The cell of amount.Therefore, in the case, such as, threshold value can be configured to more relatively low, or by cell to be deleted Quantity is set to relatively small quantity.On the other hand, if the band between image processing server 10 and graphic display terminal 30 Wide not enough, then image processing server 10 should be arranged to transmit a small amount of cell.Therefore, in the case, such as may be used Threshold value is configured to higher or the quantity of cell to be deleted is set to bigger quantity.Note, such as can be by allowing Image processing server 10 transmits predetermined data volume to measure between image processing server 10 and graphic display terminal 30 Bandwidth.Equally, in certain embodiments, data deletion determines unit 14 such as to can be configured to from graphic display terminal 30 to obtain Whether the network information (such as, uses the information of mobile network or wired lan) about graphic display terminal 30.Data deletion is true Cell 14 can use this network information by the mode being similar to bandwidth information.That is, data deletion determines unit 14 such as Threshold value or the quantity of cell to be deleted can be adjusted based on the type of the network that graphic display terminal 30 uses.
Noting, in the example shown in Fig. 8 A-8C, the viewing number of times of cell is arranged to when cell is watched It is increased.But, in other instances, such as, when cell is not contained in the viewing areas of content, cell quilt The number of times getting rid of (not watched) can be increased.Like this, image processing server 10 can be excluded with computing unit lattice The ratio of the quantity of the number of times of (not watched) and the beholder of content, and such as, if the ratio after Ji Suaning is more than or Equal to threshold value, then delete this cell.Equally, in the case of the cell retaining fixed qty, data deletion determines unit 14 cells that such as may determine that the fixed qty being excluded minimum number, and determine to retain these unit.
<content after viewing Delete Cells>
Figure 10 show by graphic display terminal 30 realize for having shown the content deleting one or more cells ( The content of experience cell delete processing) the flow chart of example procedure.The process of Figure 10 can receive at graphic display terminal 30 Start during content to be shown.Noting, graphic display terminal such as can pass through the process of step S1 and S2 that are similar to Fig. 7 and connect Receive content.
(still image)
Hereinafter, for the sake of explaining conveniently, first describing display panoramic picture is the process of still image.
When the communication unit 31 of graphic display terminal 30 receives content, image-display units 32 is aobvious on display 215 Show the panoramic picture (step S41) being included in content.
Secondly, operation input receiving unit 33 judges to be used for rotating the image rotation behaviour of image (changing currently viewing region) Make the most to be transfused to (step S42).(no in step S42), then panorama sketch it is transfused to without image rotation operation The display of picture continues.
If image rotation operation is transfused to (being in S42), then image-display units 32 judges the rotation of panoramic picture Whether the view data turning target area can use (step S43).Because image-display units 32 can identify rotation to be shown Target area (that is, response image rotation process, the viewing areas that will show on display 215), so image-display units 32 can be determined that whether all images data in rolling target region are comprised in the panorama received from image processing server 10 In image.
If the view data in rolling target region is judged as can use (no in step S43), then image-display units The 32 corresponding view data (steps showing the rolling target region retrieved from memory element 3000 on display 215 S46)。
If the view data in rolling target region is judged as unavailable (being in step S43), then operation input connects Judged whether user has been carried out specifically operating (step S44) by unit 33.Specific operation refers to user and inputs behaviour Explicitly indicate that user expects to watch one or more cell being deleted.Noting, user may know in advance will The specific operation carried out or the specific operation that will be carried out may in the way of not hindering the display (viewing) of panoramic picture quilt Display is on display 215.Such as, specific operation can relate to the image rotation carrying out at least certain number of times within certain period Operation (such as, within one second more than 3 times).
If user has been carried out specifically operating (being in step S44), then image-display units 32 will be used for panorama The request of the residual image data of image is sent to image processing server 10 (step S45).That is, image-display units 32 is asked Image processing server 10 sends the cell being deleted from panoramic picture.Note, in some situation, only can be from The cell being deleted is asked user attempt the cell of viewing, and in other cases, can ask all the most deleted Cell.In any situation, image processing server 10 transmission and user attempt the region of viewing view data and Information.In this way, graphic display terminal 30 can promptly show the region of panoramic picture that user will watch.Because Image processing server 10 can clearly identify the cell being deleted, so image processing server 10 can be from storage Retrieval in original panoramic images (not having the complete panoramic picture that any cell is deleted) in image processing server 10 The cell being deleted, and transmit the cell being deleted retrieved to graphic display terminal 30.Then, image display is single The cell received from image processing server 10 and the panoramic picture received the most in advance are combined by unit 32, rebuild Single panoramic picture, and on display 215, show the district as desirable viewing area that user specifies through specific operation The image in territory.Noting, in certain embodiments, image-display units 32 can send complete with requested image processing server 10 Panoramic picture.
In this way, even if when graphic display terminal 30 receives the panoramic picture that one or more cell is deleted, User still is able to show any region of panoramic picture on display 215.
And noting, the viewing areas that the user of display is to have been watched on display 215 is as viewing areas information quilt It is transferred to image processing server 10.In this way, such as can the viewing time in viewing areas management table of the more new record Number, and determine that process determines new cell to be deleted by cell as above deletion.
(video image)
In the following, it is described that display panoramic picture is the process of video image.This process and the place showing still image The similar part of reason is, graphic display terminal 30 detects specific operation, and (such as, user carries out the most certain within certain period The image rotation operation of number of times) as the display request of the one or more cells being deleted. note, remember continuously using In the situation of the viewing areas that recording method records full-view video image, about each frame of composition full-view video image, identical Cell be deleted, same, the process of detection specific operation can be substantially similar to the process that carries out about still image.
On the other hand, using recording method frame by frame in the situation recording the viewing areas of full-view video image, deleted The cell removed changes according to each frame.It is therefoie, for example, to specific operation (such as, carry out within certain period a number of Image rotation operates) when being detected, graphic display terminal 30 may play the next frame of (display) video image.Cause This, in this case, such as, image-display units 32 can and in step S42 the operation of first image rotation tested When measuring, the frame of display, judges whether the view data in rolling target region can be used.In this way, can accurately determine Requested view data (is equivalent to user and attempts the region of viewing).Further, in certain embodiments, can be based on specific The frame of display when operation is detected (such as, after having carried out the image rotation operation of certain number of times within certain period), Identify over several frame shown, and whether image-display units 32 can be determined that the view data in rolling target region The most unavailable to even in several frames.If view data is the most unavailable, then to even in identified frame Image-display units 32 can be arranged to receive the cell deleted from image processing server 10.Such arrangement is for display It is preferable for video image.That is, because video playback relates to showing the most continuously frame, if so rolling target region View data the most unavailable to even in several frames, then this be likely to damage user viewing experience.
Note no matter use continuous recording method recording method the most frame by frame, such as, graphic display terminal 30 can be arranged to ask Panoramic image frame after asking image processing server 10 to be sent in current shown frame (has the most been deleted cell or has not had There is the complete panoramic image frame that any cell is deleted).In this way, user can be with substantially static with viewing panorama The mode that image is identical watches full-view video image.
As it has been described above, in the image display system 100 according to the present embodiment, based on the viewing shown by multiple users The statistical information that region (viewing area) is relevant, deletes the cell most unlikely watched.In this way, may be by user A part for the panoramic picture of viewing can be transferred to graphic display terminal 30.Therefore, it can reduce transmission panoramic picture The transmission time, and user unlikely experience download panoramic picture used the long time.
[the second embodiment]
In the following, it is described that image display system 100 according to the second embodiment of the present invention.According to the second embodiment Image processing system 100 in, when content includes full-view video image, by deleting the image corresponding with sky and ground The data volume of full-view video image is reduced in region so that the download time of full-view video image is reduced.
Figure 11 is to illustrate that the image processing server 10 of the image display system 100 according to the present embodiment and image display are whole The block diagram of the functional configuration example of end 30.Note, basic and the feature that shown in Fig. 6, those are identical and the element shown in Figure 11 It is given identical reference number symbol, and their explanation can be omitted.Following description relates generally to the present embodiment with upper State the feature that first embodiment is different.
In the present embodiment, image processing server 10 does not has to record the sight of the panoramic picture watched by multiple users See region.Therefore, image processing server 10 and graphic display terminal 30 according to the present embodiment need not comprise and record viewing The function that region is relevant.Additionally, determine that the data that unit 14 has with first embodiment are deleted according to the data deletion of the present embodiment Except determining the functional character that unit 14 is different.
<data deletion determines>
Data deletion according to the present embodiment determines that unit 14 is from the panorama sketch being stored in panoramic picture management DB 1001 The video image of shooting when content registration people 8 moves in the direction of movement is identified in Xiang.At panoramic picture corresponding in movement In the situation of the video image of shooting, represent that the region of the image on sky and ground is unlikely to cause the interest of beholder, because of This, in the present embodiment, will delete corresponding sky and image-region (hereinafter referred to as " sky areas " and " the ground district on ground Territory ").Noting, in moving, the video image of shooting can follow the trail of the position of the frame constituting video image by the order according to frame Information (such as, longitude and latitude) is detected.I.e., such as, if the location information indicate that the image-capturing positions of video image Little by little with linear or curve movement, then video image can recognize that as shooting in movement.
Figure 12 is the figure explaining data deletion scope.In Figure 12, it is shown that three continuous print frames.Imaging device 7 includes inspection Survey the imaging device 7 acceleration transducer relative to the inclination on ground.Imaging device 7 is by slant correction so that be taken The vertical direction of panoramic picture can be perpendicular to ground.Therefore it is presumed that X-direction represents the horizontal direction of panoramic picture, Y in Figure 12 Direction represents the vertical direction of panoramic picture, shoots sky in the region that Y-coordinate value is little, and in the region that Y-coordinate value is big Shooting ground.It is therefoie, for example, sky areas 51 may occupy the 10-of the height from the panoramic picture that Y-coordinate value is zero beginning 15%, and ground region 52 may occupy the 10-15% from the height that Y-coordinate value is the panoramic picture that its maximum starts.
Noting, the width of sky areas 51 and ground region 52 is not required as constant, likewise it is possible to by image Reason detects sky areas 51 and ground region 52.Such as, sky areas 51 may be sky color (pale blue, blueness, Lycoperdon polymorphum Vitt, White etc.), and comprise little sharpened edge.It is therefoie, for example, by detecting the color of each intended pixel block and can incite somebody to action Block of pixels in continuous print sky color is identified as the candidate of sky areas 51, detects sky areas 51.Further, by detection Higher than the sharpened edge of predetermined value in each block of pixels, and marginal density is identified as sky less than the contiguous pixels block of predetermined value The candidate in region 51, can calculate the marginal density of each intended pixel block.Then, two candidates based on sky areas 51, Intersecting or gathering of two candidates can be identified as sky areas 51.
Note, such as, for detecting the image procossing that the ground region 52 photographing road surface can carry out being similar to.But, In the situation of detection road image, for example, it is possible to detection road color (Lycoperdon polymorphum Vitt, brown etc.) rather than sky color.On the same day Empty situation is the same, and road generally includes little sharpened edge.But, road such as may comprise white line or kerb.? This respect, such as, in the candidate of detection ground region 52, even if detecting edge, when determining this edge in block of pixels When being straight line, this is likely to represent a line on road or kerb, and similarly, this block of pixels can be considered as still ground district The candidate in territory 52.Note, use suitable technology, such as Hough transformation, straight line can be detected,.
In this way, such as, as shown in figure 12, the part of top 10% height of panoramic picture can be identified as sky Dummy section 51, and the part of the bottom 15% of panoramic picture height can be identified as ground region 52.Therefore, data deletion is true Cell 14 may decide that deletes identified sky areas 51 and ground region 52 from panoramic picture.
Figure 13 is to illustrate that the data deletion according to the present embodiment determines that unit 14 deletes sky areas 51 He from panoramic picture The flow chart of the example procedure of ground region 52.Note, the process of Figure 13 can in the figure 7 shown in the data deletion of step S10 true Fixed process starts when starting.
In step S51, read/write cell 19 reads (retrieval) from panoramic picture management DB 1001 and includes panoramic picture Content.
Then, in step S52, data deletion determines that panoramic picture that unit 14 judges to retrieve is whether as video figure Picture.Note, such as, if it is indicated that the information whether panoramic picture is video image or still image is attached to be stored in panorama In the content of image management DB 1001, then can arrange read-write cell 19 retrieval content containing video image.If panorama sketch As being not video image, then process terminates.
If panoramic picture is video image (being in step S52), then processes and proceed to step S53, delete in these data Except determining that unit 14 judges that this panoramic picture is whether as photographing in movement.If panoramic picture is not yet clapped in movement Take the photograph, then process terminates.
If panoramic picture is photographed (being in step S53) in movement, then processes and proceed to step S54, This data deletion determines that unit 14 detects the sky areas 51 of this panoramic picture and ground region 52 and determines from panoramic picture Delete the sky areas 51 and ground region 52 detected.
As it has been described above, in the image display system 100 according to the present embodiment, when panoramic picture shoots in movement During video image, sky areas 51 and the ground region 52 unlikely watched in panoramic picture are deleted, and more likely The panoramic picture watched is having the preferentially transmitted.
[the 3rd embodiment]
In the following, it is described that image display system 100 according to the third embodiment of the invention.According to the present embodiment In image processing system 100, when the full-view video image of shooting during content includes moving, contrary with moving direction by deleting Region reduce the data volume of full-view video image, in order to reduce the download time of full-view video image.
Note, according to image processing server 10 and the graphic display terminal 30 of the image display system 100 of the present embodiment Functional configuration substantially identical with the second embodiment shown in Figure 11.But, in the present embodiment, data deletion is true Cell 14 has and determines, from the data deletion of the second embodiment, the functional character that unit 14 is different.
Hereinafter, determine the functional character of unit 14 according to the data deletion of the present embodiment with reference to Figure 14 description.Figure 14 It it is the figure of the image-capturing positions schematically showing multiple panoramic picture 41-43.Such as, at panoramic picture 41,42 and more than 43 State and enumerate in the situation that order is taken, can detect in Figure 14 such as the moving direction 44 of arrow instruction.Note, such as, side Position information (such as north, south, east and west) can be affixed to panoramic picture, and can detect movement based on this azimuth information Direction 44.Hereinafter, for the sake of explaining conveniently, the direction pointing to north on the plane of reference be parallel to ground is arranged to 0 degree As reference direction, and represent moving direction 44 from the positive-angle of reference direction measured clockwise.
As a example by panoramic picture 41, the moving direction 44 of panoramic picture 41 is about 315 degree, and relative to moving direction 44 Rightabout be about 135 degree.Therefore.Data deletion determines that unit 14 can be by the predetermined angular from 135 degree Angular range is defined as the rear scope 45 of panoramic picture 41.Such as, if predetermined angular is 45 degree, then rear scope 45 is permissible It it is the angular range between 90 degree and 180 degree.Then data deletion determines that unit 14 determines after panoramic picture 41 deletes this Side's scope 45.Noting, the rear scope 45 of panoramic picture 42 and 43 can be deleted in a similar manner.
Figure 15 illustrates the example deleting the rear scope 45 contrary with moving direction 44 from panoramic picture.Shown in Figure 15 three Individual successive frame.Above with reference to described in Figure 14, data deletion determine each from three frames of rear scope 45 that unit 14 identifies It is deleted in individual.Noting, in the example of Figure 15, the rear scope 45 will deleted from each frame is identical.As at this In individual example, when moving direction 44, in can being considered as substantially the same scope, (such as, the change of moving direction 44 be 10 Within degree) time, rear scope 45 to be deleted can keep identical.
Figure 16 is to illustrate to be determined that what unit 14 realized deletes relative to moving direction from panoramic picture by data deletion The flow chart of the process instance of the rear scope 45 on the rightabout of 44.Noting, the process of step S61-S63 of Figure 16 is basic Upper identical with the process of step S51-S53 of Figure 13.Therefore, the process of step S64 is below described.
In step S64, data deletion determines that unit 14 determines to delete on the rightabout relative to moving direction 44 Rear scope 45.
As it has been described above, in the image display system 100 according to the present embodiment, when panoramic picture shoots in movement During video image, the rear scope 45 can not watched in panoramic picture is deleted, and the panorama around moving direction 44 Image is having the preferentially transmitted.
Noting, such as, the present embodiment also can realize with the second embodiment combination.I.e., such as, deleting from panoramic picture After rear scope 45, it is also possible to delete sky areas 51 and ground region 52 from consequent panoramic picture.With this Method, the data volume of the panoramic picture that will be transferred to graphic display terminal 30 from image processing server 10 can be by further Ground reduces.
[the 4th embodiment]
In the following, it is described that image display system 100 according to the fourth embodiment of the invention.According to the present embodiment In image processing system 100, in content includes moving in the situation of the full-view video image of shooting, by deleting with panorama sketch The data volume of panoramic picture is reduced in region outside the visual field (FOV) region of the surrounding centered by the moving direction of picture, thus Reduce the download time of panoramic picture.
Note, according to image processing server 10 and the graphic display terminal 30 of the image display system 100 of the present embodiment Functional configuration substantially identical with the second embodiment shown in Figure 11.But, in the present embodiment, data deletion determines list Unit 14 has the data deletion from the second embodiment and the 3rd embodiment and determines the functional character that unit 14 is different.As described above for Three embodiments are described in reference diagram 14, and data deletion determines that unit 14 can determine that the content registration people 8 of photographing panorama picture (uses Family) moving direction 44.After data deletion determines that unit 14 determines moving direction 44, data deletion determines that unit 14 will be with (such as, in longitudinal, from moving direction 44 ,-30 degree and+30 are spent in certain region of surrounding centered by moving direction 44 Between scope and on latitude direction from the plane of reference of moving direction 44-30 degree with+30 degree between scope) identify conduct The visual field (FOV) region of user (content registration people 8).In the example of Figure 14, from the center of the spheroid representing panoramic picture 41 The direction starting 315 degree is confirmed as moving direction 44.This direction is corresponding to longitudinal, and FOV region is on latitude direction The scope between+30 degree can be spent from the moving direction 44 of 315 degree-30.Further, on latitude direction, FOV region can be From the road surface (plane of reference) at the moving direction 44 of 315 degree, the scope between-30 degree and+30 degree (that is, is perpendicular to the side on road surface To).In the present embodiment, data deletion determines that unit 14 identifies this FOV region, and determines in deletion panoramic picture except Region outside the FOV region identified.
Figure 17 illustrates the example in the FOV region 53 of panoramic picture.In Figure 17, it is shown that three continuous print frames.Data deletion is true Cell 14 can identify the FOV region 53 of each frame, and determines to be deleted from panoramic picture in addition to FOV region 53 The region removed.
Figure 18 is to be shown through data deletion to determine that what unit 14 realized deletes except area of visual field 53 from panoramic picture Outside the flow chart of process instance in region.Note, the process of step S71-S73 of Figure 18 can substantially with the step of Figure 13 The process of S51-S53 is identical.Hereinafter, the process of step S74 of Figure 18 is described.
In step S74, data deletion determines that unit 14 identifies FOV region 53, and determine to delete from panoramic picture except Region beyond FOV region 53.
Therefore, according in the image display system 100 of the present embodiment, the field of vision only likely watched in panoramic picture Territory is retained so that panoramic picture can be transmitted efficiently.
[the 5th embodiment]
In the following, it is described that image display system 100 according to the fifth embodiment of the invention.Figure according to the present embodiment Allow users to As time goes on as display system 100 and monitor or watch the panoramic picture shot by imaging device 7, should Imaging device 7 is fixed on suitable place within least certain period.Use and be fixed on suitable local imaging device Observational technique is referred to as " fixed point observation ".Although imaging device 7 typically can be held by a user photographing panorama picture, but imaging device 7 also such as are used as being mounted between floors or the fixed point video camera of open air.
Figure 19 illustrates the building layout example together with the arrangement of imaging device 7.Such as, by being arranged in as shown in figure 19 As device 7, imaging device 7 can be used for the behavior analysis of consumer in the enterprise of shop or other type.Such as, install Imaging device 7 in shop/enterprise can regular photographing panorama picture, and the panoramic picture photographed is stored in image procossing Server 10.In this way, the user (such as, store manager) implementing behavior analysis can be from image processing server 10 Receive the panoramic picture as time series data.Therefore, user can analyze and access the consumer in shop and how to buy and (or do not purchase Buy) article, how office worker looks after consumer, etc..User the most such as can be with the analysis knot in exploitation sales planning etc. Really.
User such as store manager uses in the situation of the seasonal effect in time series panoramic picture of fixed point shooting, divide The viewing point of analysis is limited.Additionally, also there is the demand fixing viewing point can being analyzed.In this respect, such as, can lead to Cross the viewing number of times of each cell above in conjunction with the record panoramic picture described in first embodiment and store viewing often Cell, be capable of fixed point analysis.
On the other hand, viewing point to be analyzed such as can be according to the duty of the store manager (user) analyzing panoramic picture Position type and/or responsibility and change.In this respect, such as in order to provide shooting with every based on his/her position and responsibility The panoramic picture of individual user-dependent viewing point range, image processing server 10 can be configured to storage and manages each user's phase The viewing areas management table closed.
Additionally, viewing point to be analyzed such as can change according to time slot, before e.g. doing business in time slot, During business, close after, during rush hour and during the off-peak hours.In this respect, such as, in order to analyze each Time slot, image processing server 10 can be configured to store the viewing areas letter relevant with each time slot with management Breath.
Note, according to image processing server 10 and the graphic display terminal 30 of the image display system 100 of the present embodiment Functional configuration can be substantially identical with those of the first embodiment shown in Fig. 6.Further, show according to the image of the present embodiment Show that the overall operation process of system 100 is substantially similar with the operating process shown in Fig. 7.
<viewing areas for different time gap manages>
Hereinafter, with reference to Figure 20, the viewing that the user in the panoramic picture being included in imaging device 7 shooting watches is described Region 5.Figure 20 illustrates the example of the viewing screen 501 that user shows on graphic display terminal 30.Viewing screen 501 includes that layout is led Territory 502 and video field 503.The layout field 502 of Figure 20 shows the layout shown in Figure 19, and allows users to select to clap Take the photograph the imaging device 7 of user's panoramic picture to be watched.Noting, such as, the imaging device 7 being easily selected by a user can be by arrow 502a indicates.Video field 503 shows the panoramic picture that selected imaging device 7 shoots.More specifically, video field The viewing areas 5 of 503 display panoramic pictures.
As shown in figure 20, the viewing areas 5 that user watched is by XY coordinate identification.When user inputs change viewing areas 5 operation time, operation input receiving unit 33 accept this user operation, then image rotation unit 34 rotating panoramic image. Viewing areas record unit 35 records the viewing areas 5 of the panoramic picture the most at least continuously displaying certain period.
Noting, in the present embodiment, the image capturing time information of panoramic picture is attached to panoramic picture.Therefore, example As, based on image capturing time information, the viewing areas record unit 35 of graphic display terminal 30 can time of every 30 minutes The viewing areas information of gap record viewing areas 5.Then the viewing areas information in different time gap is transferred at image Reason server 10.In this way, such as each time slot can be stored and be managed the viewing time of each cell Number.
Note, in the present embodiment, image processing server 10 can realize substantially with first embodiment in realize That identical data deletion determines process.But, in the present embodiment, between data deletion determines that unit 14 is for each time Gap determines data to be deleted.
<<record viewing number of times>>
Figure 21 is to be shown through the viewing recording each cell time that the image processing server 10 of the present embodiment realizes The flow chart of the process instance of number.Note, the process of Figure 21 can be performed for each imaging device 7.Further, whenever viewing area Domain information is transferred to perform during image processing server 10 process of Figure 21.
Such as, the viewing areas information in content ID and different time gap can be transferred to image by graphic display terminal 30 Processing server 10.Subsequently, in step S81, the communication unit 11 of image processing server 10 receives viewing areas information.Note Meaning, if content includes still image, then the viewing areas record unit 35 of graphic display terminal 30 can be based on static map The image capturing time information of picture determines the allocated time slot of viewing areas information.Additionally, graphic display terminal 30 can To transmit image capturing time information and viewing areas information to image processing server 10.Note, in previously described enforcement In example, continuous recording method or frame by frame recording method are used to the viewing areas of record video image.In the present embodiment, at least For each time slot, record the viewing number of times of each cell.Such as, the viewing areas label of graphic display terminal 30 Unit 35 image capturing time information based on each frame can determine the allocated time slot of each frame constituting video image, And the viewing areas information of transmitting video image and time slot information.
Then, in step S82, between the viewing areas administrative unit 13 of image processing server 10 is for the different time Gap calculates each cell viewing number of times.Namely be based on the viewing areas information in different time gap, viewing areas administrative unit 13 The viewing areas information of the viewing areas 5 of each time slot being converted to represent, the cell of the cell of viewing areas 5 is compiled Number.
Then, in step S83, viewing areas administrative unit 13 will record at viewing areas pipe for each time slot The viewing number of times of the correlation unit lattice numbering in reason data base 1002 adds one.Record is being seen by viewing areas administrative unit 13 equally See that the quantity of the beholder in district management data base 1002 adds one.In this way, relative to each time slot, Mei Gedan The viewing number of times of unit's lattice can be recorded.
<<viewing areas management table>>
In the following, it is described that according to the viewing area storing and managing in viewing areas management DB 1002 of the present embodiment The example of territory management table.
[table 4A] viewing areas management table
Above-mentioned table 4A schematically illustrates the example of the viewing areas management table according to the present embodiment.Note, shown in table 4A Viewing areas management table is to create for each imaging device 7.And, it is noted that following description relates generally to the viewing areas of table 4A The feature that management table is different from table 2.In the present embodiment, viewing areas management table such as can for each 30 minutes time Between gap (time interval) and be created.Noting, time slot also can be divided into one hour, several hours or even longer one section Time.Further, distinctive time slot, shop, the such as a few hours before business, a few hours after business, noon can such as be limited Meal time, certain evening hours and a few hours after closing.
Further, the viewing areas administrative unit 13 of image processing server 10 such as can calendar based on panoramic picture and day Phase/temporal information determines the panoramic picture what day imaging device 7 shoot at.In this way, as shown in table 4B, can be right Create viewing areas management table the every day of Yu Yizhou.
[table 4B] viewing areas management table
Above-mentioned table 4B is shown as the example of the viewing areas management table of establishment every day of a week.Based on above-mentioned information, such as, Wishing according to what day user in the situation monitoring zones of different, image processing server 10 can suitably determine will quilt The cell deleted.
Additionally, for example, it is possible to be applied in combination table 4A and table 4B to create for storing the every of each time slot and a week It viewing areas management table.It addition, viewing areas management table such as can be (such as, sunny, many according to different weather conditions Cloud, rainfall, snowfall, etc.) be created.
<<cell is deleted and is determined>>
Figure 22 is to be shown through the cell that determination that the data deletion of the present embodiment determines that unit 14 realizes is to be deleted The flow chart of process instance.Note, below describe and relate generally to process steps different from the process step of Fig. 9 A in Figure 22. And, it is noted that for each imaging device 7, the process of Figure 22 is all carried out.
In step S91, the data deletion of the present embodiment determines that unit 14 reads (inspection from viewing areas management DB 1002 Rope) different time gap each cell beholder quantity and viewing number of times.Noting, the process of step S92 can be basic Upper identical with the process of the step 22 of Fig. 9 A.
Then, in step S93, data deletion determines that unit 14 identifies viewing number of times and viewing for each time slot The ratio of person's quantity is less than the cell of threshold value, and determines to delete this cell from panoramic picture.Image editing unit 15 The image capturing time information of reference panorama image determines relevant time slot, and delete step S93 from panoramic picture The cell of middle identification.In this way, it is for instance possible to obtain delete for different time gap in the video of different units lattice Hold.I.e., in the present embodiment, such as, according to deleting difference from a video content to the image capturing time of framing Cell.In the situation of still image, cell to be deleted can come really by image capturing time based on still image Fixed.
Note, although have described that the process of Figure 22 with reference to Fig. 9 A, but the tool relating to retaining fixed qty as shown in Figure 9 B The cell having the cell than other cells more height ratio is deleted and is determined that method such as can apply to the present embodiment.
By deleting different cells as described for each time slot, can subtract based on allocated time slot There is the size of the panoramic picture (still image or video image) of big data quantity less so that frequent quilt in allocated time slot The region of viewing can be transferred to graphic display terminal 30.In this way, user can be complete almost without lingeringly watching Desired region in scape image.
And, it is noted that creating viewing areas management table even for each time slot, data deletion determines unit 14 Such as can also assemble the viewing areas management table in different time gap, to determine one or more cell to be deleted. In this way, if user to given area be interested in, even if given area preset time gap be not viewed by a user, also It is possible to prevent the deletion of the cell corresponding to this region.In order to realize this process, user such as can operate image and show Terminal 30, to send association requests to image processing server 10.
<viewing areas for different user manages>
As it has been described above, region interesting in panoramic picture often can change according to each user.Such as, if user The desired region being allowed to select in panoramic picture as viewing areas, then can create the management of user's specific viewing areas Table.
Figure 23 illustrates to allow users to the user interface specifying the desired region in panoramic picture as viewing areas Example.The user interface of Figure 23 includes viewing screen 501 ', viewing screen 501 ' display and the base of display in the viewing screen 501 of Figure 20 Information similar in basis.Viewing screen 501 ' display layout field 502 ', video field 503 ', registration button 505 and cancel button 506.Such as, video field 503 display includes the content of panoramic picture that user obtains from image processing server 10.Operate defeated Enter receiving unit 33 and accept the user operation of user's input via touch panel 216.In this way, user can operate, all Panoramic picture as shown in rotate, amplify and/or reduce in video field 503 '.Further, user can be via touch panel 216 Specify any desired region (such as, user wishes the region of monitoring) in panoramic picture, to create arbitrary viewing areas 504.When arbitrary viewing areas 504 is displayed on video field 503 ' and user presses registration button 505, including seeing See that the arbitrary viewing areas information of the coordinate information in region 504 and the ID of user can be transferred to image processing services Device 10.ID is the customer identification information uniquely identifying user.Noting, ID is referred to as " user profile " or " uses The specific information in family ", and can be any kind of information that can identify user.The instantiation of this information include but It is not limited to, employee number, name, e-mail address, etc..
Image processing server 10 such as can identify ID by requiring that user logs in before viewing panoramic picture. Additionally, user can only key in his/her ID in graphic display terminal 30, and then graphic display terminal 30 is permissible Transmission ID and any viewing areas information are to image processing server 10.
As it has been described above, user can register any desired region via user interface, such as user wishes the district of monitoring Territory, as arbitrary viewing areas 504.Because arbitrary viewing areas 504 is clearly arbitrarily designated by user, so user Interesting view data can be easily identified, and unessential view data of getting on very well user then can be deleted.
Note, in this example, create viewing areas management table for each user.And, it is noted that when registration arbitrarily viewing During region 504, one or more cells corresponding to any viewing areas 504 will be considered in image processing server 10 Have already viewed by once, and the viewing number of times of the cell of correspondence may be recorded in viewing areas management DB 1002.Additionally, When user registers identical or different any viewing areas 504 again, and any viewing areas 504 overlap of earlier registration The viewing number of times of cell is added one.
When the viewing areas management table of panoramic picture is created, image editing unit 15 can edit panoramic picture (that is, Delete Cells).But, creating panoramic picture feelings after the minimizing of cell delete processing for each user In shape, it may be required a large amount of memory spaces of memory element 1000.Therefore, when receiving viewing requirement from graphic display terminal 30 Time, panoramic picture can be edited.Such as, when user provides ID request viewing content-data to image processing server 10, Image editing unit 15 can manage table, Delete Cells from content-data by viewing areas based on this user.With this Method, graphic display terminal 30 can receive and show the region that this specific user may watch.
In the example of Figure 23 described above, the desired regional registration of panoramic picture can be arbitrarily viewing by user Region 504, and any viewing areas information of any viewing areas 504 that image processing server 10 is registered based on user, Viewing areas management table is created for each user.But, the sight that image processing server 10 such as can be watched based on user See the viewing areas information in region 5, create viewing areas management table for each user similarly, as having with first embodiment above As the description closed.That is, by making graphic display terminal 30 that together with viewing areas information, the ID of user is transferred to image Processing server 10, image processing server 10 can register any viewing areas 504 to be similar to user via user interface Mode, creates viewing areas management table for each user.
<<cell is deleted and is determined>>
Figure 24 A be shown through determination that data deletion determines that unit 14 realizes about each user determine will be from panorama The flow chart of the process instance of the cell deleted in image.The process of Figure 24 A is to register via user interface based on user Any viewing areas 504 any viewing areas information and be that each user creates in the case of viewing areas management table by reality Existing.
In step S101, the data deletion of the present embodiment determines that unit 14 identifies and from graphic display terminal 30 transmission The viewing areas management table of ID association.
Then, in step S102, data deletion determines that unit 14 determines to delete the viewing number of times cell less than (i.e., Viewing number of times is the cell of zero).That is, as it has been described above, transmit (registration) as user to specify any sight of any viewing areas 504 When seeing area information, manage in table at the viewing areas for this user, represent the sight of the cell of any viewing areas 504 See and be at least arranged to one.Any viewing areas 504 that user specifies will be continuously this user and show, similarly, data are deleted Except determining that unit 14 may decide that other cells (that is, viewing number of times is the cell of zero) deleting viewing number of times less than.
Figure 24 B is the viewing areas information being shown in viewing areas 5 based on user's viewing, creates viewing for each user In the case of district management table, determined the process instance of determination that unit 14 realizes cell to be deleted by data deletion Flow chart.
Noting, step S111 of Figure 24 B processes identical with step S101 of Figure 24 A, and step S112 and the place of S113 Manage identical with step S22 of Fig. 9 A and S23 respectively.Note, but, step 112 is used for the quantity of the beholder of calculating ratio Be equivalent to same subscriber and watch the number of times of identical content.
As it has been described above, by by the viewing areas information of specific for each user viewing areas 5 or any viewing areas 504 Any viewing areas information be transferred to image processing server 10, graphic display terminal 30 such as can be according to his/her duty Position and responsibility, show the region of the panoramic picture relevant with each specific user.
Note, in certain embodiments, determine the unit to be deleted from the panoramic picture of certain imaging device 7 shooting During lattice, the such as data deletion of image processing server 10 determines that unit 14 may be arranged to be based upon except corresponding and current User outside the user of beholder creates viewing areas management table, determines one or more cell to be deleted.That is, Such as when user is transferred to new shop etc., data deletion can be arranged to determine, and unit 14 is based on the previous viewing of user History carrys out Delete Cells.In this way, such as can simplify adapter operation, and personnel's variation can smoothly realize. Further, such as this for each specific user storage and the viewing areas management table of management, image display system in order to effectively utilize The ID associated with given viewing areas management table can be changed into another of another user of identification by the manager of system 100 Individual ID (such as, the example of shop successor described above).
<content after viewing cell deletion>
As above with reference to Figure 10, in the situation deleting one or more cells from panoramic picture (content) In, the cell deleted from panoramic picture (such as, can be entered by the specific operation that detection user is carried out in a specified time The row operation of image rotation several times) and be resumed.Hereinafter, this specific operation be will be described in further detail.
Figure 25 A-25C is stored in the panorama sketch of registration in the viewing areas management table in viewing areas management DB 1002 The viewing areas of picture or the schematic top plan view of any viewing areas.Note, in Figure 25 A-25C, the viewing number of times registered (see See in district management table) more than or equal to threshold value cell formed region be represented as registration viewing areas A and B. That is, the cell in addition to the cell of region A and B corresponding to registration is deleted.Noting, image editing unit 15 is permissible A Delete Cells from panoramic picture in two methods, two methods is used to be referred to as method I and method II, following institute State.
Method I relates to actual elimination cell in addition to the cell of viewing areas A and B corresponding to registration.This If sample, panoramic picture can be divided and sign up to view region A and B is respectively displayed in image as individual images shows In terminal 30.Figure 25 B is depicted schematically in how viewing areas A and B in this case registered is displayed on image display eventually On end 30.That is, when user's Rotation screen while sign up to view region A is shown, screen can be immediately switched to display Sign up to view region B.Similarly, when user's Rotation screen while sign up to view region B is shown, screen can be immediately It is switched to show sign up to view region A.In other words, deleted cell is completely eliminated.
Method II relates to the cell in addition to the cell of viewing areas A and B of registration is replaced with black picture element Etc..Like this, panoramic picture and black picture element including sign up to view region A and B may be displayed on graphic display terminal On 30.Figure 25 C is depicted schematically in how sign up to view region A and B in this case is displayed on graphic display terminal 30. More specifically, in Figure 25 C, the region of the panoramic picture in square frame 510 is displayed on graphic display terminal 30.When with Family during Rotation screen, can show sign up to view district while sign up to view region A is shown after black picture element is shown Territory B.Identical mode is applicable to from sign up to view region B switching display sign up to view region A.That is, user can not show Sign up to view region A and B is alternately shown in the case of black picture element.
In the case of using method I, although sign up to view region A and B can show immediately, but user is determined In panoramic picture, the place of sign up to view region A and B there may be difficulty.In the case of using method II, user can hold Change places and determine the place of sign up to view region A and B in panoramic picture, but when switching between A and B of sign up to view region Inevitably show black picture element.In view of said method I and the pluses and minuses of 2 II, user is preferably allowed to select and to use Cell delet method.
Noting, in the situation of using method I Delete Cells, the specific operation of the cell that request has been deleted may It is such as, within given one period of time limit, the most alternately to show the operation of sign up to view region A and B.In using method II In the situation of Delete Cells, specific operation be probably in one period of time limit the most alternately display sign up to view region A (or Sign up to view region B) and the operation of black picture element.Further, in the situation of using method II, specific operation is probably user one The operation of black region (black picture element) is continuously displayed in specified time.
Further, in the present embodiment, graphic display terminal 30 such as can be configured to only obtain from deleted cell Take the cell that the region wishing to watch with user is corresponding, or graphic display terminal 30 can obtain whole deleted list Unit's lattice.Equally, graphic display terminal 30 can send complete panoramic picture with requested image processing server 10.Such as, business In the situation that shop layout is the most substantially altered, graphic display terminal 30 can send complete with requested image processing server 11 Panoramic picture.Like this, graphic display terminal 30 can also delete the viewing of panoramic picture by requested image processing server 10 District management table.In this way, image processing server 10 such as can create the viewing area being applicable to the new layout in shop Territory management table.
As it has been described above, according to the one side of the present embodiment, when imaging device 7 is used to ocean weather station observation, it is possible to specify complete The region that in scape image, user is interested in so that when panoramic picture is transferred to graphic display terminal 30, graphic display terminal 30 can promptly show this region.Further, graphic display terminal 30 such as can show suitably according to time and/or user Region.
Noting, such as, imaging device is not limited to be arranged in building etc., and also can be installed in open air. Equally, in addition to being arranged in shop, imaging device 7 can be installed in office, corridor, passage, Inst Foreground, shopping centre, crossroad, station, etc..
<other application>
Although below describing the present invention with reference to illustrative embodiment, but the present invention be not limited to these embodiments and Numerous modification in scope and replacement.
Such as, first embodiment, image processing server 10 transmits panoramic picture through cell delete processing and arrives Graphic display terminal 30.But, image processing server 10 can also be display configured to be stored in panoramic picture management DB Panoramic picture in 1001.Further, in certain embodiments, panoramic picture can be provided in graphic display terminal 30 to manage DB1001, and graphic display terminal 30 can be configured to from panoramic picture management DB 1001 read (retrieval) panoramic picture, Then on display 215, show the panoramic picture retrieved.
Further, the functional configuration etc. of image processing server 10 and graphic display terminal 30 is only as shown in Figure 6 The illustrated example readily appreciating image processing server 10 and the process of graphic display terminal 30 and provide.Such as, at some In embodiment, multiple image processing servers 10 can be configured to cooperate and realize the process of the embodiment of the present invention described above.Figure As the memory element 1000 of processing server 10 is not necessarily placed in image processing server 10, if image processing services Device 10 is able to access that memory element 1000, writes data reading data/in memory element 1000 from memory element 1000.
Further, although the functional character of image processing server 10 and graphic display terminal 30 is above by being divided into Several processing units are described, but the present invention is not limited to arrangement and the division of above-mentioned processing unit.Such as, image processing services One or more processing units of device 10 and/or graphic display terminal 30 can be divided into processing unit further, or The most two or more processing units can be combined into single processing unit.
Note, image editing unit 15 as above be reduce unit example, communication unit 31 be receive unit and The example of the second transmission unit, operation input receiving unit 33 is the example of operation acceptance unit, viewing areas administrative unit 13 Being the example of counting unit, image-display units 32 is the example of image-display units, and viewing areas record unit 35 is display The example of regional record unit, communication unit 11 is the example of the first transmission unit, and data deletion determines that unit 14 is that region is true The example of cell.Further, the image display system 100 of the above-described embodiment according to the invention described above the processing procedure performed It it is the example of the method for displaying image according to the present invention.
The present invention be based on and the 2015-094225 Japanese patent application that requires on May 1st, 2015 to submit to and The rights and interests of the priority of the 2016-026816 Japanese patent application that on February 16th, 2016 submits to, entire contents is by drawing With being bonded to here.

Claims (17)

1. an image display system, it is characterised in that comprise:
Messaging device;With
The terminal unit of wide angle picture is received from described messaging device;
Wherein, described messaging device includes
Area determination unit, described area determination unit is configured to determine seen more less than other regions of described wide angle picture The region of the described wide angle picture seen;
Reducing unit, described minimizing unit is configured to delete from described wide angle picture and is determined by described area determination unit The region of less viewing, to generate the wide angle picture reduced;With
First transmission unit, described first transmission unit is configured to the Radix Rumicis of the described minimizing generated by described minimizing unit Image transmitting is to described terminal unit;And
Wherein, described terminal unit includes
Receiving unit, described reception unit is configured to receive the wide angle picture of described minimizing from described messaging device;With
Image-display units, described image-display units is configured to show on the display apparatus the wide angle picture of described minimizing.
2. image display system as claimed in claim 1, it is characterised in that
Described terminal unit includes further
Viewing area record unit, described viewing area record unit is configured to record and is shown on said display means The viewing area of described wide angle picture;With
Second transmission unit, described second transmission unit is configured to by the appointment institute of described viewing area recording unit records The display region information stating viewing area is transferred to described messaging device;And
The described area determination unit of described messaging device determines described wide angle picture based on described display region information The middle region watched more less than other region described;With
Described minimizing unit deletes the described region determined by described area determination unit from described wide angle picture, to generate State the wide angle picture of minimizing.
3. image display system as claimed in claim 2, it is characterised in that
Described wide angle picture is divided into multiple zoning by described messaging device in advance;
Described messaging device includes counting unit, described counting unit to be configured to based on from described terminal setting further The standby described display region information received identifies a division of the plurality of zoning corresponding to described viewing area Region, and increase the viewing number of times associating storage with identified zoning;With
Described area determination unit, for each zoning of the plurality of zoning, calculates viewing number of times aobvious with described Show the ratio receiving number of times of information, and the ratio of calculating is defined as in described wide angle picture ratio less than the zoning of threshold value The less described region watched, other region described.
4. image display system as claimed in claim 2, it is characterised in that
Described wide angle picture is divided into multiple zoning by described messaging device in advance;
Described messaging device includes counting unit, described counting unit to be configured to based on from described terminal setting further The standby described display region information received identifies and draws corresponding in the plurality of zoning of described viewing area Subregion, and increase the viewing number of times associating storage with identified zoning;With
Described area determination unit identifies the zoning of specified quantity from the plurality of zoning, and by identified institute The zoning stating specified quantity is defined as the described region watched more less than other region described, institute in described wide angle picture The zoning stating specified quantity has the viewing number of times more than other zoning, or watches number of times and described display information The ratio receiving number of times higher than other zoning described.
5. image display system as claimed in claim 2, it is characterised in that
Second transmission unit of described terminal unit by described display region information together with relevant to the user of described terminal unit User profile be transferred to described messaging device together;
The described area determination unit of described messaging device is based on the described viewing area letter received from described terminal unit Breath and described user profile, about each user, determine the institute watched more less than other region described in described wide angle picture State region;With
Described minimizing unit deletes the described region determined by described area determination unit from described wide angle picture, with about often Individual user generates the wide angle picture of described minimizing.
6. image display system as claimed in claim 5, it is characterised in that
Described area determination unit is based on being used by the difference in addition to the viewing user watching described wide angle picture The described display region information of family transmission, determines the described district watched more less than other region described in described wide angle picture Territory.
7. the image display system as according to any one of claim 2-6, it is characterised in that
Described terminal unit includes further
Operation acceptance unit, described operation acceptance unit is configured to accept for making described display device show by described minimizing The operation in the described region that unit is deleted from described wide angle picture;And
When described operation acceptance unit accepts described operation, described image-display units asks described messaging device at least The described region that transmission is deleted from described wide angle picture.
8. image display system as claimed in claim 7, it is characterised in that
The operation in the described region deleted from described wide angle picture includes controlling described display dress to make described display device show Put and at least show the described minimizing corresponding with the described region deleted from described wide angle picture continuously at scheduled time slot The region of wide area image.
9. image display system as claimed in claim 7, it is characterised in that
The operation in the described region deleted from described wide angle picture includes controlling described display dress to make described display device show Put the Radix Rumicis of the described minimizing alternately showing region segmentation by described deletion in scheduled time slot with the most predetermined number of times A region in multiple regions of image.
10. image display system as claimed in claim 7, it is characterised in that
Described operation acceptance unit accepts assigned operation, described assigned operation specify show on said display means described extensively The region of angle image,
The information relevant to described appointment region is transferred to described messaging device by described second transmission unit, by described behaviour Make receiving unit and accept the described appointment region that described assigned operation is specified;With
The described minimizing unit of described messaging device is based on the described information relevant with described appointment region, from described Radix Rumicis Image is deleted described appointment region.
11. image display systems as claimed in claim 4, it is characterised in that
Described area determination unit, based on the bandwidth between described messaging device and described terminal unit, changes described rule Determined number.
12. image display systems as claimed in claim 1, it is characterised in that
Described wide angle picture is panoramic picture;
It is many that described area determination unit judges whether described panoramic picture is taken while changing image-capturing positions A panoramic picture in individual described panoramic picture;With
When a panoramic picture during described panoramic picture is multiple panoramic picture,
Described area determination unit by the sky areas of described panoramic picture and ground region, described panoramic picture with described figure The rear scope contrary as the moving direction of camera site or described panoramic picture are leaving described image-capturing positions The region beyond area of visual field in described moving direction preset range, is defined as the district to be deleted from described panoramic picture Territory;With
Described minimizing unit deletes the region to be deleted determined by described area determination unit from described panoramic picture.
13. image display systems as claimed in claim 2, it is characterised in that
The image capturing time letter that described viewing area recording unit records is relevant with the image capturing time of described wide angle picture Breath, and shown described viewing area on said display means in described wide angle picture;
Described second transmission unit is by by the described image capturing time information of described viewing area recording unit records and described Display region information is transferred to described messaging device;
The described area determination unit of described messaging device is by believing from the described image capturing time of described wide angle picture Multiple time slots belonging to breath determine relevant time slot, about between each time in the plurality of time slot Gap, determines the described region watched more less than other region described in described wide angle picture;With
Described minimizing unit about each time slot, is deleted from described wide angle picture and is determined by described area determination unit Described region.
14. image display systems as claimed in claim 13, it is characterised in that
Described area determination unit assembles the institute associated with the plural different time gap in the plurality of time slot State display region information, and determine in described wide angle picture more less than other regions described based on the display region information assembled The described region watched.
15. image display systems as claimed in claim 2, it is characterised in that
Described viewing area recording unit records is taken with described wide angle picture day relevant what day information, and described extensively Shown described viewing area on said display means in the image of angle.
Described second transmission unit transmits by what day information and described display described in the recording unit records of described viewing area Area information is to described messaging device;
The described area determination unit of described messaging device based on from described second transmission unit receive described in what day Information, is determined by described wide angle picture and is taken day, for determining that in described wide angle picture, ratio is described every day in one week The less described region watched, other region;With
Described minimizing unit, for the every day in one week, is deleted from described wide angle picture and is determined by described area determination unit Described region.
16. 1 kinds of messaging devices, it is characterised in that comprise:
Reading unit, described reading unit is configured to from retrieving wide angle picture described in the storage device of storage wide angle picture;
Area determination unit, described area determination unit is configured to determine more less than other region in described wide angle picture sight The region seen;With
Reducing unit, described minimizing unit is configured to delete from described wide angle picture and is determined by described area determination unit Described region, to generate the wide angle picture reduced, and stores the wide angle picture of described minimizing in described storage device;
Wherein, the Radix Rumicis figure of the described minimizing that described reading unit is generated by described minimizing unit from the retrieval of described storage device Picture.
17. 1 kinds of method for displaying image realized by information processing system, described information processing system includes messaging device And terminal unit, it is characterised in that described method for displaying image comprises:
The determination step realized by described messaging device, described determines that step is for determining in wide angle picture than described Radix Rumicis The less region watched, other region of image;
The minimizing step realized by described messaging device, described minimizing step is described for deleting from described wide angle picture Wide angle picture is confirmed as the less described region watched, to generate the wide angle picture reduced;
The transmitting step realized by described messaging device, described transmitting step is for transmitting the wide angle picture of described minimizing To described terminal unit;
The receiving step realized by described terminal unit, described receiving step transmits from described messaging device for reception The wide angle picture of described minimizing;With
The step display realized by described terminal unit, described step display is for showing the wide of described minimizing on the display apparatus Angle image.
CN201610270077.XA 2015-05-01 2016-04-27 Image display system, information processing equipment and image display method Active CN106101610B (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2015-094225 2015-05-01
JP2015094225 2015-05-01
JP2016-026816 2016-02-16
JP2016026816A JP2016213810A (en) 2015-05-01 2016-02-16 Image display system, information processing apparatus, program, and image display method

Publications (2)

Publication Number Publication Date
CN106101610A true CN106101610A (en) 2016-11-09
CN106101610B CN106101610B (en) 2019-09-13

Family

ID=57549867

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610270077.XA Active CN106101610B (en) 2015-05-01 2016-04-27 Image display system, information processing equipment and image display method

Country Status (2)

Country Link
JP (1) JP2016213810A (en)
CN (1) CN106101610B (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106791886A (en) * 2016-11-16 2017-05-31 深圳百科信息技术有限公司 The panoramic video distribution method and system of a kind of view-based access control model characteristic
CN106878611A (en) * 2016-12-29 2017-06-20 北京空间机电研究所 A kind of intelligent reconnaissance and surveillance electro-optical system
CN110169077A (en) * 2017-01-06 2019-08-23 索尼公司 Information processing unit and information processing method
CN110324574A (en) * 2018-03-29 2019-10-11 京瓷办公信息系统株式会社 Monitoring system
CN110832873A (en) * 2017-07-06 2020-02-21 夏普株式会社 System and method for signaling view information for virtual reality applications
CN110945873A (en) * 2017-06-02 2020-03-31 Vid拓展公司 360 degree video delivery over next generation networks
CN116916050A (en) * 2022-12-20 2023-10-20 哈尔滨商业大学 Method and device for transmitting road monitoring image to terminal

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106851212B (en) * 2017-03-03 2020-03-17 深圳市梦网百科信息技术有限公司 Panoramic video distribution method and system based on user characteristics
JP2020035086A (en) * 2018-08-28 2020-03-05 富士ゼロックス株式会社 Information processing system, information processing apparatus and program
JP6718937B2 (en) * 2018-09-26 2020-07-08 株式会社コロプラ Program, information processing apparatus, and method
CN112307393A (en) * 2019-09-04 2021-02-02 福建皮皮跳动科技有限公司 Information issuing method and device and electronic equipment

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102186065A (en) * 2011-06-01 2011-09-14 广州市晶华光学电子有限公司 Monitoring camera with 360-degree field angle
CN102985789A (en) * 2010-07-07 2013-03-20 莱卡地球系统公开股份有限公司 Target point recognition method and surveying instrument
US20130322844A1 (en) * 2012-06-01 2013-12-05 Hal Laboratory, Inc. Storage medium storing information processing program, information processing device, information processing system, and panoramic video display method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102985789A (en) * 2010-07-07 2013-03-20 莱卡地球系统公开股份有限公司 Target point recognition method and surveying instrument
CN102186065A (en) * 2011-06-01 2011-09-14 广州市晶华光学电子有限公司 Monitoring camera with 360-degree field angle
US20130322844A1 (en) * 2012-06-01 2013-12-05 Hal Laboratory, Inc. Storage medium storing information processing program, information processing device, information processing system, and panoramic video display method

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106791886A (en) * 2016-11-16 2017-05-31 深圳百科信息技术有限公司 The panoramic video distribution method and system of a kind of view-based access control model characteristic
CN106791886B (en) * 2016-11-16 2020-03-17 深圳市梦网百科信息技术有限公司 Panoramic video distribution method and system based on visual characteristics
CN106878611A (en) * 2016-12-29 2017-06-20 北京空间机电研究所 A kind of intelligent reconnaissance and surveillance electro-optical system
CN110169077A (en) * 2017-01-06 2019-08-23 索尼公司 Information processing unit and information processing method
CN110945873A (en) * 2017-06-02 2020-03-31 Vid拓展公司 360 degree video delivery over next generation networks
US11770594B2 (en) 2017-06-02 2023-09-26 Vid Scale, Inc. 360-degree video delivery over next generation network
CN110832873A (en) * 2017-07-06 2020-02-21 夏普株式会社 System and method for signaling view information for virtual reality applications
CN110324574A (en) * 2018-03-29 2019-10-11 京瓷办公信息系统株式会社 Monitoring system
CN110324574B (en) * 2018-03-29 2021-06-22 京瓷办公信息系统株式会社 Monitoring system
CN116916050A (en) * 2022-12-20 2023-10-20 哈尔滨商业大学 Method and device for transmitting road monitoring image to terminal
CN116916050B (en) * 2022-12-20 2024-03-19 哈尔滨商业大学 Method and device for transmitting road monitoring image to terminal

Also Published As

Publication number Publication date
CN106101610B (en) 2019-09-13
JP2016213810A (en) 2016-12-15

Similar Documents

Publication Publication Date Title
CN106101610B (en) Image display system, information processing equipment and image display method
US9996895B2 (en) Image display system, information processing apparatus, and image display method
CN1835569B (en) Time-shift image distribution system, time-shift image distribution method, time-shift image requesting apparatus, and image server
US8254727B2 (en) Method and apparatus for providing picture file
JP5184217B2 (en) Image photographing apparatus, additional information providing server, and additional information filtering system
JP5334911B2 (en) 3D map image generation program and 3D map image generation system
US10191635B1 (en) System and method of generating a view for a point of interest
JP4637889B2 (en) Virtual space broadcasting device
US20150153933A1 (en) Navigating Discrete Photos and Panoramas
CN101304466B (en) Information processing apparatus an image display method
CN102300205A (en) Publicity and transfer of mobile application program based on position and context
JPH1056609A (en) Image recording method, communication method, image recording device, communication equipment and medium
JP6046874B1 (en) Information processing apparatus, information processing method, and program
JP6555026B2 (en) Information provision system
KR101038940B1 (en) System and method for managing image information using object extracted from image
EP3388958A1 (en) Method and system for managing viewability of location-based spatial object
JP5072464B2 (en) Image providing apparatus, image providing method, image providing program, and computer-readable recording medium recording the program
US20150156460A1 (en) System and method of filling in gaps in image data
JP6617547B2 (en) Image management system, image management method, and program
US10986394B2 (en) Camera system
US9832249B2 (en) Systems and methods for streaming media content
CN103546677A (en) Interaction system and interaction method
JP2002189412A (en) Mapping system and mapping method
JP2016143269A (en) Content search device, content search method, content storage device and content storage method
JP2018174516A (en) Method, apparatus, and system for exchanging video contents

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant