CN106658220B - Subtitle creating device, display module and subtitle create display systems - Google Patents
Subtitle creating device, display module and subtitle create display systems Download PDFInfo
- Publication number
- CN106658220B CN106658220B CN201610994563.6A CN201610994563A CN106658220B CN 106658220 B CN106658220 B CN 106658220B CN 201610994563 A CN201610994563 A CN 201610994563A CN 106658220 B CN106658220 B CN 106658220B
- Authority
- CN
- China
- Prior art keywords
- subtitle
- creation
- display
- frame image
- picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000012790 confirmation Methods 0.000 claims abstract description 35
- 238000004891 communication Methods 0.000 claims description 17
- 230000006399 behavior Effects 0.000 claims description 3
- 238000010276 construction Methods 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 14
- 238000000034 method Methods 0.000 description 14
- 230000000694 effects Effects 0.000 description 4
- 230000003796 beauty Effects 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/488—Data services, e.g. news ticker
- H04N21/4884—Data services, e.g. news ticker for displaying subtitles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Studio Circuits (AREA)
Abstract
The present invention provides subtitle creating device, display module and the subtitle creation display system of a kind of 360 degree of full-view images, the subtitle creating device includes picture storage unit, input display unit and creation generating unit, and wherein picture storage unit is stored with display selection picture, creation confirmation screen and subtitle input picture；Input display unit shows that display selection picture allows operator to select frame image, and show that creating confirmation screen allows operator according to the current time location data of the predetermined time position data setting subtitle creation shown and carry out confirmation operation to subtitle creation, further shows that subtitle inputs the caption content that picture allows operator at least to input subtitle according to corresponding confirmation operation information according to corresponding selection information；The generation associated with 360 degree of full-view images of the current time location data being set and the caption content being entered is stored with 360 degree of full-view image files of subtitle by creation generating unit.
Description
Technical field
The invention belongs to 360 full-view image subtitles to create display field, and in particular to a kind of subtitle of 360 degree of full-view images
Creating device, subtitle display module and subtitle create display systems.
Background technique
Relative to traditional video mode, 360 degree of full-view images are due to that can be that experiencer brings real scene sense and friendship
The impression of mutual formula, to be applied to the fields such as displaying, video display, game, VR more and more widely.However, 360 degree of current panoramas
The display of image is only limitted to the display of image, also cannot achieve the variation with observation visual angle, and corresponding word is shown on picture
Curtain.
Traditional subtitle file format is suitable for ordinary video more, and only comprising time segment information and text information, therefore
When video playing, text information will be shown on video according to the time segment information being previously set.
In addition, the caption character information of ordinary video can only be shown in one dimension, i.e., can only laterally or longitudinally show,
When the text information of some picture of video is more, also caption character can only be divided into multirow in fixed position and shown.
The multirow of this text show not only bad for display picture beauty, and in video some picture transmitting information compared with
In the case where more, since the picture information in the display position and picture of caption character cannot correspond, it is also difficult to play letter
Cease the effect of transmitting.
It can be seen that will certainly also have above-mentioned ask even if traditional subtitle file can be applied to 360 degree of full-view images
Topic, moreover since the broadcasting form of 360 full-view images and the broadcasting form of ordinary video image are entirely different, traditional subtitle text
Part is also dfficult to apply to 360 full-view images.
Summary of the invention
The present invention is to carry out in order to solve the above problem, by providing a kind of subtitle creation dress of 360 degree of full-view images
It sets, display module and subtitle creation display system, to create subtitle file simultaneously when panoramic picture is shown in respective picture
It is upper to show corresponding caption content.Present invention employs following technical solutions:
<structure one>
The present invention provides a kind of subtitle creating devices, show on the display screen of the mobile terminal of user to needs
Frame image in the 360 degree of full-view images shown carries out corresponding subtitle creation, have a feature in that including picture storage unit,
Input display unit and creation generating unit.Wherein, picture storage unit is stored with for showing frame image and allowing operator to needs
Addition subtitle frame image carry out selection display select picture, for the frame image selected in 360 degree of full-view images
Scheduled duration time shaft on predetermined time position data shown and operator allowed to confirm subtitle creation
It creates confirmation screen and the subtitle for subtitle creation inputs picture；Input display unit display display selection picture allows operation
Member's selection frame image, and allow operator according to the predetermined time shown according to corresponding selection information display creation confirmation screen
Position data, which sets the current time location data of subtitle creation and creates to subtitle, carries out confirmation operation, further basis
Corresponding confirmation operation information shows the caption content that subtitle input picture allows operator at least to input subtitle；Creating generating unit will
The current time location data being set and the caption content being entered generation associated with 360 degree of full-view images are stored with word
360 degree of full-view image files of curtain.
<structure two>
Further, it is arranged in the mobile terminal of user the present invention also provides a kind of, to by plural frame frame image structure
360 degree of panoramas in the 360 degree of full-view image files for being stored with subtitle generated are created at and by above-mentioned subtitle creating device
The display module that image is shown has a feature in that including move angle acquisition unit, according to mobile terminal at 360 degree
Movement on direction obtains the move angle of mobile terminal；Time location data acquiring section, according to move angle and pre- timing
It is long, time location data corresponding with move angle are obtained as the corresponding time location data of angle；Image determines display unit,
When angle, which corresponds to time location data, is confirmed as predetermined time position data, on the display screen display and scheduled time position
Set the corresponding frame image of data；And subtitle determines displaying portion, when time location data are confirmed as the current time position
When setting data, subtitle corresponding with current time location data is shown.
<structure three>
Further, the present invention also provides a kind of subtitles of 360 degree of full-view images to create display system, has such
Feature: including subtitle creating device, 360 degree of panorama shadows that needs are shown on the display screen of the mobile terminal of user
Frame image as in carries out corresponding subtitle creation；And mobile terminal, pass through communication network and subtitle creating device communication link
It connects.Wherein, subtitle creating device is the subtitle creating device in structure one, contains displaying described in structure two in mobile terminal
Module.
Invention action and effect
Subtitle creating device, display module, creation display equipment and the subtitle creation method provided according to the present invention, by
Operator can be allowed to select first the frame image for needing to add subtitle in display selection picture, create confirmation screen
It can show the predetermined time position of selected frame image on a timeline, and the pre- timing for allowing operator to show according to this
Between position data setting subtitle creation current time location data then subtitle creation create or it is additional confirm, word
Curtain input picture allows operator to input the content of subtitle, makes frame image first and subtitle to be added is needed to pass through on time shaft
Time location data are associated, the addition of 360 degree of full-view image subtitles of Lai Shixian, so that 360 degree of full-view images
What subtitle addition became is easy；Secondly the exact position of subtitle on a timeline can be determined according to current time location data, make
The correspondence for obtaining subtitle and frame image is more accurate.
Detailed description of the invention
Fig. 1 is the structural block diagram of the creation display systems in embodiment according to the present invention；
Fig. 2 is the structural block diagram of the subtitle creating device in embodiment according to the present invention；
Fig. 3 is the schematic diagram of the display selection picture in embodiment according to the present invention；
Fig. 4 is the schematic diagram of the creation confirmation screen in embodiment according to the present invention；
Fig. 5 is the schematic diagram of the subtitle input picture in embodiment according to the present invention；
Fig. 6 is the structural block diagram of display module in embodiment according to the present invention；
Fig. 7 is the process flowchart of the creation display systems in embodiment according to the present invention；
Fig. 8 is that the subtitle of the creating device in embodiment according to the present invention creates process flow diagram flow chart；
Fig. 9 is the process flowchart of the display module in embodiment according to the present invention.
Specific embodiment
The present inventor's discovery when the displaying to 360 degree of full-view images is studied, if suitable according to predetermined displaying
Every frame image of 360 degree of full-view images of ordered pair is shown, then can generate a virtual time shaft, at this point, every frame image
Position on a timeline is to determine and unique, can add subtitle to 360 full-view images accordingly.In addition, when showing image
Mobile terminal starts orientation and corresponds to time location data on time shaft, be moved to when moving on 360 degree of directions
When present orientation, another time location data on time shaft are corresponded to, i.e., according to its move angle can obtain two times
The distance between position data can be used for showing subtitle.Based on above-mentioned discovery, following technical scheme is inventors herein proposed:
A kind of subtitle creating device is present embodiments provided, needs are carried out on the display screen of the mobile terminal of user
Frame image in 360 degree of full-view images of display carries out corresponding subtitle creation, has a feature in that and stores including picture
Portion, input display unit and creation generating unit.Wherein, picture storage unit is stored with for showing frame image and allowing operator to need
Add subtitle frame image carry out selection display selection picture, for the frame image selected in 360 degree of panorama shadows
Predetermined time position data on the time shaft of the scheduled duration of picture are shown and operator are allowed to confirm subtitle creation
Creation confirmation screen and for subtitle creation subtitle input picture；Input display unit display display selection picture allows behaviour
Work person selects frame image, and allows operator according to the pre- timing shown according to corresponding selection information display creation confirmation screen
Between position data setting subtitle creation current time location data and to subtitle create carry out confirmation operation, further root
The caption content that subtitle input picture allows operator at least to input subtitle is shown according to corresponding confirmation operation information；Create generating unit
The generation associated with 360 degree of full-view images of the current time location data being set and the caption content being entered is stored with
360 degree of full-view image files of subtitle.
It is literal type subtitle, figure that subtitle creating device provided in this embodiment, which can also have the following features: subtitle,
As any one in type subtitle and audio types subtitle.
Subtitle creating device provided in this embodiment can also have the following features: subtitle be literal type subtitle and
Any one in image type subtitle.Caption content is word content, picture material and to being stored in predetermined memory
Word content or the link path information that is obtained of picture material in any one.Show that subtitle is defeated in input display unit
The operator is allowed further to input coordinate position data of the subtitle on the display screen of mobile terminal when entering picture.
Subtitle creating device provided in this embodiment can also have the following features: when the caption content of input is text
When content, subtitle is word content；When the caption content of input is picture material, subtitle is picture material；When the word of input
When curtain content is link path information, subtitle is the word content or figure obtained by link path information into predetermined memory
As content.
Subtitle creating device provided in this embodiment can also have the following features: both to have been contained when in same width frame image
Literal type subtitle contains image type subtitle again when, text coordinate position data corresponding with literal type subtitle and with figure
As the corresponding coordinate position data of type subtitle is different.
It is audio types subtitle, word that subtitle creating device provided in this embodiment, which can also have the following features: subtitle,
Curtain content is the link path information obtained to the audio file being stored in predetermined memory.
Subtitle creating device provided in this embodiment can also have the following features: predetermined time position data and contain table
Show position data at the beginning of corresponding frame image starts display and indicates the end time position that the display of frame image terminates
Data；Current time location data, which contain, indicates that corresponding subtitle starts the current start time position data of display and indicates word
The current end time position data that curtain display terminates, current start time position data and current end time position data quilt
It is set in the range of time started position data and end time position data.
Further, the present embodiment additionally provides in a kind of mobile terminal that user is arranged in, to by plural frame frame image
It constitutes and complete by 360 degree in 360 degree of full-view image files for being stored with subtitle of above-mentioned subtitle creating device creation generation
The display module that scape image is shown has a feature in that including move angle acquisition unit, according to mobile terminal 360
The movement on direction is spent, the move angle of mobile terminal is obtained；Time location data acquiring section according to move angle and makes a reservation for
Duration obtains corresponding with move angle time location data as the corresponding time location data of angle；Image determines display
Portion, when angle, which corresponds to time location data, is confirmed as predetermined time position data, display and pre- timing on the display screen
Between the corresponding frame image of position data；And subtitle determines displaying portion, when time location data are confirmed as described current
Between position data when, show corresponding with current time location data subtitle.
Display module provided in this embodiment can also have the following features: when subtitle is literal type subtitle and figure
When as any one in type subtitle, display module is display module, and subtitle determines that displaying portion is that subtitle determines display unit, when
When subtitle is audio types subtitle, display module is playing module, and subtitle determines that displaying portion is that subtitle determines playback unit.
Further, the present embodiment additionally provides a kind of subtitle creation display system of 360 degree of full-view images, has in this way
Feature: including subtitle creating device, 360 degree of panoramas that needs are shown on the display screen of the mobile terminal of user
Frame image in image carries out corresponding subtitle creation；And mobile terminal, it is communicated by communication network and subtitle creating device
Connection.Wherein, subtitle creating device is above-mentioned subtitle creating device, contains above-mentioned display module in mobile terminal.
A specific embodiment of the invention is illustrated below in conjunction with attached drawing.
Fig. 1 is the structural block diagram of the creation display systems in embodiment according to the present invention.
As shown in Figure 1, the subtitle creation display system 10 of 360 degree of full-view images is whole including subtitle creating device 11, movement
End 12 and the communication network 13 for communicating to connect the two.
11 pairs of subtitle creating device 360 degree of panorama shadows for needing to be shown on the display screen of the mobile terminal of user
Frame image as in carries out corresponding subtitle creation.Mobile terminal 12 includes display module 14 and communication module 15, shows mould
For showing 360 degree of full-view images and its subtitle, communication module 15 and communication network 13 connect block 14, and pass through the communication network
13 and subtitle creating device 11 communicate to connect.
Fig. 2 is the structural block diagram of the subtitle creating device in embodiment according to the present invention.
As shown in Fig. 2, subtitle creating device 11 includes picture storage unit 16, input display unit 17, creation generating unit 18, word
Curtain creation side temporary storage part 19, subtitle creation side communication unit 20 and subtitle create side control unit 21.Wherein, in picture storage unit 16
It is stored with display selection picture 22, creation confirmation screen 23 and subtitle input picture 24.
Fig. 3 is the schematic diagram of the display selection picture in embodiment according to the present invention.
As shown in figure 3, display selection picture 22 includes that frame image selection display area 221 and thumbnail frame image are shown
Selection region 222.
Frame image selection display area 221 be provided with frame image display field 221a, upper page/nextpage selection key 221b, really
Recognize key 221c and end key 221d.Upper page/nextpage selection key 221b confirms key for selecting frame image
221c confirms that, subsequently into creation confirmation screen 23, end key 221d is in institute to the frame image for needing to add subtitle
After addition frame image in need is added subtitle, for terminating subtitle creation process.
Thumbnail frame image shows that selection region 222 and frame image selection display area 221 are corresponding, is shown which
The thumbnail of every frame image.When the frame picture number contained in 360 degree of full-view images is smaller, the selection region pair can be used
The frame image for needing to add subtitle is selected, but in the biggish situation of number, if still using the selection region, having can
Energy can there is a situation where frame images to omit, and is unfavorable for the creation of subtitle instead.
Fig. 4 is the schematic diagram of the creation confirmation screen in embodiment according to the present invention.
As shown in figure 4, creation confirmation screen 23 includes upper and lower two parts.It is complete at 360 degree that top half shows frame image
Predetermined time position data, creation/addition key 23c, delete button 23d on the time shaft of the scheduled duration of scape image and
Cancel key 23e；Lower half portion is in addition to showing on the frame image and the frame image selected by display selection picture 22
Outside the caption content of added subtitle, it is additionally provided with determining key 23f.
Predetermined time position data contain indicate at the beginning of corresponding frame image starts display position data 23a and
Indicate the end time position data 23b that the display of frame image terminates, the two time location data are to select picture 22 in display
Selection, which finishes, to be shown automatically after the frame image for needing to add subtitle.
In addition, time started position data 23a and end time position data 23b can be adjusted, beginning adjusted
Time location data 23a and end time position data 23b are used by the current time location data as subtitle creation.When
So, under the two unanimous circumstances, predetermined time position data can not also be adjusted directly as current time
Position data uses.
Creation/addition key 23c is taken as the bridge for entering subtitle input picture from creation confirmation screen, in current time
After position data is set, clicks creation/addition key 23c and then enter subtitle input picture 24.In addition, being needed when in a frame image
When adding a plurality of subtitle, creation/addition key 23c also acts as the effect of additional subtitle, is added and finishes in a upper subtitle,
The creation/addition key 23c is clicked, still enters in subtitle input picture 24, carries out the input of next subtitle.
Delete button 23d cancels key 23e and is used to currently to select for deleting the newest subtitle being added
When frame image does not need addition subtitle, display selection picture 22 is returned.
Determine that key 23f selects picture 22 for after the subtitle of this frame image is created, returning to display, it is again right
Next width frame image is selected.
Fig. 5 is the schematic diagram of the subtitle input picture in embodiment according to the present invention.
In the present embodiment, subtitle is any in literal type subtitle, image type subtitle and audio types subtitle
It is a kind of.
As shown in figure 5, subtitle input picture 24 is used to input the caption content of subtitle, there is coordinate position input area
241, word attribute setting regions 242, image attributes setting regions 243, audio attribute setting regions 244, word content input
Region 245, image link path 246, audio url path 247, web page interlinkage path 248 and determining key 249.
Coordinate position input area 241 is used to input subtitle when subtitle is literal type subtitle or image type subtitle
Coordinate position data on the display screen, i.e., the starting and ending coordinate position data of abscissa and the starting of ordinate
With end coordinate position data.
Word attribute setting regions 242 is used to set the attribute of text when subtitle is literal type subtitle, such as set word
Shape, font name, font size, font color and laterally or vertically display of font etc..
Image attributes setting regions 243 is used for when subtitle is image type subtitle the setting pixel of image, resolution ratio, big
Small, color, locating depth, any one or a few in hue, saturation, intensity.
Audio attribute setting regions 244 is used for the bit rate of setting audio, sampling frequency when subtitle is audio types subtitle
One or more of rate and bit depth.
Word content input area 245 is used to input word content when subtitle is literal type subtitle.In these texts
Appearance can both directly input, and can also be inserted by way of link.When directly inputting, the caption content in left frame is text
Word content, when linking insertion, the caption content in left frame is then from the word content or figure being stored in predetermined memory
The link path information obtained as content.
Image link path 246 is used for the link path information of the input picture when subtitle is image type subtitle.Audio
Link path 247 is used for the link path information of the input audio when subtitle is audio types subtitle.Web page interlinkage path 248 is only
It needs in certain circumstances, for inputting the Web page image link path that can switch to other webpages.
Since the content that web page interlinkage is shown is mostly text or image, it is classified as literal type subtitle or image
In type subtitle.Therefore, also its coordinate position data is set, does not need setting attribute only.
Determine key 249 for input after be back to creation confirmation screen, carry out the addition of next subtitle or lead to
The determination key 23f for crossing the picture returns to display selection picture.
In the present embodiment, link path information is the storage road of word content or picture material in predetermined memory
Diameter.Predetermined memory can be cloud storage, and the storage dish being also possible in computer can also be other servers.
In the present embodiment, in same width frame image, because there is overlapping in the current time location data of every subtitle
A possibility that it is very big, therefore, not only containing literal type subtitle but also image type subtitle is contained in same width frame image, with text class
The corresponding text coordinate position data of type-word curtain and coordinate position data corresponding with image type subtitle are different.Together
Sample, when same type of subtitle contains a plurality of in same width frame image, the coordinate position data of every subtitle is also different, in order to avoid go out
The covering of existing subtitle.
As shown in Fig. 2, input display unit 17 is for successively showing display selection picture 22, creation confirmation screen 23 and word
Curtain input picture 24, allows operator to carry out selecting or inputting operation accordingly.
The input display unit 17 first shows that display selection picture 22 allows operator to select a width frame image, selects in operator
It selects after finishing and clicking determining key 221c, input display unit 17 allows according to corresponding selection information display creation confirmation screen 23
Operator according to the predetermined time position data shown at the beginning of position data 23a and end time position data
The current start time position data of the current time location data of 23b setting subtitle creation and current end time positional number
According to after operator's setting finishes and clicks creation/addition key 23c, input display unit 17 is believed according to corresponding confirmation operation
Breath display subtitle inputs picture 24, and operator is allowed to input the caption content of a subtitle.
It completes to input in operator and after clicking determining key 249, input display unit display creation confirmation screen 23 allows behaviour
Work person sets the current time location data of next subtitle of the frame image again, to adding for next subtitle, or
Person clicks the determination key 23f of the picture, so that input display unit shows selection picture again, carries out the choosing of next width frame image
It selects.
Generating unit 18 is created by the current time location data being set and the caption content being entered and 360 degree of panoramas
Image is associated to generate 360 degree of full-view image files for being stored with subtitle.
As shown in figure 4, during subtitle creation, the caption content of one subtitle of every input is created under confirmation screen
Corresponding caption content will be associated on shown frame image in the display area of half part.
Caption content that subtitle creation side temporary storage part 19 is inputted for temporary storage person, each width are associated with subtitle
Frame image and creation generating unit generate 360 degree of full-view image files for being stored with subtitle.
Subtitle creates side communication unit 20 and is communicated to connect by the communication module 15 in communication network 13 and mobile terminal 12,
360 degree of full-view image files for being stored with subtitle are conveyed to mobile terminal.
Subtitle creation side control unit 21 is for controlling picture storage unit 16, input display unit 17, creation generating unit 18, subtitle
Create the operation of side temporary storage part 19, subtitle creation side communication unit 20.
Fig. 6 is the structural block diagram of display module in embodiment according to the present invention.
As shown in figures 1 to 6, it is complete to obtain 360 degree for being stored with subtitle received by communication module 15 for display module 14
Scape image file, and 360 degree of full-view images therein are shown, including move angle acquisition unit 25, time location data
Acquisition unit 26, image determine that display unit 27, subtitle determine displaying portion 28, show side temporary storage part 29 and show side control unit 30.
In the present embodiment, mobile terminal mobile circle on 360 degree of directions, just can be by the time with scheduled duration
All display finishes the frame image of corresponding 360 full-view image of axis, that is to say, that the move angle of mobile terminal is and the time
Time location data break on axis is corresponding.
Move angle acquisition unit 25, for 0 °, is obtained mobile terminal in real time and is moved to present bit with the initial position of mobile terminal
The move angle set.
Time location data acquiring section 26 obtains time location data corresponding to mobile terminal initial position, and according to shifting
Dynamic angle and the scheduled duration of time shaft obtain time location data corresponding to mobile terminal current location.The two times
Position data is corresponded to position data and end time position data at the beginning of time location data as angle respectively.
Image determines that display unit 27 corresponds to time location data to angle and is determined, and is confirmed as the predetermined time at it
When position data, the frame image corresponding with predetermined time position data is shown on the display screen.
Subtitle determines that displaying portion 28 also corresponds to time location data to angle at the same time and is determined, when it is confirmed as
When current time location data, subtitle corresponding with the current time location data is shown.
Show side temporary storage part 29 for temporarily storing the 360 degree of full-view image files and various subtitles that have subtitle.
Show that side control unit 30 is determined for controlling move angle acquisition unit 25, time location data acquiring section 26, image
Display unit 27, subtitle determine displaying portion 28 and show the operation of side temporary storage part 29.
In the present embodiment, difference of the display module according to subtitle type, exhibition method are different: when subtitle is literal type
When any one in subtitle and image type subtitle, display module is display module, and subtitle determines that displaying portion is that subtitle is true
Determine display unit；When subtitle is audio types subtitle, display module is playing module, and subtitle determines that displaying portion is that subtitle determination is broadcast
Put portion.
Below with reference to flow chart to subtitle creating device to the creation process and display module of subtitle to 360 degree of panorama shadows
The display process of picture is described further:
Fig. 7 is the process flowchart of the creation display systems in embodiment according to the present invention.
As shown in fig. 7, the treatment process of creation display systems includes the following steps:
Step S1: subtitle creating device 11 obtains all frame images and 360 degree of panorama shadows of 360 degree of full-view images
The time shaft of the scheduled duration of picture；
Step S2: subtitle creating device carries out corresponding subtitle creation to the frame image in 360 degree of full-view images, and generation is deposited
Contain 360 degree of full-view image files of subtitle；
Step S3: subtitle creates side communication unit 20 and 360 degree of full-view image files for being stored with subtitle is sent to movement
Terminal 12；
Step S4: the display module in mobile terminal 12 is to 360 degree in 360 degree of full-view image files for being stored with subtitle
Full-view image is shown.
Fig. 8 is that the subtitle of the creating device in embodiment according to the present invention creates process flow diagram flow chart.
As shown in figure 8, subtitle creating device carries out corresponding subtitle creation to the frame image in 360 degree of full-view images
Process the following steps are included:
Step S2-1, input display unit shows display selection picture, subsequently into step S2-2；
Step S2-2, operator's selection currently needs to add a width frame image of subtitle, and clicks determining key 221c, so
After enter step S2-3；
Step S2-3, input display unit 17 are selected according to corresponding selection information display creation confirmation screen 23, display
Predetermined time position data of the width frame image on the time shaft of scheduled duration, subsequently into step S2-4；
Step S2-4, according to the current time location number of the predetermined time position data setting subtitle creation shown
According to, and click creation additional key subtitle created carry out confirmation operation, subsequently into step S2-5；
Step S2-5, input display unit 17 according to corresponding confirmation operation information show subtitle input picture 24, then into
Enter step S2-6；
Step S2-6 inputs the caption content of a subtitle, sets the attribute of subtitle, and if necessary into an input subtitle
Coordinate position data on screen coordinate, subsequently into step S2-7；
Whether step S2-7, creation side control unit 21 correspond to the last item subtitle of current frame image to this subtitle
Determined, if it is determined that result be it is yes, then enter step in S2-8；If it is determined that result be it is no, then enter step in S2-5；
Whether step S2-8, creation side control unit 21 are frame images that last width needs to add subtitle to current frame image
Determined, if it is determined that result be it is yes, then enter step in S2-9；If it is determined that result be it is no, then enter step in S2-2；
Step S2-9, creation generating unit by the current time location data being set and the caption content being entered with
360 degree of full-view images are associated to generate 360 degree of full-view image files for being stored with subtitle, subsequently into step S2-10；
Step S2-10, subtitle create side communication unit and export 360 degree of full-view image files for being stored with subtitle.
Fig. 9 is the process flowchart of the display module in embodiment according to the present invention.
As shown in figure 9, subtitle creating device carries out the mistake of corresponding subtitle creation to the frame image in 360 degree of full-view images
Journey the following steps are included:
Step S4-1, time location data acquiring section 26 obtain time location number corresponding to mobile terminal initial position
According to subsequently into step S4-2；
Step S4-2, move angle acquisition unit 25, for 0 °, are obtained mobile terminal in real time and moved with the initial position of mobile terminal
The move angle to current location is moved, subsequently into step S4-3；
Step S4-3, time location data acquiring section 26 are obtained according to the scheduled duration of move angle and time shaft and are moved
Time location data corresponding to terminal current location, so that obtaining angle corresponds to time location data, subsequently into step S4-
4；
Step S4-4, show side control unit 30 judge the angle correspond to time location data be predetermined time position data also
It is current time location data, S4-5 is entered step when for predetermined time position data, when for current time location data
Enter step S4-6；
Step S4-5, it is corresponding with the predetermined time position data that image determines that display unit 27 is shown on the display screen
Frame image, subsequently into step S4-6；
Step S4-6, subtitle determine that displaying portion 28 shows subtitle corresponding with the current time location data.
Embodiment action and effect
According to subtitle creating device provided in this embodiment, display module and creation display system, since display selects
Picture can allow operator to select first the frame image for needing to add subtitle, and creation confirmation screen can show institute
The predetermined time position of the frame image of selection on a timeline, and the predetermined time position data for allowing operator to be shown according to this
Then the current time location data for setting subtitle creation create subtitle create or add confirms, subtitle inputs picture
It allows operator to input the content of subtitle, make frame image first and subtitle to be added is needed to pass through the time location number on time shaft
According to being associated, the addition of 360 degree of full-view image subtitles of Lai Shixian becomes so that the subtitle of 360 degree of full-view images adds
Be easy；Secondly the exact position of subtitle on a timeline can be determined according to current time location data, so that subtitle and frame
The correspondence of image is more accurate.
Further, in the present embodiment, due to creation confirmation screen be provided with creation additional key, when needing same
When width frame image adds a plurality of subtitle, after current subtitle is created, next can be realized as by clicking this key
The addition of subtitle enables and shows multiple groups caption information in same predetermined time position data, further improves information exhibition
Show efficiency.
Further, in the present embodiment, as soon as subtitle input the every input subtitle of picture, creation generating unit can by its with
Corresponding frame image associates, and by this association display in creation confirmation screen, and it is intuitive right to enable an operator to
The position correctness of the subtitle of addition is judged, the accuracy rate of subtitle creation is improved.
Claims (10)
1. a kind of subtitle creating device, the 360 degree of panoramas shown on the display screen of the mobile terminal of user to needs
Image carries out corresponding subtitle creation, which is characterized in that by 360 degree panoramic pictures according to it is predetermined show sequentially form containing
The virtual time shaft of each frame image, described in the time location data of the frame image on the time shaft correspond to when showing
The orientation of mobile terminal, comprising:
Picture storage unit, input display unit and creation generating unit,
Wherein, the picture storage unit is stored with for showing the frame image and allowing operator to needing to add described in subtitle
Frame image carries out the display selection picture of selection, on the time axis described pre- to the frame image selected
Position data of fixing time is shown and operator is allowed to create the creation confirmation screen confirmed to subtitle and for subtitle
The subtitle of creation inputs picture,
The input display unit shows that the display selection picture allows the operator to select the frame image, and according to corresponding
Selection information shows that the creation confirmation screen allows the operator according to the predetermined time position data setting shown
It the current time location data of subtitle creation and subtitle is created carries out confirmation operation, further according to corresponding confirmation behaviour
The caption content that the subtitle input picture allows the operator at least to input the subtitle is shown as information,
The current time location data that the creation generating unit will be set and the caption content being entered and institute
State 360 degree of full-view image files that the associated generation of 360 degree of full-view images is stored with subtitle.
2. subtitle creating device according to claim 1, it is characterised in that:
Wherein, the subtitle is any one in literal type subtitle, image type subtitle and audio types subtitle.
3. subtitle creating device according to claim 2, it is characterised in that:
Wherein, the subtitle is any one in literal type subtitle and image type subtitle,
The caption content is for word content, picture material and in the word content or image being stored in predetermined memory
Hold any one in the link path information obtained,
The operator is allowed further to input the subtitle in institute when the input display unit shows the subtitle input picture
State the coordinate position data on the display screen of mobile terminal.
4. subtitle creating device according to claim 3, it is characterised in that:
Wherein, when the caption content of input is word content, the subtitle is word content；
When the caption content of input is picture material, the subtitle is picture material；
When the caption content of input is the link path information, the subtitle is to be arrived by the link path information
The word content or picture material obtained in the predetermined memory.
5. subtitle creating device according to claim 3, it is characterised in that:
Wherein, described in the same width in frame image not only containing literal type subtitle but also when containing image type subtitle, with the text
The corresponding text coordinate position data of word type subtitle and image coordinate location number corresponding with described image type subtitle
According to being different.
6. subtitle creating device according to claim 2, it is characterised in that:
Wherein, the subtitle is audio types subtitle,
The caption content is the link path information obtained to the audio file being stored in predetermined memory.
7. subtitle creating device according to claim 1, which is characterized in that further include:
Wherein, predetermined time position data, which contain, indicates that the corresponding frame image starts positional number at the beginning of display
Accordingly and indicate that the frame image shows the end time position data terminated,
The current time location data, which contain, indicates that the corresponding subtitle starts the current start time position data of display
With the current end time position data for indicating that the Subtitle Demonstration terminates, the current start time position data and described work as
Preceding end time position data is set in the range of the time started position data and end time position data.
8. a kind of be arranged in the mobile terminal of user, to by the plural frame frame image construction comprising predetermined displaying sequence and by
360 degree of full-view image files for being stored with subtitle that subtitle creating device creation of any of claims 1-7 generates
In the display module that is shown of 360 degree of full-view images, which is characterized in that by 360 degree of panoramic pictures according to predetermined exhibition
Show and sequentially forms the virtual time shaft containing each frame image, the time location data pair of the frame image on the time shaft
Should when showing the mobile terminal orientation, the display module includes:
Move angle acquisition unit obtains the movement of the mobile terminal according to movement of the mobile terminal on 360 degree of directions
Angle；
Time location data acquiring section obtains and the move angle phase according to the move angle and the scheduled duration
Corresponding time location data correspond to time location data as angle；
Image determines display unit, when the angle, which corresponds to time location data, is confirmed as the predetermined time position data,
The frame image corresponding with predetermined time position data is shown on the display screen；And
Subtitle determines displaying portion, when the time location data are confirmed as the current time location data, displaying and institute
State the corresponding subtitle of current time location data.
9. display module according to claim 8, it is characterised in that:
Wherein, when the subtitle is any one in literal type subtitle and image type subtitle, the display module
For display module, the subtitle determines that displaying portion is that subtitle determines display unit,
When the subtitle is audio types subtitle, the display module is playing module, and the subtitle determines that displaying portion is word
Curtain determines playback unit.
10. a kind of subtitle creation display system of 360 degree full-view images, which is characterized in that by 360 degree of panoramic pictures according to
Predetermined displaying sequentially forms the virtual time shaft containing each frame image, the time location of the frame image on the time shaft
Data correspond to the orientation of mobile terminal when showing, the subtitle creation display system includes:
Subtitle creating device, in 360 degree of full-view images for needing to be shown on the display screen of the mobile terminal of user
Frame image carry out corresponding subtitle creation；And
Mobile terminal is communicated to connect by communication network and the subtitle creating device,
Wherein, the subtitle creating device is subtitle creating device according to any one of claims 1 to 7,
Contain display module described in any one of claim 8 and 9 in the mobile terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610994563.6A CN106658220B (en) | 2016-11-11 | 2016-11-11 | Subtitle creating device, display module and subtitle create display systems |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610994563.6A CN106658220B (en) | 2016-11-11 | 2016-11-11 | Subtitle creating device, display module and subtitle create display systems |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106658220A CN106658220A (en) | 2017-05-10 |
| CN106658220B true CN106658220B (en) | 2019-11-19 |
Family
ID=58806639
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610994563.6A Expired - Fee Related CN106658220B (en) | 2016-11-11 | 2016-11-11 | Subtitle creating device, display module and subtitle create display systems |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106658220B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107124647A (en) * | 2017-05-27 | 2017-09-01 | 深圳市酷开网络科技有限公司 | A kind of panoramic video automatically generates the method and device of subtitle file when recording |
| CN107679068B (en) * | 2017-08-15 | 2021-03-05 | 深圳天珑无线科技有限公司 | Information importing and displaying method of multimedia file, mobile terminal and storage device |
| CN109756788B (en) * | 2017-11-03 | 2022-08-23 | 腾讯科技（深圳）有限公司 | Video subtitle automatic adjustment method and device, terminal and readable storage medium |
| CN108924598A (en) * | 2018-06-29 | 2018-11-30 | 北京优酷科技有限公司 | Video caption display methods and device |
| CN108833991A (en) * | 2018-06-29 | 2018-11-16 | 北京优酷科技有限公司 | Video caption display methods and device |
| CN109191971A (en) * | 2018-11-19 | 2019-01-11 | 哈尔滨学院 | A kind of preschool education interaction systems based on intelligent image identification |
| CN110189418A (en) * | 2019-05-27 | 2019-08-30 | 浙江开奇科技有限公司 | Image generating method and terminal device for digital guide to visitors |
| CN112019772A (en) * | 2020-09-07 | 2020-12-01 | 中图云创智能科技(北京)有限公司 | Method for correcting subtitle barrel-shaped deformation in panoramic video |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101082926A (en) * | 2007-07-03 | 2007-12-05 | 浙江大学 | Modeling approachused for trans-media digital city scenic area |
| CN101918983A (en) * | 2008-01-15 | 2010-12-15 | 谷歌公司 | Three-dimensional annotations for street view data |
| JP2013020559A (en) * | 2011-07-13 | 2013-01-31 | Nec Biglobe Ltd | Caption adding device, content data, caption adding method, and program |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5392388A (en) * | 1992-12-04 | 1995-02-21 | International Business Machines Corporation | Method and system for viewing graphic images in a data processing system |
| JP2003132362A (en) * | 2001-10-22 | 2003-05-09 | Sony Corp | Information communication system, information communication method and computer program |
| KR20060008787A (en) * | 2004-07-24 | 2006-01-27 | 주식회사 대우일렉트로닉스 | Caption control apparatus and method for wide television at the panorama mode |
| KR101777354B1 (en) * | 2011-06-20 | 2017-09-11 | 삼성전자주식회사 | Digital photographing apparatus, method for controlling the same, and computer-readable storage medium |
| CN102426703B (en) * | 2011-08-11 | 2014-04-09 | 重庆市勘测院 | Course and pitch angle speed acquisition method of vehicle panoramic image acquisition platform |
| CN102420898A (en) * | 2011-09-27 | 2012-04-18 | 惠州Tcl移动通信有限公司 | Mobile phone-based panoramic photographing realization method and mobile phone |
| WO2015163555A1 (en) * | 2014-04-22 | 2015-10-29 | 주식회사 뱁션 | Subtitle inserting system and method |
| WO2016004554A1 (en) * | 2014-06-16 | 2016-01-14 | 华为技术有限公司 | Method and apparatus for presenting panoramic photo in mobile terminal, and mobile terminal |
| CN105872353A (en) * | 2015-12-15 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | System and method for implementing playback of panoramic video on mobile device |
| CN105979169A (en) * | 2015-12-15 | 2016-09-28 | 乐视网信息技术（北京）股份有限公司 | Video subtitle adding method, device and terminal |
-
2016
- 2016-11-11 CN CN201610994563.6A patent/CN106658220B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101082926A (en) * | 2007-07-03 | 2007-12-05 | 浙江大学 | Modeling approachused for trans-media digital city scenic area |
| CN101918983A (en) * | 2008-01-15 | 2010-12-15 | 谷歌公司 | Three-dimensional annotations for street view data |
| JP2013020559A (en) * | 2011-07-13 | 2013-01-31 | Nec Biglobe Ltd | Caption adding device, content data, caption adding method, and program |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106658220A (en) | 2017-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106658220B (en) | Subtitle creating device, display module and subtitle create display systems | |
| Butz et al. | A hybrid indoor navigation system | |
| CN106453284B (en) | Tag update method, apparatus and terminal device is broadcast live | |
| EP2405349A1 (en) | Apparatus and method for providing augmented reality through generation of a virtual marker | |
| CN108198098B (en) | Self-service tourism method and mobile terminal | |
| CN103873944A (en) | Method and computer program product for establishing playback timing correlation between different contents to be playbacked | |
| CN105893022A (en) | Production method and system of combined user interface control, and control method and system of combined user interface control | |
| US7010533B1 (en) | E-mail preparation device, terminal device, information forwarding system, and program recording medium | |
| CN108924622A (en) | A kind of method for processing video frequency and its equipment, storage medium, electronic equipment | |
| US10789726B2 (en) | Methods and systems for film previsualization | |
| CN105466414B (en) | The recommendation method and server of a kind of navigation routine | |
| CN109660854A (en) | Video recommendation method, device, equipment and storage medium | |
| JP6321959B2 (en) | Display control apparatus, display control method, and program | |
| US20170220314A1 (en) | Group-viewing assistance device, group-viewing assistance method, and viewing apparatus | |
| CN103488661A (en) | Audio/video file annotation system | |
| CN110475140A (en) | Barrage data processing method, device, computer readable storage medium and computer equipment | |
| CN103514621A (en) | Case and event scene all-true dynamic 3D representation method and reconstruction system | |
| CN102810099B (en) | The storage method and device of augmented reality view | |
| CN109743438A (en) | A kind of method and apparatus sending multimedia messages | |
| CN105979167A (en) | Video producing method and video producing device | |
| CN113918522A (en) | File generation method and device and electronic equipment | |
| CN205726069U (en) | Unmanned vehicle controls end and unmanned vehicle | |
| CN109934932A (en) | A kind of method and system for realizing information push based on augmented reality | |
| CN101689207A (en) | Visit to collection of content items is provided | |
| CN105988679A (en) | Information presentation method and device and user equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20191119 |