CN105280207A - Playing method, device and system associated with touch information time - Google Patents
Playing method, device and system associated with touch information time Download PDFInfo
- Publication number
- CN105280207A CN105280207A CN201510397117.2A CN201510397117A CN105280207A CN 105280207 A CN105280207 A CN 105280207A CN 201510397117 A CN201510397117 A CN 201510397117A CN 105280207 A CN105280207 A CN 105280207A
- Authority
- CN
- China
- Prior art keywords
- time point
- time
- video
- play
- video object
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 60
- 231100000647 material safety data sheet Toxicity 0.000 claims description 27
- 230000002596 correlated effect Effects 0.000 claims description 5
- 238000009434 installation Methods 0.000 description 21
- 238000010586 diagram Methods 0.000 description 11
- 230000008859 change Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 230000001364 causal effect Effects 0.000 description 5
- 230000008901 benefit Effects 0.000 description 3
- 230000006835 compression Effects 0.000 description 3
- 230000000875 corresponding effect Effects 0.000 description 3
- 238000002372 labelling Methods 0.000 description 3
- 238000005070 sampling Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000004040 coloring Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Abstract
The invention provides a playing method associated with touch information time, which comprises the following steps: reading a data table, wherein the data table comprises at least one time point and video objects related to the at least one time point; playing the audio data; displaying the video data; and when the audio data is played to a playing time point related to the at least one time point, highlighting the video object in the video data related to the at least one time point.
Description
The application to be application number be 201510358850.3 name be called the divisional application of the application for a patent for invention of " recording method of touch information time, device, system and computer readable media ", the applying date of original application is on 06 25th, 2015.
Technical field
The invention relates to record and the broadcasting of multi-medium file, the record of the multi-medium file be particularly associated with sound about touch track and broadcasting.
Background technology
The electronic installation with touch technology has been used in the middle of the modern life widely.For example, in session or upper class hour, user, except using electronic installation recording, also can use pointer or finger at contact panel or the enterprising running hand write record of screen, and save as photo archive or video archive.Afterwards, user can listen to audio file while viewing photo archive or video archive.But owing to not having any associated record between audio file and picture/video archive, user must rely on the memory of itself link audio file and picture/video archive.
In sum, need a kind of can the mechanism of auto-associating audio file and picture/video archive, particularly audio file can be formed with the touch track in the middle of picture/video archive the mechanism associated, make user audio plays archives or picture/video archive wherein any one time, the record of another one can be associated with.
Summary of the invention
Fundamental purpose of the present invention is, overcome the existing electronic installation Problems existing with touch technology, and a kind of player method being associated with the touch information time, device and system is newly provided, technical matters to be solved makes it can auto-associating audio file and picture/video archive, is very suitable for practicality.
In one embodiment of the invention, provide the recording method of a kind of touch information time, it comprises: receive the first touch point information; Judge that whether this first touch point is the starting point of track; And when this first touch point is the starting point of this track, record receives very first time point during this first touch point information.
In another embodiment, the invention provides a kind of pen recorder being associated with the touch information time, it comprises: time point generation module; And processing module, for receiving touch information to produce the first touch point information from contactor control device, judge that whether this first touch point is starting point that track comprises, and when this first touch point is the starting point of this track, records the very first time that this time point generation module is receiving this first touch point information and put memory module.
In a more embodiment, the invention provides a kind of register system being associated with the touch information time, it comprises: contactor control device; Memory module; And treating apparatus, this treating apparatus comprises: time point generation module; And processing module, for receiving touch information to produce the first touch point information from this contactor control device, judge that whether this first touch point is starting point that track comprises, and when this first touch point is the starting point of this track, records the very first time that this time point generation module is receiving this first touch point information and put this memory module.
In some embodiments, the invention provides a kind of media of embodied on computer readable, it comprises following data: at least one time point being associated with audio data; And be associated with at least one video object of this at least one time point, wherein this at least one video object is included in the middle of video data.
The object of the invention to solve the technical problems realizes by the following technical solutions.In one embodiment of the invention, provide a kind of player method being associated with the touch information time, it comprises: read a MSDS, and this MSDS comprises the video object that at least one time point of at least one time point and this is associated; Audio plays data; Display video material; And when playing this audio data to the play time that this at least one time point is relevant, highlight this video object associated with this at least one time point in the middle of this video data.
The object of the invention to solve the technical problems also can be applied to the following technical measures to achieve further.
Aforesaid player method, wherein this at least one time point and this play time are within the scope of error time.
Aforesaid player method, wherein this play time is early than this at least one time point.
Aforesaid player method, wherein this play time corresponds to the sub-data section of this audio data.
Aforesaid player method, wherein this video object comprises at least one viewing area.
Aforesaid player method, wherein this video object comprises at least one track.
The object of the invention to solve the technical problems also realizes by the following technical solutions.In another embodiment, the invention provides a kind of player method being associated with the touch information time, it comprises: read MSDS, this MSDS comprises at least one video object that at least one time point of at least one time point and this is associated; Display comprises the video data of this at least one video object; And when this at least one video object is clicked, the play time relevant from this at least one time point starts audio plays data.
The object of the invention to solve the technical problems also can be applied to the following technical measures to achieve further.
Aforesaid player method, more comprises: when this at least one video object is clicked, highlight this at least one video object.
Aforesaid player method, wherein this at least one time point and this play time are within the scope of error time.
Aforesaid player method, wherein this play time is early than this at least one time point.
Aforesaid player method, wherein this play time corresponds to the sub-data section of this audio data.
Aforesaid player method, wherein this video object comprises at least one viewing area.
Aforesaid player method, wherein this video object comprises at least one track.
Aforesaid player method, more comprises: when this video object is associated with multiple time point, show the plurality of time point; And when one of them of the plurality of time point is clicked, started to play this audio data by the play time that the time point clicked is relevant from this.
Aforesaid player method, more comprises: when this video object is associated with multiple time point, in the middle of the plurality of time point a time point the earliest the play time of being correlated with start to play this audio data.
The object of the invention to solve the technical problems realizes in addition more by the following technical solutions.In a more embodiment, the invention provides a kind of playing device being associated with the touch information time, for performing the following step: read MSDS from memory module, wherein this MSDS comprises the video object that at least one time point of at least one time point and this is associated; Make audio playing apparatus audio plays data; And make video display devices display video material, when this audio playing apparatus plays this audio data to the play time that this at least one time point is relevant, this video display devices is made to highlight this video object associated with this at least one time point in the middle of this video data.
The object of the invention to solve the technical problems also can be applied to the following technical measures to achieve further.
Aforesaid playing device, wherein this at least one time point and this play time are within the scope of error time.
Aforesaid playing device, wherein this play time is early than this at least one time point.
Aforesaid playing device, wherein this play time corresponds to the sub-data section of this audio data.
Aforesaid playing device, wherein this video object comprises at least one viewing area.
Aforesaid playing device, wherein this video object comprises at least one track.
The object of the invention to solve the technical problems also realizes in addition by the following technical solutions.In some embodiments, the invention provides a kind of Play System being associated with the touch information time, it comprises: memory module, and for the table that stores data, this MSDS comprises the video object that at least one time point of at least one time point and this is associated; Audio playing apparatus; Video display devices; Treating apparatus, for reading this MSDS from this memory module, and make this audio playing apparatus audio plays data and make this video display devices display video material, when this audio playing apparatus plays this audio data to the play time that this at least one time point is relevant, this video display devices is made to highlight this video object associated with this at least one time point in the middle of this video data.
The object of the invention to solve the technical problems also realizes in addition by the following technical solutions.In one embodiment, the invention provides a kind of playing device being associated with the touch information time, for performing the following step: read MSDS from memory module, wherein this MSDS comprises the video object that at least one time point of at least one time point and this is associated; Video display devices is made to show the video data comprising this at least one video object; And when this at least one video object is clicked, make audio playing apparatus start audio plays data from the play time that this at least one time point is relevant.
The object of the invention to solve the technical problems also can be applied to the following technical measures to achieve further.
Aforesaid playing device, more for: when this at least one video object is clicked, make this video display devices highlight this at least one video object.
Aforesaid playing device, wherein this at least one time point and this play time are within the scope of error time.
Aforesaid playing device, wherein this play time is early than this at least one time point.
Aforesaid playing device, wherein this play time corresponds to the sub-data section of this audio data.
Aforesaid playing device, wherein this video object comprises at least one viewing area.
Aforesaid playing device, wherein this video object comprises at least one track.
Aforesaid playing device, more for: when this video object is associated with multiple time point, make this video display devices show the plurality of time point; And when one of them of the plurality of time point is clicked, make this audio playing apparatus be started to play this audio data by the play time that the time point clicked is relevant from this.
Aforesaid playing device, more for: when this video object is associated with multiple time point, make this audio playing apparatus in the middle of the plurality of time point a time point the earliest the play time of being correlated with start to play this audio data.
The object of the invention to solve the technical problems also realizes in addition by the following technical solutions.In another embodiment, the invention provides a kind of Play System being associated with the touch information time, it comprises: memory module, and for the table that stores data, this MSDS comprises the video object that at least one time point of at least one time point and this is associated; Audio playing apparatus; Video display devices; And treating apparatus, for reading this MSDS from this memory module, this video display devices is made to show the video data comprising this at least one video object, and when this at least one video object is clicked, make this audio playing apparatus start audio plays data from the play time that this at least one time point is relevant.
The present invention compared with prior art has obvious advantage and beneficial effect.By technique scheme, the present invention is associated with the player method of touch information time, device and system and at least has following advantages and beneficial effect:
The present invention can auto-associating audio file and picture/video archive, particularly audio file can be formed with the touch track in the middle of picture/video archive and associate, make user audio plays archives or picture/video archive wherein any one time, another record can be associated with.
Above-mentioned explanation is only the general introduction of technical solution of the present invention, in order to technological means of the present invention can be better understood, and can be implemented according to the content of instructions, and can become apparent to allow above and other object of the present invention, feature and advantage, below especially exemplified by preferred embodiment, and coordinate accompanying drawing, be described in detail as follows.
Accompanying drawing explanation
Fig. 1 is the schematic diagram of touch track according to an embodiment of the invention.
Fig. 2 is a schematic diagram of touch track and recording track according to an embodiment of the invention.
Fig. 3 is a schematic diagram of track according to an embodiment of the invention.
Fig. 4 is a block diagram of the register system being associated with the touch information time according to an embodiment of the invention.
Fig. 5 is a schematic flow sheet of the recording method of touch information time according to an embodiment of the invention.
Fig. 6 is a schematic flow sheet of the recording method of touch information time according to an embodiment of the invention.
Fig. 7 is a schematic flow sheet of the recording method of touch information time according to an embodiment of the invention.
Fig. 8 is the block diagram that the Play System of touch information time is linked in a kind of according to an embodiment of the invention pass.
Fig. 9 is a schematic flow sheet of the player method of touch information time according to an embodiment of the invention.
Figure 10 is a schematic flow sheet of the player method of touch information time according to an embodiment of the invention.
[main element symbol description]
100: touch screen 110: touch track
120: touch track 130: touch track
140: touch track 200: contact panel/screen
210: arc lines 221 ~ 226: touch point
300: contact panel/screen 310: track
320: track 330: track
331: point 332: point
340: track 400: register system
410: contactor control device 420: memory module
430: treating apparatus 431: interface
432: time point generation module 433: processing module
510 ~ 560: step 640 ~ 650: step
740: step 800: Play System
810: audio playing apparatus 820: video display devices
830: memory module 840: treating apparatus
910 ~ 940: step 1020 ~ 1040: step
Embodiment
For further setting forth the present invention for the technological means reaching predetermined goal of the invention and take and effect, below in conjunction with accompanying drawing and preferred embodiment, to the player method being associated with the touch information time proposed according to the present invention, device and its embodiment of system, method, step, feature and effect thereof, be described in detail as follows.
Some embodiments of the present invention will be described in detail as follows.But except following description, the present invention can also implement in other embodiments widely, and protection scope of the present invention is not by the restriction of embodiment, and it is as the criterion with the protection domain of claim.Moreover for providing clearer description and being easier to understand the present invention, graphic interior each several part is not drawn according to its relative size, and some size is exaggerated compared with other scale dependents; Incoherent detail section does not also show completely, in the hope of graphic succinct.
The recording of indication of the present invention, in one embodiment, electronic installation can utilize the sound arround the soft and hardware recording of itself.Electronic installation can through sampling sound, encode and/or the signal transacting such as compression program after, become audio file.The present invention does not limit the form of audio file, sampling rate, coding and/or compression factor.In another embodiment, electronic installation can play the sound of some form, and after signal transacting, can become audio file.For example, electronic installation can download audio data immediately from the webserver, also can from Speech input port audio reception data.In the middle of some embodiment, electronic installation not only can obtain audio data by single source.In other words, electronic installation can mix multiple audio data to form new audio file.
The touch track of indication of the present invention, can comprise pointer near or the track of contact surface plate/screen, also can comprise finger near or the track of contact surface plate/screen.In certain embodiments, contact panel/screen can pick out each in the middle of branched pointer.The present invention does not limit touch technology, no matter is the touch technologies such as resistance-type, condenser type, projected capacitive, surperficial ultrasonic, optical projection type, as long as can produce touch track person, all can be suitable for the present invention.
As previously mentioned, while problem to be solved by this invention is recording, record touch track, makes these two kinds of media to associate in time.In one embodiment of this invention, the records application program of an integration can be used, above-mentioned recording can be performed and record touch track and time correlation therebetween.In the middle of a certain example, can by audio frequency and other data loggings in same archives.In the middle of another example, also can by audio frequency from other data loggings in different but relevant multiple archives.Can separate and play wherein some archives independently, also can play relevant multiple archives in conformability ground.
In the middle of another embodiment of the present invention, a recorded program and a touch track records application program can be used, so as by audio frequency from other data loggings in different but relevant multiple archives.Can separate and play wherein some archives independently, also can by the playing program integrated, relevant multiple archives are play on conformability ground.
Referring to shown in Fig. 1, is the schematic diagram of touch track according to an embodiment of the invention.In the middle of Fig. 1, the Petting Area touching screen 100 is divided into multiple region.In the middle of the embodiment shown in Fig. 1, above-mentioned region is square, and the area in each region is identical.These square area are divided into six rows, often arrange ten.In the middle of other embodiment, the shape in region can be other shapes, such as rectangle or sexangle, and the area in each region also can be different.In one embodiment, more often by touch-control to region can be divided into more multiple subarea territory, the area of every sub regions is less.The present invention does not limit the number in multiple region, shape and area.
In the middle of the embodiment shown in Fig. 1, include four touch track 110 ~ 140 with time order and function order, form a smiling face.Whenever receiving a touch point, electronic installation can judge whether this touch point falls a new region.In other words, electronic installation can judge whether this touch point is positioned at different regions from previous touch point.Such as, when first point that touch track 110 enters C3 region is detected, electronic installation can record a time point in corresponding C3 region.
This time point can be the time in electronic installation, also can be relative to any time of audio file.For example, can be the time point relative to audio file beginning, also can be a period of time relative to putting previous writing time.Often kind of electronic installation can record or be ready that the temporal analytical density recorded may be different, what have can be as accurate as centisecond, and what have can be as accurate as microsecond.The time point of each record admits of error, or the adjustment deliberately carried out, so that the data structure of the audio frequency that aligns, and such as frame (frame) structure etc.The present invention is the form of limiting time point and resolution not, only needs touch trajectory and audio file associated to be got up.
When touch track 110 leaves C3 region, when first touch point entering B3 region is detected, owing to being positioned at different regions from previous touch point, electronic installation just can record a time point in corresponding B3 region.Similarly, when touch track 110 leaves B3 region, when first touch point entering B4 region is detected, owing to being positioned at different regions from previous touch point, electronic installation just can record a time point in corresponding B4 region, by that analogy.
Please refer to table one, it is a relevant data table according to an embodiment of the invention.In the middle of the embodiment of table one, do not consider touch track, and only consider the relation in touch point and region.In the middle of the embodiment of Fig. 1, because the Petting Area touching screen 100 has 60 regions, therefore this relevant data table is up to 60 regions and relevant time point thereof.In the middle of table one, the region be not touched has been omitted, and does not carry out record, to save storer.Certainly, also storer can be saved, to promote the speed of record and the data of taking-up.
Table one
It should be noted that E5 region and E7 region, close respectively and link two time points.First time point is that touch track 130 enters this region and recorded, and second time point is touch track 140 enters this region and recorded.
In one embodiment, table one may reside in the middle of above-mentioned conformability multi-medium file, also can have one and independently associate in archives, can also be present in video archive.When playing video data, can from above-mentioned conformability multi-medium file, independently associate reading table one archives or video archive.When the vernier/finger/pointer of user points to or when being suspended in a certain region, electronic installation can find the time point of association from table one, and plays the audio frequency of this time point.The step of audio plays can be automatic, also can be just to play after user gives an order.
In the middle of the present invention, so-called video data comprises any data that can show, and can be experienced by the eyes of user.Video data can be dynamic film, static film and/or the visual material in conjunction with the dynamic and stalic state.In the middle of the present invention, summarize above-mentioned definition with video data one word.
When having multiple time point in this region, electronic installation can play the audio frequency of time point the earliest automatically, and user also can be allowed to click the audio frequency will playing which time point.For example, when the vernier/finger/pointer of user is pointed to or when being suspended in E5 region, can occur that 00h:00m:03s:11 and 00h:00m:04s:11 two time points click and broadcasting for user.Similarly, E7 region also there will be 00h:00m:03s:31 and 00h:00m:04s:51 two time points and clicks and broadcasting for users.
In the middle of the above embodiments, the broadcasting of audio data is from the time point be recorded.But, in another embodiment, also can play from a period of time before or after the time point be recorded.Such as, can start to play two seconds before the time point of record.
The reproduction time that the present invention does not limit audio data is the time point be recorded just.In the middle of some embodiment, the structure of audio data or other restrictions may cause error.For example, because after the signal transacting such as sampling, coding, compression, audio data may be carried out record in units of 1/10th seconds, also may be irregularly between carry out record as a unit.In this case, although the time point of record can be as accurate as centisecond, during audio plays data, cannot accurately play from the time point be recorded.Those having ordinary skill in the art will appreciate that, admit of error between the time point that the time point of record and audio data are play, maybe can adjust.As long as but the broadcasting of audio data is carried out according to the time point be recorded, even if having error or do further adjustment, all fall within the scope of the invention.
In the middle of the data structure of table one, query time point can be carried out from region, also oppositely can carry out query region from time point, but reverse querying method needs each row of his-and-hers watches one to carry out at least one query.In another embodiment, the data structure as table two can be made, allow time point carry out query region.
Table two
| Point correlation time (relatively) | Region labeling |
| 00h:00m:01s:11 | C3 |
| 00h:00m:01s:21 | B3 |
| 00h:00m:01s:31 | B4 |
| 00h:00m:01s:41 | B5 |
| 00h:00m:02s:11 | B7 |
| 00h:00m:02s:21 | B8 |
| 00h:00m:02s:31 | B9 |
| 00h:00m:02s:41 | C9 |
| 00h:00m:03s:11 | E5 |
| 00h:00m:03s:21 | E6 |
| 00h:00m:03s:31 | E7 |
| 00h:00m:04s:11 | E5 |
| 00h:00m:04s:21 | F5 |
| 00h:00m:04s:31 | F6 |
| 00h:00m:04s:41 | F7 |
| 00h:00m:04s:51 | E7 |
The record position of table two, may reside in the middle of above-mentioned conformability multi-medium file, also can have one and independently associate in archives, can also be present in audio file.When audio plays data, can from above-mentioned conformability multi-medium file, independently associate reading table two archives or video archive.When be played to sometime and audio frequency between next time point time, relevant region can be highlighted on screen.For example, between 00h:00m:01s:11 to 00h:00m:01s:21, C3 region can be highlighted.Between 00h:00m:01s:21 to 00h:00m:01s:31, B3 region can be highlighted.
Those having ordinary skill in the art will appreciate that, above-mentioned highlighting can utilize various ways to reach.For example show other kind of color, glimpse, lines are widened, enclose at least one of the area coloring accounted for etc. mode or its combination.
In the middle of the above embodiments, touch track is equal to the track in video archive, therefore table one and the region in table two, is close to link touch point.But under some situation, the track that touch track and video archive record is different.Referring to shown in Fig. 2, is a schematic diagram of touch track and recording track according to an embodiment of the invention.
In the middle of the embodiment shown in Fig. 2, include six touch points 221 to 226 on contact panel/screen 200, and arc lines 210.The starting point of camber line lines 210 is first touch point 221, and terminating point is last touch point 226.When user will draw arc lines 210, pointer or finger can through above-mentioned six touch points, and video data only can record arc lines 210, and can not record this six touch points.Furthermore, six above-mentioned touch points involve five regions, are also C1, B1, A2, B3 and B4.And five regions that arc lines involve are C1, B1, B2, B3 and B4.Can be clear that, touch point 223 and 224 is positioned at A2 region, and arc lines 210 can't through A2 region.Otherwise arc lines 210 have through B2 region, and do not have any touch point in B2 region.
Those having ordinary skill in the art will appreciate that, the mode of video data record arc lines 210 has many kinds.In certain embodiments, the every bit that arc lines 210 comprise can be recorded.In other embodiments, the initial of arc lines 210 and final position can be recorded, and its radian and point midway.Although in the middle of the embodiment of Fig. 2, only with arc lines 210 exemplarily.But those having ordinary skill in the art will appreciate that, the example that touch track is different from recording track also has very many.For example, draw circle, rectangle, square, polygon etc., its touch track is all different from recording track.Again for example, after gathering several touch track, electronic installation can be recognized as word, and transfers shorthand etc.
In one embodiment, by the Zone Full of arc lines 210 processes, the time point of starting point 221 can all be corresponded to.Please refer to table three, it is the enforcement example recording arc lines 210 according to the form of table one.It is all identical for can seeing that the correlation time in these regions puts.Thus, no matter be which region point arrives, all can hear the audio data that the time point associated with touch point 221 starts.
Table three
| Region labeling | Point correlation time (relatively) |
| B1 | 00h:00m:01s:11 |
| B2 | 00h:00m:01s:11 |
| B3 | 00h:00m:01s:11 |
| B4 | 00h:00m:01s:11 |
| C1 | 00h:00m:01s:11 |
Similarly, by the content of table three, the table four carrying out associated region with time point can be converted to.In other words, when the time point that audio plays data associates to this, five regions at arc lines 210 place are all highlighted.
Table four
| Point correlation time (relatively) | Region labeling |
| 00h:00m:01s:11 | B1 |
| 00h:00m:01s:11 | B2 |
| 00h:00m:01s:11 | B3 |
| 00h:00m:01s:11 | B4 |
| 00h:00m:01s:11 | C1 |
Referring to shown in Fig. 3, is a schematic diagram of track according to an embodiment of the invention.Compared to Figure 1, the contact panel/screen 300 of Fig. 3 is no longer cut into multiple region.User still depicts four tracks 310 to 340.
In one embodiment, these tracks 310 to 340 can be touch track, also can be the tracks that video data records.Associated by every bar track to time point be that electronic installation detects the time point of first touch point forming this track.The present invention does not limit and how will record these tracks 310 to 340.In an example, a track can be represented by the coordinate recording each touch point.In another example, by recording at least one coordinate and at least one geometric parameter represents a track, such as, can record coordinate and the radius in the center of circle.First touch point that it should be noted that circular trace may not be the center of circle, and also namely the coordinate of touch point may not necessarily go on record.
Please refer to table five, it is the reference table put track label and correlation time.Can according to the sequencing sequential of each track, also can according at least one coordinate sequential of each track.
Table five
| Point correlation time (relatively) | Track label |
| 00h:00m:01s:11 | 310 |
| 00h:00m:02s:11 | 320 |
| 00h:00m:03s:11 | 330 |
| 00h:00m:04s:11 | 340 |
When audio plays data, can after some correlation times to put, the track of correspondence highlights before putting by next correlation time.For example, after time point 00h:00m:01s:11, before time point 00h:00m:02s:11, track 310 is highlighted.In the middle of a change of table five, each track can also close the time point linking end.In the middle of another change of table five, multiple trajectory set can also be synthesized a track label, use single field to represent the point of initial and/or end time associated by multiple track.
On the contrary, when user clicks a certain track of video data, such as, during track 320, then electronic installation can put 00h:00m:02s:11 audio plays data from correlation time.It should be noted that and those having ordinary skill in the art will appreciate that, clicking a certain track can have many implementations.Such as to choose on track, within certain limit that point chooses trajectory shape, point chooses in scope that track surrounds or point is chosen within a certain form range that track extends out, can put and choose a certain track.
In the middle of the example shown in Fig. 3, track 330 and track 340 are occur simultaneously at point 331 and point 332 parts.In one embodiment, when put choose a little 331 or point 332 time, user can be allowed to select the audio data of two time points of broadcasting associated by track 330 and 340.In another embodiment, when put choose a little 331 or put 332 time, user can not be allowed to select audio plays data, and force user will click other parts of not occuring simultaneously of track 330 or 340.
Referring to shown in Fig. 4, is a block diagram of the register system 400 being associated with the touch information time according to an embodiment of the invention.This register system 400 comprise contactor control device 410, memory module 420, with a treating apparatus 430.Above-mentioned contactor control device 410 can be contact panel, also can be touch control screen.This treating apparatus 430 also comprises an interface 431 to be connected to this contactor control device 410, one time point generation module 432 with generation time point and a processing module 433.In one embodiment, this treating apparatus 430 also can be directly connected to this contactor control device 410, to receive touch point relevant information.Above-mentioned time point generation module 432 can receive clock signal or time signal, with generation time point to the combination of the software of processing module 433, hardware or software and hardware.This processing module 433 can be a computing unit, for performing the operating system of this register system 400, driver and/or application program.
Referring to shown in Fig. 5, is a schematic flow sheet of the recording method of touch information time according to an embodiment of the invention.This recording method can performed by the processing module 433 of Fig. 4.It should be noted that the present invention does not limit the execution sequence of each step except having except apparent causal connection between each step, also not limiting and can not add other steps between each step.It is below the explanation of each step.
Step 510: receive one first touch point information.This processing module 433 can obtain or receive a touch point information by interface 431 or directly from this contactor control device 410.
Step 520: judge that whether this first touch point is starting point that a track comprises.The definition of above-mentioned track can referring to figs. 1 to the related description of Fig. 3.
Step 530: when this first touch point is the starting point of this track, record receives a very first time point of this first touch point.Following step 535 to 560 is optional step.
Step 535: the first area judging this first touch point place.The definition of above-mentioned first area can the related description of reference diagram 1 and Fig. 2.
Step 540: record is associated with this first area of this very first time point.In one embodiment, the data structure table of table one to table four and so on can be obtained, and be stored in the middle of memory module 420.
Step 545: receive one second touch point information.Here the second touch point referred to might not be second touch point after first touch point, and can be that after first touch point second is to N number of touch point.
Step 550: judge this second touch point whether for this track comprise a bit.
Step 555: when this second touch point for this track comprise some time, judge a second area at the second touch point place.It is worth mentioning that, when this second touch point be not this track comprise some time, this second touch point may be the first point of another track, go for step 510 start flow process.
Step 560: when this second area is not equal to this first area, record receives one second time point of this second touch point and is associated with this second area of this second time point.In one embodiment, the data structure table of table one to table four and so on can be obtained, and be stored in the middle of memory module 420.
Referring to shown in Fig. 6, is a schematic flow sheet of the recording method of touch information time according to an embodiment of the invention.This recording method can performed by the processing module 433 of Fig. 4.It should be noted that the present invention does not limit the execution sequence of each step except having except apparent causal connection between each step, also not limiting and can not add other steps between each step.Fig. 6 is one change embodiment illustrated in fig. 5, and first three step is identical, unlike the explanation of optional step 640 and 650.
Step 640: judge this track comprise the region at each point place.The definition of above-mentioned track can referring to figs. 1 to the related description of Fig. 3.In one embodiment, each point that this track comprises is touch point, embodiment as shown in Figure 1.In another embodiment, this track at least comprises a non-touch-control point, embodiment as shown in Figure 2.
Step 650: respectively record be associated with this track of this very first time point comprise the region at each point place.Each region Dou Guan links identical very first time point, and is stored in the middle of memory module 420.
Referring to shown in Fig. 7, is a schematic flow sheet of the recording method of touch information time according to an embodiment of the invention.This recording method can performed by the processing module 433 of Fig. 4.It should be noted that the present invention does not limit the execution sequence of each step except having except apparent causal connection between each step, also not limiting and can not add other steps between each step.Fig. 7 is one change embodiment illustrated in fig. 5, and first three step is identical, unlike the explanation of optional step 740.
Step 740: record this track put about this very first time.Above-mentioned track can be the track of Fig. 5 embodiment.In one embodiment, each point that this track comprises is touch point.In another embodiment, this track at least comprises a non-touch-control point.In certain embodiments, the step of this recording track also can comprise at least one coordinate points recording this track, still can comprise the parameter of at least one the non-coordinate points recording this track.
In the middle of embodiment shown in Fig. 5 to Fig. 7, these recording methods can comprise record one audio data, and wherein this very first time puts is the point being sometime associated with this audio data.Still can comprise record one video data, this video data comprises this track.
Referring to shown in Fig. 8, is the block diagram that the Play System 800 of touch information time is linked in a kind of according to an embodiment of the invention pass.This Play System 800 comprise audio playing apparatus 810, video display devices 820, memory module 830, with a treating apparatus 840.Above-mentioned video display devices 820 can be touch control screen, also can be the general display device not having touch-control input capability.This treating apparatus 840 can be a computing unit, for performing the operating system of this Play System 800, driver and/or application program, can control other above-mentioned device/modules 810 to 830.In one embodiment, this treating apparatus 840 can comprise the part or all of of the processing module 433 shown in Fig. 4.This treating apparatus 840 may be used for performing each following player method.
Referring to shown in Fig. 9, is a schematic flow sheet of the player method of touch information time according to an embodiment of the invention.This player method can performed by the treating apparatus 840 of Fig. 8.It should be noted that the present invention does not limit the execution sequence of each step except having except apparent causal connection between each step, also not limiting and can not add other steps between each step.
Step 910: read the MSDS in the middle of this memory module 830, this MSDS comprises the video object that at least one time point is associated with this at least one time point.This MSDS can be that above-mentioned table one changes to the wherein a kind of of table five or its.In one embodiment, this video object comprises at least one viewing area, if table one is to the viewing area of table four reference.In another embodiment, this video object comprises at least one track, as the track of Fig. 1 to Fig. 3 institute reference.
Step 920: make this audio playing apparatus 810 play an audio data.
Step 930: make this video display devices 820 show a video data.
Step 940: when this audio playing apparatus 810 plays this audio data to the play time that this at least one time point is relevant, make this video display devices 820 highlight this video object associated with this at least one time point in the middle of this video data.
In one embodiment, this at least one time point and this play time are within the scope of an error time.In another embodiment, this play time is early than this at least one time point.In a more embodiment, this play time corresponds to a sub-data section of this audio data.
Referring to shown in Figure 10, is a schematic flow sheet of the player method of touch information time according to an embodiment of the invention.This player method can performed by the treating apparatus 840 of Fig. 8.It should be noted that the present invention does not limit the execution sequence of each step except having except apparent causal connection between each step, also not limiting and can not add other steps between each step.The step 910 of Figure 10 can be suitable for the explanation of Fig. 9 step 910, repeats no more.
Step 1020: display comprises a video data of this at least one video object.
Step 1030: when this at least one video object is clicked, a play time relevant from this at least one time point starts to play an audio data.
Optional step 1040: when this at least one video object is clicked, highlight this at least one video object.
In one embodiment, this at least one time point and this play time are within the scope of an error time.In another embodiment, this play time is early than this at least one time point.In another embodiment, this play time corresponds to a sub-data section of this audio data.
In the middle of a change of Figure 10 embodiment, when multiple time point is linked in this video object pass, show the plurality of time point.When one of them of the plurality of time point is clicked, started to play this audio data by the play time that the time point clicked is relevant from this.In the middle of another change in the middle of the plurality of time point a time point the earliest the play time of being correlated with start to play this audio data.
The above, it is only preferred embodiment of the present invention, not any pro forma restriction is done to the present invention, although the present invention discloses as above with preferred embodiment, but and be not used to limit the present invention, any those skilled in the art, do not departing within the scope of technical solution of the present invention, make a little change when the technology contents of above-mentioned announcement can be utilized or be modified to the Equivalent embodiments of equivalent variations, in every case be do not depart from technical solution of the present invention content, according to any simple modification that technical spirit of the present invention is done above embodiment, equivalent variations and modification, all still belong in the scope of technical solution of the present invention.
Claims (32)
1. be associated with the player method of touch information time, it is characterized in that comprising:
Read MSDS, this MSDS comprises the video object that at least one time point of at least one time point and this is associated;
Audio plays data;
Display video material; And
When playing this audio data to the play time that this at least one time point is relevant, highlight this video object associated with this at least one time point in the middle of this video data.
2. player method as claimed in claim 1, is characterized in that wherein this at least one time point and this play time are within the scope of error time.
3. player method as claimed in claim 1, is characterized in that wherein this play time is early than this at least one time point.
4. player method as claimed in claim 1, is characterized in that wherein this play time corresponds to the sub-data section of this audio data.
5. player method as claimed in claim 1, is characterized in that wherein this video object comprises at least one viewing area.
6. player method as claimed in claim 1, is characterized in that wherein this video object comprises at least one track.
7. be associated with the player method of touch information time, it is characterized in that comprising:
Read MSDS, this MSDS comprises at least one video object that at least one time point of at least one time point and this is associated;
Display comprises the video data of this at least one video object; And
When this at least one video object is clicked, the play time relevant from this at least one time point starts audio plays data.
8. player method as claimed in claim 7, is characterized in that more comprising:
When this at least one video object is clicked, highlight this at least one video object.
9. player method as claimed in claim 7, is characterized in that wherein this at least one time point and this play time are within the scope of error time.
10. player method as claimed in claim 7, is characterized in that wherein this play time is early than this at least one time point.
11. player methods as claimed in claim 7, is characterized in that wherein this play time corresponds to the sub-data section of this audio data.
12. player methods as claimed in claim 7, is characterized in that wherein this video object comprises at least one viewing area.
13. player methods as claimed in claim 7, is characterized in that wherein this video object comprises at least one track.
14. player methods as claimed in claim 7, is characterized in that more comprising:
When this video object is associated with multiple time point, show the plurality of time point; And
When one of them of the plurality of time point is clicked, started to play this audio data by the play time that the time point clicked is relevant from this.
15. player methods as claimed in claim 7, is characterized in that more comprising:
When this video object is associated with multiple time point, in the middle of the plurality of time point a time point the earliest the play time of being correlated with start to play this audio data.
16. 1 kinds of playing devices being associated with the touch information time, is characterized in that for performing the following step:
Read MSDS from memory module, wherein this MSDS comprises the video object that at least one time point of at least one time point and this is associated;
Make audio playing apparatus audio plays data; And
Make video display devices display video material, when this audio playing apparatus plays this audio data to the play time that this at least one time point is relevant, this video display devices is made to highlight this video object associated with this at least one time point in the middle of this video data.
17. playing devices as claimed in claim 16, is characterized in that wherein this at least one time point and this play time are within the scope of error time.
18. playing devices as claimed in claim 16, is characterized in that wherein this play time is early than this at least one time point.
19. playing devices as claimed in claim 16, is characterized in that wherein this play time corresponds to the sub-data section of this audio data.
20. playing devices as claimed in claim 16, is characterized in that wherein this video object comprises at least one viewing area.
21. playing devices as claimed in claim 16, is characterized in that wherein this video object comprises at least one track.
22. 1 kinds of Play Systems being associated with the touch information time, is characterized in that comprising:
Memory module, for the table that stores data, this MSDS comprises the video object that at least one time point of at least one time point and this is associated;
Audio playing apparatus;
Video display devices;
Treating apparatus, for reading this MSDS from this memory module, and make this audio playing apparatus audio plays data and make this video display devices display video material, when this audio playing apparatus plays this audio data to the play time that this at least one time point is relevant, this video display devices is made to highlight this video object associated with this at least one time point in the middle of this video data.
23. 1 kinds of playing devices being associated with the touch information time, is characterized in that for performing the following step:
Read MSDS from memory module, wherein this MSDS comprises the video object that at least one time point of at least one time point and this is associated;
Video display devices is made to show the video data comprising this at least one video object; And
When this at least one video object is clicked, audio playing apparatus is made to start audio plays data from the play time that this at least one time point is relevant.
24. playing devices as claimed in claim 23, it is characterized in that more for:
When this at least one video object is clicked, this video display devices is made to highlight this at least one video object.
25. playing devices as claimed in claim 23, is characterized in that wherein this at least one time point and this play time are within the scope of error time.
26. playing devices as claimed in claim 23, is characterized in that wherein this play time is early than this at least one time point.
27. playing devices as claimed in claim 23, is characterized in that wherein this play time corresponds to the sub-data section of this audio data.
28. playing devices as claimed in claim 23, is characterized in that wherein this video object comprises at least one viewing area.
29. playing devices as claimed in claim 23, is characterized in that wherein this video object comprises at least one track.
30. playing devices as claimed in claim 23, it is characterized in that more for:
When this video object is associated with multiple time point, this video display devices is made to show the plurality of time point; And
When one of them of the plurality of time point is clicked, this audio playing apparatus is made to be started to play this audio data by the play time that the time point clicked is relevant from this.
31. playing devices as claimed in claim 23, it is characterized in that more for:
When this video object is associated with multiple time point, make this audio playing apparatus in the middle of the plurality of time point a time point the earliest the play time of being correlated with start to play this audio data.
32. 1 kinds of Play Systems being associated with the touch information time, is characterized in that comprising:
Memory module, for the table that stores data, this MSDS comprises the video object that at least one time point of at least one time point and this is associated;
Audio playing apparatus;
Video display devices; And
Treating apparatus, for reading this MSDS from this memory module, this video display devices is made to show the video data comprising this at least one video object, and when this at least one video object is clicked, make this audio playing apparatus start audio plays data from the play time that this at least one time point is relevant.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW103121856 | 2014-06-25 | ||
| TW103121856A TWI556154B (en) | 2014-06-25 | 2014-06-25 | Recording method, apparatus, system, and computer readable media of touch information timing |
| CN201510358850.3A CN105224587B (en) | 2014-06-25 | 2015-06-25 | Method, device and system for recording touch information time and computer readable medium |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510358850.3A Division CN105224587B (en) | 2014-06-25 | 2015-06-25 | Method, device and system for recording touch information time and computer readable medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105280207A true CN105280207A (en) | 2016-01-27 |
| CN105280207B CN105280207B (en) | 2018-12-25 |
Family
ID=54993555
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510397117.2A Active CN105280207B (en) | 2014-06-25 | 2015-06-25 | Playing method, device and system associated with touch information time |
| CN201510358850.3A Active CN105224587B (en) | 2014-06-25 | 2015-06-25 | Method, device and system for recording touch information time and computer readable medium |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510358850.3A Active CN105224587B (en) | 2014-06-25 | 2015-06-25 | Method, device and system for recording touch information time and computer readable medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (2) | CN105280207B (en) |
| TW (1) | TWI556154B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI711947B (en) * | 2019-11-12 | 2020-12-01 | 奇勤科技股份有限公司 | Information processing method for an electronic handwriting note to link video playing time and a video recording device |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040140956A1 (en) * | 2003-01-16 | 2004-07-22 | Kushler Clifford A. | System and method for continuous stroke word-based text input |
| CN102831912A (en) * | 2012-08-10 | 2012-12-19 | 上海量明科技发展有限公司 | Method, client and system for displaying playing progress of audio information |
| CN102932623A (en) * | 2011-06-13 | 2013-02-13 | 沃克斯国际公司 | Capture, syncing and playback of audio data and image data |
| CN103077182A (en) * | 2012-12-12 | 2013-05-01 | 蔡成唯 | Electronic data management method and system based on time ruler |
| CN103390016A (en) * | 2012-05-07 | 2013-11-13 | Lg电子株式会社 | Method for displaying text associated with audio file and electronic device |
| CN103702222A (en) * | 2013-12-20 | 2014-04-02 | 惠州Tcl移动通信有限公司 | Interactive information generation method and video file playing method for mobile terminal |
| CN103838723A (en) * | 2012-11-20 | 2014-06-04 | 联想(北京)有限公司 | Data association method and electronic device |
| US20140168142A1 (en) * | 2012-12-18 | 2014-06-19 | Logitech Europe S.A. | Method and system for discriminating stylus and touch interactions |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI417782B (en) * | 2010-11-16 | 2013-12-01 | Altek Corp | An electronic apparatus having a touch-controlled interface and method of displaying figures related to files within certain time period |
| CN102890576B (en) * | 2011-07-22 | 2016-03-02 | 宸鸿科技(厦门)有限公司 | Touch screen touch track detection method and pick-up unit |
| CN102708862B (en) * | 2012-04-27 | 2014-09-24 | 苏州思必驰信息科技有限公司 | Touch-assisted real-time speech recognition system and real-time speech/action synchronous decoding method thereof |
| US9785264B2 (en) * | 2012-08-14 | 2017-10-10 | Stmicroelectronics Asia Pacific Pte Ltd | Touch filtering through virtual areas on a touch screen |
| CN103593131B (en) * | 2012-08-15 | 2017-03-08 | 北京汇冠新技术股份有限公司 | A kind of touch track tracking |
| CN102866805B (en) * | 2012-09-24 | 2015-09-09 | 杭州再灵电子科技有限公司 | For the contact movement locus pre-judging method of optical touch instrument |
| CN103198724B (en) * | 2013-03-26 | 2014-12-10 | 闫健 | Panorama mode online learning system and pen special for learning system |
-
2014
- 2014-06-25 TW TW103121856A patent/TWI556154B/en active
-
2015
- 2015-06-25 CN CN201510397117.2A patent/CN105280207B/en active Active
- 2015-06-25 CN CN201510358850.3A patent/CN105224587B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040140956A1 (en) * | 2003-01-16 | 2004-07-22 | Kushler Clifford A. | System and method for continuous stroke word-based text input |
| CN102932623A (en) * | 2011-06-13 | 2013-02-13 | 沃克斯国际公司 | Capture, syncing and playback of audio data and image data |
| CN103390016A (en) * | 2012-05-07 | 2013-11-13 | Lg电子株式会社 | Method for displaying text associated with audio file and electronic device |
| CN102831912A (en) * | 2012-08-10 | 2012-12-19 | 上海量明科技发展有限公司 | Method, client and system for displaying playing progress of audio information |
| CN103838723A (en) * | 2012-11-20 | 2014-06-04 | 联想(北京)有限公司 | Data association method and electronic device |
| CN103077182A (en) * | 2012-12-12 | 2013-05-01 | 蔡成唯 | Electronic data management method and system based on time ruler |
| US20140168142A1 (en) * | 2012-12-18 | 2014-06-19 | Logitech Europe S.A. | Method and system for discriminating stylus and touch interactions |
| CN103702222A (en) * | 2013-12-20 | 2014-04-02 | 惠州Tcl移动通信有限公司 | Interactive information generation method and video file playing method for mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105224587A (en) | 2016-01-06 |
| TWI556154B (en) | 2016-11-01 |
| CN105280207B (en) | 2018-12-25 |
| TW201601054A (en) | 2016-01-01 |
| CN105224587B (en) | 2019-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104731554B (en) | A kind of comment information dissemination method and device | |
| WO2020108339A1 (en) | Page display position jump method and apparatus, terminal device, and storage medium | |
| CN109246461A (en) | Method, applications client and the electronic equipment that video preloads | |
| CN105229590A (en) | There is the user terminal apparatus of pen and the control method of user terminal apparatus | |
| CN101727938B (en) | Information processing apparatus, information processing method and program | |
| CN109597900A (en) | The management of local and remote media item | |
| US20130167065A1 (en) | Electronic device and method for managing icons of home screen of the electronic device | |
| EP3526726B1 (en) | Time-correlated ink | |
| CN101059728A (en) | Keyboard and mouse operation data recording/reproducing system and method thereof | |
| US20160328105A1 (en) | Techniques to manage bookmarks for media files | |
| CN104270680A (en) | Resource playing control method and device | |
| WO2013032240A1 (en) | Schedule managing method and apparatus | |
| CN104020990A (en) | Date selection control displaying method and device | |
| CN109213668B (en) | Operation recording method and device and terminal | |
| CN111402933B (en) | Audio recording method, device, storage medium and related equipment | |
| US20230333716A1 (en) | Interface for radial selection of time-based events | |
| CN105280207A (en) | Playing method, device and system associated with touch information time | |
| CN106933443B (en) | Method and device for processing electronic book data and electronic book reader | |
| US20210397652A1 (en) | Method and apparatus for producing video material, electronic device and computer readable medium | |
| US10310657B2 (en) | Playback method, apparatus and system related to touch information timing | |
| CN107885571A (en) | Show page control method and device | |
| TWI517023B (en) | Playback method, apparatus, and system related to touch information timing | |
| CN114995675B (en) | Touch control jump point fault detection method, electronic equipment and readable storage medium | |
| CN103164419B (en) | File content output method and electronic equipment | |
| CN107591166B (en) | Recording marking and playback method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |