CN107731020A - Multi-medium play method, device, storage medium and electronic equipment - Google Patents

Multi-medium play method, device, storage medium and electronic equipment Download PDF

Info

Publication number
CN107731020A
CN107731020A CN201711085728.9A CN201711085728A CN107731020A CN 107731020 A CN107731020 A CN 107731020A CN 201711085728 A CN201711085728 A CN 201711085728A CN 107731020 A CN107731020 A CN 107731020A
Authority
CN
China
Prior art keywords
image
module
preview pane
multimedia file
word
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201711085728.9A
Other languages
Chinese (zh)
Other versions
CN107731020B (en
Inventor
王君龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201711085728.9A priority Critical patent/CN107731020B/en
Publication of CN107731020A publication Critical patent/CN107731020A/en
Application granted granted Critical
Publication of CN107731020B publication Critical patent/CN107731020B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/04Electrically-operated educational appliances with audible presentation of the material to be studied
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/06Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • G09B5/065Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

This application discloses a kind of multi-medium play method, device, storage medium and electronic equipment, the multi-medium play method is applied to electronic equipment, and the electronic equipment, which includes the first IMAQ module and the second IMAQ module, this method, to be included:The first preview pane and the second preview pane are generated in preview interface;First image of the first IMAQ module collection is included in first preview pane;During the display of first image, the second image is shown in second preview pane according to first preview pane and the second IMAQ module;Determine that destination multimedia file plays out according to first image and the second image, can effectively realize that the independent point of indivedual Chinese characters or word is read without relying on specific talking pen and teaching material, method is simple, and flexibility is high, and user experience is good.

Description

Multi-medium play method, device, storage medium and electronic equipment
Technical field
The application is related to field of computer technology, more particularly to a kind of multi-medium play method, device, storage medium and electricity Sub- equipment.
Background technology
It is use photoelectricity identification technology that point, which reads equipment, with reference to advanced numeral voice technological development form it is a kind of read with Learning tool.
It is usually image pickup type point-reading machine that existing point, which reads equipment, and it includes pronunciation device, signal transmitting pen, supporting class This and the camera device being oppositely arranged with textbook, the textbook need to handle by special process, and its page setup has page mark Know, each page curriculum offering has " longitude and latitude position ".When user launches pen by signal clicks on the content of pages of textbook, signal Transmitting Pen Association carries out IMAQ to textbook to camera device transmitter trigger signal to trigger it, and the image gathered then directly carries Supply pronunciation device to handle, the page iden-tity of the click page and specific latitude coordinates to analyze, and according to page iden-tity With latitude coordinates call corresponding to speech data play out, so as to realize the read-on-command function of textbook, make reading become vividly to have Interest.
But the realization of this read-on-command function need to rely on specific talking pen and point reads teaching material, cost is higher, limitation Greatly.
The content of the invention
The embodiment of the present application provides a kind of multi-medium play method, device, storage medium and electronic equipment, can low cost Realize read-on-command function, flexibility is high.
The embodiment of the present application provides a kind of multi-medium play method, and applied to electronic equipment, the electronic equipment includes First IMAQ module and the second IMAQ module, the multi-medium play method include:
The first preview pane and the second preview pane are generated in preview interface;
First image of described first image collection module collection is included in first preview pane;
During the display of described first image, according to first preview pane and the second IMAQ module described The second image is shown in second preview pane;
Determine that destination multimedia file plays out according to described first image and the second image.
The embodiment of the present application additionally provides a kind of multimedia playing apparatus, applied to electronic equipment, the electronic equipment bag The first IMAQ module and the second IMAQ module are included, the multimedia playing apparatus includes:
Generation module, for generating the first preview pane and the second preview pane in preview interface;
First display module, it is pre- described first for the first image of described first image collection module collection to be included Look in frame;
Second display module, for during the display of described first image, according to first preview pane and second IMAQ module shows the second image in second preview pane;
Playing module, for determining that destination multimedia file plays out according to described first image and the second image.
The embodiment of the present application additionally provides a kind of storage medium, and a plurality of instruction, the finger are stored with the storage medium Order is suitable to be loaded by processor to perform any of the above-described multi-medium play method.
The embodiment of the present application additionally provides a kind of electronic equipment, including processor and memory, the processor with it is described Memory is electrically connected with, and the memory is used for store instruction and data, and the processor is used for more described in any of the above-described Step in media playing method.
Multi-medium play method, device, storage medium and the electronic equipment that the application provides, applied to electronic equipment, The electronic equipment includes the first IMAQ module and the second IMAQ module, by generating the first preview pane in preview interface With the second preview pane, and the first image of the first IMAQ module collection is included in first preview pane, and at this During the display of first image, by being shown according to first preview pane and the second IMAQ module in second preview pane Show the second image, and determine that destination multimedia file plays out according to first image and the second image, without relying on Specific talking pen and teaching material can effectively realize that the independent point of indivedual Chinese characters or word in complete sentence is read, and cost is cheap, side Method is simple, and flexibility is high, and user experience is good.
Brief description of the drawings
Below in conjunction with the accompanying drawings, by the way that the embodiment of the application is described in detail, the technical scheme of the application will be made And other beneficial effects are apparent.
Fig. 1 is the schematic diagram of a scenario that the electronic equipment point that the embodiment of the present application provides reads flow.
Fig. 2 is the schematic flow sheet for the multi-medium play method that the embodiment of the present application provides.
Fig. 3 is another schematic flow sheet for the multi-medium play method that the embodiment of the present application provides.
Fig. 4 is the schematic diagram for the electronic equipment preview interface that the embodiment of the present application provides.
Fig. 5 is the schematic flow sheet that the read-on-command function that the embodiment of the present application provides is realized.
Fig. 6 is the interception process schematic for the target audio file that the embodiment of the present application provides.
Fig. 7 is the structural representation for the multimedia playing apparatus that the embodiment of the present application provides.
Fig. 8 is the structural representation for the second display module that the embodiment of the present application provides.
Fig. 9 is the structural representation for the playing module that the embodiment of the present application provides
Figure 10 is the structural representation for the electronic equipment that the embodiment of the present application provides.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present application, the technical scheme in the embodiment of the present application is carried out clear, complete Site preparation describes, it is clear that described embodiment is only some embodiments of the present application, rather than whole embodiments.It is based on Embodiment in the application, the every other implementation that those skilled in the art are obtained under the premise of creative work is not made Example, belong to the scope of the application protection.
The embodiment of the present application provides a kind of multi-medium play method, device, storage medium and electronic equipment.
A kind of multi-medium play method, applied to electronic equipment, the electronic equipment includes the first IMAQ module and the Two IMAQ modules, the multi-medium play method include:The first preview pane and the second preview pane are generated in preview interface;Should First image of the first IMAQ module collection is shown in first preview pane;During the display of first image, Second image is shown in second preview pane according to first preview pane and the second IMAQ module;According to first image Determine that destination multimedia file plays out with the second image.
Wherein, the first IMAQ module and the second IMAQ module can be cameras.The multimedia file can To be audio file or video file, it can be that producer records in advance according to a content for reading textbook, and record During, for the textbook content recorded every time, producer can take pictures to it, and by the photo and correspond to the more of recording Media file associated storage, so, subsequent user can realize the multimedia file using the electronic equipment with dual camera The point of all or part of content read.
Specifically, when user needs the partial content of certain multimedia file of point reading, such as the single word in some sentence When, it can be shot using the electronic equipment with dual camera, one of camera is for shooting whole sentence The distant view camera of son, another camera is the close shot camera for shooting single word, and its implementation process may refer to Fig. 1, such as, when user needs point to read, preview interface can be entered, the first preview pane and second pre- can be generated in preview interface Look at frame, first preview pane is square, and the second preview pane is ellipse, and now, camera can be aligned by user need to shoot Sentence, such as A1-An this n word so that distant view camera includes whole sentence in the first preview pane, afterwards, use Family can click on the single word (such as Ai) in the display picture, to control close shot camera to be amplified the click location Shooting, and magnified picture is included in the second image, electronic equipment can be according to the image in the first preview pane from record afterwards Destination multimedia file corresponding to the sentence is selected in the multimedia file made, and according to the first preview pane and the second preview pane In image intercept the word from the destination multimedia file corresponding to content play out, so as to realize the point of single word Read function.
As shown in Fig. 2 Fig. 2 is the schematic flow sheet for the multi-medium play method that the embodiment of the present application provides.The multimedia Player method is applied to electronic equipment, and the electronic equipment includes the first IMAQ module and the second IMAQ module, and it has Body flow can be as follows:
101st, the first preview pane and the second preview pane are generated in preview interface.
In the present embodiment, the first IMAQ module and the second IMAQ module refer mainly to image first-class IMAQ Equipment.The preview interface is mainly used in showing shooting picture, and it can be that a point for reading APP reads interface.First preview pane and Second preview pane can be fixed in the position of preview interface, for example the first preview pane is located at the intermediate region of preview interface, Second preview pane is located at lower section of first preview pane etc., and certainly, its position can also be moveable, for example user can be certainly By dragging first preview pane and the second preview pane position needed for.In actual mechanical process, user can pass through clicking point APP specified button (such as point read button) is read to enter the preview interface, when entrance preview interface, electronics can be triggered and set It is standby to generate first preview pane and the second preview pane.
102nd, the first image by the first IMAQ module collection is included in first preview pane.
In the present embodiment, first preview pane is used for the picture for showing the shooting of the first IMAQ module.Used specifically, working as When family needs to carry out certain word to read, this word can be shot by the first IMAQ module, and will clap Take the photograph content to be shown in the first preview pane, so that user confirms.
103rd, during the display of first image, according to first preview pane and the second IMAQ module this The second image is shown in two preview panes.
In the present embodiment, second preview pane is used for the picture for showing the shooting of the second IMAQ module, second image Gather module and carry out shooting at close range mainly for the topography of the first preview pane, namely first image is in entirety Hold and shot obtained image, second image is to be amplified obtained image for local content, generally, due to this The information content that two images are included is less than the first image, therefore the size of second preview pane can be less than the chi of first preview pane It is very little.The shape of first preview pane and the second preview pane can be manually set, for example the first preview pane can be box shape, and second Preview pane can be box shape or round frame shape, naturally it is also possible to be other shapes.
For example, above-mentioned steps 102 can specifically include:
Obtain click information of the user to first preview pane;
Second image is generated according to the click information, the first image and the second IMAQ module;
Second image is included in second preview pane.
In the present embodiment, during the display of the first image, if user and need not carry out reading to whole sentence word, only Single word need to be directed to, then the single word that required point is read can be found in the first preview pane and is chosen, the side of choosing Formula is mainly click on, for example is clicked or double-clicked.
For example, the click information includes click location, now, above-mentioned steps are " according to the click information, the first image and Two IMAQ modules generate the second image " it can specifically include:
The click location is converted into picture position;
Magnification region in first image is determined according to the picture position;
Processing is amplified to the content in the magnification region using the second IMAQ module, obtains the second image.
In the present embodiment, magnification region can be generated centered on the picture position, the shape of the magnification region can be Circular, square or other shapes, its size can be artificial setting in advance or according to real in the first preview pane What border font size determined, for example the area in the first preview pane shared by single font is bigger, the magnification region is also bigger, leads to Often, the area of the magnification region is optimal can accommodate single font.Digital Zoom can be carried out to the second IMAQ module To realize enlarging function, namely the focal length of the second IMAQ module is tuned up, the effect reached when double-clicking picture similar to user.
104th, determine that destination multimedia file plays out according to first image and the second image.
In the present embodiment, it can inform that user currently catches by the image shown in the first preview pane and the second preview pane The object content caught, so that user is confirmed whether to need to adjust, if need not, user can be by clicking in preview interface Button (for example confirming button) terminates image taking, so that electronic equipment is according to the first image and the second image finally shot Obtain corresponding points and read content.
For example, when terminating to shoot, above-mentioned steps 104 can specifically include:
(1) destination multimedia file is determined according to first image.
For example, above-mentioned steps (1) can specifically include:
First image is matched with pre-set image storehouse, and obtains the pre-set image that the match is successful;
The multimedia file according to corresponding to being searched the pre-set image that the match is successful, as destination multimedia file.
In the present embodiment, the multimedia file can be audio file or video file etc..In the pre-set image storehouse Pre-set image can be that producer sets according to a reading textbook in advance, for example producer can be in advance to each in a reading textbook Sentence, paragraph or article are taken pictures, and photo is just stored in pre-set image storehouse as pre-set image, at the same time, Producer can be directed to each sentence, paragraph or article carry out the recording of audio or video, by the audio recorded or regard afterwards Frequency is associated storage as multimedia file and corresponding photo, so as to subsequently can the multimedia according to corresponding to being found photo it is literary Part, it can also realize that the point of multimedia file is read by taking pictures.
(2) a reading content is extracted from the destination multimedia file according to second image and the first image.
For example, above-mentioned steps (2) can specifically include:
Text region is carried out to first image and the second image;
The word identified in the word and the first image that will be identified in second image is matched;
Determine in first image, arrangement position of the word that the match is successful in all words;
A reading content is extracted from the destination multimedia file according to the arrangement position.
In the present embodiment, the word can include Chinese character and word, and the arrangement position can be represented in the form of ratio, than Such as 7:14, represent includes 14 words altogether in the first image, and the word comes the 7th.The Text region mainly includes literal field Domain determines and Text segmentation, because the second image is the enlarged drawing in some region in the first image, therefore the text in the second image Word must be included in the first image.The characters matching is mainly similarity mode, it is necessary to putting in order successively according to word The similarity of word in word and the second image in the first image is calculated, and using the high word of similarity as the text that the match is successful Word.
For example, above-mentioned steps " this extracts a reading content according to the arrangement position from the destination multimedia file " are specific It can include:
Obtain total playing duration of the destination multimedia file;
The interception period is determined from total playing duration according to the arrangement position;
Content of multimedia corresponding with the interception period is extracted from the multimedia file, content is read as.
In the present embodiment, the multimedia file refers mainly to voice document, because massage voice reading person is when textbook is read aloud in recording Word speed and each literary word space duration compare fixation, therefore easily according to total playing duration and total number of word to whole voice Split, obtain each word reads aloud voice, and based on this point, reading aloud for some word in whole sentence is read when needing point During voice, it is only necessary to know that the arrangement position of the word and total playing duration of this voice can find corresponding interception position pair Voice is intercepted.
(3) content is read to the point to play out.
In the present embodiment, determine that point reads word in whole point by the first IMAQ module and the second IMAQ module Position in reading statement, and required part is intercepted out from the whole piece voice recorded based on the position, without for every Individual word carries out voice recording, and method is simple.
From the foregoing, the multi-medium play method that the present embodiment provides, applied to electronic equipment, the electronic equipment includes First IMAQ module and the second IMAQ module, by generating the first preview pane and the second preview pane in preview interface, And include the first image of the first IMAQ module collection in first preview pane, and in the display of first image During, by showing the second image in second preview pane according to first preview pane and the second IMAQ module, and Determine that destination multimedia file plays out according to first image and the second image, so as to according to the point reading demand of user from Required part is extracted in the whole multimedia file recorded, effectively realizes the list of indivedual Chinese characters or word in complete sentence Solely point is read, and method is simple, and flexibility is high, and user experience is good, and need not rely on specific talking pen and teaching material, and cost is cheap.
In the present embodiment, will be carried out specifically so that the multimedia playing apparatus specifically integrates in the electronic device as an example It is bright.
Fig. 3 is referred to, a kind of multi-medium play method, applied to electronic equipment, the electronic equipment is adopted including the first image Collect module and the second IMAQ module, idiographic flow can be as follows:
201st, electronic equipment generates the first preview pane and the second preview pane in preview interface.
For example, the first IMAQ module and the second IMAQ module are camera, first preview pane and second Preview pane can be fixed in the display location of preview interface, for example refer to Fig. 4, and the first preview pane can be located substantially at pre- Look at the position of interface upper middle, the second preview pane is located at the lower right of the first preview pane.First preview pane and the second preview The size of frame can be depending on the size of preview interface, for example in figure 3, first preview pane can be preview interface size 1/3rd, the second preview pane can be 1/10th, etc. of preview interface size.
202nd, the first image that electronic equipment gathers the first IMAQ module is included in first preview pane.
For example, Fig. 5 is referred to, the first IMAQ module alignment point can be read the content A in textbook and be clapped by user Take the photograph, so as to show that content A, content A can be passage or a word in the first preview pane, it can include This n word of A1-An.
203rd, during the display of first image, electronic equipment obtains user and carries out click behaviour to first preview pane The click location of work, and the click location is converted into picture position.
For example, during content A display, if the few words that user merely desires to be directed in content A carry out a reading, than Such as Ai, i ∈ (1, n), then clicking operation can be carried out to the word Ai in the first preview pane.
204th, electronic equipment determines the magnification region in first image according to the picture position, and utilizes second image Collection module is amplified processing to the content in the magnification region, obtains the second image, afterwards includes second image In second preview pane.
For example, the shape of second preview pane can be consistent with the shape of magnification region.Electronic equipment can be with the first figure Circle is drawn centered on position as in where Ai, the radius of the circle is slightly larger than Ai font size, and obtained region is amplification region Domain, afterwards, by the focus adjustment of the second IMAQ module to designated value, and using the second IMAQ module mixed up to class Position in sheet where magnification region is shot, and is included image in the second preview pane while shooting, so that user is true Recognize.
205th, electronic equipment is matched first image with pre-set image storehouse, and obtains the default figure that the match is successful Picture, the multimedia file according to corresponding to being searched the pre-set image that the match is successful afterwards, as destination multimedia file.
For example, the multimedia file is mainly audio file.When the content shown in the second image is to put to read needed for user Word Ai when, user can click on the confirmation button (can also be shoot button) in preview interface to terminate to shoot, now, Electronic equipment can according to corresponding to the first image when terminating to shoot find A1-An this n word audio file.Certainly, exist Before terminating shooting, the image in the first preview pane and the second preview pane is to follow the adjustment of user continually changing, and backstage Image when terminating shooting at the last moment is generally only obtained as the first image and the second image.
206th, electronic equipment carries out Text region to first image and the second image, and will be identified in second image Word and the first image in the word that identifies matched.
207th, electronic equipment is determined in first image, arrangement position of the word that the match is successful in all words, and Obtain total playing duration of the destination multimedia file.
For example, by Text region and matching, can learn in the first image comprising this n word of A1-An, the second image In include word Ai, arrangement position i/n.
208th, electronic equipment determines the interception period according to the arrangement position from total playing duration, from the multimedia file In extract content of multimedia corresponding with the interception period, as read a content, afterwards to the point read content play out.
For example, refer to Fig. 6, if total playing duration is T, the interception period can be [(i-1)/n] T~[(i+1)/ N] T, the audio content intercepted according to the interception period is word Ai point pronunciation frequency.
From the foregoing, the multi-medium play method that the present embodiment provides, application and electronic equipment, the electronic equipment include First IMAQ module and the second IMAQ module, wherein electronic equipment can preview interface generate the first preview pane and Second preview pane, and the first image of the first IMAQ module collection is included in first preview pane, then, at this During the display of first image, obtain user and the click location of clicking operation is carried out to first preview pane, and this is clicked on Position is converted into picture position, then, the magnification region in first image is determined according to the picture position, and using this second IMAQ module is amplified processing to the content in the magnification region, obtains the second image, afterwards shows second image Show in second preview pane, then, first image is matched with pre-set image storehouse, and it is default to obtain that the match is successful Image, the multimedia file according to corresponding to being searched the pre-set image that the match is successful afterwards, as destination multimedia file, then, Text region is carried out to first image and the second image, and known in the word and the first image that will be identified in second image The word not gone out is matched, it is then determined in first image, the arrangement position of the word that the match is successful in all words Put, and obtain total playing duration of the destination multimedia file, then, determined according to the arrangement position from total playing duration The period is intercepted, content of multimedia corresponding with the interception period is extracted from the multimedia file, reads content as, afterwards Content is read to the point to play out, and is extracted so as to the point reading demand according to user from the whole multimedia file recorded Required part, effectively realize that the independent point of indivedual Chinese characters or word in complete sentence is read, method is simple, and flexibility is high, user Experience property is good, and need not rely on specific talking pen and teaching material, and cost is cheap.
Method according to described by above-described embodiment, the present embodiment will further be carried out from the angle of multimedia playing apparatus Description, the multimedia playing apparatus can specifically be realized as independent entity, can also be integrated in electronic equipment, such as eventually Realized in end, the terminal can include mobile phone, tablet personal computer and personal computer etc..
Referring to Fig. 7, the multimedia playing apparatus of the embodiment of the present application offer has been described in detail in Fig. 7, set applied to electronics Standby, the electronic equipment, which includes the first IMAQ module and the second IMAQ module, the multimedia playing apparatus, to be included: Generation module 10, the first display module 20, the second display module 30 and playing module 40, wherein:
(1) generation module 10
Generation module 10, for generating the first preview pane and the second preview pane in preview interface.
In the present embodiment, the first IMAQ module and the second IMAQ module refer mainly to image first-class IMAQ Equipment.The preview interface is mainly used in showing shooting picture, and it can be that a point for reading APP reads interface.First preview pane and Second preview pane can be fixed in the position of preview interface, for example the first preview pane is located at the intermediate region of preview interface, Second preview pane is located at lower section of first preview pane etc., and certainly, its position can also be moveable, for example user can be certainly By dragging first preview pane and the second preview pane position needed for.In actual mechanical process, user can pass through clicking point APP specified button (such as point read button) is read to enter the preview interface, when entrance preview interface, generation mould can be triggered Block 10 generates first preview pane and the second preview pane.
(2) first display modules 20
First display module 20, the first image for the first IMAQ module to be gathered are included in first preview In frame.
In the present embodiment, first preview pane is used for the picture for showing the shooting of the first IMAQ module.Used specifically, working as When family needs to carry out certain word to read, the first display module 20 can be entered by the first IMAQ module to this word Row shooting, and content of shooting is included in the first preview pane, so that user confirms.
(3) second display modules 30
Second display module 30, for during the display of first image, according to first preview pane and the second figure As collection module shows the second image in second preview pane.
In the present embodiment, second preview pane is used for the picture for showing the shooting of the second IMAQ module, second image Gather module and carry out shooting at close range mainly for the topography of the first preview pane, namely first image is in entirety Hold and shot obtained image, second image is to be amplified obtained image for local content, generally, due to this The information content that two images are included is less than the first image, therefore the size of second preview pane can be less than the chi of first preview pane It is very little.The shape of first preview pane and the second preview pane can be manually set, for example the first preview pane can be box shape, and second Preview pane can be box shape or round frame shape, naturally it is also possible to be other shapes.
For example, referring to Fig. 8, second display module 30 can include acquisition submodule 31, generation submodule 32 and show Show submodule 33, wherein:
Acquisition submodule 31, for obtaining click information of the user to first preview pane;
Submodule 32 is generated, for generating the second figure according to the click information, the first image and the second IMAQ module Picture;
Display sub-module 33, for second image to be included in second preview pane.
In the present embodiment, during the display of the first image, if user and need not carry out reading to whole sentence word, only Single word need to be directed to, then the single word that required point is read can be found in the first preview pane and is chosen, the side of choosing Formula is mainly click on, for example is clicked or double-clicked.
For example, the click information includes click location, the generation submodule 32 specifically can be used for:
The click location is converted into picture position;
Magnification region in first image is determined according to the picture position;
Processing is amplified to the content in the magnification region using the second IMAQ module, obtains the second image.
In the present embodiment, generation submodule 32 can generate magnification region centered on the picture position, the magnification region Shape can be circular, square or other shapes, its size can be artificial setting in advance or according to the Actual font size determines in one preview pane, for example the area in the first preview pane shared by single font is bigger, the amplification region Domain is also bigger, and generally, the area of the magnification region is optimal can accommodate single font.Second IMAQ module can be entered Row Digital Zoom realizes enlarging function, namely tunes up the focal length of the second IMAQ module, when double-clicking picture similar to user The effect reached.
(4) playing module 40
Playing module 40, for determining that destination multimedia file plays out according to first image and the second image.
In the present embodiment, it can inform that user currently catches by the image shown in the first preview pane and the second preview pane The object content caught, so that user is confirmed whether to need to adjust, if need not, user can be by clicking in preview interface Button (for example confirming button) terminates image taking, so that electronic equipment is according to the first image and the second image finally shot Obtain corresponding points and read content.
For example, when terminating to shoot, Fig. 9 is referred to, the playing module 40 specifically can include determining that submodule 41, extraction Submodule 42 and broadcasting submodule 43, wherein:
Determination sub-module 41, for determining destination multimedia file according to first image.
For example, the determination sub-module 41 specifically can be used for:
First image is matched with pre-set image storehouse, and obtains the pre-set image that the match is successful;
The multimedia file according to corresponding to being searched the pre-set image that the match is successful, as destination multimedia file.
In the present embodiment, the multimedia file can be audio file or video file etc..In the pre-set image storehouse Pre-set image can be that producer sets according to a reading textbook in advance, for example producer can be in advance to each in a reading textbook Sentence, paragraph or article are taken pictures, and photo is just stored in pre-set image storehouse as pre-set image, at the same time, Producer can be directed to each sentence, paragraph or article carry out the recording of audio or video, by the audio recorded or regard afterwards Frequency is associated storage as multimedia file and corresponding photo, so that follow-up determination sub-module 41 can be found pair according to photo The multimedia file answered, it can also realize that the point of multimedia file is read by taking pictures.
Extracting sub-module 42, for being extracted a little from the destination multimedia file according to second image and the first image Read content.
For example, the extracting sub-module 42 specifically can be used for:
Text region is carried out to first image and the second image;
The word identified in the word and the first image that will be identified in second image is matched;
Determine in first image, arrangement position of the word that the match is successful in all words;
A reading content is extracted from the destination multimedia file according to the arrangement position.
In the present embodiment, the word can include Chinese character and word, and the arrangement position can be represented in the form of ratio, than Such as 7:14, represent includes 14 words altogether in the first image, and the word comes the 7th.The Text region mainly includes literal field Domain determines and Text segmentation, because the second image is the enlarged drawing in some region in the first image, therefore the text in the second image Word must be included in the first image.The characters matching is mainly similarity mode, it is necessary to putting in order successively according to word The similarity of word in word and the second image in the first image is calculated, and using the high word of similarity as the text that the match is successful Word.
For example, the extracting sub-module further can be used for:
Obtain total playing duration of the destination multimedia file;
The interception period is determined from total playing duration according to the arrangement position;
Content of multimedia corresponding with the interception period is extracted from the multimedia file, content is read as.
In the present embodiment, the multimedia file refers mainly to voice document, because massage voice reading person is when textbook is read aloud in recording Word speed and each literary word space duration compare fixation, therefore easily according to total playing duration and total number of word to whole voice Split, obtain each word reads aloud voice, and based on this point, reading aloud for some word in whole sentence is read when needing point During voice, it is only necessary to know that the arrangement position of the word and total playing duration of this voice can find corresponding interception position pair Voice is intercepted.
Submodule 43 is played, is played out for reading content to the point.
In the present embodiment, determine that point reads word in whole point by the first IMAQ module and the second IMAQ module Position in reading statement, and required part is intercepted out from the whole piece voice recorded based on the position, without for every Individual word carries out voice recording, and method is simple.
It when it is implemented, above unit can be realized as independent entity, can also be combined, be made Realized for same or several entities, the specific implementation of above unit can be found in embodiment of the method above, herein not Repeat again.
From the foregoing, the multimedia playing apparatus that the present embodiment provides, applied to electronic equipment, the electronic equipment includes First IMAQ module and the second IMAQ module, the first preview pane and the are generated in preview interface by generation module 10 Two preview panes, the first image that the first display module 20 gathers the first IMAQ module are included in first preview pane In, and during the display of first image, adopted by the second display module 30 according to first preview pane and the second image Collection module shows the second image in second preview pane, and playing module 40 determines target according to first image and the second image Multimedia file is played out, and institute is extracted from the whole multimedia file recorded so as to the point reading demand according to user The part needed, effectively realize that the independent point of indivedual Chinese characters or word in complete sentence is read, method is simple, and flexibility is high, user's body The property tested is good, and need not rely on specific talking pen and teaching material, and cost is cheap.
In addition, the embodiment of the present application additionally provides a kind of electronic equipment, the electronic equipment can be smart mobile phone, flat board electricity The equipment such as brain.Shown in Figure 10, electronic equipment 900 includes processor 901, memory 902, display screen 903 and control circuit 904.Wherein, processor 901 is electrically connected with memory 902, display screen 903, control circuit 904 respectively.
Processor 901 is the control centre of electronic equipment 900, utilizes various interfaces and the whole electronic equipment of connection Various pieces, by the application program of operation or load store in memory 902, and call and be stored in memory 902 Data, the various functions and processing data of electronic equipment are performed, so as to carry out integral monitoring to electronic equipment.
In the present embodiment, processor 901 in electronic equipment 900 can according to the steps, by one or one with On application program process corresponding to instruction be loaded into memory 902, and be stored in memory by processor 901 to run Application program in 902, so as to realize various functions:
The first preview pane and the second preview pane are generated in preview interface;
First image of the first IMAQ module collection is included in first preview pane;
It is second pre- at this according to first preview pane and the second IMAQ module during the display of first image Look in frame and show the second image;
Determine that destination multimedia file plays out according to first image and the second image.
Memory 902 can be used for storage application program and data.Including in the application program that memory 902 stores can be The instruction performed in processor.Application program can form various functions module.Processor 901 is stored in memory by operation 902 application program, so as to perform various function application and data processing.
Display screen 903 can be used for display by the information of user's input or be supplied to the information of user and the various figures of terminal Shape user interface, these graphical user interface can be made up of image, text, icon, video and its any combination.
Control circuit 904 is electrically connected with display screen 903, for the display information of control display screen 903.
In certain embodiments, as shown in Figure 10, electronic equipment 900 also includes:Radio circuit 905, input block 906, Voicefrequency circuit 907, sensor 908 and power supply 909.Wherein, processor 901 respectively with radio circuit 905, input block 906, Voicefrequency circuit 907, sensor 908 and power supply 909 are electrically connected with.
Radio circuit 905 is used for transceiving radio frequency signal, to be built by radio communication and the network equipment or other electronic equipments Vertical wireless telecommunications, the receiving and transmitting signal between the network equipment or other electronic equipments.
Input block 906 can be used for numeral, character information or the user's characteristic information (such as fingerprint) for receiving input, and Keyboard, mouse, action bars, optics or the trace ball signal relevant with user's setting and function control is produced to input.Wherein, Input block 906 can include fingerprint recognition module.
Voicefrequency circuit 907 can provide the COBBAIF between user and terminal by loudspeaker, microphone.
Electronic equipment 900 can also include at least one sensor 908, for example, optical sensor, motion sensor and its His sensor.Specifically, optical sensor may include ambient light sensor and proximity transducer, wherein, ambient light sensor can root The brightness of display panel is adjusted according to the light and shade of ambient light, proximity transducer can close display when terminal is moved in one's ear Panel and/or backlight.As one kind of motion sensor, gravity accelerometer can detect in all directions (generally three Axle) acceleration size, size and the direction of gravity are can detect that when static, available for identification mobile phone posture application (such as Horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap) etc.;As for The other sensors such as gyroscope that terminal can also configure, barometer, hygrometer, thermometer, infrared ray sensor, it is no longer superfluous herein State.
The all parts that power supply 909 is used for electron equipment 900 are powered.In certain embodiments, power supply 909 can pass through Power-supply management system and processor 901 are logically contiguous, so as to realize management charging, electric discharge, Yi Jigong by power-supply management system The functions such as consumption management.
Although not shown in Figure 10, electronic equipment 900 can also include camera, bluetooth module etc., will not be repeated here.
It will appreciated by the skilled person that all or part of step in the various methods of above-described embodiment can be with Completed by instructing, or control related hardware to complete by instructing, the instruction can be stored in one and computer-readable deposit In storage media, and loaded and performed by processor.Therefore, the embodiment of the present invention provides a kind of storage medium, wherein storing There is a plurality of instruction, the instruction can be loaded by processor, to perform any multimedia that the embodiment of the present invention is provided Step in player method.
Wherein, the storage medium can include:Read-only storage (ROM, Read Only Memory), random access memory Body (RAM, Random Access Memory), disk or CD etc..
By the instruction stored in the storage medium, any multimedia that the embodiment of the present invention is provided can be performed Step in player method, it is thereby achieved that any multi-medium play method institute that the embodiment of the present invention is provided can be real Existing beneficial effect, embodiment above is referred to, will not be repeated here.
The specific implementation of each operation can be found in embodiment above above, will not be repeated here.
In summary, although the application is disclosed above with preferred embodiment, above preferred embodiment simultaneously is not used to limit The application processed, one of ordinary skill in the art, do not departing from spirit and scope, can make various changes and profit Decorations, therefore the protection domain of the application is defined by the scope that claim defines.

Claims (16)

1. a kind of multi-medium play method, applied to electronic equipment, it is characterised in that the electronic equipment is adopted including the first image Collection module and the second IMAQ module, the multi-medium play method include:
The first preview pane and the second preview pane are generated in preview interface;
First image of described first image collection module collection is included in first preview pane;
During the display of described first image, according to first preview pane and the second IMAQ module described second The second image is shown in preview pane;
Determine that destination multimedia file plays out according to described first image and the second image.
2. multi-medium play method according to claim 1, it is characterised in that described according to first preview pane and Two IMAQ modules show the second image in second preview pane, including:
Obtain click information of the user to first preview pane;
Second image is generated according to the click information, the first image and the second IMAQ module;
Second image is included in second preview pane.
3. multi-medium play method according to claim 2, it is characterised in that the click information includes click location, It is described that second image is generated according to the click information, the first image and the second IMAQ module, including:
The click location is converted into picture position;
The magnification region in described first image is determined according to described image position;
Processing is amplified to the content in the magnification region using the second IMAQ module, obtains the second image.
4. multi-medium play method according to claim 1, it is characterised in that described according to described first image and second Image determines that destination multimedia file plays out, including:
Destination multimedia file is determined according to described first image;
A reading content is extracted from the destination multimedia file according to second image and the first image;
Content is read to the point to play out.
5. multi-medium play method according to claim 4, it is characterised in that described that mesh is determined according to described first image Multimedia file is marked, including:
Described first image is matched with pre-set image storehouse, and obtains the pre-set image that the match is successful;
The multimedia file according to corresponding to being searched the pre-set image that the match is successful, as destination multimedia file.
6. multi-medium play method according to claim 4, it is characterised in that described according to second image and first Image extracts a reading content from the destination multimedia file, including:
Text region is carried out to described first image and the second image;
The word identified in the word and the first image that will be identified in second image is matched;
Determine in described first image, arrangement position of the word that the match is successful in all words;
A reading content is extracted from the destination multimedia file according to the arrangement position.
7. multi-medium play method according to claim 6, it is characterised in that it is described according to the arrangement position from described A reading content is extracted in destination multimedia file, including:
Obtain total playing duration of the destination multimedia file;
The interception period is determined from total playing duration according to the arrangement position;
Content of multimedia corresponding with the interception period is extracted from the multimedia file, content is read as.
8. a kind of multimedia playing apparatus, applied to electronic equipment, it is characterised in that the electronic equipment is adopted including the first image Collection module and the second IMAQ module, the multimedia playing apparatus include:
Generation module, for generating the first preview pane and the second preview pane in preview interface;
First display module, for the first image of described first image collection module collection to be included in first preview pane In;
Second display module, for during the display of described first image, according to first preview pane and the second image Collection module shows the second image in second preview pane;
Playing module, for determining that destination multimedia file plays out according to described first image and the second image.
9. multimedia playing apparatus according to claim 8, it is characterised in that second display module includes:
Acquisition submodule, for obtaining click information of the user to first preview pane;
Submodule is generated, for generating the second image according to the click information, the first image and the second IMAQ module;
Display sub-module, for second image to be included in second preview pane.
10. multimedia playing apparatus according to claim 9, it is characterised in that the click information includes click location, The generation submodule is specifically used for:
The click location is converted into picture position;
The magnification region in described first image is determined according to described image position;
Processing is amplified to the content in the magnification region using the second IMAQ module, obtains the second image.
11. multimedia playing apparatus according to claim 8, it is characterised in that the playing module includes:
Determination sub-module, for determining destination multimedia file according to described first image;
Extracting sub-module, for extracting a reading from the destination multimedia file according to second image and the first image Content;
Submodule is played, is played out for reading content to the point.
12. multimedia playing apparatus according to claim 11, it is characterised in that the determination sub-module is specifically used for:
Described first image is matched with pre-set image storehouse, and obtains the pre-set image that the match is successful;
The multimedia file according to corresponding to being searched the pre-set image that the match is successful, as destination multimedia file.
13. multimedia playing apparatus according to claim 11, it is characterised in that the extracting sub-module is specifically used for:
Text region is carried out to described first image and the second image;
The word identified in the word and the first image that will be identified in second image is matched;
Determine in described first image, arrangement position of the word that the match is successful in all words;
A reading content is extracted from the destination multimedia file according to the arrangement position.
14. multimedia playing apparatus according to claim 13, it is characterised in that the extracting sub-module is specifically used for:
Obtain total playing duration of the destination multimedia file;
The interception period is determined from total playing duration according to the arrangement position;
Content of multimedia corresponding with the interception period is extracted from the multimedia file, content is read as.
A kind of 15. storage medium, it is characterised in that be stored with a plurality of instruction in the storage medium, the instruction be suitable to by Manage multi-medium play method of the device loading any one of with perform claim requirement 1 to 7.
16. a kind of electronic equipment, it is characterised in that including processor and memory, the processor and the memory are electrical Connection, the memory are used for store instruction and data, and the processor is used for any one of perform claim requirement 1 to 7 Multi-medium play method in step.
CN201711085728.9A 2017-11-07 2017-11-07 Multimedia playing method, device, storage medium and electronic equipment Expired - Fee Related CN107731020B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711085728.9A CN107731020B (en) 2017-11-07 2017-11-07 Multimedia playing method, device, storage medium and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711085728.9A CN107731020B (en) 2017-11-07 2017-11-07 Multimedia playing method, device, storage medium and electronic equipment

Publications (2)

Publication Number Publication Date
CN107731020A true CN107731020A (en) 2018-02-23
CN107731020B CN107731020B (en) 2020-05-12

Family

ID=61222839

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711085728.9A Expired - Fee Related CN107731020B (en) 2017-11-07 2017-11-07 Multimedia playing method, device, storage medium and electronic equipment

Country Status (1)

Country Link
CN (1) CN107731020B (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109214379A (en) * 2018-10-23 2019-01-15 北京快乐认知科技有限公司 Multi-functional point reading based on image recognition tracer technique gives directions part and reading method
CN110046009A (en) * 2019-02-19 2019-07-23 阿里巴巴集团控股有限公司 Method for recording, device, server and readable storage medium storing program for executing
CN110059678A (en) * 2019-04-17 2019-07-26 上海肇观电子科技有限公司 A kind of detection method, device and computer readable storage medium
CN110634342A (en) * 2019-09-19 2019-12-31 广东小天才科技有限公司 Identification method and system of outlining frame, storage medium and electronic equipment
CN110767000A (en) * 2019-10-28 2020-02-07 安徽信捷智能科技有限公司 Children's course synchronizer based on image recognition
CN111077992A (en) * 2019-06-09 2020-04-28 广东小天才科技有限公司 Point reading method, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101493996A (en) * 2009-01-15 2009-07-29 北方工业大学 Intelligent reader and implementation method thereof
US20130314580A1 (en) * 2012-05-24 2013-11-28 Mediatek Inc. Preview system for concurrently displaying multiple preview images generated based on input image generated by image capture apparatus and related preview method thereof
US20140127667A1 (en) * 2012-11-05 2014-05-08 Marco Iannacone Learning system
CN104253904A (en) * 2014-09-04 2014-12-31 广东小天才科技有限公司 Method and smartphone for implementing reading learning
CN106710326A (en) * 2015-07-31 2017-05-24 曾晓敏 Reading textbook system based on Chinese

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101493996A (en) * 2009-01-15 2009-07-29 北方工业大学 Intelligent reader and implementation method thereof
US20130314580A1 (en) * 2012-05-24 2013-11-28 Mediatek Inc. Preview system for concurrently displaying multiple preview images generated based on input image generated by image capture apparatus and related preview method thereof
US20140127667A1 (en) * 2012-11-05 2014-05-08 Marco Iannacone Learning system
CN104253904A (en) * 2014-09-04 2014-12-31 广东小天才科技有限公司 Method and smartphone for implementing reading learning
CN106710326A (en) * 2015-07-31 2017-05-24 曾晓敏 Reading textbook system based on Chinese

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
吴治新: "文本定位算法及其在智能读书软件中的应用", 《中国优秀硕士学位论文全文数据库》 *

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109214379A (en) * 2018-10-23 2019-01-15 北京快乐认知科技有限公司 Multi-functional point reading based on image recognition tracer technique gives directions part and reading method
CN109214379B (en) * 2018-10-23 2022-02-15 昆明微想智森科技股份有限公司 Multifunctional point reading pointing piece based on image recognition tracking technology and point reading method
CN110046009A (en) * 2019-02-19 2019-07-23 阿里巴巴集团控股有限公司 Method for recording, device, server and readable storage medium storing program for executing
CN110046009B (en) * 2019-02-19 2022-08-23 创新先进技术有限公司 Recording method, recording device, server and readable storage medium
CN110059678A (en) * 2019-04-17 2019-07-26 上海肇观电子科技有限公司 A kind of detection method, device and computer readable storage medium
CN111077992A (en) * 2019-06-09 2020-04-28 广东小天才科技有限公司 Point reading method, electronic equipment and storage medium
CN110634342A (en) * 2019-09-19 2019-12-31 广东小天才科技有限公司 Identification method and system of outlining frame, storage medium and electronic equipment
CN110767000A (en) * 2019-10-28 2020-02-07 安徽信捷智能科技有限公司 Children's course synchronizer based on image recognition

Also Published As

Publication number Publication date
CN107731020B (en) 2020-05-12

Similar Documents

Publication Publication Date Title
CN107731020A (en) Multi-medium play method, device, storage medium and electronic equipment
CN110381371B (en) Video editing method and electronic equipment
CN110740259B (en) Video processing method and electronic equipment
CN107835366A (en) Multi-medium play method, device, storage medium and electronic equipment
CN106937039A (en) A kind of imaging method based on dual camera, mobile terminal and storage medium
CN104902185B (en) Image pickup method and device
CN107995429A (en) A kind of image pickup method and mobile terminal
CN109547694A (en) A kind of image display method and terminal device
CN107592471A (en) A kind of high dynamic range images image pickup method and mobile terminal
CN101674409A (en) Mobile terminal having panorama photographing function and method for controlling operation thereof
CN108062404A (en) Processing method, device, readable storage medium storing program for executing and the terminal of facial image
CN111050070B (en) Video shooting method and device, electronic equipment and medium
CN107592459A (en) A kind of photographic method and mobile terminal
CN107317963A (en) A kind of double-camera mobile terminal control method, mobile terminal and storage medium
CN110225241A (en) A kind of video capture control method, terminal and computer readable storage medium
CN107870999A (en) Multi-medium play method, device, storage medium and electronic equipment
CN108259743A (en) Panoramic picture image pickup method and electronic equipment
CN109218626A (en) A kind of photographic method and terminal
CN113014801B (en) Video recording method, video recording device, electronic equipment and medium
CN109495616A (en) A kind of photographic method and terminal device
CN108182031A (en) A kind of photographic method, terminal and computer readable storage medium
CN110366027A (en) A kind of video management method and terminal device
CN108462826A (en) A kind of method and mobile terminal of auxiliary photo-taking
CN108984143B (en) Display control method and terminal equipment
CN107908770A (en) A kind of photo searching method and mobile terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20200512