TWI451327B - A multimedia movable termination and a method for session scheduling applied in a multimedia movable termination - Google Patents

Description

Multimedia mobile terminal and its scheduling method

The invention relates to a multimedia mobile terminal and a scheduling method thereof.

There are more and more types and functions of multimedia on multimedia mobile terminals, such as speech, tone, audio, voice memo, radio, video, vibrator. )...... However, due to the limited hardware and driver capabilities of multimedia mobile terminals, the same type of multimedia driver can only serve one upper-level program at the same time; if some different types of multimedia drivers need to use the same hardware for encoding and decoding, It can't work at the same time. The manufacturer of the mobile terminal defines the priority and coexistence relationship between various multimedia user behaviors and foreign events on the mobile terminal, so the application must comply with the following: when a certain high-priority multimedia behavior or event is operating, lower priority Multimedia behaviors or events do not work; when a high-priority multimedia behavior or event wants to use a driver, a lower-priority multimedia behavior or event must interrupt the operation of the driver and give up the right to use it. If the user is using the recorder, a text message is received. Since the recording and sound services cannot coexist, and the priority of the recorder is higher than the voice of the text message, the voice of the message cannot be sent and the recorder continues to run.

Since the multimedia driver does not know how many upper-level programs will use it at the same time, different types of multimedia drivers do not know whether another type of multimedia driver is being used. To use the multimedia driver to serve several upper-level applications at the same time and know the coexistence relationship with other multimedia drivers, the complexity of the multimedia driver operation will be greatly increased.

If the application directly uses the multimedia driver, it cannot comply with the priorities and coexistence relationships defined by the mobile terminal manufacturer with the limitations of the multimedia driver. To ensure that no other applications use the same or incompatible drivers at the same time, and then use the multimedia drivers, each application must know the usage of other applications. In addition, when a high-priority application needs to use a driver, it must first notify the low-priority application to release control of the multimedia driver before starting to use the multimedia driver. Such applications will have a coupling relationship, which will increase or decrease the application on the multimedia mobile terminal. It is necessary to check whether the application with which the coupling relationship is affected is affected, and the application development on the multimedia mobile terminal will be changed. It takes a lot of time.

In view of the above, it is necessary to provide a multimedia mobile terminal and its scheduling method.

The multimedia mobile terminal includes a session administrator and a plurality of different kinds of multimedia services; the session administrator provides different types of sessions for use by the multimedia service, and according to the relationship of each session and each session The priority in the multimedia mobile terminal application schedules the duration of the multimedia service being used. The meeting period refers to a period during which the multimedia mobile terminal application is to use the multimedia service. During this period, the multimedia service needs to obtain the right to use the multimedia driver.

The session scheduling method of the multimedia mobile terminal includes the following steps: Step A: providing a session administrator; Step B: The session administrator provides different kinds of sessions for use by the multimedia service, where the session refers to multimedia mobile During the period when the terminal application is to use the multimedia service, during this period, the multimedia service needs to obtain the right to use the multimedia driver; Step C: The session administrator will use the multimedia mobile terminal application according to the relationship between each session and each session. The priority in the schedule is scheduled for the period of time being used by the multimedia service.

The advantage of using the present invention is that, because the multimedia mobile terminal application uses the multimedia driver through the multimedia service, the application of the multimedia mobile terminal can be independently developed to reduce the complexity of development; second, the session administrator ensures Each multimedia service can serve multiple applications at the same time, and ensure that the multimedia driver is used normally by the multimedia service. Third, if you want to add a multimedia service, you only need to modify the session relationship table and run the session administrator. In the communication step, the administrator will make the multimedia service work normally. Fourthly, according to the multimedia functions of different multimedia mobile terminals, designers can add or reduce multimedia services arbitrarily, and schedule them through the session administrator. To meet the needs of mobile terminal applications.

126‧‧‧Application

12‧‧‧Multimedia administrator

122‧‧‧session administrator

124‧‧‧Multimedia Driver

120‧‧‧Multimedia services

128‧‧‧Multimedia service interface

1 is a block diagram of a preferred embodiment of a multimedia mobile terminal of the present invention.

Fig. 2 is a diagram showing the relationship between the types of the sessions of the present invention and various types of sessions.

3 is a comparison table of the priority of the session in the multimedia mobile terminal application of the present invention.

Figure 4 is a state transition diagram of the duration of the present invention, the functions used and callbacks.

FIG. 5 is a flow chart of the schedule manager of the present invention scheduling a controllable meeting period.

Figure 6 is a flow chart showing the scheduling of interruptible sessions by the session administrator of the present invention.

Figure 7 is a flow chart showing the interaction between the session administrator and the multimedia service in the same type of session.

Figures 8 and 9 are flow diagrams of interaction between a session administrator and a multimedia service in a priority competition during different types of sessions.

Figure 10 is a flow chart showing the interaction between different types of session administrators and multimedia services.

FIG. 1 is a structural diagram of a preferred embodiment of a multimedia mobile terminal of the present invention. The multimedia mobile terminal includes a plurality of applications 126 and a plurality of multimedia drivers 124. The application 126 includes a wide variety of applications running on a multimedia mobile terminal. The multimedia driver 124 includes a broadcast driver, a sound driver, a recording driver, a voice driver, and a tone driver. The multimedia driver 124 serves the application 126.

The multimedia mobile terminal also includes a multimedia administrator 12 that serves as an intermediate layer between the multimedia driver 124 and the application 126. The multimedia administrator 12 includes a session administrator 122, a plurality of multimedia services 120, and a service interface 128 for the plurality of multimedia services. The plurality of multimedia services 120 include voice services, tone services, voice services, recording services, broadcast services, and the like. Corresponding to the multimedia service, the service interface 128 includes a voice service interface, a tone service interface, a voice service interface, a recording service interface, a broadcast service interface, and the like.

Each of the multimedia services 120 can serve multiple applications 126. Multi-media The body service 120 knows which application can use the desired multimedia driver 124 through the schedule of the session manager 122. The session administrator 122 is configured to arrange the multimedia service of the application according to the priority and coexistence relationship of the session, so that each multimedia service complies with the limitations and priorities of the multimedia driver and the coexistence relationship. The respective applications 126 use the multimedia service interface provided by the multimedia mobile terminal to use the multimedia function, and each application complies with the priority order and coexistence relationship defined by the mobile manufacturer.

In order to facilitate the understanding of the present invention, the session is described as follows: Duration: The period during which the application is to use the multimedia service, that is, the duration is a length of time. During this period, the multimedia service needs to obtain the right to use the multimedia driver. Each multimedia service can achieve a corresponding type of duration. Applications can require multimedia services to have different priority sessions.

The types and relationships of the sessions are shown in Figure 2. The types of the session include the duration of the voice, the duration of the speech, the duration of the broadcast, the duration of the tone, and the duration of the recording. The relationship between the sessions includes competition, mutual exclusion, and coexistence. The same type of session will use multimedia drivers in accordance with priority competition, such as the duration of the sound and the duration of the sound will compete according to the priority. Different kinds of sessions have mutual relations and coexistence. The duration of the mutual exclusion relationship cannot use its own multimedia drivers at the same time, such as the voice duration and the sound duration, and also use the multimedia driver according to the priority competition. The duration of the coexistence relationship can be used at the same time with their respective multimedia drivers, such as tone duration and sound duration.

A comparison of the duration priorities in various applications is shown in Figure 3. The application includes a ringer, voice call, incoming call, alarm/camera, alarm, music player, newsletter, JAVA language, button sound, recorder, and the like.

If the multimedia service wants to use the multimedia driver in a certain period, it must first obtain the consent of the session administrator 122. The session manager 122 can also actively request the multimedia service to release the multimedia driver usage right of a certain period.

Referring to Figure 4, it is the state transition diagram of the session, the function used and the callback. Each session includes seven states, namely, a Null state, a Created state, an Activated state, a Ready state, a Finishing/Terminating state, and an Interrupting state. Interrupted state. Among them, the Null state indicates that this session is not used. The Created state indicates that this session is being used by the multimedia service, but it has not yet used a multimedia driver. The Activated state indicates that the multimedia driver is being used during this session. The Ready status indicates that you want to get the multimedia driver during this session, but the session administrator has not agreed or rejected it. The Finishing/Terminating state indicates that the session started or was asked to release the multimedia driver during this session, but it was not released. The Interrupting state indicates that this session is required to temporarily release the multimedia driver, but it has not been released. The Interrupted state indicates that the multimedia driver has been temporarily released during this session, waiting for the session administrator to reply.

The functions used include Create, Destroy, Start, Finishing, Finished, Interrupted ) function. The Create function indicates that the multimedia service obtains a session from the session administrator. The Destroy function indicates that the multimedia service will be returned to the session administrator. The Start function indicates that the multimedia service informs the session administrator that you want to start using the multimedia driver during this session. The Finishing function indicates that the multimedia service informs the session administrator that this session will end using the multimedia driver. The Finish function indicates that the multimedia service is informed The administrator ends the use of the multimedia driver at this end of the session. Interrupted indicates that the multimedia service informs the session administrator that the multimedia driver is temporarily terminated during this session.

The callbacks used include Reject callback, Grant callback, Terminate callback, Interrupt callback, and Resume callback. The Reject callback indicates that the session administrator rejected the multimedia service request to start using the multimedia driver during this session. The Grant callback indicates that the session administrator agrees that the multimedia service will begin to use the multimedia driver for this session. The Terminate callback indicates that the session administrator requested the multimedia service to release the multimedia driver usage rights for this session. The Interrupt callback indicates that the session administrator requested the multimedia service to temporarily release the multimedia driver for this session. Resume callback indicates that the session administrator informs the multimedia service that the multimedia driver usage rights for this session can be restored.

In addition, the multimedia service can also use the interruptible session to automatically obtain the multimedia driver usage right after releasing the multimedia driver usage right in a certain period. When a session is able to start using the multimedia driver again, the session manager 122 will call back to notify the multimedia service.

Each state of the session includes a sequence or a stack, and in each sequence or stack of states, the session in that state is stored. The sequence or stack includes: a Ready state stack, a Null state sequence, a Created state sequence, an Activated state sequence, and a Finishing/Terminating state sequence, which will be interrupted. The sequence of states, the interrupted state stack. The in-session scheduling method of the preferred embodiment schedules the latest sessions in the Ready state stack and the Interrupted state stack.

When the multimedia service changes the state of a certain period through the function, it will trigger the session manager 122 to reschedule all the sessions that are being used by the multimedia service, according to the priority of each session in FIG. 2 and FIG. The right and the relationship table with different types of sessions, once again change the state of this session or other session, and use the callback to notify the multimedia service that the session state has changed. And the multimedia service can start using or release the multimedia driver usage right in the callback.

Referring to FIG. 5, it is a flow chart of the schedule manager of the present invention scheduling a controllable session. The actions performed in the scheduling process are performed by the session administrator, so the subject is omitted. When reading this process, please refer to the in-state state transition diagram of Figure 4, the types of the session of Figure 2, and each other. The relationship and the meeting priority comparison table in the various applications of FIG.

S400, take out the latest session in the Ready state stack.

S402. Compare the priority and relationship of the latest session with other sessions in the Ready state stack. When the priority of the latest session is higher than the priority of the other session, that is, the priority of the latest session is won, the process proceeds to step S404. When the priority of the latest session is lower than the priority of the other session, that is, the priority of the latest session is lost, the process proceeds to step S401.

S404, comparing the priority and relationship of the latest session with other sessions in the Activated state sequence. When the priority of the latest session is won, the process proceeds to step S406, and when the latest session priority is lost, the process proceeds to step S401.

S401: When the priority of the latest session is lost, the state of the latest session is changed to the Created state, and the multimedia service is notified by Reject.

S406, when the priority of the latest session wins, it will be in the Ready state stack The status of other sessions that are incompatible with the latest session is changed to the Created state, and the Reject call is used to notify the multimedia service.

S408: Change the status of the other session in the Activated status sequence that is incompatible with the latest session to the Terminating state or the Interrupting state, and notify the multimedia service by using the Terminate/Interrupt callback.

S410. Determine whether there are other sessions that are incompatible with the latest session (ie, mutually exclusive) in a Terminating state or an Interrupting state. If yes, the process goes to step S414, otherwise, the process goes to step S412.

S414. If there are other sessions that are incompatible with the latest session, in the Terminating state or the Interrupting state, the latest session state in the Ready state stack remains in the Ready state, and the latest session is maintained. Still put back in the Ready state stack.

S412. If no other session incompatible with the latest session is in a Terminating state or an Interrupting state, the latest session state in the Ready state stack is changed to an Activated state, and the latest session is placed. Activated the status sequence and notify the multimedia service with Grant callback.

Referring to FIG. 6, it is a flowchart of the scheduling administrator of the present invention scheduling the interruptible meeting period. The actions performed in the scheduling process are performed by the session administrator, so the subject is omitted. When reading this process, please refer to the in-state state transition diagram of Figure 4, the types of the session of Figure 2, and each other. The relationship and the meeting priority comparison table in the various applications of FIG.

S500, taking the latest session from the Interrupted state stack.

S502, determining whether there are other periods incompatible with the latest session in the Ready shape State or Activated state or Terminating state or Interrupted state. If yes, the process goes to step S506, and if not, the process goes to step S504.

Step S504, if no other session incompatible with the latest session is in the Ready state or the Activated state or the Terminating state or the Interrupted state, the state of the latest session is changed from the Interrupted state to the Activated state, and The latest session is placed in the Activated state sequence and the multimedia service is notified with Resume callback.

Step S506, if other sessions that are incompatible with the latest session are in the Ready state or the Activated state or the Terminating state or the Interrupted state, the state of the latest session is still maintained in the Interrupted state, and the latest state is maintained. The session is still put back in the Interrupted state stack.

Please refer to FIG. 7 , which is a flow chart of interaction between the session administrator and the multimedia service in the same type of session.

When the user wants to select a song and play it, the Audio service informs the session administrator 122 that the user wants to start using the sound driver through the Start function, and the session administrator can notify the voice by calling (Grant) The service agrees that its use begins to use the sound driver. At this point, the sound service begins to use the sound driver, and the sound begins. The alarm time expires when the song is halfway through. The song and the alarm clock are all part of the sound session. The sound service to which the alarm clock belongs also informs the session administrator 122 to start using the sound driver through the Start function. Please refer to Figure 2 and Figure 3. Since the voice service can only issue the needs of an application at the same time, Moreover, the priority of the alarm clock is higher than that of the song, so the administrator will reschedule the duration of the sound service, and release the sound service of the song by releasing the (Terminate) callback to release the sound driver of the sound session. Right, the sound service After stopping the use of the sound driver, at this time, the song sound needs to be stopped, and the sound service of the song is then notified to the session administrator through the Finish function that the sound session ends with the sound driver. Then, the session administrator greets the voice service of the alarm by agreeing (Grant) call back to the request to start using the sound driver, and the alarm sound needs to be sounded after the sound service of the alarm clock acquires the right to use the sound driver.

Please refer to FIG. 8 , which is a flow chart of interaction between the session administrator and the multimedia service in the priority competition in different kinds of sessions.

The user turns on the function of the background radio (belonging to the broadcast session), and then calls (belongs to the voice session) to a contact person. Referring to Figure 2 and Figure 3, since the broadcast and voice services cannot coexist, they are mutually exclusive, and the priority of the voice call is higher than that of the broadcast radio. Therefore, the background radio needs to be interrupted, and the function of the background radio is restored after the voice call operation ends. .

As shown in Figure 9, when the user is using the recorder (belonging to the recording session), he receives a text message (belonging to the sound session). Since the recording and sound services cannot coexist, they belong to a mutually exclusive relationship, and the recorder The priority is higher than the SMS, so the SMS sound cannot be sent and the recorder continues to run.

As shown in FIG. 10, it is a flow chart of interaction between different types of session administrators and multimedia services.

When the voice call (belonging to the voice session) is halfway, there is another call waiting for the call (belonging to the tone session). Since the voice and tone service can coexist, the user can continue the call while hearing the waiting tone.

The above is only the preferred embodiment of the present invention, and has been used in a wide range of ways, and other equivalent changes or modifications have been made without departing from the spirit of the present invention. , should be included in the scope of the patent application below.

126‧‧‧Application

12‧‧‧Multimedia administrator

122‧‧‧session administrator

124‧‧‧Multimedia Driver

120‧‧‧Multimedia services

128‧‧‧Multimedia service interface

Claims (7)

A multimedia mobile terminal includes a session administrator, a plurality of multimedia drivers, and a plurality of different kinds of multimedia services, wherein: the session administrator provides different kinds of sessions for use by the multimedia service, and Scheduling the session being used by the multimedia service according to the interrelationship of each session and the priority of each session in the multimedia mobile terminal application; the session means that the multimedia mobile terminal application uses multimedia During the service period, the multimedia service needs to obtain the right to use the corresponding multimedia driver during the period. The same type of session is a competitive relationship. The same type of session uses the same multimedia driver according to the priority competition; different kinds of meetings There are mutually exclusive and coexisting interrelationships. The duration of the mutual exclusion relationship uses the respective multimedia drivers according to the priority competition. The duration of the coexistence relationship can use the respective multimedia drivers at the same time; and the session administrator The steps for scheduling the duration of the interruption include: (b1) taking out the Interr The latest session in the upted state stack; (b2) determine whether there are other sessions that are mutually exclusive with the latest session in the Ready state or the Activated state or the Terminating state or the Interrupted state. If there is a step (b3), if not Going to step (b4); (b3) maintaining the state of the latest session in the Interrupted state, and putting the latest session back into the Interrupted state stack; (b4) bringing the state of the latest session to the Interrupted state. Change to the Activated state and put the latest session into the Activated state sequence and notify the multimedia service with Resume callback. The multimedia mobile terminal according to claim 1, wherein the multimedia service comprises voice The service, the tone service, the voice service, the recording service, and the broadcast service, the multimedia driver includes a voice driver, a tone driver, a sound driver, a recording driver, and a broadcast driver, and the types of the session include a voice session. , tone session, sound session, recording session, broadcast session. A method for scheduling a multimedia mobile terminal, the method comprising: step A: providing a session administrator; step B: the session administrator provides different kinds of sessions for use by the multimedia service, wherein the session refers to During the period in which the multimedia mobile terminal application is to use the multimedia service, during this period, the multimedia service needs to obtain the right to use the corresponding multimedia driver; and step C: the session administrator is based on the relationship between each session and each session. The priority in the multimedia mobile terminal application is scheduled for the duration of the multimedia service, and the same type of session is a competitive relationship. The same type of session uses the same multimedia driver according to the priority competition; different types The duration of mutual exclusion and coexistence is mutually exclusive. The duration of the mutual exclusion relationship uses the respective multimedia drivers according to the priority competition. The duration of the coexistence relationship can use the respective multimedia drivers at the same time. Step C of the administrator scheduling the interrupted session includes: (b1) taking out the Interrupted state stack The latest session; (b2) to determine whether there are other sessions that are mutually exclusive with the latest session in the Ready state or the Activated state or the Terminating state or the Interrupted state, if there is a step (b3), if there is no entry step ( B4); (b3) keep the state of the latest session in the Interrupted state, and put the latest session back into the Interrupted state stack; (b4) change the state of the latest session from the Interrupted state to Activated Status and put the latest session into the Activated state sequence and notify the multimedia service with Resume callback. The method for scheduling a multimedia mobile terminal according to claim 3, wherein the function used by the session administrator to schedule the session includes a Create function, indicating that the multimedia service is available to the session administrator. Get a session; Destroy function, indicating that the multimedia service will be returned to the session administrator; the Start function means that the multimedia service informs the session administrator that the session wants to start using the driver; the Finishing function indicates the multimedia service. Inform the session administrator that the session will end the use of the multimedia driver; the Finish function indicates that the multimedia service informs the session administrator that the multimedia driver is used at the end of the session; and the Interrupted function indicates that the multimedia service informs the session administrator The multimedia driver will be temporarily closed during the session. The method for scheduling a multimedia mobile terminal according to claim 3, wherein the session is in a different state, each state includes a sequence or a stack, and is stored in a sequence or stack of each state. The session is in the state, the session state includes: Created state, indicating that the session is being used by the multimedia service, but the multimedia driver is not used in the session; the Activated state indicates that the session is using multimedia. Driver; Ready state, indicating that the session wants to get the multimedia driver, but the session administrator has not agreed or rejected; Finishing/Terminating state, indicating that the session starts or is required to release the multimedia driver, but has not been released; Interrupting Status, the session is required to temporarily release the multimedia driver, but not released; and Interrupted state, the session has temporarily released the driver, waiting for the session administrator to return complex. The method for scheduling a multimedia mobile terminal according to claim 5, wherein the callback used by the session administrator to schedule the meeting includes: Reject callback, indicating that the session administrator rejects the multimedia. The service began to use the multimedia driver requirements for this session; Grant called back, indicating that the session administrator agreed to the multimedia service request to start using the multimedia driver during this session; Terminate call back, indicating that the session administrator requested the multimedia service release The multimedia driver usage right of the session; Interrupt callback, indicating that the session administrator requests the multimedia service to temporarily release the multimedia driver of this session; and Resume callback, indicating that the session administrator informs the multimedia service that it can reply The multimedia driver usage rights for this session. For the scheduling process of the multimedia mobile terminal according to claim 6, the step C includes: (a1) taking out the latest session in the Ready state stack; (a2) comparing the latest session with the other in Ready. The priority and relationship of the session in the status stack, when the latest session priority is lost, the process proceeds to step (a3), and when the latest session priority is won, the process proceeds to step (a4); (a3) The state of the latest session is changed to the Created state, and the Reject call is used to notify the multimedia service to end the process; (a4) comparing the priority and relationship of the latest session with other sessions in the Activated state sequence, when When the latest session priority is lost, the process proceeds to step (a3), and when the latest session priority wins, the process proceeds to step (a5); (a5) will not be in the Ready state stack with the latest session. Compatible with other in-session states Change to the Created state, and use the Reject callback to notify the multimedia service; (a6) change the state of the other session in the Activated state sequence that is incompatible with the latest session to the Terminating state or the Interrupting state, and use the Terminate/Interrupt Calling back to notify the multimedia service; (a7) determining whether there are other sessions that are incompatible with the latest session are in a Terminating state or an Interrupting state, if there is an entry step (a8), otherwise, proceeding to step (a9); (a8) The latest session state in the Ready state stack remains in Ready, and will be put back into the Ready state stack; (a9) Change the latest session state in the Ready state stack to the Activated state and update the latest The session is placed in the Activated state sequence and the multimedia service is notified with a Grant callback.