CN101651665B - Method, device and system for controlling playing state detection of media resource - Google Patents

Abstract

The embodiment of the present invention discloses a control method, device and system for detecting the playing status of media resources. The method includes the following steps: the media processing device detects the playing status of the media according to a preset event; The preset event reports the change of the media playing state to the media playing control device. In the embodiment of the present invention, the media processing device can detect the media playback status according to preset events, and report it to the media playback control device in time when the media playback status changes, so that the media playback control device can know the media playback status in time, thereby It becomes possible to timely control and respond to changes in media playback status in a timely manner.

Description

A control method, device and system for realizing media resource playback state detection

technical field

The present invention relates to the field of communication technology, in particular to a method, device and system for realizing the control of media resource playback state detection. the

Background technique

Media Gateway Controller (MGC) and Media Gateway (MG) are two key components of the packet network under the architecture of separation of service and bearer. The MGC is responsible for the service control function, and the MG is responsible for the media bearer function, thereby realizing the separation of the service control plane and the media bearer plane, thereby fully sharing network resources, simplifying equipment upgrades and service expansion, and reducing development and maintenance costs. the

In the multimedia application environment, through the existing RTSP playback package, the MGC can instruct the MG to play the specified media file (resource), and at the same time, it can also indicate the speed and range of the media playback, for example, it can be indicated by the playback speed ratio parameter The MG plays the media at a speed twice or other values higher than the normal speed. the

However, in the process of implementing the prior art, the inventor found that the prior art has at least the following problems: in the process of playing the media file (resource), the media playback state may change, such as along with the playback of the media file, the media content And the attribute information corresponding to the media changes. For example, in the live video scene, the content of the media will change over time, and the information on the available range of the media will change accordingly; for example, if the MGC instructs the MG to follow the When playing at the relative speed of the regular speed, as time goes by, such a speed may not be able to be performed, for example, the current playback point has been caught up, and the subsequent content is still inaccessible. When the media playback state changes, the MGC needs to know the change in the media playback state in time to further instruct the MG to complete subsequent operations. However, in the current gateway control protocol, there is no effective mechanism for the MGC to know the media playback in real time. Changes in the state, which will lead to the inability to control and respond to the changes in a timely manner. the

Contents of the invention

The purpose of the embodiments of the present invention is to provide a control method, device and system for media resource playback status detection, so as to realize the timely understanding of the media playback status under the structure of separation of services and bearers, so as to timely understand the changes of the media playback status. It is possible to control and respond to the situation in a timely manner. the

In order to achieve the purpose of the embodiments of the present invention, the embodiments of the present invention provide the following technical solutions:

A method for controlling the playing state of a media resource is provided, comprising the following steps: a media processing device detects a media playing state according to a preset event; when a change in the media playing state is detected, it reports to the media playing control device according to the preset event A change in the media playback state; wherein, the preset event is sent by the media playback control device to the media processing device;

Wherein, the event is used for the media processing device to report the change of the media stream playback speed ratio to the media playback control device, and the event is preset to carry one or any combination of the following parameters:

The play action change parameter is used to indicate the play behavior of the media stream after the media processing device detects that the relative speed of the media has changed. The play behavior includes changing to normal speed play or stopping play;

Update the relative speed ratio parameter to indicate the new playback speed ratio used after the media playback speed ratio changes;

Allow ratio change parameter to indicate whether the media processing device is allowed to automatically modify the media playback speed ratio;

The scale change value parameter is used to indicate the allowed modification value when the media playback speed ratio is allowed to be automatically modified;

Media resource identifier, used to indicate the media resource entity to which the event applies;

Request ID indicating the playback request to which the event applies. the

Provided is a media processing device including a preset event storage unit, an event detection unit, and an event reporting unit, the preset event storage unit is used to store events sent by the media playback control device, and the event is used to report to the media playback control device A change in the media playing state; the event detection unit is used to detect the media playing state according to the event stored in the preset event storage unit; The event stored in the event storage unit reports the change of the media playback state to the media playback control device;

Wherein, the event stored by the preset event storage unit is specifically used for the media processing device to report the change of the media stream playback speed ratio to the media playback control device, and the event stored by the preset event storage unit carries the following parameters One or any combination:

The play action change parameter is used to indicate the play behavior of the media stream after the media processing device detects that the relative speed of the media has changed. The play behavior includes changing to normal speed play or stopping play;

Update the relative speed ratio parameter to indicate the new playback speed ratio used after the media playback speed ratio changes;

Allow ratio change parameter to indicate whether the media processing device is allowed to automatically modify the media playback speed ratio;

The scale change value parameter is used to indicate the allowed modification value when the media playback speed ratio is allowed to be automatically modified;

Media resource identifier, used to indicate the media resource entity to which the event applies;

Request ID indicating the playback request to which the event applies. the

A media playback processing device is provided, including a third receiving unit, configured to receive an event reported by the media processing device for notifying a change in the media playback state; The preset event detects the media playback status and reports when it detects a change in the media playback status;

Wherein, the preset event is sent by the media playback control device to the media processing device;

Wherein, the preset event is used for the media processing device to report the change of the media stream playback speed ratio to the media playback control device, and the preset event carries one or any combination of the following parameters when preset:

The play action change parameter is used to indicate the play behavior of the media stream after the media processing device detects that the relative speed of the media has changed. The play behavior includes changing to normal speed play or stopping play;

Update the relative speed ratio parameter to indicate the new playback speed ratio used after the media playback speed ratio changes;

Allow ratio change parameter to indicate whether the media processing device is allowed to automatically modify the media playback speed ratio;

The scale change value parameter is used to indicate the allowed modification value when the media playback speed ratio is allowed to be automatically modified;

Media resource identifier, used to indicate the media resource entity to which the event applies;

Request ID indicating the playback request to which the event applies. the

It can be seen that, in the embodiment of the present invention, the media processing device can detect the media playback status according to preset events, and report to the media playback control device in time when the media playback status changes, so that the media playback control device can know the media playback status in time. Playing state, so that it is possible to control and respond to the change of media playing state in time. the

Description of drawings

Fig. 1 is a schematic flow diagram of a control method for media resource playback state detection provided by an embodiment of the present invention;

Fig. 2 is a schematic flow diagram of another media resource playback state detection and control method provided by the embodiment of the present invention;

Fig. 3 is a schematic structural diagram of a media processing device according to an embodiment of the present invention;

Fig. 4 is a schematic structural diagram of a media playback control device provided by an embodiment of the present invention. the

Detailed ways

In a real-time multimedia session, along with the playback of media streams, attributes or states of media resources may change, such as interruption of media content, change of media playback range, and so on. The control of the playback state of media resources is mainly based on the grasp and response to resource changes during the media stream playback process, including the knowledge of state change events and the revision of corresponding resource policies. In order to realize the real-time control of the media stream playback status in the media resource session on the MG by the MGC, the MG needs to monitor the media stream playback status and report to the MGC when a change in the media stream playback status is detected. Therefore, the embodiment of the present invention needs to extend the (media) gateway control protocol. the

The event (Event) descriptor in the (media) gateway control protocol is used to control the MGC and instruct the MG to detect and report specific events that occur on the MG, including fax tones, off-hook/hang-up, and changes in bearer resources. The event descriptor includes a RequestID (request identifier) and a group of events required to be detected and reported by the MG, and the event request command and the event occurrence notification (Notify) command can be associated through the RequestID. When an event contained in the event descriptor in the active state occurs, by default, the MG sends a notification command to the MGC for reporting. The (media) gateway control protocol is the main protocol for communication between the MG and the MGC. Currently, H.248/MeGaCo and MGCP are widely used. The embodiment of the present invention uses the H.248 protocol as an example for illustration. the

The embodiment of the present invention defines an event in the H.248 protocol, which is used for the MG to notify the MGC of the change of the media playing state in the session. The detection and reporting of this event requires the setting of the MG, and the setting methods include delivery or pre-configuration. The event can be set on the ROOT terminal of the MG: it means to detect the end of the media stream event on the media stream played on the entire MG; it can also be set on a specific terminal on the MG: it means to detect the media stream played on the terminal ; It can also be a specific flow on the MG: it means that the detection of this event is only applicable to the specified flow. For example, the process for the MGC to deliver the event to the MG is as follows: the MGC can set a media stream end event to the MG through a Modify request message; after receiving the Modify request message, the MG sends a Modify reply message to the MGC. the

Therefore adopt the embodiment of the present invention to realize the method for media resource playing state detection to comprise:

S100. The MGC instructs the MG to perform media playback;

Optionally, when the MGC instructs the MG to perform media playback, it can set media playback parameters to the MG. The media playback parameters set by the MGC to the MG include one or any combination of the following information: media attribute parameters, including random access, media retention Media attribute information such as policy and content modifiability; addressing behavior parameters, indicating the addressing and positioning method of the starting position of media playback; media range parameters, indicating the content range information that the media can play. the

S101. The MG plays the corresponding media according to the instruction of the MGC, and detects the media playback state according to the preset event;

S102. The MG detects that the media playback state changes;

S103. The MG reports the change of the media playing state to the MGC according to a preset event. the

Presetting the event can be implemented by sending the media playback control device to the media processing device or by configuring it on the media processing device in advance. This event can be used by the MG to report to the MGC one or more of the three media playback state changes, the end of the media stream, the willingness to change the media stream attribute or media range, and the change in the relative speed ratio of the media stream. Examples will be described in detail. the

Embodiment one

If this event is used for the MG to report the end of the media stream to the MGC, that is, the media playback has been completed or is close to completion, then the MG can indicate the position where the media stream terminates through the carried event parameter, which may have already been played, or will be played in the near future. will be reached in the future. For example, name the event an "End of Stream (eos)" event. This event can be attributed to an existing or new package, for example included in the RTSP Play Package (RTSP Play Package, package identifier is rtspp) in H.248.65, or define a new package named Play State Control Package (Play State Control Package, abbreviated as pscp). the

The detection and reporting of the media stream end event may be based on the normal completion of the media playback, or the failure to complete the playback due to some reasons, or a reminder before the end of the playback. The MGC compares the end position of the media stream reported by the MG with the current playback position, and can know whether the media stream has ended or is about to end. the

The event can be sent or set without parameters, or with the following parameters:

The time (Time, abbreviated as time) parameter is used to indicate the time requirement for the MG to report the end event of the media stream playback. For example, if the parameter value is 5s, it means that the MGC expects the MG to report the media stream 5 seconds before the end of the media stream playback Playback event. If this parameter is carried, it means that the MGC wants to be reminded before the end of the media playing. the

The timing of media stream end event detection and reporting may be based on the normal completion of media playback, or the inability to complete the playback request due to some errors, or a reminder before the playback ends. When the MG detects a media stream end event, the MG uses the Notify command to report to the MGC. the

When the media stream end event is reported, some parameters may also be attached to indicate further information about the playback state of the media resource for the MGC to make corresponding decisions. The attached parameters include one or any combination of the following parameters:

The end range (End Range, abbreviated as er) parameter is used to indicate the position information at which the media stream playback ends. The type definition of this parameter is a string (String). This parameter may contain a list of range values, where each value is an interval, including all valid values between the first value and the second value. The default is a semi-open interval, including the first value, but not including the second value. the

Corresponding to the above range parameters, a range format (Range Format, abbreviated as rf) parameter is also required to indicate the format of the value of the end range parameter. This parameter can be an enumeration or a string type. Its value includes any format in NPT (Normal Play Time), SMPTE (Society of Motion Picture and Television Engineers), SMPTE-30, SMPTE-25, UTC (Universal Time Code), Frame, Byte, and the default is NPT format. If the event is reported, the special range format parameter may not be defined, that is, the end range parameter adopts the range format value specified when the MGC instructs the MG to play the media. the

For example, when the value of the above event parameter is "range=-120; rf=NPT", it means that the media stream ends at 120 seconds. After receiving the above parameter information, the MGC learns the current playing state by comparing it with the current playing position of the media. Taking the previous example as well, if the NPT value of the current playback position is 115, it can be known that the media stream will end in 5 seconds. the

When the RTP protocol is used to encapsulate the media for transmission, the event report can also carry RTP-related information, such as defining three event parameters respectively, named "Synchronization Source (Synchronization Source, abbreviated as ssrc)", "Packet Sequence Number (Packet Sequence) Number, abbreviated as sn)", "RTP Timestamp (abbreviated as ts)". Among them, the synchronization source parameter is used to identify the synchronization source information applied by the latter two parameters, the packet sequence number parameter is used to indicate the sequence number of the last RTP message (Packet), and the timestamp is used to indicate the end time corresponding to the media stream The RTP timestamp. the

When the event is reported, it can also carry a media resource identifier parameter (Media Resource Identifier, abbreviated as mri), used to indicate the media resource entity associated with the reported event; and a request ID (Request ID, abbreviated as rid), used to indicate the reported event The corresponding playback request. When multiple media resources are playing or there are multiple playback requests on the MG, the above parameters are used to identify the entity corresponding to the detection event.

In the above method, in addition to defining the end information of the media stream in the form of event parameters, it can also be defined in the form of attributes or signal parameters to achieve the same purpose. For example, taking the end range parameter as an example, an attribute is defined in the H.248 protocol to indicate the position information at which media stream playback ends. The type of the attribute can take a string. This property can be applied to a terminal (Termination) or a stream (Stream) on a terminal. If applied to a terminal, it is defined in the TerminationState descriptor. If applied to a stream, it is defined in the LocalControl descriptor. This attribute is readable and writable, that is, the MGC can set this attribute to the MG to indicate the end position of the media stream playback, and the MGC can also obtain this attribute from the MG to know the end position information of the media stream playback. the

In addition, the two parameters of the end range and the range format can also be combined into one parameter, and the value type is a character string, for example, er="NPT=-120". the

In this embodiment, by defining a media stream end event in the H.248 protocol, the MG can report the media stream end event to the MGC when detecting the end of the media stream or is about to end according to a preset event, so that the MGC can know the media stream in time The playback state of the system, so as to control and respond to changing conditions. the

Example two

If the event is used for the MG to notify the MGC of the willingness to change the media stream attribute or media range in the session, the event parameter carried can indicate the change of the media stream attribute expected by the MG and the availability of the media stream. Due to the master-slave structure between MGC and MG, the change of media attributes on MG needs to be instructed by MGC, so the request for changing media attributes during media playback needs to be reported to MGC in time for approval. For example, name the event a "Media Property Change (abbreviated as mpc)" event. This event can be attributed to an existing or new package, for example included in the RTSP Play Package (RTSP Play Package, package identifier is rtspp) in H.248.65, or define a new package named Play State Control Package (Play State Control Package, abbreviated as pscp). the

The event can be delivered without parameters or with the following parameters:

A time interval (Time Interval, abbreviated as ti) parameter is used to indicate a period for the MG to report a media attribute change event. For example, if the value of the parameter is 300s, it means that the MGC expects the MG to report a media attribute change event every 6 minutes. This parameter is mainly used in media playback that changes over time. The type of this parameter can be defined as an integer, and the unit is seconds. the

The reporting of media attribute change events may be periodic, such as the above-mentioned report every 6 minutes, or condition-triggered, such as when a certain attribute is expected to change. the

When the media stream attribute change event is reported, one or any combination of the following parameters can be carried to indicate further information on the playback status of the media resource for the MGC to make corresponding decisions:

The timestamp (timestamp) parameter is used to indicate the time of the media attribute change request. the

A range (Range, abbreviated as range) parameter and/or a range format (Range Format, abbreviated as rf) parameter is used to indicate the current playback position of the media stream and the remaining playback range information. The type and value of the parameters are the same as the previous parameter definitions. ("/" in "and/or" in this application document indicates a selection relationship)

The Media Range (abbreviated as mr) parameter and/or the media range format (Media RangeFormat, abbreviated as mrf) parameter are used to indicate the playable range information of the media stream requested by the MG. The type and value of the parameters are the same as the previous parameter definitions. the

For example, when the value of the above event parameter is "mrange=0-120; mrf=NPT; range=108.25-; rf=NPT", it means that the available playback range of the media stream is from 0 seconds to the end of 120 seconds, and the current playback position is 108.25 seconds, and the remaining playback interval is 108.25 to the end. the

The media properties (Media Properties, abbreviated as mp) parameter is used to indicate the media property information that the MG wishes to change, including information such as random accessibility, content retention policy, and content modification policy. The type of the parameter can be defined as string type. In addition, the information contained in the parameter may also be split into the following parameters, which respectively represent the attribute information that the MG corresponds to and wants to change. the

The random access (Random Access, abbreviated as ra) parameter is used to indicate whether the playback position of the media stream can be moved arbitrarily within the duration of the media. Support random access, users can fast-forward or rewind to watch the previous or later content, or drag the playback position of the media arbitrarily. The type of this parameter can be set as an enumeration type, and the values include: Random Access (abbreviated as RA), which means that the playback position of the media stream can be dragged and searched arbitrarily, of course, the selection of the playback point is limited by different encodings format; source point playback (Return to Start, abbreviated as RS), indicating that the content is only allowed to start playing from the starting point; prohibiting dragging (No Seeking, abbreviated as NS), indicating that the media content does not allow dragging. The parameter type can also be a string type. Because the characteristics of random access depend on the encoding format, some specific points may not be accessible, so there may be a certain deviation between the requested access point and the actual access point. A value can be defined to represent random access The maximum distance between points, for example, the value of ra is "RA=5", which means that the maximum distance between random access points is 5 seconds. the

A retention policy (retention policy, abbreviated as rp) parameter is used to indicate the status of the media content being retained. Its value includes: unlimited (Unlimited, abbreviated as un), the media content will be retained and not deleted during the entire session; time limited (Time Limited, abbreviated as t1), the media content will be retained at least until the specified time without Not to be deleted, the content may be available after a specified time, or may be deleted and unavailable; Duration Limited (abbreviated as d1), each unit of media content is only retained for a specified period of time. The parameter type may be a string type, for example, the value of rp is "d1=5s", which means that the duration of the media content unit is 5 seconds. the

A content modification (Content Modifications, abbreviated as cm) parameter is used to indicate whether the media content is allowed to change. Its values include: Unmutable (abbreviated as un), the media content will not change; dynamic change (Dynamic, abbreviated as dy), the media content will occur based on external methods or trigger mechanisms (such as changes in playlists) Changes, but the media content does not change between two explicit updates; time evolution (Time Progress), the media content changes over time, for example, during live TV, the content is constantly updated over time, if the content is acquired After being retained, the played content can be replayed with the accumulation of time. The type of this parameter can be set as an enumeration type or a string type. the

When the event is reported, it can also carry a media resource identifier parameter (Media Resource Identifier, abbreviated as mri), used to indicate the media resource entity associated with the reported event; and a request ID (Request ID, abbreviated as rid), used to indicate the reported event The corresponding playback request. When multiple media resources are playing or there are multiple playback requests on the MG, the above parameters are used to identify the entity corresponding to the detection event. the

In the above method, in addition to defining the media stream attribute information in the form of event parameters, it can also be defined in the form of attributes or signal parameters to achieve the same purpose. the

In this embodiment, a media attribute change event is defined in the H.248 protocol, so that the MG can report the media attribute change event to the MGC when the media attribute change will is detected according to the preset event, and the MG request can be indicated through the carried parameters. Changes of media stream attributes and the availability of media streams enable the MGC to know the playback status of media streams in a timely manner, so as to control and respond to change requests. Further, the MGC formulates media attribute update instructions according to the parameters carried when the MG reports media stream attribute changes; by initiating a new media playback request, which carries authorized media attribute information, instructs the MG to modify relevant media attribute parameters accordingly. the

Embodiment three

If the event is used for the MG to notify the MGC of the change in the relative speed of media playback in the session, the event can be named "Media Play Scale Change (Media Play Scale Change, abbreviated as mpsc)" event. This event can be attributed to an existing or new package, for example included in the RTSP Play Package (RTSP Play Package, package identifier is rtspp) in H.248.65, or define a new package named Play State Control Package (Play State Control Package, abbreviated as pscp). the

For the media whose playback content changes with time (such as online live broadcast), when the media playback speed ratio issued by the MGC to the MG (that is, the ratio of the playback speed to the normal speed) is greater than 1, as the media is played, the playback The point has caught up with the front end of the current media that can be played, so the relative speed greater than 1 can no longer be executed, but can only be played at a playback speed that is less than or equal to the normal speed. The situation of backward playback is also similar. When the media playback speed set by the MGC is lower than the normal speed, as time goes by, the media content played before a certain period of time may become invalid and cannot be played. The playback speed lower than the normal speed may It is no longer possible to continue. Therefore, in this case, the MG notifies the MGC of the change through the media playback speed proportional change event. At the same time, when the MGC sets the event, it can further instruct the MG to take the next action when detecting the change of the playback speed, for example, stop playing the media content, or play the media content at a normal speed. Specifically, when the above events occur, the MGC can control the MG in the following ways:

1. By expanding the event parameters, the MGC instructs the MG how to deal with the proportional change event. The following parameters can be carried while sending the event:

The Changed Playback Behavior (cpb for short) parameter is used to instruct the MG to play the media stream after the relative speed of the media changes, including changing to normal speed or stopping the playback. The type of this parameter can be set to Boolean, and its values include: ON (ON), which means to return to the normal speed, that is, to play the media stream at the normal speed; OFF (OFF), which means to stop the playback, that is, to stop the playback of the media stream . The default value is "ON". In addition, other values can also be defined, for example, the MGC can instruct the MG to play at other speeds, etc. If other values are expanded, the parameter type needs to be changed. the

2. Another alternative method is to define an event parameter: Update Relative Speed Scale (UpdateScale, abbreviated as us), which indicates the new play speed scale used after the media play speed scale changes. The type of this parameter can be defined as numeric (Integer) or string (String). A value of "0" means to stop playing the media; a value of "1" means to play the media at a normal speed; other values indicate the corresponding playback speed ratio. the

3. By defining a parameter, Enable Scale Change (abbreviated as esc), indicates whether to allow MG to automatically modify the media playback speed ratio. The parameter type is Boolean, and its values include: ON, which means that the MG is allowed to automatically modify the media playback speed ratio; OFF, which means that the MG is not allowed to automatically modify the media playback speed ratio. On this basis, another parameter can be defined, Changed Scale Value (Changed Scale Value, abbreviated as csv), which is used to indicate the allowed modification value when the automatic modification of the media playback speed ratio is allowed. This parameter is a string; the default value is l. If there is no ratio change value parameter, then when the MG enables the automatic modification function, the MG can independently determine the playback speed ratio to be changed. the

This solution can respond to the occurrence of a ratio change event by enabling the MG to automatically modify the ratio parameter, and also conforms to the complete control of the MG by the MGC. In addition, the timely modification of the ratio parameters can also ensure the continuity of media playback. the

When the media playback speed ratio change event is reported, an event parameter is defined to carry the changed playback speed ratio information, for example named as Scale Change (Scale Change, abbreviated as sc). When the value of the esc parameter delivered by the MGC is 'ON', the MG can modify the ratio value independently, and the sc parameter carries the changed ratio value of the MG, that is, the newly effective playback speed ratio; when the value of the esc parameter delivered by the MGC is When it is 'OFF', the MG cannot modify the ratio value independently, and the sc parameter carries the ratio value that the MG wants to change, but further authorization by the MGC is required to take effect. the

4. After the MG detects the willingness to change the media playback speed ratio, it reports the corresponding change willingness to the MGC, and the MG must wait for further instructions from the MGC before modifying the corresponding ratio parameter. After receiving the above event notification, the MGC may request the MG to modify the corresponding playback speed ratio parameter through a new media playback request. the

When the event is delivered, it can also carry a media resource identifier parameter (Media ResourceIdentifier, abbreviated as mri), which is used to indicate the media resource entity to which the event and its carried event parameters apply; and a request identifier (Request ID, abbreviated as rid ), used to indicate the playback request to which the event and the event parameters it carries are applicable. When multiple media resources are playing or there are multiple playback requests on the MG, the above parameters are used to identify the entity to which the event applies. The above two event parameters can also be applied to the aforementioned media stream end event or media attribute change event. For example, the media resource identification parameter and the request identification may also be carried when the event is delivered in the preceding several embodiments. the

When reporting the media playback speed ratio change event, one or any combination of the following parameters can also be carried to indicate further information about the playback status of the media resource for the MGC to make corresponding decisions:

The timestamp (timestamp) parameter is used to indicate the time when the media playback speed ratio changes;

Ratio range (Range, abbreviated as range) parameter and/or range format (Range Format, abbreviated as rf) parameter, used to indicate the position where the media playback speed ratio changes, and also represents the starting position where the new playback speed ratio takes effect . The types and values of the parameters are the same as those defined in the previous embodiments. the

When the event is reported, it can also carry a media resource identifier parameter (Media Resource Identifier, abbreviated as mri), used to indicate the media resource entity associated with the reported event; and a request ID (Request ID, abbreviated as rid), used to indicate the reported event The corresponding playback request. When multiple media resources are playing or there are multiple playback requests on the MG, the above parameters are used to identify the entity corresponding to the detection event. the

In addition, the media range parameter, media range format parameter, or media attribute parameter as described in the preceding embodiments may also be carried when the event is reported, and the media attribute parameter includes random access parameters, retention policy parameters, content modification parameters, and RTP related information parameters. One or more of these parameters, to represent the attribute information corresponding to the media stream when the media playback speed proportional change event occurs.

Similarly, in the above method, in addition to defining the corresponding parameter information in the form of event parameters, it can also be defined in the form of attributes or signal parameters to achieve the same purpose. the

In this embodiment, a media playback speed ratio change event is defined in the H.248 protocol, so that the MG can report the media playback speed ratio change event to the MGC after detecting the media playback speed ratio change event according to a preset event, so that the MGC It can know the playback status of the media stream in time, so as to control and respond to the change. At the same time, the MGC can also specify to the MG the playback behavior of the media stream after the media playback speed ratio changes by carrying event parameters. the

Embodiment four

In the above three embodiments, three events are defined for different media playback state changes: the end of the media stream, the change of the media stream attribute, and the change of the relative speed ratio of the media stream. It should be noted that one event can also be defined uniformly , for example, the event named "Media PlayState Change (mpsc for short)" includes the above three types of state changes. By setting this event, the MGC obtains the status change of the media playing on the MG. This event can be attributed to an existing or new package, for example included in the RTSP Play Package (RTSP Play Package, package identifier is rtspp) in H.248.65, or define a new package named Play State Control Package (Play State ControlPackage, abbreviated as pscp). the

The parameters carried by the dispatch of the event and the parameters carried by the report include the parameters defined in the above three events. In addition, when the event is reported, an event parameter is defined: the event type (EventType, abbreviated as et), with to indicate the type of media playback state change. The type of this parameter can be set as an enumeration type, and its values include: Media Stream End (abbreviated as mse), indicating that the reported event is a media stream end event, and the corresponding other parameters carried are the same as those in the above media stream end event The definition of Media Property Change (Media Property Change, abbreviated as mpc), which means that the reported event is a media property change event, and the corresponding other parameters carried are the same as those defined in the above media property change event; the media playback speed ratio change (Media Play Scale Change, abbreviated as mpsc), indicates that the reported event is a media playback speed proportional change event, and the corresponding other parameters carried are the same as those defined in the aforementioned media playback speed proportional change event. the

Please refer to FIG. 2 , which is a flow chart of the specific application of the embodiment of the present invention. This embodiment takes the media playback relative speed ratio change event as an example to illustrate the application flow of the above-mentioned definition mechanism, so as to realize the MGC monitoring the media playback status on the MG. the

Assuming that the media playback speed ratio change event is defined in the RTSP Play Package (RTSPPlay Package, package identifier is rtspp) in H.248.65, the full name of the event reference is "rtspp/mpsc". S200: The MGC instructs the MG to play the specified media content through a Modify request message, where the parameter ps (Playback Scale) indicates that the playback speed is twice the normal speed. At the same time, instruct the MG to detect media playback speed ratio change events (rtspp/mpsc), where the value of the allowed ratio change parameter esc is "ON", indicating that the MG is allowed to automatically modify the media playback speed ratio; once the playback speed ratio needs to change, Then the MG independently decides the playback speed ratio to be changed. In this message flow, only the parameter information related to the change of the playback speed ratio is displayed. Other message parameters may also be required in the message, but they will not be expanded here in detail, the same below. the

S201: The MG sends a modification response message to the MGC. S202: The MG starts to play the media according to the instruction of the MGC, and at the same time starts to detect the specified event. the

S203: The MG detects that the original playback speed twice the normal speed cannot be executed, and the playback speed ratio needs to be changed. At this time, the MG reports the detected media playback speed ratio change event (rtspp) to the MGC through a Notify request message. /mpsc), which contains relevant parameter information, such as the value of the newly effective ratio parameter, which indicates the playback speed ratio after MG’s independent revision; and the position information where the change occurs, indicating the range where the new playback speed takes effect. For example, in this example, sc=1.0; range="npt=1:37:21.394-", it means that MG revises the ratio value to 1.0, uses normal playback speed for media playback, and the new effective range is from 1 hour 37 minutes 21.394 seconds to start. the

S204: The MGC sends a notification response message to the MG. the

The embodiment of the present invention also provides a media gateway, which includes a preset event storage unit, a detection unit and an event reporting unit. The preset event storage unit is used to store the media gateway to control its delivery or preset events, and the event is used to report the change of the media playing state to the media gateway; the event detection unit is used to detect and detect the media stream playing state; The event reporting unit is used to report the change of the media stream playing state to the media gateway according to the event stored by the preset event storage unit when the detection unit detects that the media stream playing state changes. the

In the above method, by defining related events in the H.248 protocol, the MGC instructs the MG to detect and report the change of the media stream playing state in the media resource session. On the other hand, in order to realize the indication and setting of the media playing state on the MG by the MGC, the following mechanisms can be defined in the H.248 protocol. the

By defining properties (Property) or signal parameters in the H.248 protocol, the MGC is used to set the property information of the media on the MG, thereby effectively controlling the playback status of the media stream. For example, while the MGC indicates to the MG the resource to play the signal, it also delivers relevant parameter indication information, including media attributes, selection of the starting position of playback, and so on. the

Take media attributes as an example, including random access, media retention policy, content modifiability, etc., corresponding to the random access parameters, retention policy parameters, and content modification parameters defined in the above media attribute change event. Corresponding to these information, a property parameter of Media Properties (abbreviated as mp) can be defined, which is used for the MGC to indicate the corresponding media property information. The type of attribute parameter can be defined as string type. In addition, the information contained in the parameter may also be split into the following parameters, which respectively represent the attribute information that the MG corresponds to and wants to change. Three H.248 attribute (Property) parameters can be defined separately. The type and meaning of attribute parameters correspond to the definitions in the above scheme. These attributes are readable and writable, that is, the MGC can set this attribute to the MG to indicate the value information of the parameter, and the MGC can also obtain the attribute from the MG to know the current value information. Likewise, the above information can be defined in the form of signal parameters. For example, the media attribute parameter is defined in the media playing signal so that the MGC can control the playing state while instructing the MG to play the media. The parameter types and meanings are the same as above. The application rules for readable and writable type parameters are as follows: MGC sends the above-mentioned relevant parameters in the request sent to MG, and the value of the parameter can be set by MGC, that is, the MG is required to set according to the instruction; in addition, the value of the parameter It can also be a "select" wildcard "$", indicating that the MGC wants to obtain the actual value of the corresponding parameter of the MG, and carry it to the MGC in the response sent by the MG to the MGC. the

For other parameters, such as media range (Media Range) control, the method is similar. the

In addition, the control of the playback state also includes the control of the starting position of the media playback. Due to different media encoding formats, the composition unit of a media file may include a long duration interval. In this way, when the MGC's playback request includes a random access parameter to the media content, different strategies may be used for the starting position of the media playback. Define a signal parameter, such as a parameter named Seek Behavior (abbreviated as sb). The type of this parameter can be set as an enumeration type, and the values include: random access point (Random Access Point, abbreviated as RA), indicating that the random access point closest to the specified starting position is selected to start playing; the first priority (First Priority) , abbreviated as FP), means to start playing from the media unit with the closest playback time and priority over the request time. For discrete media, it includes the media unit that is playing at the request time. For continuous media, it includes the request start time. The media being played; the next unit (Next Unit, abbreviated as NU), means to select the next media unit to start playing according to the start time of the specified range. For continuous frame media, it is the first frame starting from the specified time , and for discrete media it is the first unit after the specified time. This signal parameter can be defined in the media playing signal, and is used for the position selection strategy for the MGC to instruct the MG to start playing. In addition to being defined in the form of signal parameters, the above information can also be defined in the form of attributes or event parameters to achieve the same purpose. the

It should be noted that the embodiment of the present invention is applicable to a media resource server adopting a separated architecture, that is, the interaction between the media resource control device and the media processing device regarding signal setting and adjustment. At this time, the media resource control device is equivalent to the MGC, and the media processing device is equivalent to the MG. the

Referring to FIG. 3 , an embodiment of the present invention also provides a media processing device 30 . the

The media processing device 30 includes a preset event storage unit 301 , a detection unit 302 and an event reporting unit 303 . The preset event storage unit 301 is used to store the event sent by the media gateway controller or preset, and the event is used to report the change of the media playback state to the media gateway, and the parameters it carries are the same as those of the foregoing embodiments, where I won't repeat them here. The event detection unit 302 is configured to detect the media playing state according to the events stored in the preset event storage unit 301 . The event reporting unit 303 is configured to report the change of the media playing state to the media playing control device 31 according to the event stored in the preset event storage unit 301 when the detection unit 302 detects that the media playing state changes.

The media processing device 30 may also include an execution unit 304, configured to execute the media playback status according to the preset event when the preset event carries a parameter indicating the next action of the media processing device 30 after detecting a change in the playback status. to modify. the

The media processing device 30 may further include a first receiving unit (not shown in the figure), configured to receive indication information sent by the media playing control device 31 according to the change of the media playing state reported by the reporting unit. At this time, the executing unit 304 is also configured to modify the media playing state according to the indication information received by the first receiving unit. the

The media processing device 30 may also include a second receiving unit (not shown), configured to receive the media playback parameters set 30 from the media playback control device 31 to the media processing device, and the media playback parameters are used to control the media playback parameters on the media processing device 30. Playing state; the executing unit 304 is also configured to play related media according to the received media playing parameters. the

The media processing device may be an MG or a media resource processing device. the

Referring to FIG. 4 , the embodiment of the present invention also provides a media playback control device 31 . the

The media playing control device 31 includes a third receiving unit 311, configured to receive an event reported by the MG for notifying the change of the media playing state. the

The media playing control device 31 may also include a decision unit 312, configured to send a command to the media processing device 30 after receiving the event reported by the MG, instructing the media processing device 30 to modify the media playing state.

The media playing control device 31 may further include a sending unit 313, configured to send an event for detecting a change in a media playing state to the media processing device 30. the

The media playback control device 31 may be an MGC or a media resource control device. the

An embodiment of the present invention also provides a control system (not shown in the figure) for realizing media playback state detection, which includes a media processing device and a media playback control device. the

The media playback control device is used to send an event to the media processing device to detect the change of the media playback state, and receive the event reported by the media processing device for notifying the change of the media playback state, and after receiving the event reported by the MG, , to send a command to the MG, instructing the MG to modify the media playing state. the

The media processing device is used to detect the media playing state according to preset events; when detecting a change in the media playing state, report the change in the media playing state to the media playing control device according to the preset event, and report the change in the media playing state according to the preset event Or modify the media playback state by an instruction issued by the media playback control device. the

The structures of the media processing device and the media playback control device in this embodiment are the same as those of the aforementioned media processing device 31 and the media playback control device 31 respectively, and will not be repeated here. the

By extending the H.248 protocol, the embodiment of the present invention defines a set of solutions applicable to the MGC and MG separation framework to realize the control of the media playback state, including the parameter information of the MGC indicating to control the media playback on the MG, and the control of the media playback status on the MG. The detection and monitoring of various media attribute change events in the media playing state provides a simple and effective solution for the media gateway controller and media gateway to effectively control the playback of media resources. the

Through the description of the above embodiments, those skilled in the art can clearly understand that the present invention can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is a better implementation Way. Based on this understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product is stored in a readable storage medium, such as a floppy disk of a computer , a hard disk or an optical disk, etc., including several instructions for enabling a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments of the present invention. the

The above is only a preferred embodiment of the present invention, it should be pointed out that, for those of ordinary skill in the art, without departing from the principle of the present invention, some improvements and modifications can also be made, and these improvements and modifications can also be made. It should be regarded as the protection scope of the present invention.

Claims (16)

1. a control method that realizes the media resource plays state-detection is characterized in that, comprises the steps: that medium processing device is according to default event detection media play state;

When detecting the media play state variation, report the variation of media play state generation to controlling media play equipment according to described default event;

Wherein, described default event is issued to medium processing device by controlling media play equipment;

Wherein, described event is used for medium processing device and reports the variation of Media Stream broadcasting speed ratio to controlling media play equipment, carries a kind of or combination in any of following parameter when described event is default:

Playback action changes parameter, is used to indicate the broadcast behavior of medium processing device Media Stream after detecting the media relative velocity and changing, and this broadcast behavior comprises that changing into conventional speeds plays or stop to play;

Upgrade relative velocity ratio parameter, in order to the new broadcasting speed ratio of indication use after the media play speed proportional changes;

The permission ratio changes parameter, in order to indicate whether allowing medium processing device automatically to revise the media play speed proportional;

Ratio changes value parameter, in order to indicate when allowing automatically to revise the media play speed proportional modification value of permission;

Medium resource identification, the media resource entity that the event that is used to indicate is suitable for;

Request mark, the playing request that the event that is used to indicate is suitable for.

2. the method for claim 1 is characterized in that, the method also comprises the steps:

When the value of permission ratio change parameter allowed medium processing device automatically to revise the media play speed proportional, medium processing device was revised the media play speed proportional automatically;

The value that changes parameter when the permission ratio allows medium processing device automatically to revise the media play speed proportional, and the event that presets comprises when ratio changes value parameter that medium processing device is revised the media play speed proportional according to the value that ratio changes value parameter.

3. the method for claim 1, it is characterized in that, when the default event of described basis reports the variation of media play state generation to controlling media play equipment, also carry the broadcasting speed percent information of change, be used for when the value of permission ratio change parameter allows medium processing device automatically to revise the media play speed proportional, reporting amended media play speed proportional to controlling media play equipment.

4. method as claimed in claim 3, it is characterized in that, described broadcasting speed percent information also is used for when the value of permission ratio change parameter does not allow medium processing device automatically to revise the media play speed proportional, report medium processing device to wish the media play speed proportional value that changes, the method also comprises the steps: the indication that medium processing device receiving media playback control device issues, and adjusts media play speed proportional value according to the indication of controlling media play equipment.

5. such as each described method in the claim 1 to 4, it is characterized in that medium processing device reports the variation of Media Stream broadcasting speed ratio to carry a kind of or combination in any of following parameter to controlling media play equipment:

The time that the media play speed proportional changes occurs in order to indication in timestamp parameter;

Proportion parameter and/or range format parameter are in order to the starting position of indicating position that the media play speed proportional changes and new broadcasting speed ratio to come into force;

Media range parameter and/or media range format parameter are in order to indicate the current available broadcast range information of Media Stream;

The medium property parameter, in order to indication attribute information corresponding to Media Stream when media play speed proportional change events occurs, described medium property parameter comprises random accessibility, media retention strategy or content alterability;

Medium resource identification is used to indicate the associated media resource entity of reported event;

Request mark is used to indicate the corresponding playing request of reported event.

6. the method for claim 1 is characterized in that, the method also comprises the steps:

Controlling media play equipment arranges the media play parameter to medium processing device, and this media play parameter is used for the state of media play on the control medium processing device;

Medium processing device is play relevant media according to the indication of this media play parameter.

7. method as claimed in claim 6 is characterized in that, described controlling media play equipment comprises a kind of or combination in any of following information to the media play parameter of medium processing device setting:

The medium property parameter comprises random accessibility, media retention strategy or content alterability;

The addressing behavioral parameters, the addressing locate mode of indication media play original position;

The media range parameter, the indication media can be for the context information of playing.

8. method as claimed in claim 7 is characterized in that, described media play parameter is carried in the signal of media play.

9. a medium processing device comprises preset event memory cell, event detection unit and reporting events unit, it is characterized in that:

This preset event memory cell is used for the event that the medium playback control device issues, and this event is used for reporting to controlling media play equipment the variation of media play state generation;

This event detection unit is used for the event detection media play state according to the preset event cell stores; This reporting events unit is used for when the event detection unit inspection changes to the media play state, reports the variation of media play state generation to controlling media play equipment according to the event of preset event cell stores;

Wherein, the event of described preset event cell stores specifically is used for described medium processing device and reports the variation of Media Stream broadcasting speed ratio to described controlling media play equipment, and the event of described preset event cell stores is carried a kind of or combination in any of following parameter:

Playback action changes parameter, is used to indicate the broadcast behavior of medium processing device Media Stream after detecting the media relative velocity and changing, and this broadcast behavior comprises that changing into conventional speeds plays or stop to play;

Upgrade relative velocity ratio parameter, in order to the new broadcasting speed ratio of indication use after the media play speed proportional changes;

The permission ratio changes parameter, in order to indicate whether allowing medium processing device automatically to revise the media play speed proportional;

Ratio changes value parameter, in order to indicate when allowing automatically to revise the media play speed proportional modification value of permission;

Medium resource identification, the media resource entity that the event that is used to indicate is suitable for;

Request mark, the playing request that the event that is used to indicate is suitable for.

10. medium processing device as claimed in claim 9 is characterized in that, also comprises performance element,

This performance element is used for according to default event the media play state being made amendment.

11. medium processing device as claimed in claim 10, it is characterized in that, also comprise the first receiving element, this first receiving element, the indication information that the variation that the media play state that reports according to described reporting events unit for the receiving media playback control device occurs issues;

Described performance element also is used for according to the indication information that the first receiving element receives the media play state being made amendment.

12. such as right 11 described medium processing devices, it is characterized in that, also comprise the second receiving element,

This second receiving element is used for the media play parameter that the receiving media playback control device issues to medium processing device, and this media play parameter is used for the state of media play on the control medium processing device;

Described performance element also is used for playing relevant media according to the media play parameter that receives.

13. a controlling media play equipment is characterized in that, comprises the 3rd receiving element, is used for the event for the variation of circulating a notice of the generation of media play state that the receiving media treatment facility reports; The event that described media play state changes is the default event detection media play state of described medium processing device basis, and when detecting the media play state variation, report;

Wherein, described default event is issued to described medium processing device by described controlling media play equipment;

Wherein, described default event is used for medium processing device and reports the variation of Media Stream broadcasting speed ratio to controlling media play equipment, carries a kind of or combination in any of following parameter when described default event is default:

Playback action changes parameter, is used to indicate the broadcast behavior of medium processing device Media Stream after detecting the media relative velocity and changing, and this broadcast behavior comprises that changing into conventional speeds plays or stop to play;

Upgrade relative velocity ratio parameter, in order to the new broadcasting speed ratio of indication use after the media play speed proportional changes;

The permission ratio changes parameter, in order to indicate whether allowing medium processing device automatically to revise the media play speed proportional;

Ratio changes value parameter, in order to indicate when allowing automatically to revise the media play speed proportional modification value of permission;

Medium resource identification, the media resource entity that the event that is used to indicate is suitable for;

Request mark, the playing request that the event that is used to indicate is suitable for.

14. controlling media play equipment as claimed in claim 13, it is characterized in that, also comprise decision package, be used for after receiving the event that medium processing device reports, send order to medium processing device, the indication medium processing device is made amendment to the media play state.

15. controlling media play equipment as claimed in claim 13 is characterized in that, also comprises issuing the unit, is used for issuing to medium processing device the event of the variation that detects the generation of media play state.

16. a control system that realizes the media play state-detection, it comprises medium processing device and controlling media play equipment, it is characterized in that:

This medium processing device is used for according to default event detection media play state, when detecting the media play state variation, reports the variation of media play state generation to controlling media play equipment according to described default event;

This controlling media play equipment is used for receiving the event for the variation of circulating a notice of the generation of media play state that described medium processing device reports;

Wherein, described default event is issued to medium processing device by controlling media play equipment;

Wherein, described default event is used for medium processing device and reports the variation of Media Stream broadcasting speed ratio to controlling media play equipment, carries a kind of or combination in any of following parameter when described default event is default:

Playback action changes parameter, is used to indicate the broadcast behavior of medium processing device Media Stream after detecting the media relative velocity and changing, and this broadcast behavior comprises that changing into conventional speeds plays or stop to play;

Upgrade relative velocity ratio parameter, in order to the new broadcasting speed ratio of indication use after the media play speed proportional changes;

The permission ratio changes parameter, in order to indicate whether allowing medium processing device automatically to revise the media play speed proportional;

Ratio changes value parameter, in order to indicate when allowing automatically to revise the media play speed proportional modification value of permission;

Medium resource identification, the media resource entity that the event that is used to indicate is suitable for;

Request mark, the playing request that the event that is used to indicate is suitable for.

Images