[go: up one dir, main page]

WO2007068139A1 - Systeme et procede pour la commande de flux multimedias sur la communication video a plusieurs abonnes - Google Patents

Systeme et procede pour la commande de flux multimedias sur la communication video a plusieurs abonnes Download PDF

Info

Publication number
WO2007068139A1
WO2007068139A1 PCT/CN2005/002152 CN2005002152W WO2007068139A1 WO 2007068139 A1 WO2007068139 A1 WO 2007068139A1 CN 2005002152 W CN2005002152 W CN 2005002152W WO 2007068139 A1 WO2007068139 A1 WO 2007068139A1
Authority
WO
WIPO (PCT)
Prior art keywords
unit
real
communication terminal
communication
server
Prior art date
Application number
PCT/CN2005/002152
Other languages
English (en)
Chinese (zh)
Inventor
Zhengxun Xia
Jindong Wang
Jianzhang Ye
Chengjin Pan
Original Assignee
Zte Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zte Corporation filed Critical Zte Corporation
Priority to PCT/CN2005/002152 priority Critical patent/WO2007068139A1/fr
Priority to CN2005800516476A priority patent/CN101273631B/zh
Publication of WO2007068139A1 publication Critical patent/WO2007068139A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H04N7/152—Multipoint control units therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/23614—Multiplexing of additional data and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4348—Demultiplexing of additional data and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H04N21/6437—Real-time Transport Protocol [RTP]

Definitions

  • the present invention relates to the field of multimedia technologies, and relates to a multi-party video communication media stream control system and method, and more particularly to a static image and a real-time stream in real-time multi-party video communication.
  • TS stream Transport Stream
  • Streaming media refers to continuous time-based media, such as audio, video or multimedia files, that use streaming technology in the network.
  • Streaming media technology has been greatly used in video telephony and video conferencing systems.
  • each communication terminal communicates through a streaming media server.
  • a communication terminal usually has a plurality of communication links to receive audio and video data of other communication terminals. As a communication center, it is very burdensome.
  • an object of the present invention is to provide a multi-party video communication media stream control system and method.
  • the invention fully considers the characteristics of the multi-party video communication system, and proposes a System and method for hybrid transmission of static images and TS streams and a system and method for seamlessly switching and controlling media streams, which can provide sufficient information while reducing the load of servers and communication terminals, thereby simplifying the process of multi-party video communication .
  • the present invention mainly proposes a system and method for solving the following three problems:
  • the communication terminal receives the static image of the other communication terminal, and selects the main media source concerned by it;
  • a multi-party video communication media stream control system of the present invention includes a media stream transmission control path for transmitting audio and video data and a control signal; and a communication terminal responsible for transmitting and receiving the audio and video data and the control signal;
  • the server is responsible for providing the media stream service for the video communication terminal in response to the above control signal;
  • the communication terminal includes: Real Time Transport Control Protocol (RTCP) unit, Real Time Transport Protocol (hereinafter) RTP) output unit and RTP input unit, TS coding unit, intra-framed frame (I-frame, also called intra picture) (hereinafter referred to as I frame) coding unit, media buffer unit, TS decoding unit, I a frame decoding unit and a flow control unit;
  • the server includes: an I frame storage unit, a flow control unit, and a communication subunit, wherein the communication subunit includes: an RTCP transmission unit, an RTP output unit, and an RTP input unit, an I frame extraction unit, and an RTP Unpacking unit, media buffer Meta and media source
  • the RTP output unit of the communication terminal is responsible for transmitting the audio and video data of the communication terminal to the RTP input unit of the communication subunit corresponding to the communication terminal in the server; the RTP input unit of the communication terminal is responsible for receiving from the server Audio and video data of other communication terminals;
  • the TS coding unit of the communication terminal is responsible for TS stream coding of the communication terminal;
  • the I frame coding unit of the communication terminal is responsible for periodically encoding the static image of the communication terminal, and forming I frame data output to the RTP output unit of the communication terminal, and using a specific Payload type in the above RTP packet to mark the I frame data of the communication terminal;
  • the media buffer unit of the communication terminal is responsible for receiving data of the RTP input unit of the communication terminal;
  • the TS decoding unit of the communication terminal is responsible for extracting the TS stream from the media buffer unit and decoding it;
  • the I frame decoding unit of the communication terminal is configured to extract the RTP packet having the specific Payload type from the media buffer unit, and decode the I frame data to form a still image;
  • the flow control unit of the communication terminal is responsible for the flow with the server.
  • the control unit communicates, notifies the server of the main media source currently used by the communication terminal or the instruction of the TS coding unit that starts the communication terminal of the server;
  • the I frame storage unit of the server is responsible for storing I frame data of each communication terminal;
  • the flow control unit of the server is responsible for controlling the link of the audio and video streams of each communication terminal;
  • the communication subunit of the server is responsible for establishing a communication link with the communication terminal. Transmitting the audio and video data and the control signal, and outputting the video I frame data to the I frame storage unit of the server, and acquiring the media from the RTP unpacking unit of the I frame storage unit of the server and other communication subunits of the server
  • Source data is input to a media source unit of the communication subunit;
  • the RTP output unit of the communication subunit of the server is responsible for transmitting audio and video data of other communication terminals to the communication terminal corresponding to the communication subunit;
  • the RTP input unit of the communication subunit of the server is responsible for receiving audio and video data of the communication terminal;
  • the I frame extracting unit of the communication subunit of the server is responsible for extracting I frame data according to a specific Payload type of the RTP packet, and storing it in the I frame storage unit of the server; if the I frame extracting unit is not found For the above type of RTP packet, the I frame data is directly extracted from the data in the RTP unpacking unit of the communication subunit of the server; for example: if the current video adopts the MPEG4 encoding format, the vop-coding-type or group_of may be adopted.
  • the -vop_start_code field finds the I frame data;
  • the RTP unpacking unit of the communication subunit of the server is responsible for removing the RTP header of the received audio and video data after filtering out the data packet required by the I frame extracting unit of the communication subunit of the server, and outputting the RTP header. Go to the media buffer unit of the communication subunit;
  • the media buffer unit of the communication subunit of the server is responsible for receiving data output by the RTP unpacking unit of the communication subunit of the server;
  • the media source unit of the communication subunit of the server is responsible for acquiring audio and video data required by the communication terminal corresponding to the communication subunit from the I frame storage unit of the server and the media buffer unit of the communication subunit corresponding to the other communication terminal.
  • the RTP output unit of the communication terminal is respectively connected to the TS coding unit and the I frame coding unit of the communication terminal;
  • the RTP input unit of the communication terminal is connected to the media buffer unit of the communication terminal; the media buffer unit of the communication terminal is respectively connected to the TS decoding unit and the I frame decoding unit of the communication terminal;
  • the I frame extracting unit of the communication subunit of the server is respectively connected to the I frame storage unit of the server, the RTP input unit of the communication subunit of the server, and the RTP unpacking unit; the RTP unpacking unit of the communication subunit of the server respectively Connecting to the RTP input unit, the I frame extracting unit, and the media buffer unit of the communication subunit of the server;
  • the media source units of the communication subunits of the server are respectively connected to the RTP output unit of the communication subunit of the server, the I frame storage unit of the server, and the flow control unit.
  • the communication terminal marks the I frame data of the communication terminal by defining a specific load type (hereinafter referred to as a Payload type) in the RTP packet, and the RTP packet of the type includes only the I frame data of the audio and video data of the communication terminal; Because it is a communication system, the communication terminal and the server are two-way audio and video stream communication; when the multi-party video communication is established, the server includes a plurality of the communication subunits, and each of the communication subunits and each of the communication terminals Corresponding; After the multi-party video communication is established, the above communication terminal and the server can transmit audio and video data through at least the RTP/RTCP transmission channel.
  • a specific load type hereinafter referred to as a Payload type
  • a multi-party video communication media stream control method of the present invention includes the following steps: Step 101: The RTP output ⁇ input unit of the communication terminal establishes a pair of data communication links with the RTP input/output unit of the communication subunit corresponding to the communication terminal in the server, wherein the static image and the TS stream pass through the pair. Data communication link transmission;
  • Step 102 The I frame encoding unit of the communication terminal periodically encodes the static image into I frame data, and transmits the static image to the RTP output unit of the communication terminal.
  • Step 103 If the RTP output unit of the communication terminal receives the I frame data in the I frame coding unit, package it into an RTP packet with a specific Payload type, and send it immediately; if the RTP output unit of the communication terminal receives The data of the TS coding unit of the communication terminal is encapsulated into an RTP packet, and then sent according to a time stamp (hereinafter referred to as TimeStamp); wherein the RTP packet of the specific Payload type is different from the RTP packet of the TS stream; 104: If the RTP input unit of the communication subunit corresponding to each communication terminal in the server receives the RTP packet of the specific Payload type, extract the I frame data and store it in the I frame storage in the server. In the unit; if the TS stream data is received, the packet header is removed by the RTP unpacking unit of the communication subunit, and then stored in the media buffer unit of the communication subunit;
  • TimeStamp time stamp
  • Step 105 The media source unit timing of the communication subunit corresponding to each communication terminal in the server acquires I frame data of another communication terminal from the I frame storage unit, and the main media source determined by each communication terminal Obtaining the TS stream data in a media buffer unit of the corresponding communication subunit;
  • Step 106 If the RTP output unit of the communication subunit corresponding to each communication terminal in the server receives the RTP packet of the specific Payload type, send it immediately; if the RTP packet of the TS stream is received, press The above TimeStamp is sent;
  • Step 107 If the RTP input module of the communication terminal receives the RTP packet of the specific Payload type, transmit it to the I frame decoding unit of the communication terminal to form a still image of another communication terminal; if the TS is received The streamed RTP packet is transmitted to the TS decoding unit of the communication terminal to form a TS stream of the primary media source.
  • the data communication link in the above step 101 can be, for example, an RTP/RTCP transmission. Road.
  • the method for selecting a primary media source for a still image received through a communication terminal includes the following steps:
  • Step 201 When initially starting multi-party video communication, the communication terminal only performs I frame coding, and the I frame data is periodically sent to the server through an RTP packet of a specific Payload type;
  • Step 202 The server receives the I frame data of each communication terminal, and stores the data in the I frame storage unit of the server.
  • Step 203 The communication subunit corresponding to each communication terminal in the server acquires I frame data of another communication terminal from the I frame storage unit, and sends the I frame data to the communication terminal.
  • Step 205 The server checks whether the primary media source selected by the communication terminal is transmitting a TS stream, and if not, notifies the flow control unit of the primary media source to start the TS coding unit;
  • the primary media source is another communication terminal different from the communication terminal.
  • the method for switching a communication terminal from a current primary media source to another primary media source includes the following steps: Step 301: Flow control of the communication terminal 4
  • the unit notifies the server's flow control unit to switch its current primary media source from 4, A 2 , ..., 4 to 4;
  • Step 302 The server checks whether the primary media source is transmitting the TS stream, and if not, notifies the flow control unit of the primary media source to activate the TS encoding unit of the primary media source.
  • Step 303 The flow control unit of the server sends a control signal to the communication terminal.
  • the media source unit of the corresponding communication subunit obtains the TS stream data from the media buffer unit of the communication subunit corresponding to the above main media source y .
  • the current primary media sources 4, ..., 4 and the primary media source are communication terminals different from the communication terminal; the subscripts x, y, and n are different from each other.
  • the invention Compared with the existing video communication system, the invention has the following advantages:
  • the communication terminal When the multi-party video communication is established in the initial stage, the communication terminal only periodically transmits the video I frame data, thereby shortening the time for establishing the multi-party video communication;
  • the communication terminal can receive the TS stream data of the main media source of the communication terminal concerned by the current communication terminal while displaying the static image of the other communication terminal that is updated regularly, and can save the bandwidth while ensuring the maximum amount of information acquired;
  • FIG. 1 is a system configuration diagram of the present invention
  • FIG. 2 is a schematic diagram of an application environment according to a preferred embodiment of the present invention
  • FIG. 3 is a schematic diagram of system processing during three-party communication in the system of the present invention
  • FIG. 4 is a schematic flowchart of a process when a communication terminal periodically displays a still image of another communication terminal according to the present invention
  • FIG. 5 is a flowchart of processing when the communication terminal A of the present invention confirms the communication terminal B as its main media source;
  • FIG. 6 is a flowchart of processing when the communication terminal A of the present invention switches its main media source from the communication terminal B to the communication terminal C.
  • FIG. 1 is a block diagram of the system of the present invention.
  • the system of the present invention includes a media stream transmission control path, a communication terminal, and a server, wherein the communication terminal includes: an RTCP unit, an RTP output unit, and an RTP input unit, a TS coding unit, an I frame coding unit, and a media.
  • the server includes: an I frame storage unit, a flow control unit and a communication subunit, wherein the communication subunit comprises: an RTCP transmission unit, an RTP output unit, and an RTP input Unit, I frame extraction unit, RTP unpacking unit, media buffer unit and media source unit.
  • FIG. 2 is a schematic diagram of an application environment according to a preferred embodiment of the present invention.
  • communication terminals A, B, and C are connected to the video communication system server through the mobile network, the Internet (Internet), and the intranet (intranet) respectively.
  • Internet the Internet
  • intranet intranet
  • the server creates three communication sub-units respectively corresponding to the three communication terminals A, B, and C; each of the communication terminals establishes an RTCP control link and an RTP input/output link for each of the communication sub-units to transmit Audio and video data, and a flow control link is established to transmit primary media source control information.
  • the communication terminal A receives the audio and video data sent from the server, extracts the I frame data therein to form a static image of the timing update of the other communication terminal, and determines that the main media source is the communication terminal B according to the display screen, so the above
  • the communication terminal B needs to simultaneously output TS stream data and timed still image data, and the communication terminal A receives the TS stream data of the communication terminal B while receiving the static image data of the timing of the communication terminals B and C.
  • the server can smoothly switch the TS stream from the communication terminal B to the communication terminal C without the communication terminal A performing the switching operation.
  • the operation is seamless switching.
  • the present invention must have the following functions after being successfully implemented:
  • the I frame data sent by the communication terminals B and C, the communication terminal A can receive and display; 2. After the communication terminal A determines that the communication terminal B is its main media source according to the display image, the communication terminal B starts to transmit its TS stream, and the communication terminal A can receive the static image sent by the communication terminal C at the same time.
  • the server can switch the TS stream from the communication terminal B to the communication terminal C without the above-mentioned communication terminal A being aware of it.
  • each communication terminal participating in the communication only periodically transmits the I frame data, and each communication terminal can display the static image of the timing update of the other communication terminals.
  • the general process of this process is shown in Figure 4. Please refer to Figure 2, Figure 3 and Figure 4 for the specific implementation steps as follows - Step 1:
  • the server creates a corresponding communication sub-unit for each communication terminal.
  • the communication terminal and the communication subunit establish an RTP/RTCP transmission channel;
  • Step 2 The I frame encoding unit of the communication terminal VIII, B, and C periodically (for example, every 10 seconds) acquires the current still image of the communication terminal, encodes it into I frame data, and transmits it to the above communication terminals.
  • Step 3 When receiving the data of the I frame coding unit, the RTP output unit of the communication terminals A, B, and C encapsulates an RTP header for the data, where the SSRC field of the RTP header and the RTP header of the TS stream data of the communication terminal SSRC, which marks the source of the data; meanwhile, the Payload field of the RTP header is defined as a specific 7-bit data to mark the static image data packet from the TS stream;
  • Step 4 After the RTP output unit of the communication terminal adds the RTP header to the static image data, immediately sends the RTP header to the communication subunit A corresponding to each communication terminal, B, C in the server through the RTP transmission channel. , B, C RTP input unit;
  • Step 5 The I frame extracting unit of the communication subunits A, B, and C corresponding to each of the communication terminals A, B, and C in the server periodically periodically receives the Payload of the RTP header from the RTP input unit of the communication subunit. Field extracting still image data and transmitting it to the I frame storage unit of the above server; Step 6: The I frame storage unit of the server distinguishes static image data from different communication terminals according to different SSRC fields in the RTP header of each data packet;
  • Step 7 The media source units of the communication subunits A, B, and C corresponding to the communication terminals A, B, and C in the server periodically acquire static image data of other communication terminals from the I frame storage unit. And immediately transmit it to the RTP output unit of its communication subunit, the RTP output unit immediately transmits such data to the RTP input unit of the communication terminal corresponding to its communication subunit;
  • Step 8 The media buffer unit of the communication terminals A, B, and C receives data from the RTP input unit of the communication terminal, extracts still image data according to the Payload field of the RTP packet, and distinguishes other data according to the SSRC field of the RTP packet. Data of different communication terminals to form complete I frame data of different communication terminals;
  • Step 9 The I frame decoding unit of the communication terminals A, B, and C decodes the I frame data, and distinguishes different sources of the decoded image according to the SSRC field, so that the communication terminals VIII, B, and C can See the static image of the timing update of other communication terminals.
  • the terminal A For the communication terminal A, it is now possible to see the static images of the communication terminals B and C that are regularly updated, and to select the main media source B of interest according to the static images of the B and C of the communication terminal, so that the communication is performed.
  • the terminal A can receive the TS stream of the communication terminal B while receiving the static image updated by the timing of the communication terminals B and C.
  • FIG. 5 Please refer to FIG. 2, FIG. 3 and FIG. 5.
  • the specific implementation steps of this process are as follows:
  • Step 1 The communication terminal A selects the communication terminal B as its current main media source, and the flow control unit of the communication terminal A sends a control signal to the flow control unit of the server to request the current primary media source of the communication terminal A to be the communication terminal B;
  • Step 2 After receiving the request that the primary media source is the communication terminal B, the flow control unit of the server first checks whether the TS stream access count of the current communication terminal B is 0, and if the communication terminal B The TS stream access count is 0, indicating that the communication terminal B starts to establish multi-party video communication, and the flow control unit of the server sends a TS stream start request to the flow control unit of the communication terminal B; otherwise, step 6 is performed; Step 3: After receiving the TS stream start request sent by the server, the flow control unit of the communication terminal B notifies the TS coding unit of the communication terminal to start working, and the TS coding unit is working on the current communication terminal.
  • the audio and video data of B is encoded, and the encoded data is transmitted to the RTP output unit of the communication terminal B, and the RTP output unit adds the RTP header to the encoded data, and transmits it according to TimeStamp;
  • Step 4 After receiving the TS stream data sent by the communication terminal B, the RTP input unit of the communication subunit B in the server transmits the TS stream data to the RTP unpacking unit of the communication subunit, where the Payload field according to the RTP packet is used.
  • the difference is static image data or TS stream data;
  • Step 5 The RTP unpacking unit of the communication subunit B in the server removes the RTP header of the TS stream data and stores the data in the media buffer unit of the communication subunit.
  • Step 6 The flow control unit notification of the server The media source unit of the communication subunit A takes data from the media buffer unit of the communication subunit B, and the TS stream access count of the communication terminal B is incremented by one; • the I frame data of the TS stream is started when the data is started. Start fetching, if it is MPEG4 compression encoding, you can find the I frame by vop-coding_type or group-of-vop-start_code field;
  • Step 7 The media source unit of the communication subunit A of the server obtains the TS stream data from the media buffer unit of the communication subunit B, and transmits the TS stream data to the RTP output unit of the communication subunit;
  • Step 8 The RTP output unit of the communication subunit A of the server adds an RTP header to the TS stream data according to the RTP session attribute currently established with the communication terminal A, that is, the SSRC field of the RTP header is the communication terminal A and the communication.
  • Subunit A establishes the SSRC of the RTP session, wherein the TimeStamp and the serial number (hereinafter referred to as SqucneceNumber) are independent of the source of the data source; the RTP output unit of the communication subunit transmits the TS stream data according to the TimeStamp;
  • Step 9 The RTP input unit of the communication terminal A receives the TS stream data and transmits it to the TS decoding unit of the communication terminal, and the TS decoding unit decodes the real-time audio and video stream data of the communication terminal B, and Display images and play sounds.
  • the communication terminal A can receive and play the real-time audio and video data of the communication terminal B while receiving the static image updated by the timing of the communication terminals B and C.
  • the communication terminal A wants to switch the current main media source from the communication terminal B to the communication terminal C, the communication terminal C only needs to be selected according to the static image, and the server uses the main media source of the communication terminal A from the communication terminal.
  • Step 1 The flow control unit of the communication terminal A sends a flow switching instruction to the flow control unit of the server, requesting that its main media source be switched from the communication terminal B to the communication terminal C;
  • Step 2 After receiving the flow switching instruction of the communication terminal A, the flow control unit of the server first checks the current TS flow access count of the communication terminal C, and if the TS flow access count of the communication terminal C is > 0, the communication is indicated. If the terminal C has started to transmit its TS stream, step 3 is performed. If the TS stream access count of the communication terminal C is 0, indicating that the communication terminal C does not transmit the TS stream, the flow control unit of the server provides the communication terminal C. The flow control unit sends a TS stream start request, as described above, the communication terminal C starts to send its TS stream, and the media buffer unit of the communication subunit C stores the real-time audio and video data of the communication terminal C;
  • Step 3 The flow control unit of the server reduces the TS flow access count of the communication terminal B by one, and checks whether the current TS terminal access count of the communication terminal B is 0. If the count is 0, it indicates that no communication terminal needs the communication terminal.
  • the flow control unit of the server In the TS stream of B, the flow control unit of the server notifies the flow control unit of the communication terminal B to stop its current TS stream coding operation, and the flow control unit of the communication terminal B sends a stop real-time coding to the TS coding unit of the communication terminal.
  • step 4 the flow control unit of the server notifies that the media source unit of the communication subunit A is taken from the media buffer unit of the communication subunit C
  • the TS stream access count of the communication terminal C is incremented by 1; the data is started from the I frame data of the TS stream, and if it is MPEG4 compression code, it can be vopt-coding-type or group-of-vop.
  • start— code The PT/CN2005/002152 field finds the I frame;
  • Step 5 The media source unit of the communication subunit A of the server obtains the TS stream data from the media buffer unit of the communication subunit C and transmits the TS stream data to the RTP output unit of the communication subunit;
  • Step 6 The RTP output unit of the communication subunit A of the server adds an RTP header to the TS stream data according to the RTP session attribute currently established with the communication terminal A, that is, the SSRC field of the RTP header is the communication terminal A.
  • the SSRC, the TimeStam and the SequenceNumber of the communication subunit A are independent of the source of the data source, and the RTP output unit of the communication subunit transmits the TS stream data according to the TimeStamp;
  • the RTP input unit of the communication terminal A receives After the TS stream data is transmitted to the TS decoding unit of the communication terminal, the TS decoding unit decodes the real-time audio and video stream data of the communication terminal C, and displays an image and a playback sound.
  • the media stream switching method according to the present invention is characterized by:
  • the switching can be completed by selecting different data sources, without changing the TimeStamp, SequenceNumber, and SSRC in the RTP session;
  • Switching to one or more streams to the same media source is the same for media sources.
  • the present invention may also have other various embodiments, such as transmitting static image data by using a Transmission Control Protocol (hereinafter referred to as TCP protocol), or using static image data and TS stream data differently.
  • TCP protocol Transmission Control Protocol
  • static image data and TS stream data may also have other various embodiments, such as transmitting static image data by using a Transmission Control Protocol (hereinafter referred to as TCP protocol), or using static image data and TS stream data differently. Transmission channel transmission.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

La présente invention concerne un système et un procédé pour la commande de flux multimédias sur la communication vidéo à plusieurs abonnés. Le système comporte un trajet de commande de transmission pour flux multimédias, un terminal de communication et un serveur. Le terminal de communication comprend une unité de protocole de contrôle en temps réel (RTCP), une unité de sortie de protocole de temps réel de transmission (RTP), une unité d'entrée de protocole de temps réel de transmission (RTP), une unité de codage TS, et une unité de codage d'images I, une unité de mémoire tampon de multimédias et une unité de commande de flux. Le serveur comporte une unité de mémoire d'images I, une unité de commande de flux et une sous-unité de communication. La sous-unité de communication comporte une unité de transmission RTCP, une unité de sortie RTP et une unité d'entrée RTP, une unité d'extraction d'images I, une unité de dépaquétisation RTP, une unité de mémoire tampon de multimédias et une unité de source multimédias. L'invention concerne également un procédé pour la transmission d'image statique mélangée avec le flux TS et un procédé pour la commutation sans coupure et la commande du flux multimédias, qui réduisent la charge du serveur et du terminal de communication et fournissent une information suffisante afin de réduire le traitement de la communication vidéo à plusieurs abonnés.
PCT/CN2005/002152 2005-12-12 2005-12-12 Systeme et procede pour la commande de flux multimedias sur la communication video a plusieurs abonnes WO2007068139A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2005/002152 WO2007068139A1 (fr) 2005-12-12 2005-12-12 Systeme et procede pour la commande de flux multimedias sur la communication video a plusieurs abonnes
CN2005800516476A CN101273631B (zh) 2005-12-12 2005-12-12 一种多方视频通讯媒体流控制系统和方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2005/002152 WO2007068139A1 (fr) 2005-12-12 2005-12-12 Systeme et procede pour la commande de flux multimedias sur la communication video a plusieurs abonnes

Publications (1)

Publication Number Publication Date
WO2007068139A1 true WO2007068139A1 (fr) 2007-06-21

Family

ID=38162531

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2005/002152 WO2007068139A1 (fr) 2005-12-12 2005-12-12 Systeme et procede pour la commande de flux multimedias sur la communication video a plusieurs abonnes

Country Status (2)

Country Link
CN (1) CN101273631B (fr)
WO (1) WO2007068139A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009015611A1 (fr) * 2007-08-01 2009-02-05 Huawei Technologies Co., Ltd. Procédé, système et appareil pour une commutation rapide de source multimédia
CN101562911B (zh) * 2008-04-16 2011-06-15 北京信威通信技术股份有限公司 一种支持端到端应用的无线接入系统空中接口rtp代理方法

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101867764A (zh) * 2010-04-21 2010-10-20 崔崧 移动多方视频通话系统
CN106341642A (zh) * 2016-08-29 2017-01-18 安徽云图信息技术有限公司 大数据多维的可视化系统

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002045398A1 (fr) * 1999-06-14 2002-06-06 Ginganet Corporation Systeme de teleconference
CN1510919A (zh) * 2002-12-23 2004-07-07 ����ͨѶ�ɷ����޹�˾ 会议电视多点控制设备中数据处理的方法及装置
CN1581967A (zh) * 2003-08-11 2005-02-16 英业达股份有限公司 视频会议中切换通信联机的系统及其方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002045398A1 (fr) * 1999-06-14 2002-06-06 Ginganet Corporation Systeme de teleconference
CN1510919A (zh) * 2002-12-23 2004-07-07 ����ͨѶ�ɷ����޹�˾ 会议电视多点控制设备中数据处理的方法及装置
CN1581967A (zh) * 2003-08-11 2005-02-16 英业达股份有限公司 视频会议中切换通信联机的系统及其方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009015611A1 (fr) * 2007-08-01 2009-02-05 Huawei Technologies Co., Ltd. Procédé, système et appareil pour une commutation rapide de source multimédia
CN101562911B (zh) * 2008-04-16 2011-06-15 北京信威通信技术股份有限公司 一种支持端到端应用的无线接入系统空中接口rtp代理方法

Also Published As

Publication number Publication date
CN101273631B (zh) 2010-04-21
CN101273631A (zh) 2008-09-24

Similar Documents

Publication Publication Date Title
US10045052B2 (en) System and method for transferring data
KR100906687B1 (ko) 다지점회의시스템 및 다지점회의장치
CN101156374B (zh) 一种监听视频呼叫的系统和方法
CN104883344B (zh) 协商媒体能力的方法和设备
CN108366044B (zh) 一种VoIP远程音视频共享方法
US8750317B2 (en) Multimedia data monitoring system and multimedia data monitoring method
TW202423095A (zh) 回應於網路中斷的視訊內容的自動產生
JPWO2008117892A1 (ja) コンテンツ配信システム、変換装置及びそれらに用いるコンテンツ配信方法
WO2010124499A1 (fr) Procédé et terminal d'enregistrement synchrone de sons et d'images à des extrémités opposées en visiophonie par circuits
JP2013042492A (ja) 常駐表示式ビデオ会議においてビデオストリームを切替える方法およびシステム
WO2007068139A1 (fr) Systeme et procede pour la commande de flux multimedias sur la communication video a plusieurs abonnes
JP2008311855A (ja) 通信端末装置
JP2002152301A (ja) データ通信システム、データ受信装置、データ通信方法、並びにプログラム記憶媒体
WO2009145293A1 (fr) Dispositif serveur. procédé de communication et programme
CN102957893B (zh) 用于在连续呈现会议中的视频流之间切换的方法和系统
JP3969155B2 (ja) マルチメディア通信転送方法、マルチメディア通信端末、交換機、管理装置
JP2009044287A (ja) 映像配信装置，配信映像切替え方法，配信映像切替えプログラムおよび配信映像切替えプログラム記録媒体
JP4818309B2 (ja) テレビ電話端末
JPWO2009145294A1 (ja) サーバ装置と通信方法ならびにプログラム
CN116471373A (zh) 基于e1与ip网络视频会议终端的密友共享系统及方法
KR20050068095A (ko) 영상 프레임 저장 및 재생을 위한 통화로 재설정 장치 및그 방법
JP2008182336A (ja) 受信端末
JP2006180371A (ja) ゲートウェイ装置、通信端末及び呼制御方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 200580051647.6

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 05820622

Country of ref document: EP

Kind code of ref document: A1