CN103856787B - Commentary video passing-back live system based on public network and live method of commentary video passing-back live system based on public network - Google Patents
Commentary video passing-back live system based on public network and live method of commentary video passing-back live system based on public network Download PDFInfo
- Publication number
- CN103856787B CN103856787B CN201210511265.9A CN201210511265A CN103856787B CN 103856787 B CN103856787 B CN 103856787B CN 201210511265 A CN201210511265 A CN 201210511265A CN 103856787 B CN103856787 B CN 103856787B
- Authority
- CN
- China
- Prior art keywords
- video
- audio
- server end
- rate
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 30
- 230000005540 biological transmission Effects 0.000 claims abstract description 14
- 238000004891 communication Methods 0.000 claims abstract description 4
- 230000015572 biosynthetic process Effects 0.000 claims description 2
- 238000003786 synthesis reaction Methods 0.000 claims description 2
- 230000000694 effects Effects 0.000 abstract description 4
- 230000001360 synchronised effect Effects 0.000 abstract description 4
- 238000005516 engineering process Methods 0.000 description 5
- 238000003672 processing method Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 230000001934 delay Effects 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000012856 packing Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a commentary video passing-back live system based on the public network. The commentary video passing-back live system is of a C/S structure and comprises a server terminal and a client terminal, and the server terminal is connected with the client terminal through the public network. The server terminal is composed of a video encoder, a receiving-transmitting server and an audio/video synthesizer, the video encoder is respectively connected with the receiving-transmitting server and the audio/video synthesizer to convert original high-code-rate video SDI signals into low-code-rate IP data flow suitable for network transmission to enable the low-code-rate IP data flow to be output, the receiving-transmitting server is connected with the video encoder and the audio/video synthesizer to serve as a communication interface of the server terminal and the client terminal, and the audio/video synthesizer synthesizes original high-code-rate video data and commentary passing-back audio data and then carries out output. The client terminal is provided with an audio input device and a screen. According to the commentary video passing-back live system, a commentator can carry out commentary in the place with the network, the proper video code rate is automatically selected according to the network condition, and the optimal watching effect is achieved; live delay is controlled within the minimum range, it is guaranteed that finally-output audios and finally-output videos are synchronous, and the broadcast quality standard is met.
Description
Technical field
The present invention relates to a kind of live broadcast system is and in particular to a kind of band based on public network explains the live broadcast system of audio return
And its live broadcasting method.
Background technology
With wired and wireless broadband network technology high speed development, people quickly and efficiently can be obtained by the Internet
The information of video/audio, then Streaming Media arise at the historic moment, meet the need on the internet to high-quality multimedia messages for the user
Ask.Broadcast application compared to traditional media, Streaming Media has more flexible, more diversified application model, can meet different
Consumer's Experience.Just because of the great potential that stream media technology possesses, it is online, directly that it will be widely used in multimedia news
Broadcast, video request program, the network information service such as long-distance education.
, its its form main is divided into on-the-spot broadcasting and studio talk-show live taking traditional sports event live broadcast as a example,
This is necessary for requiring to explain being explained when watching match in specified place.This situation is wanted to explanation side or broadcast side
Ask all harsher, the first explanation must be on the scene；Second is live relatively costly.If can accomplish now where to be in no matter explaining
Can watch and compete and explained, then this will be one kind innovation to traditional live game coverage, may be pregnant with new afterwards
Live-mode, such as ordinary people is in and can be achieved with the explanation dream of oneself.
Require to realize above-mentioned functions, now, the transmission of signal can only be by network flow-medium.Though nowadays on the market
Internet video client software not within minority, but because such software all only support one-side data transfer be service end to
Client sends media data it is impossible to meet above-mentioned demand, and high cost, efficiency are low, time-consuming.
In view of the above problems, the invention discloses a kind of band based on public network explains the live broadcast system of audio return and its straight
Broadcasting method.It has technical characteristic as mentioned below, to solve existing problem.
Content of the invention
It is an object of the invention to provide a kind of band based on public network explains live broadcast system and its live broadcasting method of audio return,
It can receive raw video signal by client from network, and gathers the audio return of explanation to server end, by video and audio
Export after synthesis, ensure to reach the live standard of broadcast level simultaneously.
It is by following that the band based on public network for the present invention explains the live broadcast system of audio return and its purpose of live broadcasting method
Technical scheme is realized：A kind of band based on public network explains the live broadcast system of audio return, the described band explanation based on public network
The live broadcast system of audio return is C/S structure, including：It is provided with server end and client two parts of TCP listening port；It is special
Levy and be, described server end is connected by public network with described client.
Described server end is made up of video encoder, transmitting/receiving server and audio frequency and video synthesizer；Described video is compiled
Code device is connected with described transmitting/receiving server and audio frequency and video synthesizer respectively, and the original high bit-rate video sdi signal of input is turned
Change the low bit- rate IP traffic output being applied to network transmission into；Described transmitting/receiving server is used for connecting described Video coding
Device and audio frequency and video synthesizer, and the communication interface as described server end and client；Described audio frequency and video synthesizer will
Original high bit-rate video data is exported after being synthesized with the voice data explaining passback.
Described client is PC, and is provided with audio input device and screen in described client.
The above-mentioned band based on public network explains the live broadcast system of audio return, wherein, sets in described audio frequency and video synthesizer
There is a video cache region, the size in described video cache region keeps constant, for judging video data and voice data
Timestamp, and cache high bit-rate video.
The above-mentioned band based on public network explains the live broadcasting method of the live broadcast system of audio return, and wherein, the method is at least wrapped
Include following steps：
Step 1, described server end opens TCP listening port, and circular wait is derived from the connection of described client, institute
The client stated is passed through ICP/IP protocol and is sent connection request to described server end.
Server end has three kinds of situations：1st, no respond；2nd, connect number full；3rd, successful connection；Described server end
Connectionless, then continue waiting for；The described server end judgement maximum number of connections that now server end reaches, if be more than Dalian
Connect several, refuse this connection, if being less than maximum number of connections, successful connection.
Step 2, after described server end and client successful connection, described client obtains the bandwidth of local network
And the network delay existing and server end between, the data of network delay regards by being sent to transmitting/receiving server and passing to sound
Frequency synthesizer.
Step 3, after user selected channel, the channel that user selects is sent instructions to described service by described client
Device end, now described server end cannot actively send data to described client, and server end is according to the finger of client
Order opens corresponding video encoder to select suitably to export video code rate.
Step 4, described client realizes existing NAT crossing technology, after client transmission UDP burrows information, with
Described server end is set up UDP interface channel and is set up, and described server end sends low bit- rate IP number to described client
According to stream.
Step 5, described client exports screen by after the decoding of low bit- rate IP traffic.
Step 6, when announcer prepares to start to explain, opens described audio input device, just can pass through audio input
Equipment collection explains sound, and the voice data collecting is encoded to be packaged into TS audio pack.
Step 7, stamps timestamp information PTS on the TS voice data that described client is described.
The value of the timestamp information PTS of the TS voice data described in first can according to user seen at that time a certain
Depending on the value of timestamp information PTS ' of frame video pictures, i.e. the PTS of the first frame TS audio pack0=PTS ', TS audio frequency number afterwards
According to timestamp information PTSnKeep continuous to increase.The value of PTS ' should keep strict one with original high bit-rate video timestamp information
Cause.
Step 8, complete TS audio pack is passed back to described server end by UDP interface channel.
In described step 4, the transmission of low bit- rate IP traffic and the transmission of TS audio pack in step 8 are in two new thread
Upper synchronous transfer.
Step 9, the high bit-rate video receiving is synthesized by described audio frequency and video synthesizer with TS voice data, circulates successively,
Treat that described client disconnects after live end.
Under normal circumstances, in the case of that is, no-delay, complete TS audio pack is averagely interweaved and arrives by audio frequency and video synthesizer
In high bit-rate video.
In the case of time delay, the discreet value of described server end computation delay, if described server end with described
Client two at program constant time lag be t, described server end is T with the network delay of described client, then in advance
Valuation is T+t, and this discreet value is also the minimum time delay of live broadcast system simultaneously, is also time delay minimum in existing similar technique.
Corresponding time span t of high bit-rate video of described video cache region caching ' it is described live broadcast system
Time delay T+t.
In the case of losing synchronization, after the high bit-rate video receiving exceedes the size in video cache region, high code check
Video data does not also receive then it is assumed that not having TS voice data during corresponding TS voice data, then in the high code of output
Insert quiet bag in the corresponding frame of rate video data and normally broadcast ensureing video signal；Need while receiving audio pack afterwards
Timestamp information to be passed through judges that the high bit-rate video whether this TS voice data has lagged behind at that time broadcasts progress, if falling behind one
Rule abandons this data, until the timestamp of TS voice data catches up with the timestamp of now high bit-rate video, as no-delay situation
Middle TS voice data is interweaved with original high bit-rate video and exports.
The band based on public network for the present invention explains the live broadcast system of audio return and its live broadcasting method due to employing above-mentioned side
Case, is allowed to compared with prior art, have the following advantages that and good effect：
1st, the band based on public network for the present invention explains the live broadcast system of audio return and can make where no matter announcer be in, as long as
Conveniently can be explained on the ground having network, and suitable video codes can be automatically selected according to the on-site network condition of announcer
Rate, reaches and best watches effect.
2nd, employ time delay situation in the live broadcasting method of live broadcast system that the band based on public network for the present invention explains audio return
Under processing method, live delays time to control can be made in minimum scope, be that in existing similar technique, time delay is minimum；Using
Processing method in the case of lock-out, it is ensured that the synchronization of final output signal audio frequency and video and stable, has reached broadcast level
Standard.
Hereinafter, will be described further by specific embodiment, but embodiment will be only the optional embodiment party of the present invention
The citing of formula, the feature disclosed in it is merely to illustrate and illustrates technical scheme, is not intended to limit the present invention
Protection domain.
Brief description
In order to be better understood from the present invention, can refer to the accompanying drawing for reference that this specification is quoted, in accompanying drawing：
Fig. 1 is the structural representation of the live broadcast system that the band based on public network for the present invention explains audio return.
Fig. 2 is the flow chart of the live broadcasting method of live broadcast system that the band based on public network for the present invention explains audio return.
Fig. 3 is dividing of the server end of the live broadcasting method of live broadcast system that the band based on public network for the present invention explains audio return
Solution flow chart.
Fig. 4 is the decomposition of the client of the live broadcasting method of live broadcast system that the band based on public network for the present invention explains audio return
Flow chart.
Fig. 5 is the TS audio pack packing flow chart of the live broadcast system that the band based on public network for the present invention explains audio return.
Fig. 6 is that the band based on public network for the present invention explains the sound of live broadcast system of audio return, video frame structure figure.
Fig. 7 is the intertexture of the audio frequency and video synthesizer output of the live broadcast system that the band based on public network for the present invention explains audio return
TS audio pack together and the frame structure schematic diagram of original high bit-rate video.
Fig. 8 is audio frequency and video synthesizer output after the live broadcast system time delay of band explanation audio return based on public network for the present invention
The TS audio pack of weave in and the frame structure schematic diagram of original high bit-rate video.
Fig. 9 is audio frequency and video synthesizer output during live system's lock-out of band explanation audio return based on public network for the present invention
The TS audio pack of weave in and the frame structure schematic diagram of original high bit-rate video.
Specific embodiment
Claim according to the present invention and content of the invention disclosure of that, technical scheme institute specific as follows
State.
Refer to shown in accompanying drawing 1, the live broadcast system that the band based on public network for the present invention explains audio return adopts C/S structure,
Including the server end 1 being provided with TCP listening port and client 2 two parts, described server end 1 and described client 2
Connected by public network；Described server end 1 is made up of video encoder 11, transmitting/receiving server 12 and audio frequency and video synthesizer 13；
Described video encoder 11 is connected with described transmitting/receiving server 12 and audio frequency and video synthesizer 13 respectively, by the original height of input
Bit-rate video sdi signal is converted into being applied to the low bit- rate IP traffic output of network transmission；Described transmitting/receiving server 12 is used
In the described video encoder 11 of connection and audio frequency and video synthesizer 13, and the communication as described server end 1 and client 2
Interface；Described audio frequency and video synthesizer 13 is defeated synthesize original high bit-rate video data with the voice data explaining passback after
Go out；Described client 2 is PC, and is provided with audio input device 21 and screen 22 in described client 2.
It is provided with video cache region 14, the size in described video cache region 14 is protected in described audio frequency and video synthesizer 13
Hold constant, judge the timestamp of video data and voice data, and cache high bit-rate video；When video cache region 14 is full,
As soon as often receiving the new high bit-rate video of frame, export the high bit-rate video of earliest frame caching.
Refer to accompanying drawing 2 to shown in accompanying drawing 5, the band based on public network for the present invention explains the live of the live broadcast system of audio return
Method, this live broadcast system includes server end 1 and client 2, and this live broadcasting method at least comprises the steps：
Step 1, described server end 1 opens TCP listening port, and circular wait is derived from the connection of described client 2,
Described client 2 is passed through ICP/IP protocol and is sent connection request to described server end 1.
Now have three kinds of situations：1st, no respond；2nd, connect number full；3rd, successful connection.Described server end 1 no connects
Connect, then continue waiting for；Described server end 1 judges the maximum number of connections that now server end 1 reaches, if connecting more than maximum
Several, refuse this connection, if being less than maximum number of connections, successful connection.
Step 2, after described server end 1 and client 2 successful connection, described client 2 obtains local network
Bandwidth and the network delay existing and server end 1 between, the data of network delay is passed by being sent to transmitting/receiving server 12
Pass audio frequency and video synthesizer 13.
Network delay can export time delay and TS audio pack as final signal afterwards and original high bit-rate video is synchronous
Foundation is sent to described server end 1.
Step 3, after user selected channel, the channel that user selects is sent instructions to described clothes by described client 2
Business device end 1, now described server end 1 cannot actively send data to described client 2, and server end 1 is according to client
The corresponding video encoder of instruction unpack 11 at end 2 is to select suitably to export video code rate it is ensured that client 2 reaches most preferably
Result of broadcast.
The net that the output format of described video encoder 11 is then located according to client 2 for H.264 TS, bit rate output
Depending on network bandwidth.
Step 4, described client 2 realizes existing network address translation（Network Address
Translation, abbreviation NAT）Pass through, treat that client 2 sends UDP（Abbreviation UDP）After the information that burrows, with institute
The server end 1 stated sets up UDP（Abbreviation UDP）Interface channel is set up, and described server end 1 is to described
Client 2 sends low bit- rate IP traffic.
Step 5, described client 2 exports screen 22 by after the decoding of low bit- rate IP traffic.
Step 6, when announcer prepares to start to explain, opens described audio input device 21, just can be defeated by audio frequency
Enter equipment 21 collection and explain sound, the voice data collecting is encoded to be packaged into TS audio pack.
Step 7, in order to ensure the TS voice data of final output and the synchronization of original high bit-rate video, in described client
End 2 is to stamp timestamp information PTS on described TS voice data.
Refer to shown in accompanying drawing 6, the value of the timestamp information PTS of the TS voice data described in first can be according to user
Depending on the value of timestamp information PTS ' of a certain frame video pictures seen at that time, i.e. the PTS of the first frame TS audio pack0=
PTS ', the timestamp information PTS of TS voice data afterwardsnKeep continuous to increase.The value of PTS ' should be with original high bit-rate video
Timestamp information keeps strict conformance.
The input video stream signal of audio frequency and video synthesizer 13 is the high bit-rate video stream through time delay, this high bit-rate video
Timestamp information must be strict with the time stamp signal of the low bit- rate IP traffic that client 2 receives be consistent and just can complete
Final synchronization.The timestamp information wrapped according to the TS voice data of passback, just can be by friendship average for TS packets of audio data
Knit in original high bit-rate video flow data, thus reaching the synchronization of sound picture, that is, the recording point that starts explaining is exactly at that time
That frame picture that he is seen.
Step 8, complete TS audio pack is passed back to described server end 1 by UDP interface channel.
In described step 4, the transmission of low bit- rate IP traffic and the transmission of TS audio pack in step 8 are in two new thread
Upper synchronous transfer.
Step 9, the high bit-rate video receiving is synthesized by described audio frequency and video synthesizer 13 with TS voice data, follows successively
Ring, treats that described client 2 disconnects after live end.
Refer to shown in accompanying drawing 7, under normal circumstances, that is, no-delay in the case of, audio frequency and video synthesizer 13 will be complete
TS audio pack averagely interweaves in high bit-rate video.
Because voice data is based on public network transmission, thus there are various uncertain factors, so to former
Beginning video data enters row cache and is extremely necessary.But the magnitude relationship of caching has arrived live delay time size, delay
Depositing conference leads to live time delay excessive；Caching is too small, video and audio time stamp can occur when network delay is excessive always
Cannot align thus leading to not broadcast.In the case of time delay, the discreet value of described server end 1 computation delay, if institute
The server end 1 stated is t with the program constant time lag at 2 liang described of client place, described server end 1 and described client
The network delay at end 2 is T, then discreet value is T+t, and this discreet value is also the minimum time delay of the live broadcast system of the present invention simultaneously,
It is also time delay minimum in existing similar technique.But discreet value can be shaken during practice, so live time delay should
Leave certain surplus capacity, so could effectively control live smoothness stable.
Corresponding time span t of high bit-rate video of described video cache region 14 caching ' it is described live system
System time delay T+t.
After T=delay threshold T ', when that is, video cache region 14 is full, it is new that video cache region 14 often receives a frame
Video data, just exports the video data of earliest frame caching, to keep video cache area from video cache region 14
The size in domain 14 is constant；Judge the timestamp PTS of audio frequency and video simultaneously, find TS audio pack after the TS audio pack corresponding to video
It is inserted in video output streams.Such as, video second frame data corresponding be audio frequency the first frame data, then audio frequency and video output stream
As shown in Figure 8.
Refer to shown in accompanying drawing 9, due to the uncertain factor of network, UDP can occur situations such as time delay, packet loss, run into this
If kind of a situation does not deal with, system will occur unpredictable consequence, ultimately results in live signal abnormal.Such as, UDP occurs
Time delay, the video data corresponding to voice data now receiving is possible to outwards export, if now not processing, can
The phenomenons such as card that occur that sound picture is asynchronous or picture pauses；Packet loss in such as network again, and this situation then may directly result in video
The interruption of signal.Case above is all fatal in live, is also absolutely not to allow to occur.
In the case of losing synchronization, after the high bit-rate video receiving exceedes the size in video cache region 14, high code
Rate video data does not also receive then it is assumed that not having TS voice data during corresponding TS voice data, then in the height of output
Insert quiet bag in the corresponding frame of bit-rate video data and normally broadcast ensureing video signal, afterwards while receiving audio pack
Need to judge that the high bit-rate video whether this TS voice data has lagged behind at that time broadcasts progress by timestamp information, if fallen
Abandon this data afterwards without exception, until the timestamp of TS voice data catches up with the timestamp of now high bit-rate video, subsequently as before
The same TS voice data is interweaved with original high bit-rate video and exports.
In sum, the live broadcast system of the band explanation audio return based on public network for the present invention can make no matter announcer is in what
Side, as long as conveniently can be explained on the ground having network, and can automatically select properly according to the on-site network condition of announcer
Video code rate, reach and best watch effect；The band based on public network for the present invention explains the live of the live broadcast system of audio return
Employ the processing method in the case of time delay in method, live delays time to control can be made in minimum scope, be existing similar
Time delay minimum in technology；Employ processing method in the case of lock-out it is ensured that the synchronization of final output signal audio frequency and video
With stably, reach the standard of broadcast level.
The above is that the band based on public network for the present invention explains the live broadcast system of audio return and its concrete of live broadcasting method
The enumerating of embodiment, the equipment for wherein not detailed description and structure are it should be understood that take that this area is existing general to be set
Standby and universal method is being practiced.
Claims (10)
1. a kind of band based on public network explains the live broadcast system of audio return, and the described band based on public network explains audio return
Live broadcast system is C/S structure, including：It is provided with the server end of TCP listening port（1）And client（2）Two parts；Its feature exists
In described server end（1）With described client（2）Connected by public network；
Described server end（1）By video encoder（11）, transmitting/receiving server（12）And audio frequency and video synthesizer（13）Composition；Institute
The video encoder stated（11）Respectively with described transmitting/receiving server（12）And audio frequency and video synthesizer（13）Connect, input is former
Begin high bit-rate video sdi signal be converted into being applied to network transmission low bit- rate IP traffic output；Described server（1）To institute
State client（2）Send low bit- rate IP traffic；Described transmitting/receiving server（12）For connecting described video encoder
（11）And audio frequency and video synthesizer（13）, and as described server end（1）And client（2）Communication interface；Described sound
Video synthesizer（13）Export after original high bit-rate video data is synthesized with the voice data explaining passback, its number explaining
According to being in client（2）, by audio input device（21）Collection explains sound；Its generated data is used for carrying out live；
Described client（2）It is PC, and described client（2）Inside it is provided with audio input device（21）And screen（22）.
2. band based on public network according to claim 1 explain audio return live broadcast system it is characterised in that：Described
Audio frequency and video synthesizer（13）Inside it is provided with video cache region（14）, described video cache region（14）Size keep constant,
For judging the timestamp of video data and voice data, and cache high bit-rate video.
3. the band based on public network according to claim 1 explains the live broadcasting method of the live broadcast system of audio return, its feature
It is：The method at least comprises the following steps：Step 1, described server end（1）Open TCP listening port, circular wait comes
From described client（2）Connection, described client（2）By ICP/IP protocol to described server end（1）Send
Connection request；Step 2, described server end（1）With client（2）After successful connection, described client（2）Obtain local
The bandwidth of network and and server end（1）Between the network delay that exists, the data of network delay passes through to be sent to transmitting-receiving clothes
Business device（12）Pass to audio frequency and video synthesizer（13）；Step 3, after user selected channel, described client（2）User is selected
Channel send instructions to described server end（1）, now described server end（1）Cannot actively send data to described
Client（2）, server end（1）According to client（2）The corresponding video encoder of instruction unpack（11）Suitable to select
Output video code rate；Step 4, described client（2）Realize NAT to pass through, treat client（2）Transmission UDP burrows after information,
With described server end（1）Set up UDP interface channel to set up, described server end（1）To described client（2）Send
Low bit- rate IP traffic；Step 5, described client（2）Screen is exported after low bit- rate IP traffic is decoded（22）；Step
6, when announcer prepares to start to explain, open described audio input device（21）, just can pass through audio input device（21）
Collection explains sound, and the voice data collecting is encoded to be packaged into TS audio pack；Step 7, in described client（2）For
Timestamp information PTS is stamped on described TS voice data；Step 8, complete TS audio pack is returned by UDP interface channel
To described server end（1）；Step 9, described audio frequency and video synthesizer（13）By the high bit-rate video receiving and TS audio frequency number
According to synthesis, circulate successively, after live end, treat described client（2）Disconnect.
4. the band based on public network according to claim 3 explains the live broadcasting method of the live broadcast system of audio return, its feature
It is：In described step 1, server end（1）There are three kinds of situations：1st, no respond；2nd, connect number full；3rd, successful connection；If
Described server end（1）Connectionless, then continue waiting for；Described server end（1）Judge now server end（1）Reach
Maximum number of connections, if being more than maximum number of connections, refuses this connection, if being less than maximum number of connections, successful connection.
5. the band based on public network according to claim 3 explains the live broadcasting method of the live broadcast system of audio return, its feature
It is：In described step 7, the value of the timestamp information PTS of the TS voice data described in first can according to user at that time
Depending on the value of timestamp information PTS ' of a certain frame video pictures seen, i.e. the PTS0=PTS ' of the first frame TS audio pack, it
The timestamp information PTSn of TS voice data afterwards keeps continuous and increases；The value of PTS ' should be believed with original high bit-rate video timestamp
Breath keeps strict conformance.
6. the band based on public network according to claim 3 explains the live broadcasting method of the live broadcast system of audio return, its feature
It is：In described step 4, the transmission of low bit- rate IP traffic is same in two new thread with the transmission of TS audio pack in step 8
Step transmission.
7. the band based on public network according to claim 3 explains the live broadcasting method of the live broadcast system of audio return, its feature
It is：In described step 9, under normal circumstances, in the case of that is, no-delay, audio frequency and video synthesizer（13）By complete TS sound
Frequency bag averagely interweaves in high bit-rate video.
8. the band based on public network according to claim 3 explains the live broadcasting method of the live broadcast system of audio return, its feature
It is：In described step 9, in the case of time delay, described server end（1）The discreet value of computation delay, if described
Server end（1）With described client（2）Program constant time lag at two is t, described server end（1）With described visitor
Family end（2）Network delay be T, then discreet value be T+t, this discreet value is also the minimum time delay of live broadcast system simultaneously.
9. the band based on public network according to claim 2 or 8 explains the live broadcasting method of the live broadcast system of audio return, and it is special
Levy and be：Described video cache region（14）Corresponding time span t of high bit-rate video of caching ' it is described live system
System time delay T+t.
10. the band based on public network according to claim 3 explains the live broadcasting method of the live broadcast system of audio return, its feature
It is：In described step 9, in the case of losing synchronization, when the high bit-rate video receiving exceedes video cache region（14）
Size after, high bit-rate video data does not also receive then it is assumed that not having TS voice data during corresponding TS voice data,
Then insert quiet bag to ensure that video signal normally broadcasts in the corresponding frame of high bit-rate video data of output；Receiving afterwards
Need while audio pack to judge that the high bit-rate video whether this TS voice data has lagged behind at that time is broadcast by timestamp information
Go out progress, if fall behind abandoning this data without exception, until the timestamp of TS voice data catches up with the timestamp of now high bit-rate video,
As TS voice data and original high bit-rate video interweave output in the case of no-delay.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210511265.9A CN103856787B (en) | 2012-12-04 | 2012-12-04 | Commentary video passing-back live system based on public network and live method of commentary video passing-back live system based on public network |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210511265.9A CN103856787B (en) | 2012-12-04 | 2012-12-04 | Commentary video passing-back live system based on public network and live method of commentary video passing-back live system based on public network |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103856787A CN103856787A (en) | 2014-06-11 |
| CN103856787B true CN103856787B (en) | 2017-02-22 |
Family
ID=50863927
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210511265.9A Active CN103856787B (en) | 2012-12-04 | 2012-12-04 | Commentary video passing-back live system based on public network and live method of commentary video passing-back live system based on public network |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103856787B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104618798B (en) * | 2015-02-12 | 2016-01-20 | 北京清源新创科技有限公司 | The broadcasting moment control method of Internet net cast and device |
| CN106162221A (en) * | 2015-03-23 | 2016-11-23 | 阿里巴巴集团控股有限公司 | The synthetic method of live video, Apparatus and system |
| CN105025314B (en) * | 2015-07-15 | 2016-11-16 | 腾讯科技（深圳）有限公司 | Multimedia live broadcast method and apparatus |
| CN106507186B (en) * | 2016-10-31 | 2020-01-10 | 腾讯科技（深圳）有限公司 | Media information switching method, server and storage medium |
| CN106941613A (en) * | 2017-04-14 | 2017-07-11 | 武汉鲨鱼网络直播技术有限公司 | A kind of compacting of audio frequency and video interflow and supplying system and method |
| CN107124622A (en) * | 2017-04-14 | 2017-09-01 | 武汉鲨鱼网络直播技术有限公司 | A kind of audio frequency and video interflow compact system and method |
| CN107197186A (en) * | 2017-04-14 | 2017-09-22 | 武汉鲨鱼网络直播技术有限公司 | A kind of audio frequency and video compact system and method |
| CN107995503B (en) * | 2017-11-07 | 2020-07-14 | 西安万像电子科技有限公司 | Audio and video playing method and device |
| CN110691218B (en) * | 2019-09-09 | 2021-05-14 | 苏州臻迪智能科技有限公司 | Audio data transmission method and device, electronic equipment and readable storage medium |
| CN115942066B (en) * | 2022-12-06 | 2024-09-03 | 腾讯音乐娱乐科技（深圳）有限公司 | Audio live broadcast method, electronic equipment and computer readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101018237A (en) * | 2007-01-16 | 2007-08-15 | 成都金山互动娱乐科技有限公司 | A method for playing the online synchronization explication of the network game |
| CN101420621A (en) * | 2007-10-24 | 2009-04-29 | 深圳华为通信技术有限公司 | Transmission equipment, system and method for interactive television message |
| CN101938606A (en) * | 2009-07-03 | 2011-01-05 | 北京大学 | Multimedia data push method, system and device |
| CN102195939A (en) * | 2010-03-11 | 2011-09-21 | 盛乐信息技术（上海）有限公司 | High-speed wireless network remote-control competition system and implementation method thereof |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6434398B1 (en) * | 2000-09-06 | 2002-08-13 | Eric Inselberg | Method and apparatus for interactive audience participation at a live spectator event |
| US7542814B2 (en) * | 2004-06-01 | 2009-06-02 | Craig Barr | Home entertainment apparatus and method |
-
2012
- 2012-12-04 CN CN201210511265.9A patent/CN103856787B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101018237A (en) * | 2007-01-16 | 2007-08-15 | 成都金山互动娱乐科技有限公司 | A method for playing the online synchronization explication of the network game |
| CN101420621A (en) * | 2007-10-24 | 2009-04-29 | 深圳华为通信技术有限公司 | Transmission equipment, system and method for interactive television message |
| CN101938606A (en) * | 2009-07-03 | 2011-01-05 | 北京大学 | Multimedia data push method, system and device |
| CN102195939A (en) * | 2010-03-11 | 2011-09-21 | 盛乐信息技术（上海）有限公司 | High-speed wireless network remote-control competition system and implementation method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103856787A (en) | 2014-06-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103856787B (en) | Commentary video passing-back live system based on public network and live method of commentary video passing-back live system based on public network | |
| CN105491393A (en) | Method for implementing multi-user live video business | |
| DE60310017T2 (en) | Method and device for decentralizing audio / visual components | |
| CN102946570B (en) | Transmission system and method for multi-stream streaming media of self-adaption network bandwidth | |
| CN103733631B (en) | Media content transceiving method and transceiving apparatus using same | |
| CN107846633A (en) | A kind of live broadcasting method and system | |
| CN110267064B (en) | Audio playing state processing method, device, equipment and storage medium | |
| CN103546662A (en) | A method for synchronizing audio and video in a network monitoring system | |
| JP2004525545A (en) | Webcast method and system for synchronizing multiple independent media streams in time | |
| CN101938606B (en) | Method, system and device for propelling multimedia data | |
| JP2003504897A (en) | High-speed video transmission via telephone line | |
| CN101237586A (en) | Synchronous playing method for audio and video buffer | |
| CN106341563A (en) | Terminal communication based echo suppression method and device | |
| CN109168059A (en) | A lip synchronization method for playing audio and video separately on different devices | |
| CN103888815A (en) | Method and system for real-time separation treatment and synchronization of audio and video streams | |
| CN102404646A (en) | Wireless television live broadcasting system and live broadcasting method thereof | |
| CN108124158B (en) | The data processing method of multimedia terminal and multimedia terminal | |
| CN105357590A (en) | Method and device for achieving terminal multimedia broadcast | |
| US20040086051A1 (en) | Data transmission device and method | |
| CN107920072A (en) | A kind of multimedia sharing method and system based on data characteristics | |
| CN103826084A (en) | Audio encoding method | |
| CN103269448A (en) | Realization of Audio and Video Synchronization Method Based on RTP/RTCP Feedback Early Warning Algorithm | |
| CN105933759A (en) | Red envelope grabbing method for digital television, server and system | |
| CN109862386A (en) | Live data transmission method and device | |
| WO2006066454A1 (en) | A method for transmitting the multichannel video sources on video conferencing system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |