[go: up one dir, main page]

CN102572420B - Method, system and device for dynamic packet loss control based on scalable video coding - Google Patents

Method, system and device for dynamic packet loss control based on scalable video coding Download PDF

Info

Publication number
CN102572420B
CN102572420B CN201010618196.2A CN201010618196A CN102572420B CN 102572420 B CN102572420 B CN 102572420B CN 201010618196 A CN201010618196 A CN 201010618196A CN 102572420 B CN102572420 B CN 102572420B
Authority
CN
China
Prior art keywords
truncation
layer
packet
data packet
flag
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201010618196.2A
Other languages
Chinese (zh)
Other versions
CN102572420A (en
Inventor
颜乐驹
孙俊
郭宗明
肖建国
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
New Founder Holdings Development Co ltd
Peking University
Beijing Founder Electronics Co Ltd
Original Assignee
Peking University
Peking University Founder Group Co Ltd
Beijing Founder Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Peking University, Peking University Founder Group Co Ltd, Beijing Founder Electronics Co Ltd filed Critical Peking University
Priority to CN201010618196.2A priority Critical patent/CN102572420B/en
Publication of CN102572420A publication Critical patent/CN102572420A/en
Application granted granted Critical
Publication of CN102572420B publication Critical patent/CN102572420B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Data Exchanges In Wide-Area Networks (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses a method, a system and a device for dynamic packet loss control based on scalable video coding (SVC), which are used for solving the problem of packet loss control in SVC different actual transmission processes in the prior art. The method includes that a client detects quality of played video resources and sends control instructions for controlling the quality to a server, and the server judges whether packet loss processing is performed on a data packet through the control instructions and Naltype information value of the data packet to be transmitted. Due to the fact that the client detects the quality of the played video resources to generate the control instructions for performing packet loss processing on the data packet, the server can perform real-time dynamic packet loss processing according to playing states of the client.

Description

Dynamic packet loss control method, system and device based on scalable video
Technical field
The present invention relates to technical field of data processing, relate in particular to a kind of dynamic packet loss control method, system and device based on scalable video (SVC).
Background technology
Along with the development of video coding technique and the raising of user's requirement, user has not only proposed very high requirement to the compression efficiency of Video coding, and requires Video coding result can meet different quality requirements.Therefore in order to make, to the coding result of video resource, can meet different quality requirements, in the prior art, according to the different requirements of code check, frame per second and resolution, coding repeatedly, reaches the object that meets different quality requirement respectively.
But in above-mentioned implementation, because needs are encoded repeatedly to video resource, can generate a plurality of different coded files.Therefore this implementation need to be wasted larger memory space, and because needs are encoded respectively, therefore the efficiency of coding is lower.
In order to address the above problem, can adopt SVC technology to encode to video resource, SVC can provide the scalability of time, three aspects of quality and space.Based on SVC, video resource is carried out to first encoding, can according to the scalability of three aspects, coded file be extracted according to user's different demands, can meet user's different demands.For example, when the bandwidth in the network of video resource transmission is lower, the data of basic layer of the video resource after just can a transfer encoding, abandon the packet of enhancement layer; When the resolution of the video resource that requires to show is higher, the packet of reinforced partly layer can be transmitted together and decodes, thereby meet the requirement of resolution.
Although but the current concept that has proposed SVC, and also provide corresponding packet loss possibility based on SVC, but the packet loss strategy and the packet drop mechanism that do not provide the real-time requirement with actual transmitting procedure and user to match, so this SVC can not carry out actual packet loss control in transmitting procedure.
Summary of the invention
In view of this, the embodiment of the present invention provides a kind of dynamic packet loss control method, system and device based on SVC, in order to solve the problem of carrying out packet loss control in the actual transmissions process that in prior art, SVC is different.
A kind of dynamic packet loss control method based on SVC that the embodiment of the present invention provides, comprising:
Server receives the control signal that client sends, wherein said control signal is that described client generates according to the monitored results of the quality of the video resource that self is play, and carries the parameter information to adopting the equivalent layer of the video resource of SVC to adjust in this control signal;
Server parses is obtained described parameter information, and according to the interceptive value of the equivalent layer of the video resource in a upper moment of preserving, determines the interceptive value of the equivalent layer of current time video resource;
According to the interceptive value of the described equivalent layer of determining, and the value of the NalType information of each packet of video resource waiting for transmission, whether judgement carries out packet loss processing to this packet.
A kind of dynamic packet loss control system based on SVC that the embodiment of the present invention provides, comprising:
Client, for generating control signal according to the monitored results of the quality of the video resource that self is play, and described control signal is sent to server, wherein, in this control signal, carry the parameter information to adopting the equivalent layer of the video resource of SVC to adjust;
Server, be used for receiving described control signal, the parameter information that the equivalent layer to the video resource of employing SVC carrying in this control signal of parsing acquisition is adjusted, and according to the interceptive value of the equivalent layer of the video resource in a upper moment of preserving, determine the interceptive value of the equivalent layer of current time video resource, according to the interceptive value of the described equivalent layer of determining, and the value of the NalType information of each packet of video resource waiting for transmission, whether judgement carries out packet loss processing to this packet.
A kind of dynamic packet loss control device based on SVC that the embodiment of the present invention provides, comprising:
Receiver module, the control signal sending for receiving client, wherein said control signal is that described client generates according to the monitored results of the quality of the video resource that self is play, and carries the parameter information to adopting the equivalent layer of the video resource of SVC to adjust in this control signal;
Determination module, obtains described parameter information for resolving, and according to the interceptive value of the equivalent layer of the video resource in a upper moment of preserving, determines the interceptive value of the equivalent layer of current time video resource;
Packet loss processing module, the interceptive value of the described equivalent layer of determining for basis, and the value of the NalType information of each packet of video resource waiting for transmission, whether judgement carries out packet loss processing to this packet.
The embodiment of the present invention provides a kind of dynamic packet loss control method based on SVC, system and device, in method, by client, detect the quality of the video resource of playing, and the control command of quality being controlled to server transmission, server is by the NalType value of information of control command and packet waiting for transmission, whether judgement carries out packet loss processing to this packet, the quality of the video resource of playing by detection due to client in the embodiment of the present invention, the control command that raw paired data bag carries out packet loss processing, therefore server can carry out dynamic packet loss processing according to the broadcast state of client in real time.
Accompanying drawing explanation
The dynamic packet loss control flow chart based on SVC that Fig. 1 provides for the embodiment of the present invention;
The structural representation of the dynamic packet loss control system based on SVC that Fig. 2 provides for the embodiment of the present invention;
Fig. 3 for the embodiment of the present invention provide when the NalType of this packet value of information is 14, corresponding dynamic packet loss control process;
Fig. 4 for the embodiment of the present invention provide when the NalType of this packet value of information is 1 or 5, corresponding dynamic packet loss control process;
Fig. 5 for the embodiment of the present invention provide when the NalType of this packet value of information is 20, corresponding dynamic packet loss control process;
The structural representation of a kind of dynamic packet loss control device based on scalable video SVC that Fig. 6 provides for the embodiment of the present invention.
Embodiment
The embodiment of the present invention is in transmitting procedure, according to the difference of packet, carry out corresponding packet loss control, a kind of dynamic packet loss control method based on SVC is provided, in the method, client, according to actual transmission demand, generates and comprises the control signal of adjusting parameter, this control signal is sent to server end, server, according to this control signal, to each packet receiving, adopts corresponding packet loss control strategy according to the value of the NalType information of this packet.
Below in conjunction with Figure of description, the embodiment of the present invention is elaborated.
Fig. 1 is the dynamic packet loss control process based on SVC that the embodiment of the present invention provides, and in this process, comprises the following steps:
S101: client, according to the monitored results to the play quality of video resource, generates control signal, wherein carries the parameter information to adopting the equivalent layer of the video resource of SVC to adjust in this control signal.
S102: client sends to server by this control signal generating.
S103: server receives this control signal, the parameter information that the equivalent layer to the video resource of employing SVC carrying in this control signal of parsing acquisition is adjusted.
S104: the described parameter information obtaining according to parsing, and the interceptive value of the equivalent layer of upper one video resource constantly of preserving, determine the interceptive value of the equivalent layer of current time video resource.
S105: server is according to the interceptive value of the described equivalent layer of determining, and the value of the NalType information of each packet of video resource waiting for transmission, whether judgement carries out packet loss processing to this packet.
In embodiments of the present invention in order to realize the dynamic packet loss control method based on SVC, to real-time streaming protocol (Real Time Streaming Protocol, RTSP) a territory is expanded, the communication between client and server is realized in the territory expanding to by this, and when server receives after the information of client transmission, according to this information, carry out corresponding data bag to be sent and carry out packet loss control.
The structural representation of the dynamic packet loss control system based on SVC that Fig. 2 provides for the embodiment of the present invention, comprises in this system: client 21 and server 22.
Wherein, client 21, for generating control signal according to the monitored results of the quality of the video resource that self is play, and sends to server 22 by described control signal, wherein, in this control signal, carry the parameter information to adopting the equivalent layer of the video resource of SVC to adjust;
Server 22, be used for receiving described control signal, the parameter information that the equivalent layer to the video resource of employing SVC carrying in this control signal of parsing acquisition is adjusted, and according to the interceptive value of the equivalent layer of the video resource in a upper moment of preserving, determine the interceptive value of the equivalent layer of current time video resource, according to the interceptive value of the described equivalent layer of determining, and the value of the NalType information of each packet of video resource waiting for transmission, whether judgement carries out packet loss processing to this packet.
This client 21 comprises:
Control signal generation module, for generating control signal according to the monitored results of the play quality of the video resource that self is play, wherein, carries the parameter information to adopting the equivalent layer of the video resource of SVC to adjust in this control signal;
Sending module, sends to server for the control signal that control signal generation module is generated.
In embodiments of the present invention, the monitored results of the quality of the video resource that the control signal generation module of client is play self in basis, while generating control signal, the quality monitoring result that can send to this client according to user, determine the monitored results of the quality of the video resource that self plays, thereby generation control signal, can certainly be according to the monitored results of the quality of the video resource that self is play, thereby generates control signal.
In client, according to the monitored results of the quality of the video resource that self is play, while generating control signal, due to the occupancy of the video resource of this broadcasting in client buffer district, can reflect the play quality of this video resource.When in this buffering area, the occupation rate of the data message of the video resource of this broadcasting is larger, illustrate that the transmission quality between server and client is better, for video resource is clearly provided to user, can suitably improve the play quality of video resource, when the occupancy of the data message of the video resource of this broadcasting in this buffering area is lower, illustrate that the transmission quality between current server and client is poor, for the fluency that guarantees that user views and admires, need suitably to reduce the play quality of video resource.
Therefore in embodiments of the present invention, client can detect the occupation rate of data message of the video resource of this broadcasting of self buffer, thereby determine the parameter information to adopting the equivalent layer of the video resource of SVC to adjust, according to this parameter information of determining, generate the control signal that carries this parameter information.For example, when the occupancy of buffering area is interval lower than the first threshold of setting, the quality layers threshold value of the video resource of the employing SVC of definite this broadcasting reduces, or space layer or the reduction of time horizon threshold value, and determine the quality layers threshold value of the video resource of this employing SVC is reduced to Yi Ge unit, therefore generate control signal, in this control signal, carry the parameter information that the quality layers threshold value of the video resource of this employing SVC is reduced to Yi Ge unit.
Or client also can be according to the transmission rate current to network, the threshold interval corresponding according to this transmission rate, the parameter information that generation is adjusted the equivalent layer of the video resource of the employing SVC of this broadcasting, according to this parameter information of determining, generates the control signal that carries this parameter information.
While generating by client specific implementation control signal, can directly to the internet message processing module of client (Source Filter), operate by application programming interfaces, thereby realize the generation of control signal.
Due to RSTP territory is expanded, the territory after this expansion can be when not affecting existing RSTP video broadcasting condition in embodiments of the present invention, and the information of carrying by this territory realizes the control of server end to the transmission quality of this video resource.
When concrete client is in embodiments of the present invention carried out the transmission of control signal by sending module, can in broadcasting (PLAY) information of RSTP, expand a parameter field, for example this parameter field can be: x-Send-Qid.By realizing the embedding to control signal to the coding of this parameter field, and in this control signal, carry the parameter information of adjusting to the equivalent layer of the video resource of employing SVC.Parameter field after this expansion has embedded after control signal, can send according to the send mode of parameter in traditional RTSP.
The monitored results of the quality of the video resource that can play according to self due to client, generate in real time the control signal that carries the parameter information that the equivalent layer of the video resource of employing SVC is adjusted, when this control signal is transferred to server end, the parameter information that server can carry according to this control signal of real-time reception, carries out corresponding packet loss control to each packet of video resource waiting for transmission.
When server receives after the control signal of client transmission, obtain in this control signal, carry to the parameter information that adopts the equivalent layer of the video resource of SVC to adjust, according to this parameter information, and the value of the NalType information of the packet of this video resource waiting for transmission, to adopting the corresponding data bag of the video resource of SVC to carry out the whether judgement of packet loss, process.When server receives after the PLAY information that comprises this x-Send-Qid parameter field, obtain the control signal embedding in this parameter field, extract in this control signal, carry to the parameter information that adopts the equivalent layer of the video resource of SVC to adjust, according to this parameter information, and the value of the NalType information of each packet of this video resource waiting for transmission, whether judgement carries out packet loss processing to this packet.
Server obtained in this control signal, carry to adopting after the parameter information that the equivalent layer of the video resource of SVC adjusts, the information of the equivalent layer threshold value of SVC being adjusted due to the message identification of this parameter.Therefore when this server has obtained after this parameter information, the standby interceptive value of space layer, time horizon and the quality layers of the video resource according to this parameter information after to the employing SVC transmitting is adjusted.Specifically comprise after receiving this parameter information, according to the interceptive value of the equivalent layer of the video resource in a upper moment of preserving, and the parameter information of in this control signal, the equivalent layer of video resource being adjusted, determine the interceptive value of the equivalent layer of current time video resource.The interceptive value that adopts the equivalent layer of the definite video resource of current time, upgrades the interceptive value of the equivalent layer of upper one video resource of constantly preserving.
For example in a upper moment because the play quality of video resource is higher, therefore all higher to the interceptive value of the space layer of this video resource, quality layers and time horizon, be for example all maximum 3, the interceptive value of the space layer of this video resource, quality layers and time horizon is all kept in server.And this moment, due to the occupancy decline of this video resource in client buffer district, and the threshold interval corresponding according to this occupancy, determine the time horizon, space layer and the quality layers difference adjustment downwards Yi Ge unit that this are adopted to the video resource of SVC.The parameter information that the standby interceptive value of time horizon, space layer and the quality layers of the video resource of this employing SVC is adjusted respectively to Yi Ge unit downwards that client is determined this is carried in control signal, sends to server.
Receive the server of this control signal, the parameter information carrying in this control signal is obtained in parsing, determine this constantly the interceptive value of time horizon, space layer and the quality layers of this video resource adjust Yi Ge unit downwards, now, server determines that the standby interceptive value of time horizon, space layer and the quality layers of this video resource is all 2.The standby interceptive value of time horizon, space layer and the quality layers of this this video resource constantly that server adopts that this determines upgrades preserving the standby interceptive value of corresponding time horizon, space layer and quality layers, and in conjunction with the value of the NalType information of each packet waiting for transmission, to each, whether this packet waiting for transmission carries out packet loss processing in judgement.
For the video resource transmitting, owing to comprising a plurality of packets in each Frame of this video resource, each packet has the NalType information that belongs to self, and the value of the NalType information comprising in the packet of video resource is generally 1,5,14,20,24,28.The value of the NalType information that therefore can comprise according to each packet waiting for transmission in embodiments of the present invention, and local standby interceptive value information of preserving, whether judgement carries out packet loss processing to each packet waiting for transmission.
And, in embodiments of the present invention because client can be according to the quality condition of the video resource of self actual play, generate in real time the control signal that carries parameter information, therefore when server is after receiving this parameter information, at this, constantly determine the standby interceptive value corresponding to time horizon, space layer and quality layers of video resource, and adopt this standby interceptive value to upgrade the corresponding standby interceptive value in a local upper moment of preserving.When constantly there is new packet waiting for transmission in the next one, adopt the standby interceptive value after this renewal, and the value of the NalType information of this packet waiting for transmission, whether judgement carries out packet loss processing to this packet.
When server preserved this moment to the standby interceptive value of the space layer of video resource, quality layers and time horizon after, according to the value of the NalType information of each packet of video resource waiting for transmission, judgement whether this packet is carried out to packet loss processing.
Owing to comprising a plurality of Frames at video resource, each Frame comprises a plurality of packets, and the value that each packet comprises corresponding NalType information in same Frame.And in each packet, comprise its time horizon information, and space layer information, can think that each packet exists its time horizon mark and space layer mark.Mainly because adopt the video resource of SVC, it has extensibility in spatial domain, time-domain and mass domain, therefore for video resource, it comprises a plurality of layers in spatial domain, time-domain and mass domain, space layer, time horizon and quality layers that different packet is corresponding different, and space layer corresponding to packet and time horizon can be thought space layer mark and the time horizon mark of this packet.And server, when each packet waiting for transmission is transmitted, can get the time horizon mark and the space layer mark that in packet, exist.
When this is 14 with the value of the NalType information of the packet of the video resource of transmission constantly, during the first packet that packet of this video resource waiting for transmission is this Frame, server adopts the standby interceptive value corresponding to space layer, quality layers and time horizon of the local video resource of preserving, and replaces the interceptive value corresponding to space layer, quality layers and time horizon of this video resource.Block mark and be set to vacation, and again determine whether that blocking mark is set to very.Wherein block determining of mark, should be according to upper one constantly definite time horizon interceptive value and space layer interceptive value, and the time horizon mark of notebook data bag and space layer mark are determined.For example, when upper one interceptive value corresponding to this time horizon of constantly determining is 2, the time horizon of this packet is labeled as 3, puts to block to be labeled as very.Similar to the judgement of space layer and above-mentioned deterministic process to time horizon, here just do not repeat one by one.
Server detects space layer mark and the time horizon mark of each packet in current data frame, before whether judgement carries out packet loss processing to this packet, needs the current mark that blocks, and specifically comprises:
According to the space layer mark of this packet, time horizon mark, and the interceptive value of definite equivalent layer, determine and block mark.
Specifically comprise: when the packet waiting for transmission in current data frame is not 14 number bag, the space layer that server detects current data packet marks whether to equal in interceptive value corresponding to space layer, and the quality layers of current data packet marks whether to equal quality layers interceptive value, when meeting simultaneously, write frame end mark, and block mark and be set to very.
Because when writing frame end mark,, in the middle of this frame, all subsequent packet are unwanted enhanced layer packets, and therefore known what block that mark shows is a kind of state of server, and expression will abandon in this frame, all packets after current bag.Therefore need to block mark is set to very.
When server starts to process each non-No. 14 bag, identification blocks to mark whether to be true, when blocking, is labeled as true time, and server carries out packet loss processing by this packet.And for No. 14 bags, after the step that mark is blocked in identification occurs in and determines and block mark.Afterwards the packet after this packet is carried out to subsequent treatment.Until having been carried out to the whether judgement of packet loss, processes each packet in this Frame.
Fig. 3 for the embodiment of the present invention provide when the NalType of this packet value of information is 14, corresponding dynamic packet loss control process comprises the following steps in this process:
S301: server adopts the standby interceptive value corresponding to space layer, quality layers and time horizon of the local video resource of preserving, replaces the interceptive value corresponding to space layer, quality layers and time horizon of this video resource.
S302: server blocks mark and is set to vacation.
S303: server judges that the space layer of this packet marks whether to be not more than interceptive value corresponding to space layer, when judgment result is that while being, carries out step S305, otherwise, carry out step S304.
S304: server blocks mark and is set to very, and be labeled as true time recognizing to block, this packet is carried out to packet loss processing.The NalType value of information of the next packet waiting for transmission of server identification afterwards, and process accordingly.
S305: server is for this packet waiting for transmission, and the time horizon that detects this packet marks whether to be less than or equal to the interceptive value that time horizon is corresponding, when judgment result is that while being, carries out step S306, otherwise, carry out step S307.
S306: the NalType value of information of the next packet waiting for transmission of server identification, and process accordingly.
S307: server blocks mark and is set to very, and be labeled as true time recognizing to block, this packet is carried out to packet loss processing.The NalType value of information of the next packet waiting for transmission of server identification afterwards, and process accordingly.
When in this server, the value of the NalType information of the packet of video resource waiting for transmission is 1 or 5, according to blocking mark, process.When blocking, be labeled as true time, this packet is carried out to packet loss processing.Otherwise, judge whether interceptive value corresponding to quality layers is 0, and judge whether interceptive value corresponding to current space layer equals the space layer mark of this packet, when judged result is all when being, in this current data packet, write frame end mark, juxtaposition is blocked and is labeled as very.The time horizon space layer quality layers mark of the current bag of herein mentioning, is determined by upper No. 14 bag.
Fig. 4 for the embodiment of the present invention provide when the NalType of this packet value of information is 1 or 5, corresponding dynamic packet loss control process, this process comprises the following steps:
S401: current the blocking of server judgement marks whether to be true, if true, carries out step S402.Otherwise, carry out step S403.
S402: server carries out packet loss processing by this packet waiting for transmission.The NalType value of information of the next packet waiting for transmission of server identification afterwards, and process accordingly.
S403: judge whether current quality layers interceptive value is 0, and judge whether interceptive value corresponding to current space layer equals the space layer mark of this packet, if be very, write frame end mark, juxtaposition is blocked and is labeled as very.
S404: the NalType value of information of the next packet waiting for transmission of server identification, and process accordingly.
When the value of the NalType information of packet waiting for transmission is 14 in this server, blocks mark and be set to vacation, detect space layer mark and the time horizon mark of this packet, determine whether this packet needs to carry out packet loss processing.Detailed process comprises:
The space layer that server detects current packet waiting for transmission marks whether to be not more than interceptive value corresponding to space layer, when the space layer mark of this packet is not more than interceptive value corresponding to space layer, this packet is not carried out to any processing, when the space layer mark of this packet is greater than interceptive value corresponding to space layer, blocks mark and be set to very.When server recognizes to block, be labeled as true time, this packet is carried out to packet loss processing, server is to identifying the value of the NalType information of the packet after this packet afterwards, and processes accordingly.
Otherwise, server detects this packet time horizon and marks whether to be less than or equal to the interceptive value that time horizon is corresponding, when the time horizon mark of this packet is not more than interceptive value corresponding to time horizon, at this packet, do not carry out any processing, when the time horizon mark of this packet is greater than interceptive value corresponding to time horizon, blocks mark and be set to very.When server recognizes, block mark and be set to true time, this packet is carried out to packet loss processing, server is to identifying the value of the NalType information of the packet after this packet afterwards, and processes accordingly.
Because for 14 number Bao Eryan, its effect is to indicate space layer, time horizon, quality layers mark to 1 or 5 number bags subsequently in fact.Therefore, if should write frame end mark No. 14 bag judgements, packet that so should be after packet, writes this frame end mark in No. 1 or 5 number bags.
Fig. 5 for the embodiment of the present invention provide when the NalType of this packet value of information is 20, corresponding dynamic packet loss control process, this process comprises the following steps:
S501: server detects current blocking and marks whether to be true, is labeled as true time when this blocks, and this packet is carried out to packet loss processing, otherwise, carry out step S502.
S502: the quality layers that judges this packet marks whether to equal interceptive value corresponding to quality layers, and whether interceptive value corresponding to space layer equals the space layer mark of current data packet, when judged result is all when being, carry out step S503, otherwise, carry out step S504.
S503: server writes frame end mark in this packet, juxtaposition is blocked and is labeled as very.Then carry out step S504.
S504: server is identified the value of the NalType information of the packet after this packet, and processes accordingly.
When in server, the value of the NalType information of video resource packet waiting for transmission is 24, illustrate that this packet is for combination bag, in this current data packet, comprise a plurality of data sub-packets, for each data sub-packets, detect the value of the NalType information of each data sub-packets, and operate accordingly according to the value of this NalType information, until detect complete to each data sub-packets in this packet.Whether No. 24 bags write frame end mark is determined by last attached bag wherein comprising.
When the value of the NalType information of server video resource packet waiting for transmission is 28, illustrate that this packet is for splitting bag, the value of the NalType information of the data sub-packets comprising in this sequence of data packet is identical, because the value that comprises NalType information in first data sub-packets in packet, determine corresponding above-mentioned corresponding implementation, after having determined the respective handling process of this data sub-packets, for example, to the just packet loss processing of this data sub-packets, each data sub-packets in this packet is carried out to packet loss processing.When this is operating as when this data sub-packets is write to frame end mark accordingly, in last data sub-packets of this packet, write frame end mark.
The structural representation of a kind of dynamic packet loss control device based on scalable video SVC that Fig. 6 provides for the embodiment of the present invention, described device comprises:
Receiver module 61, the control signal sending for receiving client, wherein said control signal is that described client generates according to the monitored results of the quality of the video resource that self is play, and carries the parameter information to adopting the equivalent layer of the video resource of SVC to adjust in this control signal;
Determination module 62, obtains described parameter information for resolving, and according to the interceptive value of the equivalent layer of the video resource in a upper moment of preserving, determines the interceptive value of the equivalent layer of current time video resource;
Packet loss processing module 63, the interceptive value of the described equivalent layer of determining for basis, and the value of the NalType information of each packet of video resource waiting for transmission, whether judgement carries out packet loss processing to this packet.
Described device also comprises:
Update module 64, for adopting the interceptive value of the equivalent layer of definite current time video resource, upgraded the interceptive value of the equivalent layer of the video resource in a upper moment of preserving.
Described packet loss processing module 63 specifically for, when the NalType of this packet waiting for transmission value of information is 14, block mark and be set to vacation, the space layer mark corresponding according to data to be transmitted bag, and definite space layer interceptive value, determine whether to block mark and be set to very, when blocking mark, be set to true time, this packet is carried out to packet loss processing; When blocking mark, be set to fictitious time, the time horizon mark corresponding according to this data to be transmitted bag, and definite time horizon interceptive value, determine whether to block mark and be set to very, when blocking mark, is set to true time, and this packet is carried out to packet loss processing.
Described packet loss processing module 63 specifically for, when the NalType of this packet waiting for transmission value of information is 1 or 5, judgement blocks to mark whether to be true, when determining to block, is labeled as true time, and this packet is carried out to packet loss processing.
Described packet loss processing module 63 also for, when determining to block, be labeled as vacation, the space layer mark of packet waiting for transmission equals space layer interceptive value, and quality layers interceptive value is 0 o'clock, writes frame end mark, juxtaposition block be labeled as true.
Described packet loss processing module 63 specifically for, when the NalType of this packet waiting for transmission value of information is 20, whether be true, when definite current blocking is labeled as true time, this packet is carried out to packet loss processing if detecting the current sign of blocking.
Described packet loss processing module 63 also for, when the space layer mark of this packet waiting for transmission equals interceptive value corresponding to space layer, when this packet quality layers mark equals interceptive value corresponding to quality layers, write frame end mark, juxtaposition block be labeled as true.
Described packet loss processing module 63 specifically for:
The time horizon that detects 14 number bags in current data frame marks whether to be greater than the interceptive value that time horizon is corresponding, when the time horizon mark of this packet is greater than interceptive value corresponding to time horizon, arrange block be labeled as true.
Described packet loss processing module 63 specifically for, the space layer that detects 14 number bags in current data frame marks whether to be greater than interceptive value corresponding to space layer, when the space layer mark of this packet is greater than interceptive value corresponding to space layer, arrange block be labeled as true.
The embodiment of the present invention provides a kind of dynamic packet loss control method based on SVC, system and device, in method, by client, detect the quality of the video resource of playing, and the control command of quality being controlled to server transmission, server is by the NalType value of information of control command and packet waiting for transmission, whether judgement carries out packet loss processing to this packet, the quality of the video resource of playing by detection due to client in the embodiment of the present invention, the control command that raw paired data bag carries out packet loss processing, therefore server can carry out dynamic packet loss processing according to the broadcast state of client in real time.
Obviously, those skilled in the art can carry out various changes and modification and not depart from the spirit and scope of the present invention the present invention.Like this, if within of the present invention these are revised and modification belongs to the scope of the claims in the present invention and equivalent technologies thereof, the present invention is also intended to comprise these changes and modification interior.

Claims (16)

1.一种基于可伸缩视频编码SVC的动态丢包控制方法,其特征在于,包括:1. A dynamic packet loss control method based on Scalable Video Coding SVC, characterized in that, comprising: 服务器接收客户端发送的控制信令,其中所述控制信令为所述客户端根据对自身播放的视频资源的质量的监控结果生成,该控制信令中携带对采用SVC的视频资源的相应层进行调整的参数信息;The server receives the control signaling sent by the client, wherein the control signaling is generated by the client according to the monitoring result of the quality of the video resource played by the client, and the control signaling carries the corresponding layer of the video resource using SVC Parameter information for adjustment; 服务器解析获取所述参数信息,并根据保存的上一时刻的视频资源的相应层的截断阈值,确定当前时刻视频资源的相应层的截断阈值;The server parses and obtains the parameter information, and determines the cut-off threshold of the corresponding layer of the video resource at the current moment according to the saved cut-off threshold of the corresponding layer of the video resource at the previous moment; 根据确定的所述相应层的截断阈值,及待传输的视频资源的每个数据包的NalType信息的值,判断对该数据包是否进行丢包处理。According to the determined truncation threshold of the corresponding layer and the value of the NalType information of each data packet of the video resource to be transmitted, it is judged whether to perform packet loss processing on the data packet. 2.如权利要求1所述的方法,其特征在于,扩展实时流协议的一个域,通过扩展的域传输所述控制信令。2. The method according to claim 1, characterized in that a field of the real-time streaming protocol is extended, and the control signaling is transmitted through the extended field. 3.如权利要求2所述的方法,其特征在于,所述方法还包括:3. The method of claim 2, further comprising: 采用确定的当前时刻视频资源的相应层的截断阈值,对保存的上一时刻的视频资源的相应层的截断阈值进行更新。Using the determined truncation threshold of the corresponding layer of the video resource at the current moment, the saved truncation threshold of the corresponding layer of the video resource at the previous moment is updated. 4.如权利要求3所述的方法,其特征在于,当该待传输的数据包的NalType信息值为14时,判断对该数据包是否进行丢包处理包括:4. The method according to claim 3, wherein, when the NalType information value of the data packet to be transmitted is 14, judging whether the data packet is discarded includes: 将当前截断标记设置为假;set the current truncation flag to false; 根据待传输数据包对应的空间层,及确定的空间层截断阈值,确定是否置截断标记为真;According to the spatial layer corresponding to the data packet to be transmitted, and the determined spatial layer truncation threshold, determine whether to set the truncation flag as true; 当将截断标记置为真时,对该数据包进行丢包处理;When the truncation flag is set to true, the data packet is discarded; 当将截断标记置为假时,根据该待传输数据包对应的时间层,以及确定的时间层截断阈值,确定是否将截断标记设置为真;When the truncation flag is set to false, determine whether the truncation flag is set to true according to the time layer corresponding to the data packet to be transmitted, and the determined time layer truncation threshold; 当将截断标记设置为真时,对该数据包进行丢包处理。When the truncate flag is set to true, the packet is dropped. 5.如权利要求3所述的方法,其特征在于,当该待传输的数据包的NalType信息值为1或5时,判断对该数据包是否进行丢包处理包括:5. The method according to claim 3, wherein, when the NalType information value of the data packet to be transmitted is 1 or 5, judging whether the packet is discarded includes: 判断截断标记是否为真;Determine whether the truncation flag is true; 当确定截断标记为真时,对该数据包进行丢包处理;When it is determined that the truncation flag is true, the packet is discarded; 当确定截断标记为假,待传输的数据包的空间层标记等于空间层截断阈值,并且质量层截断阈值为0时,写入帧结束标记,并置截断标记为真。When it is determined that the truncation flag is false, the space layer flag of the data packet to be transmitted is equal to the space layer truncation threshold, and the quality layer truncation threshold is 0, the frame end flag is written, and the truncation flag is set as true. 6.如权利要求3所述的方法,其特征在于,当该待传输的数据包的NalType信息值为20时,判断对该数据包是否进行丢包处理包括:6. The method according to claim 3, wherein, when the NalType information value of the data packet to be transmitted is 20, judging whether the data packet is discarded includes: 检测当前的截断标记是否为真;Check if the current truncation flag is true; 当确定当前的截断标记为真时,对该数据包进行丢包处理;When it is determined that the current truncation flag is true, the packet is discarded; 当该待传输的数据包的空间层标记等于空间层对应的截断阈值,该数据包质量层标记等于质量层对应的截断阈值时,写入帧结束标记,并置截断标记为真。When the space layer mark of the data packet to be transmitted is equal to the truncation threshold value corresponding to the space layer, and the quality layer mark of the data packet is equal to the truncation threshold value corresponding to the quality layer, the frame end mark is written, and the truncation mark is set as true. 7.如权利要求4、5或6所述的方法,其特征在于,截断标记的确定包括:7. The method according to claim 4, 5 or 6, wherein the determination of the truncation marker comprises: 检测当前数据帧中的14号数据包的时间层标记是否大于时间层对应的截断阈值;Detect whether the time layer mark of the No. 14 data packet in the current data frame is greater than the truncation threshold corresponding to the time layer; 当该数据包的时间层标记大于时间层对应的截断阈值时,设置截断标记为真。When the time layer flag of the data packet is greater than the truncation threshold corresponding to the time layer, set the truncation flag to be true. 8.如权利要求7所述的方法,其特征在于,截断标记的确定包括:8. The method of claim 7, wherein the determination of the truncation marker comprises: 检测当前数据帧中的14号数据包的空间层标记是否大于空间层对应的截断阈值;Detect whether the space layer mark of the No. 14 data packet in the current data frame is greater than the corresponding truncation threshold of the space layer; 当该数据包的空间层标记大于空间层对应的截断阈值时,设置截断标记为真。When the spatial layer flag of the data packet is greater than the truncation threshold corresponding to the spatial layer, set the truncation flag to true. 9.一种基于可伸缩视频编码SVC的动态丢包控制系统,其特征在于,所述系统包括:9. A dynamic packet loss control system based on Scalable Video Coding SVC, characterized in that said system comprises: 客户端,用于根据对自身播放的视频资源的质量的监控结果生成控制信令,并将所述控制信令发送到服务器,其中,该控制信令中携带对采用SVC的视频资源的相应层进行调整的参数信息;The client is configured to generate control signaling according to the monitoring result of the quality of the video resource played by itself, and send the control signaling to the server, wherein the control signaling carries the corresponding layer of the video resource using SVC Parameter information for adjustment; 服务器,用于接收所述控制信令,解析获得该控制信令中携带的对采用SVC的视频资源的相应层进行调整的参数信息,并根据保存的上一时刻的视频资源的相应层的截断阈值,确定当前时刻视频资源的相应层的截断阈值,根据确定的所述相应层的截断阈值,及待传输的视频资源的每个数据包的NalType信息的值,判断对该数据包是否进行丢包处理。The server is configured to receive the control signaling, analyze and obtain the parameter information carried in the control signaling to adjust the corresponding layer of the video resource using SVC, and truncate the corresponding layer of the video resource according to the saved previous moment. Threshold, determine the truncation threshold of the corresponding layer of the video resource at the current moment, and judge whether to discard the data packet according to the determined truncation threshold of the corresponding layer and the value of the NalType information of each data packet of the video resource to be transmitted Package processing. 10.一种基于可伸缩视频编码SVC的动态丢包控制装置,其特征在于,所述装置包括:10. A dynamic packet loss control device based on Scalable Video Coding SVC, characterized in that the device comprises: 接收模块,用于接收客户端发送的控制信令,其中所述控制信令为所述客户端根据对自身播放的视频资源的质量的监控结果生成,该控制信令中携带对采用SVC的视频资源的相应层进行调整的参数信息;The receiving module is used to receive the control signaling sent by the client, wherein the control signaling is generated by the client according to the monitoring results of the quality of the video resources played by itself, and the control signaling carries the video information using SVC The parameter information adjusted by the corresponding layer of the resource; 确定模块,用于解析获取所述参数信息,并根据保存的上一时刻的视频资源的相应层的截断阈值,确定当前时刻视频资源的相应层的截断阈值;The determination module is used to analyze and obtain the parameter information, and determine the truncation threshold of the corresponding layer of the video resource at the current moment according to the truncation threshold of the corresponding layer of the video resource at the previous moment saved; 丢包处理模块,用于根据确定的所述相应层的截断阈值,及待传输的视频资源的每个数据包的NalType信息的值,判断对该数据包是否进行丢包处理。The packet loss processing module is used to determine whether to perform packet loss processing on the data packet according to the determined truncation threshold of the corresponding layer and the value of the NalType information of each data packet of the video resource to be transmitted. 11.如权利要求10所述的装置,其特征在于,所述装置还包括:11. The device of claim 10, further comprising: 更新模块,用于采用确定的当前时刻视频资源的相应层的截断阈值,对保存的上一时刻的视频资源的相应层的截断阈值进行更新。The update module is configured to update the saved truncation threshold of the corresponding layer of the video resource at the previous moment by adopting the determined truncation threshold of the corresponding layer of the video resource at the current moment. 12.如权利要求11所述的装置,其特征在于,所述丢包处理模块具体用于,当该待传输的数据包的NalType信息值为14时,将截断标记设置为假,根据待传输数据包对应的空间层标记,及确定的空间层截断阈值,确定是否将截断标记设置为真,当将截断标记置为真时,对该数据包进行丢包处理;当将截断标记置为假时,根据该待传输数据包对应的时间层标记,以及确定的时间层截断阈值,确定是否将截断标记设置为真,当将截断标记设置为真时,对该数据包进行丢包处理。12. The device according to claim 11, wherein the packet loss processing module is specifically configured to, when the NalType information value of the data packet to be transmitted is 14, the truncation flag is set to false, according to the data packet to be transmitted The space layer mark corresponding to the data packet, and the determined space layer truncation threshold determine whether the truncation mark is set to true, and when the truncation mark is set to true, the packet is discarded; when the truncation mark is set to false , according to the time layer flag corresponding to the data packet to be transmitted, and the determined time layer truncation threshold, determine whether the truncation flag is set to true, and when the truncation flag is set to true, the data packet is discarded. 13.如权利要求11所述的装置,其特征在于,所述丢包处理模块具体用于,当该待传输的数据包的NalType信息值为1或5时,判断截断标记是否为真,当确定截断标记为真时,对该数据包进行丢包处理;13. The device according to claim 11, wherein the packet loss processing module is specifically configured to, when the NalType information value of the data packet to be transmitted is 1 or 5, determine whether the truncation flag is true, when When it is determined that the truncation flag is true, the packet is discarded; 当确定截断标记为假,待传输的数据包的空间层标记等于空间层截断阈值,并且质量层截断阈值为0时,写入帧结束标记,并置截断标记为真。When it is determined that the truncation flag is false, the space layer flag of the data packet to be transmitted is equal to the space layer truncation threshold, and the quality layer truncation threshold is 0, the frame end flag is written, and the truncation flag is set as true. 14.如权利要求11所述的装置,其特征在于,所述丢包处理模块具体用于,当该待传输的数据包的NalType信息值为20时,检测当前截断标识是否为真,当确定当前的截断标记为真时,对该数据包进行丢包处理;14. The device according to claim 11, wherein the packet loss processing module is specifically configured to, when the NalType information value of the data packet to be transmitted is 20, detect whether the current truncation flag is true, when it is determined When the current truncation flag is true, the packet is discarded; 当该待传输的数据包的空间层标记等于空间层对应的截断阈值,该数据包质量层标记等于质量层对应的截断阈值时,写入帧结束标记,并置截断标记为真。When the space layer mark of the data packet to be transmitted is equal to the truncation threshold value corresponding to the space layer, and the quality layer mark of the data packet is equal to the truncation threshold value corresponding to the quality layer, the frame end mark is written, and the truncation mark is set as true. 15.如权利要求12、13或14所述的装置,其特征在于,所述丢包处理模块具体用于:15. The device according to claim 12, 13 or 14, wherein the packet loss processing module is specifically used for: 检测当前数据帧中的14号数据包的时间层标记是否大于时间层对应的截断阈值,当该数据包的时间层标记大于时间层对应的截断阈值时,设置截断标记为真。Detect whether the time layer mark of No. 14 data packets in the current data frame is greater than the corresponding truncation threshold of the time layer, when the time layer mark of the data packet is greater than the corresponding truncation threshold of the time layer, set the truncation mark to be true. 16.如权利要求15所述的装置,其特征在于,所述丢包处理模块具体用于,检测当前数据帧中的14号数据包的空间层标记是否大于空间层对应的截断阈值,当该数据包的空间层标记大于空间层对应的截断阈值时,设置截断标记为真。16. The device according to claim 15, wherein the packet loss processing module is specifically used to detect whether the spatial layer mark of the No. 14 data packet in the current data frame is greater than the corresponding truncation threshold of the spatial layer, when the Set the truncation flag to true when the spatial layer flag of the packet is greater than the truncation threshold corresponding to the spatial layer.
CN201010618196.2A 2010-12-22 2010-12-22 Method, system and device for dynamic packet loss control based on scalable video coding Expired - Fee Related CN102572420B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201010618196.2A CN102572420B (en) 2010-12-22 2010-12-22 Method, system and device for dynamic packet loss control based on scalable video coding

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201010618196.2A CN102572420B (en) 2010-12-22 2010-12-22 Method, system and device for dynamic packet loss control based on scalable video coding

Publications (2)

Publication Number Publication Date
CN102572420A CN102572420A (en) 2012-07-11
CN102572420B true CN102572420B (en) 2014-04-02

Family

ID=46416731

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201010618196.2A Expired - Fee Related CN102572420B (en) 2010-12-22 2010-12-22 Method, system and device for dynamic packet loss control based on scalable video coding

Country Status (1)

Country Link
CN (1) CN102572420B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1829326A (en) * 2005-03-04 2006-09-06 三星电子株式会社 Color space scalability video encoding and decoding method and device thereof
WO2007035147A1 (en) * 2005-09-23 2007-03-29 Telefonaktiebolaget Lm Ericsson (Publ) Adaptive source signal encoding
CN101601305A (en) * 2006-10-20 2009-12-09 诺基亚公司 Be used for the general indication of the Adaptive Path of scalable multimedia
CN101888561A (en) * 2010-07-02 2010-11-17 西南交通大学 A rate-distortion optimization and dynamic adjustment method for multi-view video transmission error control

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7072394B2 (en) * 2002-08-27 2006-07-04 National Chiao Tung University Architecture and method for fine granularity scalable video coding

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1829326A (en) * 2005-03-04 2006-09-06 三星电子株式会社 Color space scalability video encoding and decoding method and device thereof
WO2007035147A1 (en) * 2005-09-23 2007-03-29 Telefonaktiebolaget Lm Ericsson (Publ) Adaptive source signal encoding
CN101601305A (en) * 2006-10-20 2009-12-09 诺基亚公司 Be used for the general indication of the Adaptive Path of scalable multimedia
CN101888561A (en) * 2010-07-02 2010-11-17 西南交通大学 A rate-distortion optimization and dynamic adjustment method for multi-view video transmission error control

Also Published As

Publication number Publication date
CN102572420A (en) 2012-07-11

Similar Documents

Publication Publication Date Title
JP6022608B2 (en) Customized playback on sink devices in wireless display systems
CN102395027B (en) System and method for transferring multiple data channels
JP4321284B2 (en) Streaming data transmission apparatus and information distribution system
RU2601442C2 (en) Method and apparatus for transmitting/receiving media contents in multimedia system
CN101116308B (en) Method for signaling buffer parameters, communication system, terminal, server and method for determining buffer status
CN106105141A (en) Realize the delivery acceleration device of extension transmission control function
CN102130886B (en) Network video streaming media system, transmission processing method, transmitting end
CN102143130B (en) Method, device and system for acquiring key information in rapid channel switching
CN102006501B (en) Streaming media play control method and device and streaming media player
FR2921529B1 (en) METHOD OF TRANSMITTING DATA FROM AN INFRASTRUCTURE OF A RADIO COMMUNICATION NETWORK TO USER EQUIPMENT, AND EQUIPMENT FOR IMPLEMENTING THE METHOD
EP3281317B1 (en) Multi-layer timing synchronization framework
CN102164276A (en) A streaming media processing method and system
CN102572420B (en) Method, system and device for dynamic packet loss control based on scalable video coding
CN102340442A (en) Method for adjusting interface receiving queue length and apparatus thereof
KR101196451B1 (en) Apparatus and method for transfering bitstream
US11853261B2 (en) Coded-caching in a wireless communication network
CN104753815A (en) Flow cache based transparent transmission acceleration network and method
KR101148072B1 (en) Multimedia supporting system and method thereof
CN113038289A (en) Method for sending and receiving video data, terminal equipment and server
JP2014039183A (en) Communication device
JP2002064438A (en) Wireless data transmission system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20220621

Address after: 100871 No. 5, the Summer Palace Road, Beijing, Haidian District

Patentee after: Peking University

Patentee after: New founder holdings development Co.,Ltd.

Patentee after: BEIJING FOUNDER ELECTRONICS Co.,Ltd.

Address before: 100871 No. 5, the Summer Palace Road, Beijing, Haidian District

Patentee before: Peking University

Patentee before: PEKING UNIVERSITY FOUNDER GROUP Co.,Ltd.

Patentee before: BEIJING FOUNDER ELECTRONICS Co.,Ltd.

TR01 Transfer of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20140402

CF01 Termination of patent right due to non-payment of annual fee