[go: up one dir, main page]

CN109886337B - Depth measurement learning method and system based on self-adaptive sampling - Google Patents

Depth measurement learning method and system based on self-adaptive sampling Download PDF

Info

Publication number
CN109886337B
CN109886337B CN201910134063.9A CN201910134063A CN109886337B CN 109886337 B CN109886337 B CN 109886337B CN 201910134063 A CN201910134063 A CN 201910134063A CN 109886337 B CN109886337 B CN 109886337B
Authority
CN
China
Prior art keywords
metric
training
sampler
network
sampling
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910134063.9A
Other languages
Chinese (zh)
Other versions
CN109886337A (en
Inventor
鲁继文
周杰
郑文钊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tsinghua University
Original Assignee
Tsinghua University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tsinghua University filed Critical Tsinghua University
Priority to CN201910134063.9A priority Critical patent/CN109886337B/en
Publication of CN109886337A publication Critical patent/CN109886337A/en
Application granted granted Critical
Publication of CN109886337B publication Critical patent/CN109886337B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Image Analysis (AREA)
  • Length Measuring Devices With Unspecified Measuring Means (AREA)

Abstract

本发明公开了一种基于自适应采样的深度度量学习方法及系统,其中,该方法包括以下步骤:通过采样器采样得到采样样本;根据采样样本更新度量网络;通过更新后的度量网络在验证集下的表现训练采样器;通过训练后的采样器训练度量网络;根据样本图片通过训练后的度量网络获取测试样本的在度量空间下的表示。该方法通过使用一个可学习的采样器,自适应地对训练集中的样本进行采样,并使用元学习的方法,并通过最大化度量网络的泛化能力来训练采样器,从而可以整合到目前多数深度度量学习方法中的模块。

Figure 201910134063

The invention discloses a deep metric learning method and system based on adaptive sampling, wherein the method includes the following steps: sampling samples by a sampler; updating a metric network according to the sampling samples; The performance of the training sampler under the training; through the training of the sampler to train the metric network; according to the sample picture through the trained metric network to obtain the representation of the test sample in the metric space. The method uses a learnable sampler to adaptively sample the samples in the training set, and uses a meta-learning method to train the sampler by maximizing the generalization ability of the metric network. Modules in Deep Metric Learning Methods.

Figure 201910134063

Description

Depth measurement learning method and system based on self-adaptive sampling
Technical Field
The invention relates to the technical field of computer vision and machine learning, in particular to a depth measurement learning method and system based on adaptive sampling.
Background
Vision is the largest source of information for humans to obtain outside information. With the development of electronic technology, various visual sensors are applied in real life, and a large number of images are generated to record various information, so that it becomes impossible to simply rely on human to find required information from a large number of pictures. Therefore, it is desirable to extract information in an image by a computer. In computer vision, people need to model related information transmitted in images, and feature learning is to learn vectors to accurately and efficiently express information in the images. The goal of metric learning is to learn a distance to accurately and robustly characterize the correlation between features.
Metric learning can be widely applied to various visual applications, such as image retrieval, face recognition, pedestrian re-recognition, target tracking, object recognition, blood relationship verification and the like. Large-scale monitoring systems not only play a very large role in the criminal investigation field, but are also increasingly used in security maintenance of enterprises, schools, and the like. In order to extract effective information from the surveillance video, it is often necessary to analyze the people therein. The monitoring system is generally composed of a plurality of cameras, and therefore cooperation among the plurality of cameras is an important issue. The similarity between two pedestrians can be measured through the learned measure, and then the positions of the same person at different times can be obtained. In addition, the face recognition can be carried out on people entering the monitoring system, the similarity comparison is carried out between the learned measurement and the blacklist in the database, and dangerous people can be found in time.
Training of the depth metric learning method typically includes two phases, data sampling and network updating. In the data sampling phase, a small batch is first sampled, either randomly or in some pattern, from the entire training data set and then organized into a structure. In the network updating stage, the loss of the small batch is calculated according to the definition of the optimization target, and then the network is updated by using a back propagation algorithm.
The current research on the aspect of depth metric learning is divided into two directions, wherein one direction is improvement on a network optimization target, including a sample structure based on which the optimization target is selected and direct improvement on a loss function. For example, Wang et al consider the third order geometric information in the triplet, optimize the distance relationship between samples by limiting the angle at the negative sample, avoid using the absolute distance between samples, achieve scale invariance, and improve the robustness of the optimization target with respect to feature changes. Movshovit et al propose a triple loss function based on proxy points, which enables one proxy point to represent information of a plurality of sample points by reasonably selecting and continuously updating the proxy points, so that the loss function based on several proxy points can limit the relationship among a plurality of sample points, utilize the overall information of the sample, and avoid sampling all the sample points. Another direction is to improve the data sampling strategy, including how to construct small batches from a large number of samples in the training set, and how to sample useful samples for training from the small batches. For example, Sohn proposes a small lot organization called N-pair, which can more efficiently use all sample information in a small lot. Song et al propose to expand the distance vector of the sample pairs in the small lot to a distance matrix consisting of the distances between every two samples, which can make more full use of the correlation between the samples, thereby improving the efficiency of using the small lot.
While many of the current sampling strategies have proven effective in experimentation, there are two problems with them. The first problem is that they are all strategies pre-designed according to a priori knowledge, but at present there is no good standard to determine what sampling strategy is optimal; the second problem is that it is fixed during the training process of the metrology network, and thus cannot adaptively sample the samples that are most helpful for the metrology network training. The development of meta-learning in recent years makes it possible to train a sampler by means of meta-learning.
Disclosure of Invention
The present invention is directed to solving, at least to some extent, one of the technical problems in the related art.
Therefore, an object of the present invention is to provide a depth metric learning method based on adaptive sampling, which can improve the performance of the final learned metric and improve the generalization capability of the learned metric, thereby improving the performance of the depth metric learning method.
Another objective of the present invention is to provide an adaptive sampling-based depth metric learning system.
In order to achieve the above object, the present invention provides a depth metric learning method based on adaptive sampling, including the following steps: step S1, sampling by a sampler to obtain a sampling sample; step S2, updating the measurement network according to the sampling sample; step S3, training the sampler through the updated performance of the measurement network under the verification set; step S4, training the measurement network through the trained sampler; and step S5, obtaining the representation of the test sample in the measurement space through the trained measurement network according to the sample picture.
According to the depth measurement learning method based on the self-adaptive sampling, disclosed by the embodiment of the invention, a learnable sampler can interact with a measurement network, so that the performance of finally learned measurement can be improved; the sampler is trained by taking the updated performance of the metric on the verification set as a meta-objective function in a meta-learning mode, so that the generalization capability of the learned metric is improved; meanwhile, the depth metric learning method can be integrated into a generator module in most depth metric learning models at present, and the performance of the depth metric learning method is improved.
In addition, the depth metric learning method based on adaptive sampling according to the above embodiment of the present invention may further have the following additional technical features:
further, in an embodiment of the present invention, the step S1 includes: and sampling samples in different orders by adopting corresponding sampling strategies according to the sample input sequence, and updating the sampler in the training process of the measurement network.
Further, in an embodiment of the present invention, the update formula of the metric network is:
Figure GDA0003098018870000031
wherein, θ represents the parameter of the metric network, α is the training learning rate thereof, T represents a tuple, { T } tr represents all tuples in a small batch of training sets, s is the sampler, Φ is the parameter thereof, and L is the training loss function of the metric network.
Further, in an embodiment of the present invention, the training formula of the sampler is:
Figure GDA0003098018870000032
where φ represents the parameters of the sampler, β is its training learning rate, T' represents a tuple, { T } va represents all tuples in a small batch validation set, and L is the training loss function of the metric network.
Further, in an embodiment of the present invention, the training formula of the metric network is:
Figure GDA0003098018870000033
where θ represents the parameters of the metric network, α is its training learning rate, T represents a tuple, { T } tr represents all tuples in a small batch of training sets, s is the sampler, φ*For it after renewalL is a training loss function of the metric network.
In order to achieve the above object, another aspect of the present invention provides an adaptive sampling-based depth metric learning system, including: the sampling module is used for obtaining a sampling sample by sampling through the sampler; an update module for updating the metric network according to the sampling samples; a first training module, configured to train the sampler through the updated performance of the metric network in a validation set; a second training module for training the metric network through the trained sampler; and the acquisition module is used for acquiring the representation of the test sample in the measurement space through the trained measurement network according to the sample picture.
According to the depth measurement learning system based on the self-adaptive sampling, the learnable sampler can interact with the measurement network, and the performance of the final learned measurement can be improved; the sampler is trained by taking the updated performance of the metric on the verification set as a meta-objective function in a meta-learning mode, so that the generalization capability of the learned metric is improved; meanwhile, the depth metric learning method can be integrated into a generator module in most depth metric learning models at present, and the performance of the depth metric learning method is improved.
In addition, the depth metric learning system based on adaptive sampling according to the above embodiment of the present invention may also have the following additional technical features:
further, in an embodiment of the present invention, the sampling module is further configured to sample samples in different orders according to the sample input order by using corresponding sampling strategies, and update the sampler in a training process of the metric network.
Further, in an embodiment of the present invention, the update formula of the metric network is:
Figure GDA0003098018870000041
wherein, θ represents the parameter of the metric network, α is the training learning rate thereof, T represents a tuple, { T } tr represents all tuples in a small batch of training sets, s is the sampler, Φ is the parameter thereof, and L is the training loss function of the metric network.
Further, in an embodiment of the present invention, the training formula of the sampler is:
Figure GDA0003098018870000042
where φ represents the parameters of the sampler, β is its training learning rate, T' represents a tuple, { T } va represents all tuples in a small batch validation set, and L is the training loss function of the metric network.
Further, in an embodiment of the present invention, the training formula of the metric network is:
Figure GDA0003098018870000043
where θ represents the parameters of the metric network, α is its training learning rate, T represents a tuple, { T } tr represents all tuples in a small batch of training sets, s is the sampler, φ*For its parameters after updating, L is the training loss function of the metric network.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The foregoing and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a flow chart of a depth metric learning method based on adaptive sampling according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a detailed network structure of the sampling process of step S1 according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a depth metric learning system based on adaptive sampling according to an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.
The following describes a depth metric learning method and system based on adaptive sampling proposed in an embodiment of the present invention with reference to the drawings, and first, a depth metric learning method based on adaptive sampling proposed in an embodiment of the present invention will be described with reference to the drawings.
Fig. 1 is a flowchart of a depth metric learning method based on adaptive sampling according to an embodiment of the present invention.
As shown in fig. 1, the depth metric learning method based on adaptive sampling includes the following steps:
step S1, obtaining a sample by sampling with a sampler.
Further, in an embodiment of the present invention, the step S1 includes: and sampling samples in different orders by adopting corresponding sampling strategies according to the sample input sequence, and updating the sampler in the training process of the measurement network.
It should be noted that, the embodiment of the present invention uses a learnable sampler to perform adaptive sampling, and uses a meta-learning method to train the sampler.
Specifically, as shown in fig. 2, for a small batch, the samples are divided into a training set and a testing set. For the samples in the training set, a series of weights are obtained by sequentially passing the samples through the sampler, and the loss function of the small batch is calculated by weighting the corresponding samples by the weights:
Figure GDA0003098018870000051
firstly, because different sample input sequences have an influence on the training of the network, the sampler needs to use different strategies to sample samples in different sequences; secondly, the sampler needs to update itself continuously in the training process of the measurement network, and a better effect is achieved through interaction between the sampler and the measurement network. Thus, the present invention uses a learnable long-short term memory model as a sampler that outputs different results for different input sequences.
Step S2, updating the metric network according to the sample.
Further, in one embodiment of the present invention, the update formula of the metric network is:
Figure GDA0003098018870000052
wherein, θ represents the parameter of the metric network, α is the training learning rate thereof, T represents a tuple, { T } tr represents all tuples in a small batch of training sets, s is the sampler, Φ is the parameter thereof, and L is the training loss function of the metric network.
That is, on the training set, a one-step random gradient update is performed on the metric network using a weighted loss function.
Step S3, training the sampler through the updated performance of the metric network under the validation set.
Further, in one embodiment of the present invention, the training formula of the sampler is:
Figure GDA0003098018870000053
where φ represents the parameters of the sampler, β is its training learning rate, T' represents a tuple, { T } va represents all tuples in a small batch validation set, and L is the training loss function of the metric network.
That is, after a metric update, embodiments of the present invention evaluate it for performance on a validation set, specifically using an unweighted loss function to measure its performance. Since the updated metrics are affected by the sampler, embodiments of the invention may train the sampler using the loss function on the validation set:
Figure GDA0003098018870000061
it is noted that training on the training set and testing on the validation set this process simulates training and testing of the network in the usual sense, so maximizing test performance can improve the generalization ability of the measured network.
Step S4, training the metric network by the trained sampler.
Further, after the sampler is updated, the embodiment of the present invention trains the original metric network by using the sampler, wherein the training formula of the metric network is as follows:
Figure GDA0003098018870000062
in the formula, theta represents the parameter of the measurement network, alpha is the training learning rate of the measurement network, T represents a multi-tuple, { T } tr represents all the multi-tuples in a small-batch training set, s is a sampler, phi*For its parameters after updating, L is the training loss function of the metric network.
And step S5, obtaining the representation of the test sample in the measurement space through the trained measurement network according to the sample picture.
In other words, after the entire network is trained, the representation of the test sample in the metric space is directly obtained from the sample picture through the metric network without using a sampler, which is only used during the training process of the network.
In summary, in the embodiments of the present invention, a pre-designed fixed sampling method is mostly used in the current depth metric learning, and the pre-designed fixed sampling method cannot be adjusted along with the training process, so that the sampling method cannot be optimized. Therefore, the embodiment of the invention uses a long-short term memory model as a learnable sampler and trains the sampler by means of meta-learning. First, the samples in the small lot are divided into a training set and a verification set, and for each sample in the training set, a weight is generated using a sampler. Second, the weighted loss function is used to train the metric model and tested on the validation set to update the sampler. Finally, the metric model is trained using the updated samplers. After the network training is finished, a sampler is not needed for the test sample, so that no additional calculation process is introduced in the practical application.
Stated another way, firstly, a depth network is used for a picture to obtain a vector representation of the picture in a metric space; the sampler then samples each sample with a weight using a long short term memory model (LSTM) and calculates a weighted loss function; updating the metric network using the weighted loss function and training the sampler by its behavior on the validation set; finally, optimizing the measurement network by using the trained sampler; and updating the measurement network and the sampler network in each small batch, wherein the measurement network and the sampler network interact and influence with each other in the training process, and finally learning a measurement with accuracy and strong generalization capability.
According to the depth measurement learning method based on the self-adaptive sampling provided by the embodiment of the invention, a learnable sampler can interact with a measurement network, so that the performance of finally learned measurement can be improved; the sampler is trained by taking the updated performance of the metric on the verification set as a meta-objective function in a meta-learning mode, so that the generalization capability of the learned metric is improved; meanwhile, the depth metric learning method can be integrated into a generator module in most depth metric learning models at present, and the performance of the depth metric learning method is improved.
Next, a depth metric learning system based on adaptive sampling proposed according to an embodiment of the present invention is described with reference to the drawings.
Fig. 3 is a structural diagram of a depth metric learning system based on adaptive sampling according to an embodiment of the present invention.
As shown in fig. 3, the adaptive sampling-based depth metric learning system 10 includes: a sampling module 100, an update module 200, a first training module 300, a second training module 400, and an acquisition module 500.
The sampling module 100 is configured to obtain a sample by sampling with a sampler.
Further, in an embodiment of the present invention, the sampling module 100 is further configured to sample samples in different orders according to the sample input order by using corresponding sampling strategies, and update the sampler during the training process of the metrology network.
The update module 200 is configured to update the metric network based on the sample.
Further, in one embodiment of the present invention, the update formula of the metric network is:
Figure GDA0003098018870000071
wherein, θ represents the parameter of the metric network, α is the training learning rate thereof, T represents a tuple, { T } tr represents all tuples in a small batch of training sets, s is the sampler, Φ is the parameter thereof, and L is the training loss function of the metric network.
The first training module 300 is used to train the sampler through the updated metric network performance under the validation set.
Further, in one embodiment of the present invention, the training formula of the sampler is:
Figure GDA0003098018870000072
where φ represents the parameters of the sampler, β is its training learning rate, T' represents a tuple, { T } va represents all tuples in a small batch validation set, and L is the training loss function of the metric network.
The second training module 400 is used to train the metric network through the trained sampler.
Wherein, the training formula of the measurement network is as follows:
Figure GDA0003098018870000073
in the formula, theta represents the parameter of the measurement network, alpha is the training learning rate of the measurement network, T represents a multi-tuple, { T } tr represents all the multi-tuples in a small-batch training set, s is a sampler, phi*For its parameters after updating, L is the training loss function of the metric network.
The obtaining module 500 is configured to obtain a representation of the test sample in the metric space through the trained metric network according to the sample picture.
It should be noted that the foregoing explanation of the depth metric learning method based on adaptive sampling is also applicable to the system, and is not repeated here.
According to the depth measurement learning system based on the self-adaptive sampling provided by the embodiment of the invention, a learnable sampler can interact with a measurement network, so that the performance of finally learned measurement can be improved; the sampler is trained by taking the updated performance of the metric on the verification set as a meta-objective function in a meta-learning mode, so that the generalization capability of the learned metric is improved; meanwhile, the depth metric learning method can be integrated into a generator module in most depth metric learning models at present, and the performance of the depth metric learning method is improved. Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
In the present invention, unless otherwise expressly stated or limited, the terms "mounted," "connected," "secured," and the like are to be construed broadly and can, for example, be fixedly connected, detachably connected, or integrally formed; can be mechanically or electrically connected; they may be directly connected or indirectly connected through intervening media, or they may be connected internally or in any other suitable relationship, unless expressly stated otherwise. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
In the present invention, unless otherwise expressly stated or limited, the first feature "on" or "under" the second feature may be directly contacting the first and second features or indirectly contacting the first and second features through an intermediate. Also, a first feature "on," "over," and "above" a second feature may be directly or diagonally above the second feature, or may simply indicate that the first feature is at a higher level than the second feature. A first feature being "under," "below," and "beneath" a second feature may be directly under or obliquely under the first feature, or may simply mean that the first feature is at a lesser elevation than the second feature.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.

Claims (8)

1.一种基于自适应采样的深度度量学习方法,其特征在于,包括以下步骤:1. a deep metric learning method based on adaptive sampling, is characterized in that, comprises the following steps: 步骤S1,通过采样器采样得到采样样本;Step S1, sampling samples through a sampler to obtain sampling samples; 步骤S2,根据所述采样样本更新度量网络;Step S2, update the metric network according to the sampling sample; 步骤S3,通过更新后的所述度量网络在验证集下的表现训练所述采样器;Step S3, train the sampler by the updated performance of the metric network under the validation set; 步骤S4,通过训练后的所述采样器训练所述度量网络;以及Step S4, training the metric network through the trained sampler; and 步骤S5,根据样本图片通过训练后的所述度量网络获取测试样本的在度量空间下的表示,其中,所述度量网络的训练公式为:Step S5, obtaining the representation of the test sample in the metric space through the metric network after training according to the sample picture, wherein the training formula of the metric network is:
Figure FDA0003098018860000011
Figure FDA0003098018860000011
其中,θ表示度量网络的参数,α为其训练学习率,T表示一个多元组,{T}tr表示一个小批量训练集中的所有多元组,s为采样器,φ*为其参在更新后的参数,L为度量网络的训练损失函数。where θ represents the parameters of the metric network, α is the training learning rate, T represents a tuple, {T}tr represents all tuples in a mini-batch training set, s is the sampler, and φ * is the parameter after updating , L is the training loss function of the metric network.
2.根据权利要求1所述的基于自适应采样的深度度量学习方法,其特征在于,所述步骤S1包括:2. The deep metric learning method based on adaptive sampling according to claim 1, wherein the step S1 comprises: 根据样本输入顺序采用对应采样策略对不同次序的样本进行采样,并在度量网络的训练过程中更新所述采样器。Samples in different orders are sampled by corresponding sampling strategies according to the sample input order, and the sampler is updated during the training process of the metric network. 3.根据权利要求1所述的基于自适应采样的深度度量学习方法,其特征在于,所述度量网络的更新公式为:3. the deep metric learning method based on adaptive sampling according to claim 1, is characterized in that, the update formula of described metric network is:
Figure FDA0003098018860000012
Figure FDA0003098018860000012
其中,θ表示度量网络的参数,α为其训练学习率,T表示一个多元组,{T}tr表示一个小批量训练集中的所有多元组,s为采样器,φ为其参数,L为度量网络的训练损失函数。where θ represents the parameters of the metric network, α is the training learning rate, T represents a tuple, {T}tr represents all tuples in a mini-batch training set, s is the sampler, φ is the parameter, and L is the metric The training loss function of the network.
4.根据权利要求3所述的基于自适应采样的深度度量学习方法,其特征在于,所述采样器的训练公式为:4. The deep metric learning method based on adaptive sampling according to claim 3, is characterized in that, the training formula of described sampler is:
Figure FDA0003098018860000013
Figure FDA0003098018860000013
其中,φ表示采样器的参数,β为其训练学习率,T'表示一个多元组,{T}va表示一个小批量验证集中的所有多元组,L为度量网络的训练损失函数。where φ represents the parameters of the sampler, β is the training learning rate, T' represents a tuple, {T}va represents all tuples in a mini-batch validation set, and L is the training loss function of the metric network.
5.一种基于自适应采样的深度度量学习系统,其特征在于,包括:5. A deep metric learning system based on adaptive sampling is characterized in that, comprising: 采样模块,用于通过采样器采样得到采样样本;The sampling module is used to obtain sampling samples through sampling by the sampler; 更新模块,用于根据所述采样样本更新度量网络;an update module for updating the metric network according to the sampling sample; 第一训练模块,用于通过更新后的所述度量网络在验证集下的表现训练所述采样器;a first training module, used to train the sampler through the updated performance of the metric network under the validation set; 第二训练模块,用于通过训练后的所述采样器训练所述度量网络;以及a second training module for training the metric network through the trained sampler; and 获取模块,用于根据样本图片通过训练后的所述度量网络获取测试样本的在度量空间下的表示,其中,所述度量网络的训练公式为:The acquisition module is used to obtain the representation of the test sample in the metric space through the trained metric network according to the sample picture, wherein the training formula of the metric network is:
Figure FDA0003098018860000021
Figure FDA0003098018860000021
其中,θ表示度量网络的参数,α为其训练学习率,T表示一个多元组,{T}tr表示一个小批量训练集中的所有多元组,s为采样器,φ*为其参在更新后的参数,L为度量网络的训练损失函数。where θ represents the parameters of the metric network, α is the training learning rate, T represents a tuple, {T}tr represents all tuples in a mini-batch training set, s is the sampler, and φ * is the parameter after updating , L is the training loss function of the metric network.
6.根据权利要求5所述的基于自适应采样的深度度量学习系统,其特征在于,所述采样模块进一步用于根据样本输入顺序采用对应采样策略对不同次序的样本进行采样,并在度量网络的训练过程中更新所述采样器。6. The deep metric learning system based on adaptive sampling according to claim 5, is characterized in that, described sampling module is further used for adopting corresponding sampling strategy to sample the samples of different orders according to the sample input order, and in the metric network. The sampler is updated during the training process. 7.根据权利要求5所述的基于自适应采样的深度度量学习系统,其特征在于,所述度量网络的更新公式为:7. The deep metric learning system based on adaptive sampling according to claim 5, is characterized in that, the update formula of described metric network is:
Figure FDA0003098018860000022
Figure FDA0003098018860000022
其中,θ表示度量网络的参数,α为其训练学习率,T表示一个多元组,{T}tr表示一个小批量训练集中的所有多元组,s为采样器,φ为其参数,L为度量网络的训练损失函数。where θ represents the parameters of the metric network, α is the training learning rate, T represents a tuple, {T}tr represents all tuples in a mini-batch training set, s is the sampler, φ is the parameter, and L is the metric The training loss function of the network.
8.根据权利要求7所述的基于自适应采样的深度度量学习系统,其特征在于,所述采样器的训练公式为:8. The deep metric learning system based on adaptive sampling according to claim 7, is characterized in that, the training formula of described sampler is:
Figure FDA0003098018860000023
Figure FDA0003098018860000023
其中,φ表示采样器的参数,β为其训练学习率,T'表示一个多元组,{T}va表示一个小批量验证集中的所有多元组,L为度量网络的训练损失函数。where φ represents the parameters of the sampler, β is the training learning rate, T' represents a tuple, {T}va represents all tuples in a mini-batch validation set, and L is the training loss function of the metric network.
CN201910134063.9A 2019-02-22 2019-02-22 Depth measurement learning method and system based on self-adaptive sampling Active CN109886337B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910134063.9A CN109886337B (en) 2019-02-22 2019-02-22 Depth measurement learning method and system based on self-adaptive sampling

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910134063.9A CN109886337B (en) 2019-02-22 2019-02-22 Depth measurement learning method and system based on self-adaptive sampling

Publications (2)

Publication Number Publication Date
CN109886337A CN109886337A (en) 2019-06-14
CN109886337B true CN109886337B (en) 2021-09-14

Family

ID=66928917

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910134063.9A Active CN109886337B (en) 2019-02-22 2019-02-22 Depth measurement learning method and system based on self-adaptive sampling

Country Status (1)

Country Link
CN (1) CN109886337B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110569982A (en) * 2019-08-07 2019-12-13 南京智谷人工智能研究院有限公司 Active sampling method based on meta-learning
CN112115993B (en) * 2020-09-11 2023-04-07 昆明理工大学 Zero sample and small sample evidence photo anomaly detection method based on meta-learning
US11977602B2 (en) * 2020-11-10 2024-05-07 Nec Corporation Domain generalized margin via meta-learning for deep face recognition
CN113128619B (en) * 2021-05-10 2022-05-31 北京瑞莱智慧科技有限公司 Method for training detection model of counterfeit sample, method for identifying counterfeit sample, apparatus, medium, and device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102663436A (en) * 2012-05-03 2012-09-12 武汉大学 Self-adapting characteristic extracting method for optical texture images and synthetic aperture radar (SAR) images
CN103778569A (en) * 2014-02-13 2014-05-07 上海交通大学 Distributed generation island detection method based on meta learning
CN106228512A (en) * 2016-07-19 2016-12-14 北京工业大学 Based on learning rate adaptive convolutional neural networks image super-resolution rebuilding method
CN107886133A (en) * 2017-11-29 2018-04-06 南京市测绘勘察研究院股份有限公司 A kind of underground piping defect inspection method based on deep learning
CN108694413A (en) * 2018-05-10 2018-10-23 广州大学 Adaptively sampled unbalanced data classification processing method, device, equipment and medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9031331B2 (en) * 2012-07-30 2015-05-12 Xerox Corporation Metric learning for nearest class mean classifiers
US9471828B2 (en) * 2014-07-28 2016-10-18 Adobe Systems Incorporated Accelerating object detection

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102663436A (en) * 2012-05-03 2012-09-12 武汉大学 Self-adapting characteristic extracting method for optical texture images and synthetic aperture radar (SAR) images
CN103778569A (en) * 2014-02-13 2014-05-07 上海交通大学 Distributed generation island detection method based on meta learning
CN106228512A (en) * 2016-07-19 2016-12-14 北京工业大学 Based on learning rate adaptive convolutional neural networks image super-resolution rebuilding method
CN107886133A (en) * 2017-11-29 2018-04-06 南京市测绘勘察研究院股份有限公司 A kind of underground piping defect inspection method based on deep learning
CN108694413A (en) * 2018-05-10 2018-10-23 广州大学 Adaptively sampled unbalanced data classification processing method, device, equipment and medium

Also Published As

Publication number Publication date
CN109886337A (en) 2019-06-14

Similar Documents

Publication Publication Date Title
CN109886337B (en) Depth measurement learning method and system based on self-adaptive sampling
Huang et al. Damage identification of steel bridge based on data augmentation and adaptive optimization neural network
CN109522857B (en) A population estimation method based on generative adversarial network model
CN111178548B (en) Ensemble learning prediction method and system
CN110120064B (en) Depth-related target tracking algorithm based on mutual reinforcement and multi-attention mechanism learning
CN114357594B (en) Bridge abnormity monitoring method, system, equipment and storage medium based on SCA-GRU
CN113837000A (en) A Few-Sample Fault Diagnosis Method Based on Task Ranking Meta-Learning
US20230115987A1 (en) Data adjustment system, data adjustment device, data adjustment method, terminal device, and information processing apparatus
CN113281048A (en) Rolling bearing fault diagnosis method and system based on relational knowledge distillation
CN112990082B (en) Detection and identification method of underwater sound pulse signal
CN108960142B (en) Pedestrian re-identification method based on global feature loss function
CN114139601B (en) A method and system for evaluating artificial intelligence algorithm models in power inspection scenarios
CN111859241B (en) An Unsupervised Sound Source Orientation Method Based on Acoustic Transfer Function Learning
CN113330462B (en) Neural Network Training Using Soft Nearest Neighbor Loss
Mulyono et al. Design and implementation of real-time object detection for blind using convolutional neural network
CN118915129B (en) Earthquake prediction method and system based on space-time attention mechanism
CN107437112B (en) A kind of mixing RVM model prediction methods based on the multiple dimensioned kernel function of improvement
CN119167166A (en) Circuit breaker fault detection optimization method and system based on convolutional neural network
CN113762082A (en) Unsupervised Skeletal Action Recognition Method Based on Recurrent Graph Convolutional Autoencoder
Zhu et al. Rethink of orthographic constraints on RNN and its application in acoustic sensor data modeling
CN109187898B (en) Soft measurement method and device for ammonia nitrogen content of water in aquaculture environment
CN115329146B (en) Link prediction method, electronic device and storage medium in time series network
CN118133163A (en) Structural damage identification method based on data fusion and one-dimensional convolutional neural network
JP2021056928A (en) Optimal solution acquisition program, optimal solution acquisition method, and information processor
CN107065524B (en) A kind of servo system frequency domain identification system and identification method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant