[go: up one dir, main page]

CN113515638B - Student clustering-oriented research interest mining method and device and storage medium - Google Patents

Student clustering-oriented research interest mining method and device and storage medium Download PDF

Info

Publication number
CN113515638B
CN113515638B CN202111072396.7A CN202111072396A CN113515638B CN 113515638 B CN113515638 B CN 113515638B CN 202111072396 A CN202111072396 A CN 202111072396A CN 113515638 B CN113515638 B CN 113515638B
Authority
CN
China
Prior art keywords
topic
distribution
data
academic
chinese
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111072396.7A
Other languages
Chinese (zh)
Other versions
CN113515638A (en
Inventor
寇菲菲
王文东
杜军平
李昂
薛哲
梁美玉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing University of Posts and Telecommunications
Original Assignee
Beijing University of Posts and Telecommunications
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing University of Posts and Telecommunications filed Critical Beijing University of Posts and Telecommunications
Priority to CN202111072396.7A priority Critical patent/CN113515638B/en
Publication of CN113515638A publication Critical patent/CN113515638A/en
Application granted granted Critical
Publication of CN113515638B publication Critical patent/CN113515638B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/35Clustering; Classification
    • G06F16/353Clustering; Classification into predefined classes
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/3331Query processing
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2216/00Indexing scheme relating to additional aspects of information retrieval not explicitly covered by G06F16/00 and subgroups
    • G06F2216/03Data mining

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本发明提供一种面向学者聚类的研究兴趣挖掘方法、装置和存储介质,该方法包括以下步骤:基于多源学者相关学术数据构造学术元数据集合;将学术元数据作为输入数据输入到预先建立的研究兴趣挖掘模型中,对主题模型进行采样获得学者兴趣语义表示,学者兴趣语义表示包括专业领域‑主题分布、主题‑英文单词分布、主题‑中文单词分布和主题‑学者分布;基于获得的学者兴趣语义表示进行学者聚类,获得学者聚类结果;研究兴趣挖掘模型对来自同一数据源且属于同一个专业领域的学者的数据共享同一个主题分布,研究兴趣挖掘模型中,专业领域‑主题分布被建模为狄利克雷分布,主题‑英文单词分布、主题‑中文单词分布和主题‑学者分布被建模为多项式分布。

Figure 202111072396

The invention provides a research interest mining method, device and storage medium oriented to scholar clustering. The method includes the following steps: constructing an academic metadata set based on multi-source scholar-related academic data; inputting the academic metadata as input data into a pre-established In the research interest mining model of the The semantics of interest expresses scholar clustering and obtains scholar clustering results; the research interest mining model shares the same topic distribution for the data of scholars from the same data source and belongs to the same professional field. In the research interest mining model, the professional field-topic distribution are modeled as Dirichlet distributions, topic-English word distribution, topic-Chinese word distribution, and topic-scholar distribution are modeled as multinomial distributions.

Figure 202111072396

Description

面向学者聚类的研究兴趣挖掘方法、装置和存储介质Research interest mining method, device and storage medium for scholar clustering

技术领域technical field

本发明涉及大数据技术领域,具体是一种面向学者聚类的研究兴趣挖掘方法、装置和存储介质。The invention relates to the technical field of big data, in particular to a research interest mining method, device and storage medium oriented to scholar clustering.

背景技术Background technique

学者、科研项目和论文等学术数据都有自己的专业领域。例如,有些数据属于软件工程,有些数据属于人工智能。不同专业领域的研究内容不同,同一专业领域的数据往往具有共同的主题分布。针对学者学术数据,从学术数据中发现学者的研究兴趣,并根据其研究兴趣对学者进行聚类,对于许多任务都很重要,例如为学者选择合作者,为期刊选择审稿人,为政府挑选专家。与一般数据不同,学者兴趣相关的学术数据有其独特的属性。一方面,它是多源的,学者主持的基金项目和发表的论文都能反映其研究兴趣。另一方面,它是多语言的,论文和基金申请书通常用母语或英语撰写。此外,学术数据会随着时间的推移而增加。Academic data such as scholars, research projects, and dissertations all have their own areas of expertise. For example, some data belongs to software engineering and some data belongs to artificial intelligence. The research contents of different professional fields are different, and the data of the same professional field often have a common topic distribution. Targeting scholar academic data, discovering scholars' research interests from academic data, and clustering scholars according to their research interests is important for many tasks, such as selecting collaborators for scholars, selecting reviewers for journals, and selecting for governments expert. Unlike general data, academic data related to scholars' interests has its own unique properties. On the one hand, it is multi-source, and the funded projects and published papers of scholars can reflect their research interests. On the other hand, it is multilingual and essays and grant applications are usually written in the native language or English. Also, academic data increases over time.

目前虽然有许多方法可以处理用户聚类问题,但它们大多只适用于单一来源的数据。例如,可以使用用户聚类主题模型(UCT)或者深度学习方法将用户表示为向量,然后利用典型的聚类算法对用户进行聚类。作为示例,UCT利用单一数据源的信息对用户的兴趣进行建模,通过对时间进行划片,获取不同时间片内的用户兴趣语义表示。然后利用K-means聚类算法对用户的兴趣语义表示结果进行聚类,最终得到用户的聚类结果。该方法仅仅使用单一来源的数据,而且也仅仅利用了单一的语言,将其用在学者用户兴趣语义表示时,其表示质量有待提升。此外,K-Means存在一定的局限性,尤其是需要提前设定K值,这就使得用户聚类的效果鲁棒性比较受限。Although there are many methods to deal with the user clustering problem, most of them are only applicable to a single source of data. For example, users can be represented as vectors using User Clustering Topic Models (UCT) or deep learning methods, and then users can be clustered using typical clustering algorithms. As an example, UCT uses information from a single data source to model user interests, and obtains semantic representations of user interests in different time slices by slicing time. Then, the K-means clustering algorithm is used to cluster the semantic representation results of users' interests, and finally the clustering results of users are obtained. This method only uses data from a single source, and only uses a single language. When it is used in the semantic representation of scholar user interests, its representation quality needs to be improved. In addition, K-Means has certain limitations, especially the need to set the K value in advance, which makes the robustness of the user clustering effect relatively limited.

用多源数据代替单源数据可以更全面、准确地挖掘并表示用户的兴趣,聚类的有效性取决于用户兴趣语义表示的质量。然而,大多数学者的相关研究只是以论文为材料,而忽略科研项目数据。此外,多源数据并不能直接合并在一起。这是因为,不同来源的数据量存在较大的区别,比如学者主持的基金项目数量往往较少,发表论文的数量则几十倍甚至百倍于学者的基金项目数量。如果简单地混合使用不同来源的数据,那小样本源的影响将会被大样本源淹没。因此,多源数据的信息集成是一个挑战。Replacing single-source data with multi-source data can mine and represent user interests more comprehensively and accurately. The effectiveness of clustering depends on the quality of semantic representation of user interests. However, most scholars' related research only uses papers as materials, ignoring scientific research project data. Furthermore, multi-source data cannot be directly merged together. This is because there is a big difference in the amount of data from different sources. For example, the number of funded projects hosted by scholars is often small, and the number of published papers is dozens or even hundreds of times the number of funded projects by scholars. If you simply mix data from different sources, the impact of small sample sources will be overwhelmed by large sample sources. Therefore, information integration of multi-source data is a challenge.

聚类学者面临的另一个挑战是如何充分利用多语言数据的丰富语义。对于大规模的多语言语料库,将多种语言翻译成一种语言是不现实的,这是因为翻译过程会引入错误并耗费时间和精力。典型的多语言数据处理方法是基于概率主题模型或词嵌入方法。但是这些方法都要求不同语言之间有很强的关联,例如具有翻译对应关系的句子对、词语对、或者文档对。然而,学者用不同语言呈现的学术数据则缺乏明确的翻译对应关系。因此,如果要充分利用多语言的学术数据,就需要能够找到不同语言之间关联的桥梁。Another challenge facing cluster scholars is how to fully exploit the rich semantics of multilingual data. For large-scale multilingual corpora, translating multiple languages into one language is impractical because the translation process introduces errors and consumes time and effort. Typical multilingual data processing methods are based on probabilistic topic models or word embedding methods. But these methods all require strong associations between different languages, such as sentence pairs, word pairs, or document pairs with translation correspondences. However, academic data presented by scholars in different languages lacks a clear translation correspondence. Therefore, if multilingual academic data is to be fully utilized, it is necessary to be able to find bridges between different languages.

例如,用户协同兴趣追踪模型(UCIT)利用了不同来源的数据对用户兴趣进行追踪。该模型同时利用用户本身的数据和用户的粉丝数据对用户兴趣进行挖掘,相比仅利用单一来源其效果有较大提升。该模型虽然利用了多源数据,但是其仅利用了单一的语言,没有同时利用不同的语言对用户进行建模。而且在用户聚类阶段,同样使用了K-means,因此也会受K-means的局限性的影响。For example, the User Collaborative Interest Tracking Model (UCIT) uses data from different sources to track user interests. The model uses both the user's own data and the user's fan data to mine user interests, which has a greater effect than only using a single source. Although this model utilizes multi-source data, it only utilizes a single language and does not use different languages to model users at the same time. And in the user clustering stage, K-means is also used, so it is also affected by the limitations of K-means.

此外,与日常兴趣的转移类似,学者的研究兴趣也会随着时间的推移而动态变化,因此对学者聚类时,也需要考虑学者兴趣的变化。现有的动态表示模型可分为两类,一种是将时间视为连续的,以在线方式处理数据,另一种是将时间看作离散的,以划分时间片即批处理的方式处理数据。然而,这些动态表示模型都无法从学术数据中追踪学者的研究兴趣。一方面,论文发表时间和项目申请时间不连续,不适合以在线方式处理学术数据。另一方面,现有的批处理的方法只适用于单源数据或单语数据,因此不能直接用来获取动态的学者研究兴趣语义表示。In addition, similar to the transfer of daily interests, the research interests of scholars also change dynamically over time, so when clustering scholars, changes in scholars’ interests also need to be considered. Existing dynamic representation models can be divided into two categories, one treats time as continuous and processes data online, and the other treats time as discrete and processes data by dividing time slices, that is, batch processing. . However, none of these dynamic representation models can track the research interests of scholars from academic data. On the one hand, the publication time of the paper and the project application time are not continuous, which is not suitable for processing academic data in an online manner. On the other hand, the existing batch processing methods are only applicable to single-source data or monolingual data, so they cannot be directly used to obtain dynamic semantic representations of scholars' research interests.

如何有效地利用多源多语言学术数据实现精准的动态的学者聚类,从而实现研究兴趣挖掘,是一个有待解决的问题。How to effectively use multi-source and multi-language academic data to achieve accurate and dynamic scholar clustering, so as to realize research interest mining, is a problem to be solved.

发明内容SUMMARY OF THE INVENTION

有鉴于此,本发明的目的在于提供一种面向学者聚类的研究兴趣挖掘方法、装置和存储介质,以解决现有技术中存在的一个或更多个问题。In view of this, the purpose of the present invention is to provide a research interest mining method, device and storage medium for scholar clustering, so as to solve one or more problems existing in the prior art.

本发明的一个方面,提供了一种面向学者聚类的研究兴趣挖掘方法,该方法包括以下步骤:One aspect of the present invention provides a research interest mining method for scholar clustering, the method comprising the following steps:

基于多源学者相关学术数据构造学术元数据集合,所述学术元数据集合中的每条学术元数据包括如下信息:专业领域信息、数据源信息、学者信息和文本内容信息;An academic metadata set is constructed based on academic data related to scholars from multiple sources, and each piece of academic metadata in the academic metadata set includes the following information: professional field information, data source information, scholar information and text content information;

将构造的学术元数据集合中的至少部分学术元数据作为输入数据输入到预先建立的研究兴趣挖掘模型中,通过对主题模型进行采样获得学者兴趣语义表示,所述学者兴趣语义表示包括专业领域-主题分布、主题-英文单词分布、主题-中文单词分布和主题-学者分布;其中,所述研究兴趣挖掘模型对来自同一数据源并且属于同一个专业领域的学者的数据共享同一个主题分布,并且,所述研究兴趣挖掘模型中,所述专业领域-主题分布被建模为狄利克雷分布,所述主题-英文单词分布、主题-中文单词分布和主题-学者分布被建模为多项式分布;Input at least part of the academic metadata in the constructed academic metadata set as input data into the pre-established research interest mining model, and obtain the scholar's interest semantic representation by sampling the topic model, and the scholar's interest semantic representation includes the professional field- topic distribution, topic-English word distribution, topic-Chinese word distribution, and topic-scholar distribution; wherein the research interest mining model shares the same topic distribution for data from scholars from the same data source and belonging to the same professional field, and , in the research interest mining model, the professional field-topic distribution is modeled as Dirichlet distribution, and the topic-English word distribution, topic-Chinese word distribution and topic-scholar distribution are modeled as multinomial distributions;

基于获得的学者兴趣语义表示进行学者聚类,获得学者聚类结果。Based on the obtained semantic representation of scholars' interest, scholars are clustered, and the results of scholars' clustering are obtained.

在本发明一些实施方式中,所述学术数据包括基金项目数据和论文数据;所述专业领域-主题分布包括科研项目的专业领域-主题分布和论文数据的专业领域-主题分布。In some embodiments of the present invention, the academic data includes fund project data and dissertation data; the professional field-topic distribution includes professional field-topic distribution of scientific research projects and professional field-topic distribution of dissertation data.

在本发明一些实施方式中,所述方法还包括构建研究兴趣挖掘模型的步骤,该步骤包括:确定学术元数据所属于的专业领域;从来自科研项目且属于确定的专业领域的主题分布和来自论文且属于确定的专业领域的主题分布中协同地对主题进行采样,得到学术元数据主题;根据主题-英文单词分布、主题-中文单词分布、主题-学者分布来生成英文单词、中文单词和学者。In some embodiments of the present invention, the method further includes the step of constructing a research interest mining model, the step comprising: determining the professional field to which the academic metadata belongs; The topics are sampled collaboratively in the topic distribution of papers and belong to a certain professional field to obtain academic metadata topics; English words, Chinese words and scholars are generated according to topic-English word distribution, topic-Chinese word distribution, and topic-scholar distribution .

在本发明一些实施方式中,所述构造学术元数据集合,包括:判断每条学术元数据的来源,确定是基金项目数据还是论文数据;确定当前学术元数据所属的学者;提取每个基金项目或者论文的文本信息;确定所述基金项目或者论文的文本信息是中文还是英文;确定当前学术元数据所属的时段,将当前学术元数据归入所述所属时段对应的学术元数据子集,由此构造包括所述学术元数据子集的学术元数据集合。In some embodiments of the present invention, constructing an academic metadata set includes: judging the source of each piece of academic metadata, and determining whether it is funded project data or dissertation data; determining the scholar to which the current academic metadata belongs; extracting each funded project Or the text information of the paper; determine whether the text information of the fund project or paper is Chinese or English; determine the time period to which the current academic metadata belongs, and classify the current academic metadata into the academic metadata subset corresponding to the time period, by This construct includes a collection of academic metadata for the subset of academic metadata.

在本发明一些实施例中,所述将构造的学术元数据集合中的至少部分学术元数据作为输入数据输入到预先建立的研究兴趣挖掘模型中,通过对主题模型进行采样获得学者兴趣语义表示,包括:对来自科研项目且属于预定专业领域的学术元数据采样得到科研项目的专业领域-主题分布;对来自论文且属于预定专业领域的学术元数据采样得到论文数据的专业领域-主题分布;针对每个预定主题进行采样获得对应的主题-中文词分布、主题-学者分布和主题-英文词分布;针对每条学术元数据中的文本内容确定其为中文还是英文;在文本内容为中文的情况下,提取双词并针对每个双词采取以下操作:采样中文双词的主题、独立地采样两个词以及采样双词的作者;在文本内容为英文的情况下,针对每个单词采样以下操作:采样英文主题、采样每个英文单词以及采样英文单词的作者。In some embodiments of the present invention, at least part of the academic metadata in the constructed academic metadata set is input into a pre-established research interest mining model as input data, and the semantic representation of scholar interest is obtained by sampling the topic model, Including: sampling the academic metadata from scientific research projects and belonging to a predetermined professional field to obtain the professional field-topic distribution of scientific research projects; sampling academic metadata from papers and belonging to a predetermined professional field to obtain the professional field-topic distribution of paper data; Each predetermined topic is sampled to obtain the corresponding topic-Chinese word distribution, topic-scholar distribution and topic-English word distribution; determine whether it is Chinese or English for the text content in each academic metadata; in the case that the text content is Chinese , extract the double words and take the following actions for each double word: sample the topic of the Chinese double word, independently sample the two words, and sample the author of the double word; in the case of the text content in English, sample the following for each word Action: Sample English topics, sample each English word, and sample the author of the English word.

在本发明一些实施例中,所述将构造的学术元数据集合中的至少部分学术元数据作为输入数据输入到预先建立的研究兴趣挖掘模型中,通过多次迭代地对主题模型进行采样获得学者兴趣语义表示,还包括:将不同时段对应的学术元数据子集中学术元数据作为输入数据输入到所述研究兴趣挖掘模型中,得到不同时刻的学者兴趣语义表示;所述对获得的学者兴趣语义表示进行聚类包括:利用单遍聚类算法对所获取的不同时刻的学者兴趣语义表示进行聚类。In some embodiments of the present invention, at least part of the academic metadata in the constructed academic metadata set is input into a pre-established research interest mining model as input data, and scholars are obtained by sampling the topic model multiple times iteratively. Interest semantic representation, further comprising: inputting academic metadata in academic metadata subsets corresponding to different time periods into the research interest mining model as input data to obtain scholar interest semantic representation at different times; The clustering of representations includes: using a single-pass clustering algorithm to cluster the acquired semantic representations of scholars' interests at different times.

在本发明一些实施例中,所述研究兴趣挖掘模型中的待估计参数采用吉布斯采样方法推算得到;In some embodiments of the present invention, the parameters to be estimated in the research interest mining model are estimated by using a Gibbs sampling method;

对中文双词的采样采用如下公式:The sampling of Chinese double words adopts the following formula:

Figure DEST_PATH_IMAGE001
Figure DEST_PATH_IMAGE001

对每个英文单词的采样采用如下公式:The following formula is used for the sampling of each English word:

Figure DEST_PATH_IMAGE002
Figure DEST_PATH_IMAGE002

其中,Z表示主题的总数,

Figure 100002_DEST_PATH_IMAGE003
表示中文主题Z b 下的中文词i
Figure DEST_PATH_IMAGE004
表示除了第i个单词外的所有中文主题的集合;
Figure DEST_PATH_IMAGE005
表示的英文主题Z b 下的英文单词i
Figure DEST_PATH_IMAGE006
表示除了第i个单词外的所有英文主题的集合;
Figure DEST_PATH_IMAGE007
表示第p个专业领域下,除了词i之外,科研项目数据里属于主题z的所有中英文词总数;
Figure DEST_PATH_IMAGE008
表示第p个专业领域下,除了词i之外,论文数据里属于主题z的中英文词总数;
Figure DEST_PATH_IMAGE009
分别表示主题z的中文主题Z b 下除中文词i外,所有科研项目和论文数据里中文单词
Figure DEST_PATH_IMAGE010
出现的次数;
Figure DEST_PATH_IMAGE011
表示主题z下除了词i之外,所有科研项目和论文数据里属于学者s i 的中英文词出现的次数;
Figure DEST_PATH_IMAGE012
表示主题z的英文主题Z e 下除英文单词i外,所有科研项目和论文数据里英文单词
Figure DEST_PATH_IMAGE013
出现的次数;
Figure DEST_PATH_IMAGE014
,
Figure DEST_PATH_IMAGE015
分别为科研项目数据的主题分布以及论文数据的主题分布;
Figure DEST_PATH_IMAGE016
为符合狄利克雷分布的主题-英文单词分布,
Figure DEST_PATH_IMAGE017
为符合狄利克雷分布的主题-学者分布,
Figure DEST_PATH_IMAGE018
为符合狄利克雷分布的主题-中文单词分布;R表示不同学者的个数,B表示双词的集合,S表示学者的集合,Wb表示不同中文单词的个数,We表示不同英文单词的个数,
Figure DEST_PATH_IMAGE019
为平衡因子;where Z represents the total number of topics,
Figure 100002_DEST_PATH_IMAGE003
represents the Chinese word i under the Chinese topic Z b ,
Figure DEST_PATH_IMAGE004
Represents the set of all Chinese topics except the ith word;
Figure DEST_PATH_IMAGE005
represents the English word i under the English topic Z b ,
Figure DEST_PATH_IMAGE006
Represents the set of all English topics except the ith word;
Figure DEST_PATH_IMAGE007
Indicates the total number of all Chinese and English words belonging to topic z in the scientific research project data except word i in the pth professional field;
Figure DEST_PATH_IMAGE008
Indicates the total number of Chinese and English words belonging to topic z in the paper data except word i in the pth professional field;
Figure DEST_PATH_IMAGE009
In addition to the Chinese word i , the Chinese words in all scientific research projects and paper data under the Chinese topic Z b respectively represent the topic z .
Figure DEST_PATH_IMAGE010
the number of occurrences;
Figure DEST_PATH_IMAGE011
Indicates the number of occurrences of Chinese and English words belonging to scholar si in all scientific research projects and paper data except word i under topic z ;
Figure DEST_PATH_IMAGE012
Except for the English word i , the English words in all scientific research projects and thesis data under the English topic Z e representing the topic z
Figure DEST_PATH_IMAGE013
the number of occurrences;
Figure DEST_PATH_IMAGE014
,
Figure DEST_PATH_IMAGE015
are the subject distribution of scientific research project data and the subject distribution of paper data;
Figure DEST_PATH_IMAGE016
For the topic-English word distribution that conforms to the Dirichlet distribution,
Figure DEST_PATH_IMAGE017
To fit the subject-scholar distribution of the Dirichlet distribution,
Figure DEST_PATH_IMAGE018
It is the topic-Chinese word distribution that conforms to the Dirichlet distribution; R represents the number of different scholars, B represents the set of double words, S represents the set of scholars, W b represents the number of different Chinese words, and We e represents different English words number of ,
Figure DEST_PATH_IMAGE019
is the balance factor;

在对所述研究兴趣挖掘模型进行迭代操作后,得到如下估计参数:After the iterative operation of the research interest mining model, the following estimated parameters are obtained:

Figure 100002_DEST_PATH_IMAGE020
Figure 100002_DEST_PATH_IMAGE020
;

Figure DEST_PATH_IMAGE021
Figure DEST_PATH_IMAGE021
;

Figure 100002_DEST_PATH_IMAGE022
Figure 100002_DEST_PATH_IMAGE022
;

Figure DEST_PATH_IMAGE023
Figure DEST_PATH_IMAGE023
;

Figure 100002_DEST_PATH_IMAGE024
Figure 100002_DEST_PATH_IMAGE024
;

其中,

Figure DEST_PATH_IMAGE025
表示科研项目的专业领域为p主题为z的专业领域-主题分布;
Figure 100002_DEST_PATH_IMAGE026
表示论文数据的专业领域为p主题为z的专业领域-主题分布;
Figure DEST_PATH_IMAGE027
表示第p个专业领域下,科研项目数据里属于主题z的所有中英文词总数;
Figure 100002_DEST_PATH_IMAGE028
表示第p个专业领域下,论文数据里属于主题z的所有中英文词总数;
Figure DEST_PATH_IMAGE029
表示第zb个主题下,所有科研项目和论文数据里中文单词出现的次数;
Figure DEST_PATH_IMAGE030
表示主题为z的中文双词的主题-中文单词分布;
Figure DEST_PATH_IMAGE031
表示第ze个主题下,所有科研项目和论文数据里英文单词出现的次数;
Figure DEST_PATH_IMAGE032
表示主题为z的英文单词w e 的主题-英文单词分布;
Figure DEST_PATH_IMAGE033
表示主题为z、学者为s的主题-学者分布;
Figure DEST_PATH_IMAGE034
表示主题z下所有科研项目和论文数据里属于学者s的中英文词出现的次数。in,
Figure DEST_PATH_IMAGE025
Indicates that the professional field of the scientific research project is the professional field of p and the topic is z - topic distribution;
Figure 100002_DEST_PATH_IMAGE026
Indicates that the professional field of the paper data is p and the topic is the professional field of z - topic distribution;
Figure DEST_PATH_IMAGE027
Indicates the total number of all Chinese and English words belonging to topic z in the scientific research project data under the pth professional field;
Figure 100002_DEST_PATH_IMAGE028
Indicates the total number of all Chinese and English words belonging to topic z in the paper data under the pth professional field;
Figure DEST_PATH_IMAGE029
Indicates the number of occurrences of Chinese words in the data of all scientific research projects and papers under the z- th topic;
Figure DEST_PATH_IMAGE030
Represents the topic-Chinese word distribution of Chinese double words with topic z;
Figure DEST_PATH_IMAGE031
Represents the number of occurrences of English words in all scientific research projects and paper data under the z e -th topic;
Figure DEST_PATH_IMAGE032
Represents the topic-English word distribution of the English word we with topic z ;
Figure DEST_PATH_IMAGE033
Represents the topic-scholar distribution with topic z and scholar s;
Figure DEST_PATH_IMAGE034
Indicates the number of occurrences of Chinese and English words belonging to scholar s in all scientific research projects and paper data under topic z.

在本发明一些实施例中,所述方法还包括:将前一时段的主题分布作为当前时段的先验分布来基于如下公式计算当前时段的先验参数:In some embodiments of the present invention, the method further includes: using the topic distribution of the previous period as the prior distribution of the current period to calculate the prior parameters of the current period based on the following formula:

Figure DEST_PATH_IMAGE035
Figure DEST_PATH_IMAGE035

其中,

Figure DEST_PATH_IMAGE036
为衰减因子,
Figure DEST_PATH_IMAGE037
表示在t-1时刻,第p个专业领域下,科研项目数据里属于主题
Figure DEST_PATH_IMAGE038
的所有中英文词总数;
Figure DEST_PATH_IMAGE039
表示在t-1时刻,科研项目数据的专业领域主题分布;
Figure DEST_PATH_IMAGE040
表示在
Figure DEST_PATH_IMAGE041
时刻,科研项目数据的专业领域主题分布;
Figure DEST_PATH_IMAGE042
表示在
Figure DEST_PATH_IMAGE043
时刻,第
Figure DEST_PATH_IMAGE044
个专业领域下,论文数据里属于主题
Figure 336761DEST_PATH_IMAGE038
的所有中英文词总数;
Figure DEST_PATH_IMAGE045
表示在
Figure 833601DEST_PATH_IMAGE043
时刻,论文数据的专业领域主题分布;
Figure DEST_PATH_IMAGE046
表示在
Figure 484025DEST_PATH_IMAGE041
时刻,论文数据的专业领域主题分布;
Figure DEST_PATH_IMAGE047
表示在
Figure 391807DEST_PATH_IMAGE043
时刻,第
Figure DEST_PATH_IMAGE048
个主题下,所有科研项目和论文数据里中文单词
Figure DEST_PATH_IMAGE049
出现的次数;
Figure DEST_PATH_IMAGE050
表示在
Figure 494893DEST_PATH_IMAGE043
时刻,所有科研项目和论文数据的主题中文单词分布;
Figure DEST_PATH_IMAGE051
表示在
Figure 529845DEST_PATH_IMAGE041
时刻,所有科研项目和论文数据的主题中文单词分布;
Figure DEST_PATH_IMAGE052
表示在
Figure 565934DEST_PATH_IMAGE043
时刻,第
Figure DEST_PATH_IMAGE053
个主题下,所有科研项目和论文数据里英文单词
Figure DEST_PATH_IMAGE054
出现的次数;
Figure DEST_PATH_IMAGE055
表示在
Figure 632502DEST_PATH_IMAGE043
时刻,所有科研项目和论文数据的主题英文单词分布;
Figure DEST_PATH_IMAGE056
表示在
Figure 488462DEST_PATH_IMAGE041
时刻,所有科研项目和论文数据的主题英文单词分布;
Figure DEST_PATH_IMAGE057
表示在
Figure 592685DEST_PATH_IMAGE043
时刻,第
Figure DEST_PATH_IMAGE058
个主题下,所有科研项目和论文数据里学者
Figure DEST_PATH_IMAGE059
出现的次数;
Figure DEST_PATH_IMAGE060
表示在
Figure 670231DEST_PATH_IMAGE043
时刻,所有科研项目和论文数据的主题学者分布;
Figure DEST_PATH_IMAGE061
表示在
Figure 936127DEST_PATH_IMAGE041
时刻,所有科研项目和论文数据的主题学者分布。in,
Figure DEST_PATH_IMAGE036
is the attenuation factor,
Figure DEST_PATH_IMAGE037
Indicates that at time t-1 , under the pth professional field, the scientific research project data belongs to the theme
Figure DEST_PATH_IMAGE038
The total number of all Chinese and English words of ;
Figure DEST_PATH_IMAGE039
Represents the subject distribution of scientific research project data in professional fields at time t-1 ;
Figure DEST_PATH_IMAGE040
expressed in
Figure DEST_PATH_IMAGE041
Time, subject distribution of scientific research project data in professional fields;
Figure DEST_PATH_IMAGE042
expressed in
Figure DEST_PATH_IMAGE043
time, the
Figure DEST_PATH_IMAGE044
Under a professional field, the thesis data belongs to the topic
Figure 336761DEST_PATH_IMAGE038
The total number of all Chinese and English words of ;
Figure DEST_PATH_IMAGE045
expressed in
Figure 833601DEST_PATH_IMAGE043
Moment, the subject distribution of the professional field of the paper data;
Figure DEST_PATH_IMAGE046
expressed in
Figure 484025DEST_PATH_IMAGE041
Moment, the subject distribution of the professional field of the paper data;
Figure DEST_PATH_IMAGE047
expressed in
Figure 391807DEST_PATH_IMAGE043
time, the
Figure DEST_PATH_IMAGE048
Under this topic, Chinese words in all scientific research projects and paper data
Figure DEST_PATH_IMAGE049
the number of occurrences;
Figure DEST_PATH_IMAGE050
expressed in
Figure 494893DEST_PATH_IMAGE043
Time, topic Chinese word distribution of all scientific research projects and dissertation data;
Figure DEST_PATH_IMAGE051
expressed in
Figure 529845DEST_PATH_IMAGE041
Time, topic Chinese word distribution of all scientific research projects and dissertation data;
Figure DEST_PATH_IMAGE052
expressed in
Figure 565934DEST_PATH_IMAGE043
time, the
Figure DEST_PATH_IMAGE053
Under this topic, English words in all scientific research projects and paper data
Figure DEST_PATH_IMAGE054
the number of occurrences;
Figure DEST_PATH_IMAGE055
expressed in
Figure 632502DEST_PATH_IMAGE043
Time, the subject English word distribution of all scientific research projects and paper data;
Figure DEST_PATH_IMAGE056
expressed in
Figure 488462DEST_PATH_IMAGE041
Time, the subject English word distribution of all scientific research projects and paper data;
Figure DEST_PATH_IMAGE057
expressed in
Figure 592685DEST_PATH_IMAGE043
time, the
Figure DEST_PATH_IMAGE058
Under this topic, scholars in all scientific research projects and dissertation data
Figure DEST_PATH_IMAGE059
the number of occurrences;
Figure DEST_PATH_IMAGE060
expressed in
Figure 670231DEST_PATH_IMAGE043
Time, the distribution of subject scholars for all scientific research projects and dissertation data;
Figure DEST_PATH_IMAGE061
expressed in
Figure 936127DEST_PATH_IMAGE041
Moment, subject scholar distribution of all research projects and dissertation data.

本发明的另一方面,提供了一种面向学者聚类的研究兴趣挖掘装置,该装置包括处理器和存储器,所述存储器中存储有计算机指令,所述处理器用于执行所述存储器中存储的计算机指令,当所述计算机指令被处理器执行时该装置实现如前所述方法的步骤。Another aspect of the present invention provides a research interest mining device for scholar clustering, the device includes a processor and a memory, where computer instructions are stored in the memory, and the processor is configured to execute the data stored in the memory. Computer instructions which, when executed by a processor, implement the steps of the method as previously described.

本发明的又一方面,还提供了一种计算机存储介质,其上存储有计算机程序,该程序被处理器执行时实现如前所述方法的步骤。In yet another aspect of the present invention, there is also provided a computer storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of the aforementioned method are implemented.

本发明实施例提供的面向学者聚类的研究兴趣挖掘方法和装置,可以有效地利用多源多语言学术数据通过研究兴趣挖掘模型获取高质量的学者兴趣语义表示,提高聚类准确率,实现精准的动态的学者聚类,从而实现研究兴趣挖掘。The research interest mining method and device for scholar clustering provided by the embodiments of the present invention can effectively utilize multi-source and multilingual academic data to obtain high-quality semantic representation of scholars' interests through the research interest mining model, improve the clustering accuracy, and achieve precise Dynamic clustering of scholars, so as to realize research interest mining.

进一步地,本发明可以能够根据时间的变化,获取不同时段的学者聚类结果。Further, the present invention may be able to obtain scholar clustering results in different time periods according to changes in time.

本发明的附加优点、目的,以及特征将在下面的描述中将部分地加以阐述,且将对于本领域普通技术人员在研究下文后部分地变得明显,或者可以根据本发明的实践而获知。本发明的目的和其它优点可以通过在书面说明及其权利要求书以及附图中具体指出的结构实现到并获得。Additional advantages, objects, and features of the present invention will be set forth in part in the description that follows, and in part will become apparent to those of ordinary skill in the art upon study of the following, or may be learned from practice of the invention. The objectives and other advantages of the invention may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

本领域技术人员将会理解的是,能够用本发明实现的目的和优点不限于以上具体所述,并且根据以下详细说明将更清楚地理解本发明能够实现的上述和其他目的。Those skilled in the art will appreciate that the objects and advantages that can be achieved with the present invention are not limited to those specifically described above, and that the above and other objects that can be achieved by the present invention will be more clearly understood from the following detailed description.

附图说明Description of drawings

此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,并不构成对本发明的限定。在附图中:The accompanying drawings described herein are used to provide a further understanding of the present invention, and constitute a part of the present application, and do not constitute a limitation to the present invention. In the attached image:

图1为本发明一实施例中面向学者聚类的研究兴趣挖掘方法的流程示意图。FIG. 1 is a schematic flowchart of a research interest mining method for scholar clustering according to an embodiment of the present invention.

图2为本发明另一实施例中研究兴趣挖掘模型的示意图。FIG. 2 is a schematic diagram of a research interest mining model in another embodiment of the present invention.

具体实施方式Detailed ways

为使本发明的目的、技术方案和优点更加清楚明白,下面结合实施方式和附图,对本发明做进一步详细说明。在此,本发明的示意性实施方式及其说明用于解释本发明,但并不作为对本发明的限定。In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the embodiments and accompanying drawings. Here, the exemplary embodiments of the present invention and their descriptions are used to explain the present invention, but not to limit the present invention.

在此,还需要说明的是,为了避免因不必要的细节而模糊了本发明,在附图中仅仅示出了与根据本发明的方案密切相关的结构和/或处理步骤,而省略了与本发明关系不大的其他细节。Here, it should also be noted that, in order to avoid obscuring the present invention due to unnecessary details, only the structures and/or processing steps closely related to the solution according to the present invention are shown in the drawings, and the related structures and/or processing steps are omitted. Other details not relevant to the invention.

应该强调,术语“包括/包含”在本文使用时指特征、要素、步骤或组件的存在,但并不排除一个或更多个其它特征、要素、步骤或组件的存在或附加。It should be emphasized that the term "comprising/comprising" when used herein refers to the presence of a feature, element, step or component, but does not exclude the presence or addition of one or more other features, elements, steps or components.

针对已有的用户兴趣挖掘方法不能有效地利用多源多语言数据,以致于不能实现精准的动态的学者聚类问题,本发明利用学者的多源多语言信息,提出了新的研究兴趣挖掘模型(Research Interest Mining Module,RIMM),可以获取高质量的学者的研究兴趣语义表示,从而实现精准的学者聚类。Aiming at the problem that the existing user interest mining methods cannot effectively utilize multi-source and multi-language data, so that accurate and dynamic scholar clustering cannot be realized, the present invention uses the multi-source and multi-language information of scholars to propose a new research interest mining model. (Research Interest Mining Module, RIMM), can obtain high-quality scholars' research interest semantic representation, so as to achieve accurate scholar clustering.

本发明提出的RIMM可以从学术数据中对学者进行动态地聚类。在RIMM中,设定不同来源的数据属于不同的主题分布,并且为了能够同时利用不同来源的数据获取学者的兴趣语义表示,本发明设计了一个平衡因子来协同地从主题分布中抽取主题。为了弥合不同语言的词汇鸿沟,本发明还将属于同一专业领域并且来自同一数据源的不同语言设置为共享同一主题分布,从而获得不同语言的共同语义,生成模型的各项主题分布。通过以上操作,本发明可以充分利用多源多语言的数据,实现精准的学者兴趣挖掘。此外,本发明还以历史时刻的主题分布作为先验知识,在不同的时间片上执行RIMM,可以获得不同时刻上的学者的兴趣语义表示,并根据兴趣语义表示,利用单遍(single-pass)聚类算法对学者进行聚类。The RIMM proposed by the present invention can dynamically cluster scholars from academic data. In RIMM, it is assumed that data from different sources belong to different topic distributions, and in order to obtain the semantic representation of scholars' interests by using data from different sources at the same time, the present invention designs a balance factor to synergistically extract topics from topic distributions. In order to bridge the lexical gap of different languages, the present invention also sets different languages belonging to the same professional field and from the same data source to share the same topic distribution, thereby obtaining the common semantics of different languages and generating the topic distributions of the model. Through the above operations, the present invention can make full use of multi-source and multi-language data to achieve accurate scholar interest mining. In addition, the present invention also takes the topic distribution of historical moments as prior knowledge, executes RIMM on different time slices, and can obtain the semantic representation of scholars' interests at different moments, and uses a single-pass according to the semantic representation of interest. Clustering algorithms cluster scholars.

研究兴趣可以从很多方面反映出来。从数据来源来看,无论是科研项目信息(如申请书和结题报告)还是论文都能反映学者的兴趣。此外,学术数据是多种语言的。因此,本发明将用户、项目信息、论文、中文和英文映射到同一个主题空间,并在一个多维(如K维)的主题向量中表示学者的兴趣,其中每个K值可体现学者对该主题感兴趣的概率。Research interest can be reflected in many ways. From the perspective of data sources, both scientific research project information (such as applications and final reports) and papers can reflect the interests of scholars. In addition, academic data is multilingual. Therefore, the present invention maps users, project information, papers, Chinese and English to the same topic space, and expresses the scholar's interest in a multi-dimensional (eg K-dimensional) topic vector, where each K value can reflect the scholar's interest in the topic The probability that the topic is of interest.

图1所示为本发明一实施例中面向学者聚类的研究兴趣挖掘方法的流程示意图,如图1所示,该方法包括以下步骤S110-S130:FIG. 1 is a schematic flowchart of a research interest mining method for scholar clustering in an embodiment of the present invention. As shown in FIG. 1 , the method includes the following steps S110-S130:

步骤S110,基于多源学者相关学术数据构造学术元数据集合。Step S110 , constructing an academic metadata set based on academic data related to multi-source scholars.

所述学术元数据集合中的每条学术元数据可包括如下信息:专业领域信息、数据源信息、学者信息和文本内容信息。Each piece of academic metadata in the academic metadata set may include the following information: professional field information, data source information, scholar information and text content information.

科研项目和论文都属于本发明的研究资料。虽然很难获得科研项目申请书的全文或科研项目的结题报告,但可以很容易获得它们的标题、关键词和摘要。对于论文来说,论文全文虽然容易获取,但获取论文全文却需要消耗大量的资源,而论文的标题、关键词摘要,足以用来挖掘学者的兴趣。因此,本发明实施例中,可以将科研项目(如基金项目)数据和论文数据作为多源学者相关学术数据,也即,学术元数据既可能来自于科研项目也可能来自于论文,进一步地,基于多源学者相关学术数据定义了学术元数据的概念,定义的学术元数据可包括如下信息:专业领域信息、数据源信息、学者信息和文本内容信息。作为示例,本发明可使用四元组来表示学术元数据m=(p m , d m , s m , t m ), 其中,p m 表示专业领域,d m 表示数据源,s m 表示学者,t m 表示文本内容,m表示第m条学术元数据。其中,学术元数据的文本内容包括基金项目或者论文的标题、关键词和/或摘要等,但并不限于此。Scientific research projects and papers belong to the research materials of the present invention. Although it is difficult to obtain the full text of a research project application or a research project final report, their titles, keywords, and abstracts can be easily obtained. For the paper, although the full text of the paper is easy to obtain, it requires a lot of resources to obtain the full text of the paper, and the title and keyword abstract of the paper are enough to tap the interest of scholars. Therefore, in this embodiment of the present invention, the data of scientific research projects (such as funded projects) and thesis data can be used as multi-source scholar-related academic data, that is, academic metadata may come from both scientific research projects and papers, and further, Based on academic data related to scholars from multiple sources, the concept of academic metadata is defined. The defined academic metadata can include the following information: professional field information, data source information, scholar information and text content information. As an example, the present invention can use a quadruple to represent academic metadata m = ( p m , d m , s m , t m ), where p m represents a professional field, d m represents a data source, s m represents a scholar, t m represents the text content, and m represents the mth academic metadata. The text content of the academic metadata includes titles, keywords and/or abstracts of funded projects or papers, but is not limited thereto.

本发明一些实施例中,收集了我国学者的学术资料,如基金项目数据和论文数据,作为学术数据,然后采用国家自然科学基金申请代码对学者的专业领域进行了划分,获得专业领域信息。具体来说,本发明首先获取学者主持的科研项目的申请代码,并在科研项目执行过程中将该代码设置为学者的专业领域。In some embodiments of the present invention, academic data of Chinese scholars, such as fund project data and dissertation data, are collected as academic data, and then the National Natural Science Foundation of China application code is used to divide the scholar's professional field to obtain professional field information. Specifically, the present invention first obtains the application code of the scientific research project hosted by the scholar, and sets the code as the professional field of the scholar during the execution of the scientific research project.

在本发明一些实施例中,学术元数据集合可以包括多个学术元数据子集,每个学术元数据子集中可包括基于不同时段的学术元数据。In some embodiments of the present invention, the academic metadata set may include multiple academic metadata subsets, and each academic metadata subset may include academic metadata based on different time periods.

步骤S120,将构造的学术元数据集合中的至少部分学术元数据作为输入数据输入到预先建立的研究兴趣挖掘模型(RIMM)中,通过对这种主题模型进行采样获得学者兴趣语义表示。Step S120 , input at least part of the academic metadata in the constructed academic metadata set as input data into a pre-established Research Interest Mining Model (RIMM), and obtain a semantic representation of scholar interest by sampling this topic model.

学者兴趣语义表示可包括专业领域-主题分布、主题-英文单词分布、主题-中文单词分布和主题-学者分布;其中,专业领域-主题分布可包括科研项目的专业领域-主题分布和论文数据的专业领域-主题分布。The semantic representation of scholars’ interests can include professional field-topic distribution, topic-English word distribution, topic-Chinese word distribution, and topic-scholar distribution; among them, professional field-topic distribution can include professional field-topic distribution of scientific research projects and the distribution of paper data. Areas of Expertise - Subject distribution.

在本发明实施例构建的RIMM中,设定来自同一数据源并且属于同一个专业领域的学者的数据共享一个主题分布,不同来源的数据属于不同的主题分布,例如,属于同一专业领域并且来自同一数据源的不同语言设置为共享同一主题分布,从而获得不同语言的共同语义,生成模型的各项主题分布,从而弥合不同语言的词汇鸿沟。In the RIMM constructed by the embodiment of the present invention, it is assumed that the data of scholars from the same data source and belonging to the same professional field share a subject distribution, and the data from different sources belong to different subject distributions, for example, belong to the same professional field and come from the same subject distribution Different languages of the data source are set to share the same topic distribution, so as to obtain the common semantics of different languages, and generate the topic distribution of the model, thereby bridging the lexical gap of different languages.

此外,在本发明实施例构建的RIMM中,专业领域-主题分布被建模为狄利克雷(Dirichlet)分布,主题-英文单词分布、主题-中文单词分布和主题-学者分布被建模为多项式分布。图2为本发明提出的研究兴趣挖掘模型(或称社交网络多特征主题模型)的图模型示例,如图2所示,科研项目数据的专业领域-主题分布

Figure DEST_PATH_IMAGE062
、论文数据的专业领域-主题分布
Figure DEST_PATH_IMAGE063
分别建模为具有参数
Figure DEST_PATH_IMAGE064
,
Figure DEST_PATH_IMAGE065
的狄利克雷分布。主题-英文单词分布
Figure DEST_PATH_IMAGE066
、主题-学者分布
Figure DEST_PATH_IMAGE067
、主题-中文单词分布
Figure DEST_PATH_IMAGE068
分别建模为具有参数
Figure DEST_PATH_IMAGE069
,
Figure DEST_PATH_IMAGE070
,
Figure DEST_PATH_IMAGE071
的多项式分布。由此可知,通过本发明提出的研究兴趣挖掘模型得到的主题分布是科研项目、论文、中文、英文的混合。In addition, in the RIMM constructed by the embodiment of the present invention, the professional field-topic distribution is modeled as a Dirichlet distribution, and the topic-English word distribution, the topic-Chinese word distribution, and the topic-scholar distribution are modeled as polynomials distributed. Fig. 2 is an example of a graph model of the research interest mining model (or a multi-feature topic model of social network) proposed by the present invention. As shown in Fig. 2, the professional field-topic distribution of scientific research project data
Figure DEST_PATH_IMAGE062
, the professional field of the paper data - topic distribution
Figure DEST_PATH_IMAGE063
separately modeled as having parameters
Figure DEST_PATH_IMAGE064
,
Figure DEST_PATH_IMAGE065
The Dirichlet distribution. Topic - English word distribution
Figure DEST_PATH_IMAGE066
, subject-scholar distribution
Figure DEST_PATH_IMAGE067
, subject-Chinese word distribution
Figure DEST_PATH_IMAGE068
separately modeled as having parameters
Figure DEST_PATH_IMAGE069
,
Figure DEST_PATH_IMAGE070
,
Figure DEST_PATH_IMAGE071
the multinomial distribution of . It can be seen that the topic distribution obtained by the research interest mining model proposed by the present invention is a mixture of scientific research projects, papers, Chinese and English.

图2中涉及的符号及描述如下面的表1所示。The symbols and descriptions involved in Figure 2 are shown in Table 1 below.

表1. 符号及其描述Table 1. Symbols and their descriptions

Figure DEST_PATH_IMAGE072
Figure DEST_PATH_IMAGE072

在本发明实施例中,可以将构造的学术元数据集合中的全部学术元数据作为输入数据输入到预先建立的研究兴趣挖掘模型(RIMM)中,也可以将构造的学术元数据集合中的部分学术元数据作为输入数据输入到预先建立的研究兴趣挖掘模型(RIMM)中。该部分学术元数据例如可以是学术元数据集合中的一个或多个学术元数据子集。In this embodiment of the present invention, all academic metadata in the constructed academic metadata set may be input into a pre-established research interest mining model (RIMM) as input data, or part of the constructed academic metadata set may be Academic metadata is fed into a pre-built Research Interest Mining Model (RIMM) as input data. The portion of academic metadata may be, for example, one or more subsets of academic metadata in a set of academic metadata.

步骤S130,基于获得的学者兴趣语义表示进行学者聚类,获得学者聚类结果。Step S130, perform scholar clustering based on the obtained scholar's interest semantic representation, and obtain a scholar clustering result.

由上可知,通过研究兴趣挖掘模型可以获得学者的语义表示,然而该表示是静态的,仅为一段时间内的主题表示。因此,本发明为了能够根据不同时段的学者兴趣语义表示对学者进行聚类,要跟踪学者的兴趣动态变化。尽管学者的兴趣是动态变化的,但是也是存在一定的持续性,因此,本发明并不是简单的对语料进行切片,而是利用学者历史兴趣来帮助推断当前时段的主题分布。为了能够保持学者在不同时段的兴趣连续性,本发明将前一时段(如,第t-1时段)的主题分布作为当前时段(如第t时段)的先验分布。It can be seen from the above that the semantic representation of scholars can be obtained by studying the interest mining model. However, the representation is static and is only a topic representation within a period of time. Therefore, in the present invention, in order to be able to cluster scholars according to the semantic representation of scholars' interests in different time periods, it is necessary to track the dynamic changes of scholars' interests. Although the interests of scholars are dynamic, there is also a certain persistence. Therefore, the present invention does not simply slice the corpus, but uses the historical interests of scholars to help infer the topic distribution of the current period. In order to maintain the continuity of scholars' interests in different periods, the present invention uses the topic distribution of the previous period (eg, the t-1th period) as the prior distribution of the current period (eg, the tth period).

在本发明实施例中,步骤S130是利用单遍(single-pass)聚类算法来对学者进行聚类。In the embodiment of the present invention, step S130 is to use a single-pass clustering algorithm to cluster scholars.

单遍聚类算法通常是流式数据聚类的经典方法。对于依次到达的数据流,该聚算法按输入顺序每次处理一个数据,依据当前数据与已有类的匹配度大小,将该数据判为已有类或者创建一个新的数据类,实现流式数据的增量和动态聚类。在本发明实施例中,通过利用single-pass对所获取的不同时刻的学者兴趣语义表示进行聚类,可以获得动态的学者聚类结果,克服了传统的学者聚类中K-means聚类算法的局限性。The single-pass clustering algorithm is usually the classic method for streaming data clustering. For the data streams that arrive in sequence, the aggregation algorithm processes one data at a time in the input order, and judges the data as an existing class or creates a new data class according to the matching degree between the current data and the existing class to realize streaming Incremental and dynamic clustering of data. In the embodiment of the present invention, by using single-pass to cluster the acquired scholar's interest semantic representation at different times, dynamic scholar clustering results can be obtained, which overcomes the traditional K-means clustering algorithm in scholar clustering. limitations.

本发明如上面向学者聚类的研究兴趣挖掘方法,可以有效地利用多源多语言学术数据通过研究兴趣挖掘模型获取高质量的学者兴趣语义表示,提高聚类准确率,实现精准的动态的学者聚类,从而实现研究兴趣挖掘。The present invention is the research interest mining method for scholar clustering as above, which can effectively utilize multi-source and multilingual academic data to obtain high-quality semantic representation of scholars' interests through the research interest mining model, improve the clustering accuracy, and realize accurate and dynamic scholar clustering. class, so as to realize research interest mining.

在本发明一些实施例中,学术元数据既可能来自于科研项目也可能来自于论文。对于每条学术元数据,由学术元数据构建RIMM的过程如下:In some embodiments of the present invention, academic metadata may come from both scientific research projects and papers. For each piece of academic metadata, the process of constructing a RIMM from academic metadata is as follows:

首先,获取到该条元数据所属于的专业领域pFirst, obtain the professional field p to which the piece of metadata belongs;

然后,从来自科研项目且属于专业领域p的主题分布

Figure DEST_PATH_IMAGE073
和来自论文且属于专业领域p的主题分布
Figure DEST_PATH_IMAGE074
中协同地对主题进行采样,得到主题z,其中,
Figure 108745DEST_PATH_IMAGE073
Figure DEST_PATH_IMAGE075
分别表示科研项目的专业领域p的学术元数据的专业领域-主题分布和论文数据的专业领域-主题分布。Then, from the distribution of topics from research projects that belong to the area of expertise p
Figure DEST_PATH_IMAGE073
and the distribution of topics from papers that belong to the area of expertise p
Figure DEST_PATH_IMAGE074
The topics are sampled collaboratively in , to get the topic z, where,
Figure 108745DEST_PATH_IMAGE073
and
Figure DEST_PATH_IMAGE075
Respectively represent the professional field-topic distribution of academic metadata and the professional field-topic distribution of dissertation data of the professional field p of the scientific research project.

然后,根据主题-英文单词分布、主题-中文单词分布、主题-学者分布来生成英文单词、中文单词和学者。Then, English words, Chinese words, and scholars are generated according to topic-English word distribution, topic-Chinese word distribution, and topic-scholar distribution.

此外,由于中文数据比较稀疏,为了缓解中文数据的稀疏性,本发明还引入了双词模型,设定处于同一学术元数据中的两个中文单词共享同一个主题。In addition, since Chinese data is relatively sparse, in order to alleviate the sparseness of Chinese data, the present invention also introduces a two-word model, setting two Chinese words in the same academic metadata to share the same topic.

在本发明一些实施例中,构造学术元数据集合的步骤S110可以具体包括以下步骤:In some embodiments of the present invention, the step S110 of constructing the academic metadata set may specifically include the following steps:

(1)确定每条学术元数据的专业领域;(1) Determine the professional field of each piece of academic metadata;

(2)确定每条学术元数据的来源,即确定是基金项目数据还是论文数据;(2) Determine the source of each piece of academic metadata, that is, determine whether it is fund project data or dissertation data;

(3)提取当前学术元数据所属的学者;学术元数据所属的学者可以包括项目主持人或论文作者等。也即本步骤可以提取每个科研项目的主持人,或者论文的作者,也就是确定该学术元数据属于哪个学者;(3) Extract the scholars to which the current academic metadata belongs; the scholars to which the academic metadata belongs may include the project host or the author of the paper, etc. That is, in this step, the moderator of each scientific research project or the author of the paper can be extracted, that is, to determine which scholar the academic metadata belongs to;

(4)提取每个基金项目或者论文的文本信息(如题目、关键词和/或摘要等);(4) Extract the text information (such as title, keywords and/or abstract, etc.) of each funded project or paper;

(5)确定该基金项目或者论文的文本信息是中文还是英文;(5) Determine whether the text information of the funded project or thesis is in Chinese or English;

(6)确定该学术元数据所属的时段,将当前学术元数据归入所述所属的时段对应的学术元数据子集,由此构造出包括多个学术元数据子集的学术元数据集合。(6) Determine the time period to which the academic metadata belongs, and classify the current academic metadata into the academic metadata subset corresponding to the time period to which the academic metadata belongs, thereby constructing an academic metadata set including multiple academic metadata subsets.

例如,在爬取了多条基金项目(科研项目)信息后,通过对科研项目数据进行预处理,来获取描述科研项目的学术元数据,然后将上述的科研项目的主持人作为研究对象,并提取这些科研项目的文本信息和项目有效时间信息;进一步从百度学术上爬取上述学者所发表的论文,并且提取了这些论文的文本信息(如标题、摘要和关键词)以及论文的发表时间。基于得到的信息可构造得到学术元数据集合。For example, after crawling a number of fund projects (scientific research projects) information, the academic metadata describing the scientific research project is obtained by preprocessing the scientific research project data, and then the host of the above-mentioned scientific research project is used as the research object, and the Extract the text information and project effective time information of these scientific research projects; further crawl the papers published by the above scholars from Baidu Scholar, and extract the text information (such as titles, abstracts and keywords) of these papers and the publication time of the papers. Based on the obtained information, a collection of academic metadata can be constructed.

此外,上述对学术元数据的预处理可以包括:对文本要进行分词、去停用词、去高频词等数据清洗,然后把每条中文的学术元数据中同时出现的两个单词进行两两组合,提取双词。获取学者id号,对学者进行编码等。In addition, the above preprocessing of academic metadata may include: word segmentation, stop word removal, high frequency word removal and other data cleaning for the text, and then two words appearing simultaneously in each piece of Chinese academic metadata. Two combinations to extract double words. Obtain the scholar id number, code the scholar, etc.

之后,将构造好的学术元数据集合中的至少部分数据输入到研究兴趣挖掘模型(RIMM)中,也即执行步骤S120。更具体而言,在步骤S120中,将这些处理好的学术元数据集合作为输入数据输入到提出的研究兴趣挖掘模型RIMM中,可以对主题数、迭代次数、超参数(在开始机器学习过程之前设置值的参数)等根据经验进行设置,通过多次迭代地执行RIMM进行采样来最终获得主题相关的学者兴趣语义表示,所述学者兴趣语义表示包括科研项目专业领域-主题分布、主题-英文单词分布、主题-中文单词分布、主题-学者分布。After that, at least part of the data in the constructed academic metadata set is input into the research interest mining model (RIMM), that is, step S120 is executed. More specifically, in step S120, these processed academic metadata sets are input into the proposed research interest mining model RIMM as input data, and the number of topics, the number of iterations, and the hyperparameters (before starting the machine learning process) can be determined. The parameters of setting value) are set according to experience, and the semantic representation of scholar interest related to the topic is finally obtained by repeatedly performing RIMM sampling for multiple iterations, and the semantic representation of scholar interest includes scientific research project professional field-topic distribution, topic-English words Distribution, topic-Chinese word distribution, topic-scholar distribution.

作为示例,在学术元数据集合中包括对不同时段t的学术元数据子集

Figure DEST_PATH_IMAGE076
的情况下,可分别对不同时段t的学术元数据子集
Figure DEST_PATH_IMAGE077
通过多次迭代来执行RIMM,由此就可以得到不同时段的学者兴趣表示。As an example, a subset of academic metadata for different time periods t is included in the academic metadata set
Figure DEST_PATH_IMAGE076
In the case of , the subsets of academic metadata for different periods t can be
Figure DEST_PATH_IMAGE077
The RIMM is performed through multiple iterations, so that the interest representations of scholars at different time periods can be obtained.

此外,在本发明一些实施例中,可通过对每个时段的学者兴趣语义表示运行single-pass聚类算法,最终得到多个时段(如T个时段)的学者聚类结果。In addition, in some embodiments of the present invention, a single-pass clustering algorithm may be run on the scholar's interest semantic representation of each time period, and finally the scholar clustering results of multiple time periods (eg, T time periods) are obtained.

在本发明实施例中,研究兴趣挖掘模型的执行过程可包括如下步骤:In the embodiment of the present invention, the execution process of the research interest mining model may include the following steps:

步骤S1,对来自于科研项目并且属于专业领域p的学术元数据采样一个主题分布:

Figure DEST_PATH_IMAGE078
;In step S1, a topic distribution is sampled for academic metadata from scientific research projects and belonging to the professional field p :
Figure DEST_PATH_IMAGE078
;

步骤S2,对来自于论文并且属于专业领域p的学术元数据采样一个主题分布:

Figure DEST_PATH_IMAGE079
;Step S2, sample a topic distribution for academic metadata from papers and belonging to the professional domain p :
Figure DEST_PATH_IMAGE079
;

步骤S3,对每个主题,采样一个主题-中文词分布

Figure DEST_PATH_IMAGE080
和一个主题-学者分布
Figure DEST_PATH_IMAGE081
以及主题-英文词分布
Figure DEST_PATH_IMAGE082
;Step S3, for each topic, sample a topic-Chinese word distribution
Figure DEST_PATH_IMAGE080
and a subject-scholar distribution
Figure DEST_PATH_IMAGE081
and topic-English word distribution
Figure DEST_PATH_IMAGE082
;

步骤S4,针对每条学术元数据中的文本内容判断其为中文还是英文:Step S4, according to the text content in each piece of academic metadata, determine whether it is Chinese or English:

(1)如果是中文,提取双词,针对每个双词,

Figure DEST_PATH_IMAGE083
b i 表示第i个双词,
Figure DEST_PATH_IMAGE084
表示属于专业领域p的第m条元数据中的双词集合):(1) If it is Chinese, extract double words, for each double word,
Figure DEST_PATH_IMAGE083
( b i represents the i -th double word,
Figure DEST_PATH_IMAGE084
represents the set of bigrams in the m-th metadata belonging to the domain of expertise p ):

i. 采样一个主题

Figure DEST_PATH_IMAGE085
;i. Sampling a topic
Figure DEST_PATH_IMAGE085
;

其中,

Figure DEST_PATH_IMAGE086
表示第i个中文双词的主题,
Figure DEST_PATH_IMAGE087
表示多项式分布,
Figure 829707DEST_PATH_IMAGE019
为平衡因子,用来调节学者的兴趣受科研项目和论文的影响的大小。in,
Figure DEST_PATH_IMAGE086
Represents the subject of the i -th Chinese double word,
Figure DEST_PATH_IMAGE087
represents a multinomial distribution,
Figure 829707DEST_PATH_IMAGE019
It is a balance factor, which is used to adjust the influence of scholars' interests by scientific research projects and papers.

ii. 独立地采样中文双词中的两个单词

Figure DEST_PATH_IMAGE088
;ii. Independently sample two words in Chinese double words
Figure DEST_PATH_IMAGE088
;

iii. 采样中文双词的学者

Figure DEST_PATH_IMAGE089
;iii. Scholars who sample Chinese double words
Figure DEST_PATH_IMAGE089
;

(2)如果是英文,对每个单词,

Figure DEST_PATH_IMAGE090
:(2) If it is in English, for each word,
Figure DEST_PATH_IMAGE090
:

i. 采样一个主题

Figure DEST_PATH_IMAGE091
;i. Sampling a topic
Figure DEST_PATH_IMAGE091
;

其中,

Figure DEST_PATH_IMAGE092
表示第i个英文单词的主题。in,
Figure DEST_PATH_IMAGE092
Represents the subject of the i -th English word.

ii. 采样每个英文单词

Figure DEST_PATH_IMAGE093
;ii. Sample each English word
Figure DEST_PATH_IMAGE093
;

iii. 采样英文单词的学者

Figure DEST_PATH_IMAGE094
。iii. Scholars who sample English words
Figure DEST_PATH_IMAGE094
.

研究兴趣挖掘模型RIMM中有两个个潜在变量z b 和z e ,以及五个待估计参数

Figure DEST_PATH_IMAGE095
Figure DEST_PATH_IMAGE096
Figure DEST_PATH_IMAGE097
Figure DEST_PATH_IMAGE098
Figure DEST_PATH_IMAGE099
。本发明实施例中可以采用吉布斯采样方法(如collapsed Gibbs sampling)算法来推断RIMM中待估计的参数。吉布斯采样(Gibbs sampling)是统计学中用于马尔科夫蒙特卡洛(MCMC)的一种算法,用于在难以直接采样时从某一多变量概率分布中近似抽取样本序列。Research Interests There are two latent variables z b and z e in the mining model RIMM, and five parameters to be estimated
Figure DEST_PATH_IMAGE095
,
Figure DEST_PATH_IMAGE096
,
Figure DEST_PATH_IMAGE097
,
Figure DEST_PATH_IMAGE098
and
Figure DEST_PATH_IMAGE099
. In this embodiment of the present invention, a Gibbs sampling method (eg, collapsed Gibbs sampling) algorithm may be used to infer parameters to be estimated in the RIMM. Gibbs sampling is an algorithm used in statistics for Markov Monte Carlo (MCMC) to approximate a sequence of samples from a multivariate probability distribution when direct sampling is difficult.

在本发明实施例中,每个中文双词主题的采样公式如下:In the embodiment of the present invention, the sampling formula of each Chinese two-word topic is as follows:

Figure DEST_PATH_IMAGE100
(1)
Figure DEST_PATH_IMAGE100
(1)

为了推导公式(1),首先计算其联合分布:To derive formula (1), first calculate its joint distribution:

Figure DEST_PATH_IMAGE101
(2)
Figure DEST_PATH_IMAGE101
(2)

其中,所述联合分布表示的是基于上述采样获得的结果推断出的近似分布。Wherein, the joint distribution represents an approximate distribution inferred based on the results obtained by the above sampling.

根据公式(1)和公式(2),得到双词的采样公式如下:According to formula (1) and formula (2), the sampling formula of double words is obtained as follows:

Figure DEST_PATH_IMAGE102
(3)
Figure DEST_PATH_IMAGE102
(3)

其中,Z表示主题的总数,

Figure DEST_PATH_IMAGE103
表示中文主题Z b 下的中文词i
Figure DEST_PATH_IMAGE104
表示除了第i个单词外的所有中文主题的集合;
Figure DEST_PATH_IMAGE105
表示的英文主题Z b 下除英文单词i
Figure 856700DEST_PATH_IMAGE006
表示除了第i个单词外的所有英文主题的集合;
Figure DEST_PATH_IMAGE106
表示第p个专业领域下,除了词i之外,科研项目数据里属于主题z的所有中英文词总数;
Figure DEST_PATH_IMAGE107
表示第p个专业领域下,除了词i之外,论文数据里属于主题z的中英文词总数;
Figure DEST_PATH_IMAGE108
分别表示主题z的中文主题Z b 下除中文词i外,所有科研项目和论文数据里中文单词
Figure DEST_PATH_IMAGE109
出现的次数;
Figure DEST_PATH_IMAGE110
表示主题z下除了词i之外,所有科研项目和论文数据里属于学者s i 的中英文词出现的次数;
Figure DEST_PATH_IMAGE111
表示主题z的英文主题Z e 下除英文单词i外,所有科研项目和论文数据里英文单词
Figure DEST_PATH_IMAGE112
出现的次数;
Figure DEST_PATH_IMAGE113
,
Figure DEST_PATH_IMAGE114
分别为科研项目数据的主题分布以及论文数据的主题分布;
Figure DEST_PATH_IMAGE115
为符合狄利克雷分布的主题-英文单词分布,
Figure DEST_PATH_IMAGE116
为符合狄利克雷分布的主题-学者分布,
Figure DEST_PATH_IMAGE117
为符合狄利克雷分布的主题-中文单词分布;
Figure DEST_PATH_IMAGE118
为平衡因子,表示利用论文信息的比例,用来调节学者的兴趣受科研项目和论文的影响的大小;R表示不同学者的个数,B表示双词的集合,S表示学者的集合,Wb表示不同中文单词的个数,We表示不同英文单词的个数。where Z represents the total number of topics,
Figure DEST_PATH_IMAGE103
represents the Chinese word i under the Chinese topic Z b ,
Figure DEST_PATH_IMAGE104
Represents the set of all Chinese topics except the ith word;
Figure DEST_PATH_IMAGE105
In addition to the English word i under the English topic Z b represented,
Figure 856700DEST_PATH_IMAGE006
Represents the set of all English topics except the ith word;
Figure DEST_PATH_IMAGE106
Indicates the total number of all Chinese and English words belonging to topic z in the scientific research project data except word i in the pth professional field;
Figure DEST_PATH_IMAGE107
Indicates the total number of Chinese and English words belonging to topic z in the paper data except word i in the pth professional field;
Figure DEST_PATH_IMAGE108
In addition to the Chinese word i , the Chinese words in all scientific research projects and paper data under the Chinese topic Z b respectively represent the topic z .
Figure DEST_PATH_IMAGE109
the number of occurrences;
Figure DEST_PATH_IMAGE110
Indicates the number of occurrences of Chinese and English words belonging to scholar si in all scientific research projects and paper data except word i under topic z ;
Figure DEST_PATH_IMAGE111
Except for the English word i , the English words in all scientific research projects and thesis data under the English topic Z e representing the topic z
Figure DEST_PATH_IMAGE112
the number of occurrences;
Figure DEST_PATH_IMAGE113
,
Figure DEST_PATH_IMAGE114
are the subject distribution of scientific research project data and the subject distribution of paper data;
Figure DEST_PATH_IMAGE115
For the topic-English word distribution that conforms to the Dirichlet distribution,
Figure DEST_PATH_IMAGE116
To fit the subject-scholar distribution of the Dirichlet distribution,
Figure DEST_PATH_IMAGE117
is a topic-Chinese word distribution that conforms to the Dirichlet distribution;
Figure DEST_PATH_IMAGE118
is a balance factor, which indicates the proportion of the information of the papers used to adjust the influence of scholars' interests by scientific research projects and papers; R represents the number of different scholars, B represents the set of double words, S represents the set of scholars, and W b Represents the number of different Chinese words, We represent the number of different English words.

在本发明实施例,设计了一个平衡因子

Figure 366267DEST_PATH_IMAGE118
来协同地从主题分布中抽取主题,以能够同时利用不同来源的数据获取学者的兴趣语义表示,能克服现有技术中小样本源的影响会被大样本源淹没的问题。In the embodiment of the present invention, a balance factor is designed
Figure 366267DEST_PATH_IMAGE118
To synergistically extract topics from the topic distribution, to be able to use data from different sources at the same time to obtain the semantic representation of scholars' interests, and to overcome the problem that the influence of small sample sources in the prior art will be overwhelmed by large sample sources.

类似地,本发明实施例中,为英文单词采样主题,采样公式如下:Similarly, in the embodiment of the present invention, it is the English word sampling subject, and the sampling formula is as follows:

Figure DEST_PATH_IMAGE119
(4)
Figure DEST_PATH_IMAGE119
(4)

根据联合公式(2),可以得到英文单词的采样公式如下:According to the joint formula (2), the sampling formula of English words can be obtained as follows:

Figure DEST_PATH_IMAGE120
(5)
Figure DEST_PATH_IMAGE120
(5)

其中,

Figure DEST_PATH_IMAGE121
表示主题z下除英文单词i外,所有基金项目和论文数据里英文单词
Figure DEST_PATH_IMAGE122
出现的次数。in,
Figure DEST_PATH_IMAGE121
Indicates the English words in all fund projects and thesis data except the English word i under topic z
Figure DEST_PATH_IMAGE122
the number of occurrences.

迭代执行上述采样规则直到结果收敛,最终可得到如下估计参数:Iteratively execute the above sampling rules until the results converge, and finally the following estimated parameters can be obtained:

Figure DEST_PATH_IMAGE123
; (6-1)
Figure DEST_PATH_IMAGE123
; (6-1)

Figure DEST_PATH_IMAGE124
; (6-2)
Figure DEST_PATH_IMAGE124
; (6-2)

Figure DEST_PATH_IMAGE125
; (6-3)
Figure DEST_PATH_IMAGE125
; (6-3)

Figure DEST_PATH_IMAGE126
; (6-4)
Figure DEST_PATH_IMAGE126
; (6-4)

Figure DEST_PATH_IMAGE127
(6-5)
Figure DEST_PATH_IMAGE127
(6-5)

其中,

Figure DEST_PATH_IMAGE128
表示科研项目的专业领域为p主题为z的专业领域-主题分布;
Figure DEST_PATH_IMAGE129
表示论文数据的专业领域为p主题为z的专业领域-主题分布;
Figure DEST_PATH_IMAGE130
表示第p个专业领域下,科研项目数据里属于主题z的所有中英文词总数;
Figure 790295DEST_PATH_IMAGE028
表示第p个专业领域下,论文数据里属于主题z的所有中英文词总数;
Figure DEST_PATH_IMAGE131
表示第zb个主题下,所有科研项目和论文数据里中文单词出现的次数;
Figure DEST_PATH_IMAGE132
表示主题为z的中文双词的主题-中文单词分布;
Figure DEST_PATH_IMAGE133
表示第ze个主题下,所有科研项目和论文数据里英文单词出现的次数;
Figure 705161DEST_PATH_IMAGE132
表示主题为z的英文单词w e 的主题-英文单词分布;
Figure DEST_PATH_IMAGE134
表示主题为z、学者为s的主题-学者分布;
Figure 789923DEST_PATH_IMAGE034
表示主题z下所有科研项目和论文数据里属于学者s的中英文词出现的次数。in,
Figure DEST_PATH_IMAGE128
Indicates that the professional field of the scientific research project is the professional field of p and the topic is z - topic distribution;
Figure DEST_PATH_IMAGE129
Indicates that the professional field of the paper data is p and the topic is the professional field of z - topic distribution;
Figure DEST_PATH_IMAGE130
Indicates the total number of all Chinese and English words belonging to topic z in the scientific research project data under the pth professional field;
Figure 790295DEST_PATH_IMAGE028
Indicates the total number of all Chinese and English words belonging to topic z in the paper data under the pth professional field;
Figure DEST_PATH_IMAGE131
Indicates the number of occurrences of Chinese words in the data of all scientific research projects and papers under the z- th topic;
Figure DEST_PATH_IMAGE132
Represents the topic-Chinese word distribution of Chinese double words with topic z;
Figure DEST_PATH_IMAGE133
Represents the number of occurrences of English words in all scientific research projects and paper data under the z e -th topic;
Figure 705161DEST_PATH_IMAGE132
Represents the topic-English word distribution of the English word we with topic z ;
Figure DEST_PATH_IMAGE134
Represents the topic-scholar distribution with topic z and scholar s;
Figure 789923DEST_PATH_IMAGE034
Indicates the number of occurrences of Chinese and English words belonging to scholar s in all scientific research projects and paper data under topic z.

由上可知,通过研究兴趣挖掘模型可以获得学者的研究兴趣语义表示,然而该表示是静态的,即仅为一段时间内的主题表示。因此,为了能够根据不同时间的用户的兴趣语义表示,对学者进行聚类,需要体现学者的兴趣动态变化。尽管学者的兴趣是动态变化的,但是也是存在一定的持续性,因此,本发明并不是简单的对语料进行切片,而是利用学者历史兴趣来帮助推断当前时刻的主题分布。It can be seen from the above that the semantic representation of scholars' research interests can be obtained through the research interest mining model, but the representation is static, that is, only a topic representation for a period of time. Therefore, in order to cluster scholars according to the semantic representation of users' interests at different times, it is necessary to reflect the dynamic changes of scholars' interests. Although the interests of scholars are dynamic, there is also a certain persistence. Therefore, the present invention does not simply slice the corpus, but uses the historical interests of scholars to help infer the topic distribution at the current moment.

假设在时段t内有

Figure DEST_PATH_IMAGE135
位学者,对于每一位学者,都收集了他的写书消息。基于这些学术消息,如果利用RIMM来获取他们的兴趣语义表示,并将具有共同兴趣的学者聚集在一起作为一个聚类c。则该聚类的正式陈述如下:Suppose that in time period t there are
Figure DEST_PATH_IMAGE135
A scholar, for each scholar, has collected his writing news. Based on these academic messages, if we utilize RIMM to obtain semantic representations of their interests, and gather scholars with common interests together as a cluster c . Then the formal statement of the cluster is as follows:

Figure DEST_PATH_IMAGE136
Figure DEST_PATH_IMAGE136
;

其中,f表示独立的学者到学者簇之间的映射关系。c代表一个具有共同兴趣的学者群体。

Figure 132043DEST_PATH_IMAGE135
Figure DEST_PATH_IMAGE137
分别表示学者和簇在时段t 内的数量。Among them, f represents the mapping relationship between independent scholars to scholar clusters. c represents a group of scholars with common interests.
Figure 132043DEST_PATH_IMAGE135
and
Figure DEST_PATH_IMAGE137
are the numbers of scholars and clusters in time period t , respectively.

为了对学者兴趣动态变化进行建模,本发明充分考虑了如何利用多源多语言数据的历史主题分布来推断当前学者的主题分布。In order to model the dynamic changes of scholars' interests, the present invention fully considers how to use the historical topic distribution of multi-source and multilingual data to infer the topic distribution of current scholars.

为了能够保持学者在不同时段的兴趣连续性,本发明将前一时段(如第(t-1)时段)的主题分布作为当前时段(如第t时段)的先验分布。因此,当前时刻的先验参数计算如下:In order to maintain the continuity of scholars' interests in different periods, the present invention takes the topic distribution of the previous period (eg, the (t-1)th period) as the prior distribution of the current period (eg, the tth period). Therefore, the prior parameters at the current moment are calculated as follows:

Figure DEST_PATH_IMAGE138
; (7-1)
Figure DEST_PATH_IMAGE138
; (7-1)

Figure DEST_PATH_IMAGE139
; (7-2)
Figure DEST_PATH_IMAGE139
; (7-2)

Figure DEST_PATH_IMAGE140
; (7-3)
Figure DEST_PATH_IMAGE140
; (7-3)

Figure DEST_PATH_IMAGE141
; (7-4)
Figure DEST_PATH_IMAGE141
; (7-4)

Figure DEST_PATH_IMAGE142
; (7-5)
Figure DEST_PATH_IMAGE142
; (7-5)

其中,

Figure DEST_PATH_IMAGE143
为衰减因子,
Figure DEST_PATH_IMAGE144
值越大,表示历史兴趣对当前主题分布的影响越大;
Figure 200624DEST_PATH_IMAGE037
表示在t-1时刻,第p个专业领域下,科研项目数据里属于主题
Figure 919181DEST_PATH_IMAGE038
的所有中英文词总数;
Figure 904455DEST_PATH_IMAGE039
表示在t-1时刻,科研项目数据的专业领域主题分布;
Figure 948634DEST_PATH_IMAGE040
表示在
Figure 3047DEST_PATH_IMAGE041
时刻,科研项目数据的专业领域主题分布;
Figure 790874DEST_PATH_IMAGE042
表示在
Figure 365075DEST_PATH_IMAGE043
时刻,第
Figure 580156DEST_PATH_IMAGE044
个专业领域下,论文数据里属于主题
Figure 607018DEST_PATH_IMAGE038
的所有中英文词总数;
Figure 198536DEST_PATH_IMAGE045
表示在
Figure 627243DEST_PATH_IMAGE043
时刻,论文数据的专业领域主题分布;
Figure 278804DEST_PATH_IMAGE046
表示在
Figure 58542DEST_PATH_IMAGE041
时刻,论文数据的专业领域主题分布;
Figure 938904DEST_PATH_IMAGE047
表示在
Figure 222118DEST_PATH_IMAGE043
时刻,第
Figure 44580DEST_PATH_IMAGE048
个主题下,所有科研项目和论文数据里中文单词
Figure 46034DEST_PATH_IMAGE049
出现的次数;
Figure 979355DEST_PATH_IMAGE050
表示在
Figure 382655DEST_PATH_IMAGE043
时刻,所有科研项目和论文数据的主题中文单词分布;
Figure 110439DEST_PATH_IMAGE051
表示在
Figure 599190DEST_PATH_IMAGE041
时刻,所有科研项目和论文数据的主题中文单词分布;
Figure 319890DEST_PATH_IMAGE052
表示在
Figure 577696DEST_PATH_IMAGE043
时刻,第
Figure 7540DEST_PATH_IMAGE053
个主题下,所有科研项目和论文数据里英文单词
Figure 718007DEST_PATH_IMAGE054
出现的次数;
Figure 993131DEST_PATH_IMAGE055
表示在
Figure 371022DEST_PATH_IMAGE043
时刻,所有科研项目和论文数据的主题英文单词分布;
Figure 440610DEST_PATH_IMAGE056
表示在
Figure 169531DEST_PATH_IMAGE041
时刻,所有科研项目和论文数据的主题英文单词分布;
Figure 982766DEST_PATH_IMAGE057
表示在
Figure 215165DEST_PATH_IMAGE043
时刻,第
Figure 200526DEST_PATH_IMAGE058
个主题下,所有科研项目和论文数据里学者
Figure 151165DEST_PATH_IMAGE059
出现的次数;
Figure 768091DEST_PATH_IMAGE060
表示在
Figure 120575DEST_PATH_IMAGE043
时刻,所有科研项目和论文数据的主题学者分布;
Figure 797544DEST_PATH_IMAGE061
表示在
Figure 969899DEST_PATH_IMAGE041
时刻,所有科研项目和论文数据的主题学者分布。in,
Figure DEST_PATH_IMAGE143
is the attenuation factor,
Figure DEST_PATH_IMAGE144
The larger the value, the greater the impact of historical interest on the current topic distribution;
Figure 200624DEST_PATH_IMAGE037
Indicates that at time t-1 , under the pth professional field, the scientific research project data belongs to the theme
Figure 919181DEST_PATH_IMAGE038
The total number of all Chinese and English words of ;
Figure 904455DEST_PATH_IMAGE039
Represents the subject distribution of scientific research project data in professional fields at time t-1 ;
Figure 948634DEST_PATH_IMAGE040
expressed in
Figure 3047DEST_PATH_IMAGE041
Time, subject distribution of scientific research project data in professional fields;
Figure 790874DEST_PATH_IMAGE042
expressed in
Figure 365075DEST_PATH_IMAGE043
time, the
Figure 580156DEST_PATH_IMAGE044
Under a professional field, the thesis data belongs to the topic
Figure 607018DEST_PATH_IMAGE038
The total number of all Chinese and English words of ;
Figure 198536DEST_PATH_IMAGE045
expressed in
Figure 627243DEST_PATH_IMAGE043
Moment, the subject distribution of the professional field of the paper data;
Figure 278804DEST_PATH_IMAGE046
expressed in
Figure 58542DEST_PATH_IMAGE041
Moment, the subject distribution of the professional field of the paper data;
Figure 938904DEST_PATH_IMAGE047
expressed in
Figure 222118DEST_PATH_IMAGE043
time, the
Figure 44580DEST_PATH_IMAGE048
Under this topic, Chinese words in all scientific research projects and paper data
Figure 46034DEST_PATH_IMAGE049
the number of occurrences;
Figure 979355DEST_PATH_IMAGE050
expressed in
Figure 382655DEST_PATH_IMAGE043
Time, topic Chinese word distribution of all scientific research projects and dissertation data;
Figure 110439DEST_PATH_IMAGE051
expressed in
Figure 599190DEST_PATH_IMAGE041
Time, topic Chinese word distribution of all scientific research projects and dissertation data;
Figure 319890DEST_PATH_IMAGE052
expressed in
Figure 577696DEST_PATH_IMAGE043
time, the
Figure 7540DEST_PATH_IMAGE053
Under this topic, English words in all scientific research projects and paper data
Figure 718007DEST_PATH_IMAGE054
the number of occurrences;
Figure 993131DEST_PATH_IMAGE055
expressed in
Figure 371022DEST_PATH_IMAGE043
Time, the subject English word distribution of all scientific research projects and paper data;
Figure 440610DEST_PATH_IMAGE056
expressed in
Figure 169531DEST_PATH_IMAGE041
Time, the subject English word distribution of all scientific research projects and paper data;
Figure 982766DEST_PATH_IMAGE057
expressed in
Figure 215165DEST_PATH_IMAGE043
time, the
Figure 200526DEST_PATH_IMAGE058
Under this topic, scholars in all scientific research projects and dissertation data
Figure 151165DEST_PATH_IMAGE059
the number of occurrences;
Figure 768091DEST_PATH_IMAGE060
expressed in
Figure 120575DEST_PATH_IMAGE043
Time, the distribution of subject scholars for all scientific research projects and dissertation data;
Figure 797544DEST_PATH_IMAGE061
expressed in
Figure 969899DEST_PATH_IMAGE041
Moment, subject scholar distribution of all research projects and dissertation data.

如果给定T个时间片(时段),可以将整个语料(学术元数据集合)M根据时段t切分成T个语料子集:

Figure DEST_PATH_IMAGE145
,其中,
Figure DEST_PATH_IMAGE146
。通过在每个子集上运行研究兴趣挖掘模型就可以得到不同时间片内的主题-学者分布,也就是可以获得学者在不同时段t的兴趣语义表示。本发明实施例中利用单遍(single-pass)聚类算法对所获取的不同时刻的学者兴趣语义表示进行聚类,来获得动态的学者聚类结果。If T time slices (periods) are given, the entire corpus (a collection of academic metadata) M can be divided into T corpus subsets according to the period t :
Figure DEST_PATH_IMAGE145
,in,
Figure DEST_PATH_IMAGE146
. By running the research interest mining model on each subset, the topic-scholar distribution in different time slices can be obtained, that is, the semantic representation of scholars' interests in different time periods t can be obtained. In the embodiment of the present invention, a single-pass clustering algorithm is used to cluster the acquired scholar's interest semantic representations at different times, so as to obtain a dynamic scholar clustering result.

上述可知,本发明研究了多源、多语言、不断增长的学术数据中的学者聚类问题,通过新提出的RIMM能够推断学者的主题分布,并根据其研究兴趣实现了动态聚类。本发明提出的研究兴趣挖掘模型(RIMM)能够有效地整合多源数据,弥补多语言数据的词汇鸿沟,从而准确挖掘学者的研究兴趣。此外,本发明还提出了采用吉布斯采样方法来推断RIMM的参数。通过对主题的迭代采样,本发明可以将学术数据的所有特征映射到一个公共语义空间中,并获得它们的主题分布。本发明的基于RIMM的研究兴趣追踪和动态学者聚类方法,通过捕捉学者研究兴趣的连续性和变化性,可以动态地追踪学者的兴趣并对学者进行聚类。As can be seen from the above, the present invention studies the scholar clustering problem in multi-source, multi-language, and growing academic data, and can infer the topic distribution of scholars through the newly proposed RIMM, and realize dynamic clustering according to their research interests. The research interest mining model (RIMM) proposed by the present invention can effectively integrate multi-source data, make up the vocabulary gap of multilingual data, and accurately mine the research interests of scholars. In addition, the present invention also proposes to use the Gibbs sampling method to infer the parameters of the RIMM. Through iterative sampling of topics, the present invention can map all features of academic data into a common semantic space and obtain their topic distribution. The RIMM-based research interest tracking and dynamic scholar clustering method of the present invention can dynamically track and cluster scholars' interests by capturing the continuity and variability of scholars' research interests.

与上述方法相应地,本发明还提供了一种面向学者聚类的研究兴趣挖掘装置,包括处理器和存储器,所述存储器中存储有计算机指令,所述处理器用于执行所述存储器中存储的计算机指令,当所述计算机指令被处理器执行时该装置实现如前所述边缘计算服务器部署方法的步骤。Corresponding to the above method, the present invention also provides a research interest mining device for scholar clustering, comprising a processor and a memory, wherein the memory stores computer instructions, and the processor is used to execute the data stored in the memory. Computer instructions, when the computer instructions are executed by the processor, the apparatus implements the steps of the aforementioned edge computing server deployment method.

本发明实施例还提供一种计算机可读存储介质,其上存储有计算机程序,该计算机程序被处理器执行时以实现前述边缘计算服务器部署方法的步骤。该计算机可读存储介质可以是有形存储介质,诸如光盘、U盘、软盘、硬盘等。Embodiments of the present invention further provide a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, implements the steps of the foregoing method for deploying an edge computing server. The computer-readable storage medium may be a tangible storage medium, such as an optical disk, a USB flash drive, a floppy disk, a hard disk, and the like.

需要明确的是,本发明并不局限于上文所描述并在图中示出的特定配置和处理。为了简明起见,这里省略了对已知方法的详细描述。在上述实施例中,描述和示出了若干具体的步骤作为示例。但是,本发明的方法过程并不限于所描述和示出的具体步骤,本领域的技术人员可以在领会本发明的精神后,作出各种改变、修改和添加,或者改变步骤之间的顺序。It is to be understood that the present invention is not limited to the specific arrangements and processes described above and shown in the figures. For the sake of brevity, detailed descriptions of known methods are omitted here. In the above-described embodiments, several specific steps are described and shown as examples. However, the method process of the present invention is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the sequence of steps after comprehending the spirit of the present invention.

本领域普通技术人员应该可以明白,结合本文中所公开的实施方式描述的各示例性的组成部分、系统和方法,能够以硬件、软件或者二者的结合来实现。具体究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本发明的范围。当以硬件方式实现时,其可以例如是电子电路、专用集成电路(ASIC)、适当的固件、插件、功能卡等等。当以软件方式实现时,本发明的元素是被用于执行所需任务的程序或者代码段。程序或者代码段可以存储在机器可读介质中,或者通过载波中携带的数据信号在传输介质或者通信链路上传送。It should be understood by those of ordinary skill in the art that the various exemplary components, systems and methods described in conjunction with the embodiments disclosed herein can be implemented in hardware, software or a combination of the two. Whether it is implemented in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of the present invention. When implemented in hardware, it may be, for example, an electronic circuit, an application specific integrated circuit (ASIC), suitable firmware, a plug-in, a function card, or the like. When implemented in software, elements of the invention are programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine-readable medium or transmitted over a transmission medium or communication link by a data signal carried in a carrier wave.

还需要说明的是,本发明中提及的示例性实施例,基于一系列的步骤或者装置描述一些方法或系统。但是,本发明不局限于上述步骤的顺序,也就是说,可以按照实施例中提及的顺序执行步骤,也可以不同于实施例中的顺序,或者若干步骤同时执行。It should also be noted that the exemplary embodiments mentioned in the present invention describe some methods or systems based on a series of steps or devices. However, the present invention is not limited to the order of the above steps, that is, the steps may be performed in the order mentioned in the embodiments, or may be different from the order in the embodiments, or several steps may be performed simultaneously.

本发明中,针对一个实施方式描述和/或例示的特征,可以在一个或更多个其它实施方式中以相同方式或以类似方式使用,和/或与其他实施方式的特征相结合或代替其他实施方式的特征。In the present invention, features described and/or illustrated with respect to one embodiment may be used in the same or similar manner in one or more other embodiments, and/or in combination with or in place of features of other embodiments Features of the implementation.

以上所述仅为本发明的优选实施例而已,并不用于限制本发明,对于本领域的技术人员来说,本发明实施例可以有各种更改和变化。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. For those skilled in the art, various modifications and changes may be made to the embodiments of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included within the protection scope of the present invention.

Claims (8)

1.一种面向学者聚类的研究兴趣挖掘方法,其特征在于,该方法包括以下步骤:1. A research interest mining method for scholar clustering, characterized in that the method comprises the following steps: 基于多源学者相关学术数据构造学术元数据集合,所述学术元数据集合中的每条学术元数据包括如下信息:专业领域信息、数据源信息、学者信息和文本内容信息,所述学术数据包括科研项目数据和论文数据;An academic metadata set is constructed based on academic data related to scholars from multiple sources. Each piece of academic metadata in the academic metadata set includes the following information: professional field information, data source information, scholar information and text content information. The academic data includes Research project data and dissertation data; 将构造的学术元数据集合中的至少部分学术元数据作为输入数据输入到预先建立的研究兴趣挖掘模型中,通过多次迭代地执行研究兴趣挖掘模型进行采样来获得学者兴趣语义表示,所述学者兴趣语义表示包括专业领域-主题分布、主题-英文单词分布、主题-中文单词分布和主题-学者分布;其中,所述研究兴趣挖掘模型对来自同一数据源并且属于同一个专业领域的学者的数据共享同一个主题分布,并且,所述研究兴趣挖掘模型中,所述专业领域-主题分布被建模为狄利克雷分布,所述主题-英文单词分布、主题-中文单词分布和主题-学者分布被建模为多项式分布,所述专业领域-主题分布包括科研项目的专业领域-主题分布和论文数据的专业领域-主题分布;Input at least part of the academic metadata in the constructed academic metadata set as input data into the pre-established research interest mining model, and obtain the scholar interest semantic representation by repeatedly executing the research interest mining model for sampling multiple iterations. The semantic representation of interests includes professional field-topic distribution, topic-English word distribution, topic-Chinese word distribution, and topic-scholar distribution; wherein, the research interest mining model is based on the data of scholars from the same data source and belonging to the same professional field share the same topic distribution, and, in the research interest mining model, the professional field-topic distribution is modeled as a Dirichlet distribution, the topic-English word distribution, topic-Chinese word distribution and topic-scholar distribution is modeled as a polynomial distribution, and the area of expertise-topic distribution includes the area of expertise-topic distribution of scientific research projects and the area of expertise-topic distribution of dissertation data; 基于获得的学者兴趣语义表示进行学者聚类,获得学者聚类结果;Perform scholar clustering based on the obtained semantic representation of scholar interest, and obtain scholar clustering results; 其中,所述将构造的学术元数据集合中的至少部分学术元数据作为输入数据输入到预先建立的研究兴趣挖掘模型中,通过多次迭代地执行研究兴趣挖掘模型进行采样来获得学者兴趣语义表示,包括:Wherein, at least part of the academic metadata in the constructed academic metadata set is input into the pre-established research interest mining model as input data, and the scholar's interest semantic representation is obtained by repeatedly executing the research interest mining model for sampling multiple times. ,include: 对来自科研项目且属于预定专业领域的学术元数据采样得到科研项目的专业领域-主题分布;Sampling the academic metadata from scientific research projects and belonging to a predetermined professional field to obtain the professional field-topic distribution of scientific research projects; 对来自论文且属于预定专业领域的学术元数据采样得到论文数据的专业领域-主题分布;Sampling academic metadata from papers that belong to a predetermined professional domain to obtain the professional domain-topic distribution of the paper data; 针对每个预定主题进行采样获得对应的主题-中文词分布、主题-学者分布和主题-英文词分布;Sampling for each predetermined topic to obtain the corresponding topic-Chinese word distribution, topic-scholar distribution and topic-English word distribution; 针对每条学术元数据中的文本内容确定其为中文还是英文;在文本内容为中文的情况下,把每条中文的学术元数据中同时出现的两个单词进行两两组合来提取双词,并针对每个双词采取以下操作:采样中文双词的主题、独立地采样两个词以及采样双词的作者;在文本内容为英文的情况下,针对每个单词采样以下操作:采样英文主题、采样每个英文单词以及采样英文单词的作者。Determine whether it is Chinese or English according to the text content in each piece of academic metadata; in the case that the text content is Chinese, the two words appearing at the same time in each piece of Chinese academic metadata are combined in pairs to extract the double words. And take the following actions for each double word: sample the topic of the Chinese double word, independently sample the two words, and sample the author of the double word; in the case of the text content in English, sample the following operations for each word: sample the English topic , sample each English word, and the author of the sampled English word. 2.根据权利要求1所述的方法,其特征在于,所述方法还包括构建研究兴趣挖掘模型的步骤,该步骤包括:2. The method according to claim 1, wherein the method further comprises the step of constructing a research interest mining model, the step comprising: 确定学术元数据所属于的专业领域;Identify the area of expertise to which the academic metadata falls; 从来自科研项目且属于确定的专业领域的主题分布和来自论文且属于确定的专业领域的主题分布中协同地对主题进行采样,得到学术元数据主题;To obtain academic metadata topics by collaboratively sampling topics from a distribution of topics from research projects and belonging to a defined area of expertise and a distribution of topics from papers and belonging to a defined area of expertise; 根据主题-英文单词分布、主题-中文单词分布、主题-学者分布来生成英文单词、中文单词和学者。Generate English words, Chinese words, and scholars according to topic-English word distribution, topic-Chinese word distribution, and topic-scholar distribution. 3.根据权利要求1所述的方法,其特征在于,所述构造学术元数据集合,包括:3. The method according to claim 1, wherein the constructing an academic metadata set comprises: 确定每条学术元数据的来源,确定是科研项目数据还是论文数据;Determine the source of each piece of academic metadata, and determine whether it is scientific research project data or paper data; 提取当前学术元数据所属的学者;Extract the scholar to which the current academic metadata belongs; 提取每个科研项目或者论文的文本信息;Extract the text information of each scientific research project or paper; 确定所述科研项目或者论文的文本信息是中文还是英文;Determine whether the text information of the scientific research project or paper is in Chinese or English; 确定当前学术元数据所属的时段,将当前学术元数据归入所述所属的时段对应的学术元数据子集,由此构造包括所述学术元数据子集的学术元数据集合。The time period to which the current academic metadata belongs is determined, and the current academic metadata is classified into the academic metadata subset corresponding to the time period to which the current academic metadata belongs, thereby constructing an academic metadata set including the academic metadata subset. 4.根据权利要求1所述的方法,其特征在于,4. The method of claim 1, wherein 所述将构造的学术元数据集合中的至少部分学术元数据作为输入数据输入到预先建立的研究兴趣挖掘模型中,通过多次迭代地执行研究兴趣挖掘模型进行采样来获得学者兴趣语义表示,还包括:将不同时段对应的学术元数据子集中学术元数据作为输入数据输入到所述研究兴趣挖掘模型中,得到不同时刻的学者兴趣语义表示;Said inputting at least part of the academic metadata in the constructed academic metadata set into the pre-established research interest mining model as input data, and obtaining the scholar's interest semantic representation by iteratively executing the research interest mining model for multiple times for sampling, and further Including: inputting the academic metadata in the academic metadata subsets corresponding to different time periods as input data into the research interest mining model to obtain the semantic representation of scholars' interests at different times; 所述对获得的学者兴趣语义表示进行聚类包括:利用单遍聚类算法对所获取的不同时刻的学者兴趣语义表示进行聚类。The clustering of the acquired scholar's interest semantic representation includes: using a single-pass clustering algorithm to cluster the acquired scholar's interest semantic representation at different times. 5.根据权利要求1所述的方法,其特征在于,所述研究兴趣挖掘模型中的待估计参数采用吉布斯采样方法推算得到;5. The method according to claim 1, wherein the parameters to be estimated in the research interest mining model are calculated by using a Gibbs sampling method; 对中文双词的采样采用如下公式:The sampling of Chinese double words adopts the following formula:
Figure 447327DEST_PATH_IMAGE002
Figure 447327DEST_PATH_IMAGE002
对每个英文单词的采样采用如下公式:The following formula is used for the sampling of each English word:
Figure DEST_PATH_IMAGE003
Figure DEST_PATH_IMAGE003
其中,Z表示主题的总数,
Figure 173975DEST_PATH_IMAGE004
表示中文主题Z b 下的中文词i
Figure 541502DEST_PATH_IMAGE005
表示除了第i个单词外的所有中文主题的集合;
Figure 455232DEST_PATH_IMAGE006
表示的英文主题Z b 下的英文单词i
Figure 199197DEST_PATH_IMAGE007
表示除了第i个单词外的所有英文主题的集合;
Figure 577089DEST_PATH_IMAGE008
表示第p个专业领域下,除了词i之外,科研项目数据里属于主题z的所有中英文词总数;
Figure 584359DEST_PATH_IMAGE009
表示第p个专业领域下,除了词i之外,论文数据里属于主题z的中英文词总数;
Figure 47701DEST_PATH_IMAGE010
分别表示主题z的中文主题Z b 下除中文词i外,所有科研项目和论文数据里中文单词
Figure 595357DEST_PATH_IMAGE011
出现的次数;
Figure 753720DEST_PATH_IMAGE012
表示主题z下除了词i之外,所有科研项目和论文数据里属于学者s i 的中英文词出现的次数;
Figure 259787DEST_PATH_IMAGE013
表示主题z的英文主题Z e 下除英文单词i外,所有科研项目和论文数据里英文单词
Figure 679267DEST_PATH_IMAGE014
出现的次数;a 1, a 2分别为科研项目数据的主题分布以及论文数据的主题分布;
Figure 233877DEST_PATH_IMAGE015
为符合狄利克雷分布的主题-英文单词分布,
Figure 55202DEST_PATH_IMAGE016
为符合狄利克雷分布的主题-学者分布,
Figure 732171DEST_PATH_IMAGE017
为符合狄利克雷分布的主题-中文单词分布;R表示不同学者的个数,B表示双词的集合,S表示学者的集合,Wb表示不同中文单词的个数,We表示不同英文单词的个数,
Figure 842210DEST_PATH_IMAGE018
为平衡因子;
where Z represents the total number of topics,
Figure 173975DEST_PATH_IMAGE004
represents the Chinese word i under the Chinese topic Z b ,
Figure 541502DEST_PATH_IMAGE005
Represents the set of all Chinese topics except the ith word;
Figure 455232DEST_PATH_IMAGE006
represents the English word i under the English topic Z b ,
Figure 199197DEST_PATH_IMAGE007
Represents the set of all English topics except the ith word;
Figure 577089DEST_PATH_IMAGE008
Indicates the total number of all Chinese and English words belonging to topic z in the scientific research project data except word i in the pth professional field;
Figure 584359DEST_PATH_IMAGE009
Indicates the total number of Chinese and English words belonging to topic z in the paper data except word i in the pth professional field;
Figure 47701DEST_PATH_IMAGE010
In addition to the Chinese word i , the Chinese words in all scientific research projects and paper data under the Chinese topic Z b respectively represent the topic z .
Figure 595357DEST_PATH_IMAGE011
the number of occurrences;
Figure 753720DEST_PATH_IMAGE012
Indicates the number of occurrences of Chinese and English words belonging to scholar si in all scientific research projects and paper data except word i under topic z ;
Figure 259787DEST_PATH_IMAGE013
Except for the English word i , the English words in all scientific research projects and thesis data under the English topic Z e representing the topic z
Figure 679267DEST_PATH_IMAGE014
The number of occurrences; a 1 and a 2 are the subject distribution of scientific research project data and the subject distribution of paper data respectively;
Figure 233877DEST_PATH_IMAGE015
For the topic-English word distribution that conforms to the Dirichlet distribution,
Figure 55202DEST_PATH_IMAGE016
To fit the subject-scholar distribution of the Dirichlet distribution,
Figure 732171DEST_PATH_IMAGE017
It is the topic-Chinese word distribution that conforms to the Dirichlet distribution; R represents the number of different scholars, B represents the set of double words, S represents the set of scholars, W b represents the number of different Chinese words, and We e represents different English words number of ,
Figure 842210DEST_PATH_IMAGE018
is the balance factor;
在对所述研究兴趣挖掘模型进行迭代操作后,得到如下估计参数:After the iterative operation of the research interest mining model, the following estimated parameters are obtained:
Figure 731668DEST_PATH_IMAGE019
Figure 731668DEST_PATH_IMAGE019
;
Figure DEST_PATH_IMAGE020
Figure DEST_PATH_IMAGE020
;
Figure 407500DEST_PATH_IMAGE021
Figure 407500DEST_PATH_IMAGE021
;
Figure DEST_PATH_IMAGE022
Figure DEST_PATH_IMAGE022
;
Figure 661895DEST_PATH_IMAGE023
Figure 661895DEST_PATH_IMAGE023
;
其中,
Figure DEST_PATH_IMAGE024
表示科研项目的专业领域为p主题为z的专业领域-主题分布;
Figure 993650DEST_PATH_IMAGE025
表示论文数据的专业领域为p主题为z的专业领域-主题分布;
Figure DEST_PATH_IMAGE026
表示第p个专业领域下,科研项目数据里属于主题z的所有中英文词总数;
Figure 421221DEST_PATH_IMAGE027
表示第p个专业领域下,论文数据里属于主题z的所有中英文词总数;
Figure DEST_PATH_IMAGE028
表示第zb个主题下,所有科研项目和论文数据里中文单词出现的次数;
Figure 623663DEST_PATH_IMAGE029
表示主题为z的中文双词的主题-中文单词分布;
Figure 376855DEST_PATH_IMAGE030
表示第ze个主题下,所有科研项目和论文数据里英文单词出现的次数;
Figure 523803DEST_PATH_IMAGE031
表示主题为z的英文单词w e 的主题-英文单词分布;
Figure 223906DEST_PATH_IMAGE032
表示主题为z、学者为s的主题-学者分布;
Figure 139909DEST_PATH_IMAGE033
表示主题z下所有科研项目和论文数据里属于学者s的中英文词出现的次数。
in,
Figure DEST_PATH_IMAGE024
Indicates that the professional field of the scientific research project is the professional field of p and the topic is z - topic distribution;
Figure 993650DEST_PATH_IMAGE025
Indicates that the professional field of the paper data is p and the topic is the professional field of z - topic distribution;
Figure DEST_PATH_IMAGE026
Indicates the total number of all Chinese and English words belonging to topic z in the scientific research project data under the pth professional field;
Figure 421221DEST_PATH_IMAGE027
Indicates the total number of all Chinese and English words belonging to topic z in the paper data under the pth professional field;
Figure DEST_PATH_IMAGE028
Indicates the number of occurrences of Chinese words in the data of all scientific research projects and papers under the z- th topic;
Figure 623663DEST_PATH_IMAGE029
Represents the topic-Chinese word distribution of Chinese double words with topic z;
Figure 376855DEST_PATH_IMAGE030
Represents the number of occurrences of English words in all scientific research projects and paper data under the z e -th topic;
Figure 523803DEST_PATH_IMAGE031
Represents the topic-English word distribution of the English word we with topic z ;
Figure 223906DEST_PATH_IMAGE032
Represents the topic-scholar distribution with topic z and scholar s;
Figure 139909DEST_PATH_IMAGE033
Indicates the number of occurrences of Chinese and English words belonging to scholar s in all scientific research projects and paper data under topic z.
6.根据权利要求3所述的方法,其特征在于,所述方法还包括:6. The method according to claim 3, wherein the method further comprises: 将前一时段的主题分布作为当前时段的先验分布来基于如下公式计算当前时段的先验参数:Taking the topic distribution of the previous period as the prior distribution of the current period, the prior parameters of the current period are calculated based on the following formula:
Figure 798424DEST_PATH_IMAGE034
Figure 798424DEST_PATH_IMAGE034
其中,
Figure 370350DEST_PATH_IMAGE035
为衰减因子,
Figure 405303DEST_PATH_IMAGE036
表示在t-1时刻,第p个专业领域下,科研项目数据里属于主题z的所有中英文词总数;
Figure 441392DEST_PATH_IMAGE037
表示在t-1时刻,科研项目数据的专业领域主题分布;
Figure 270807DEST_PATH_IMAGE038
表示在
Figure 330030DEST_PATH_IMAGE039
时刻,科研项目数据的专业领域主题分布;
Figure 168673DEST_PATH_IMAGE040
表示在
Figure 793690DEST_PATH_IMAGE041
时刻,第
Figure 59586DEST_PATH_IMAGE042
个专业领域下,论文数据里属于主题
Figure 340526DEST_PATH_IMAGE043
的所有中英文词总数;
Figure 248439DEST_PATH_IMAGE044
表示在
Figure 727962DEST_PATH_IMAGE041
时刻,论文数据的专业领域主题分布;
Figure 368022DEST_PATH_IMAGE045
表示在
Figure 932995DEST_PATH_IMAGE039
时刻,论文数据的专业领域主题分布;
Figure 379020DEST_PATH_IMAGE046
表示在
Figure 713049DEST_PATH_IMAGE041
时刻,第
Figure 524011DEST_PATH_IMAGE047
个主题下,所有科研项目和论文数据里中文单词
Figure 841859DEST_PATH_IMAGE048
出现的次数;
Figure 560417DEST_PATH_IMAGE049
表示在
Figure 14532DEST_PATH_IMAGE041
时刻,所有科研项目和论文数据的主题中文单词分布;
Figure 996394DEST_PATH_IMAGE050
表示在
Figure 801539DEST_PATH_IMAGE039
时刻,所有科研项目和论文数据的主题中文单词分布;
Figure 323787DEST_PATH_IMAGE051
表示在
Figure 835671DEST_PATH_IMAGE041
时刻,第
Figure 50752DEST_PATH_IMAGE052
个主题下,所有科研项目和论文数据里英文单词
Figure 812035DEST_PATH_IMAGE053
出现的次数;
Figure 341236DEST_PATH_IMAGE054
表示在
Figure 504364DEST_PATH_IMAGE041
时刻,所有科研项目和论文数据的主题英文单词分布;
Figure 902065DEST_PATH_IMAGE055
表示在
Figure 619485DEST_PATH_IMAGE039
时刻,所有科研项目和论文数据的主题英文单词分布;
Figure 749115DEST_PATH_IMAGE056
表示在
Figure 766750DEST_PATH_IMAGE041
时刻,第
Figure 526895DEST_PATH_IMAGE057
个主题下,所有科研项目和论文数据里学者
Figure 262770DEST_PATH_IMAGE058
出现的次数;
Figure 196091DEST_PATH_IMAGE059
表示在
Figure 68232DEST_PATH_IMAGE041
时刻,所有科研项目和论文数据的主题学者分布;
Figure 999279DEST_PATH_IMAGE060
表示在
Figure 488029DEST_PATH_IMAGE039
时刻,所有科研项目和论文数据的主题学者分布。
in,
Figure 370350DEST_PATH_IMAGE035
is the attenuation factor,
Figure 405303DEST_PATH_IMAGE036
Represents the total number of all Chinese and English words belonging to topic z in the scientific research project data under the pth professional field at time t-1 ;
Figure 441392DEST_PATH_IMAGE037
Represents the subject distribution of scientific research project data in professional fields at time t-1 ;
Figure 270807DEST_PATH_IMAGE038
expressed in
Figure 330030DEST_PATH_IMAGE039
Time, subject distribution of scientific research project data in professional fields;
Figure 168673DEST_PATH_IMAGE040
expressed in
Figure 793690DEST_PATH_IMAGE041
time, the
Figure 59586DEST_PATH_IMAGE042
Under a professional field, the thesis data belongs to the topic
Figure 340526DEST_PATH_IMAGE043
The total number of all Chinese and English words of ;
Figure 248439DEST_PATH_IMAGE044
expressed in
Figure 727962DEST_PATH_IMAGE041
Moment, the subject distribution of the professional field of the paper data;
Figure 368022DEST_PATH_IMAGE045
expressed in
Figure 932995DEST_PATH_IMAGE039
Moment, the subject distribution of the professional field of the paper data;
Figure 379020DEST_PATH_IMAGE046
expressed in
Figure 713049DEST_PATH_IMAGE041
time, the
Figure 524011DEST_PATH_IMAGE047
Under this topic, Chinese words in all scientific research projects and paper data
Figure 841859DEST_PATH_IMAGE048
the number of occurrences;
Figure 560417DEST_PATH_IMAGE049
expressed in
Figure 14532DEST_PATH_IMAGE041
Time, topic Chinese word distribution of all scientific research projects and dissertation data;
Figure 996394DEST_PATH_IMAGE050
expressed in
Figure 801539DEST_PATH_IMAGE039
Time, topic Chinese word distribution of all scientific research projects and dissertation data;
Figure 323787DEST_PATH_IMAGE051
expressed in
Figure 835671DEST_PATH_IMAGE041
time, the
Figure 50752DEST_PATH_IMAGE052
Under this topic, English words in all scientific research projects and paper data
Figure 812035DEST_PATH_IMAGE053
the number of occurrences;
Figure 341236DEST_PATH_IMAGE054
expressed in
Figure 504364DEST_PATH_IMAGE041
Time, the subject English word distribution of all scientific research projects and paper data;
Figure 902065DEST_PATH_IMAGE055
expressed in
Figure 619485DEST_PATH_IMAGE039
Time, the subject English word distribution of all scientific research projects and paper data;
Figure 749115DEST_PATH_IMAGE056
expressed in
Figure 766750DEST_PATH_IMAGE041
time, the
Figure 526895DEST_PATH_IMAGE057
Under this topic, scholars in all scientific research projects and dissertation data
Figure 262770DEST_PATH_IMAGE058
the number of occurrences;
Figure 196091DEST_PATH_IMAGE059
expressed in
Figure 68232DEST_PATH_IMAGE041
Time, the distribution of subject scholars for all scientific research projects and dissertation data;
Figure 999279DEST_PATH_IMAGE060
expressed in
Figure 488029DEST_PATH_IMAGE039
Moment, subject scholar distribution of all research projects and dissertation data.
7.一种面向学者聚类的研究兴趣挖掘装置,包括处理器和存储器,其特征在于,所述存储器中存储有计算机指令,所述处理器用于执行所述存储器中存储的计算机指令,当所述计算机指令被处理器执行时该装置实现如权利要求1至6中任意一项所述方法的步骤。7. A research interest mining device for scholar clustering, comprising a processor and a memory, characterized in that the memory stores computer instructions, and the processor is used to execute the computer instructions stored in the memory, when the memory is stored. The apparatus implements the steps of the method as claimed in any one of claims 1 to 6 when the computer instructions are executed by the processor. 8.一种计算机可读存储介质,其上存储有计算机程序,其特征在于,该程序被处理器执行时实现如权利要求1至6中任意一项所述方法的步骤。8. A computer-readable storage medium on which a computer program is stored, characterized in that, when the program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
CN202111072396.7A 2021-09-14 2021-09-14 Student clustering-oriented research interest mining method and device and storage medium Active CN113515638B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111072396.7A CN113515638B (en) 2021-09-14 2021-09-14 Student clustering-oriented research interest mining method and device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111072396.7A CN113515638B (en) 2021-09-14 2021-09-14 Student clustering-oriented research interest mining method and device and storage medium

Publications (2)

Publication Number Publication Date
CN113515638A CN113515638A (en) 2021-10-19
CN113515638B true CN113515638B (en) 2021-12-07

Family

ID=78063070

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111072396.7A Active CN113515638B (en) 2021-09-14 2021-09-14 Student clustering-oriented research interest mining method and device and storage medium

Country Status (1)

Country Link
CN (1) CN113515638B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114528393B (en) * 2022-01-10 2023-02-14 华南理工大学 Method, system and medium for mining and evolution analysis of interest tag research by scholars
CN115618257B (en) * 2022-12-15 2023-07-21 北京邮电大学 Multi-view-based learner dynamic interest clustering method and device
CN118982024B (en) * 2024-10-16 2025-01-10 深圳国家高技术产业创新中心 Dynamic theme evolution mining method, system and medium based on dynamic academic network

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112765305A (en) * 2020-12-31 2021-05-07 北京工业大学 Method and device for analyzing interest topic of author, electronic equipment and storage medium

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8458115B2 (en) * 2010-06-08 2013-06-04 Microsoft Corporation Mining topic-related aspects from user generated content

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112765305A (en) * 2020-12-31 2021-05-07 北京工业大学 Method and device for analyzing interest topic of author, electronic equipment and storage medium

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
基于成果特征的学者学术专长识别方法;陈翀等;《图书情报工作》;20191020(第20期);全文 *
面向科研人员兴趣画像的多语作者主题模型研究;李岩等;《情报学报》;20200624(第06期);全文 *

Also Published As

Publication number Publication date
CN113515638A (en) 2021-10-19

Similar Documents

Publication Publication Date Title
Ganea et al. Probabilistic bag-of-hyperlinks model for entity linking
CN113515638B (en) Student clustering-oriented research interest mining method and device and storage medium
Kenter et al. Short text similarity with word embeddings
Madhoushi et al. Sentiment analysis techniques in recent works
Furlan et al. Semantic similarity of short texts in languages with a deficient natural language processing support
RU2720074C2 (en) Method and system for creating annotation vectors for document
Antognini et al. Learning to create sentence semantic relation graphs for multi-document summarization
JP6769140B2 (en) Ranking of learning material segments
US9773166B1 (en) Identifying longform articles
CN105760363B (en) Word sense disambiguation method and device for text files
Gharavi et al. Scalable and language-independent embedding-based approach for plagiarism detection considering obfuscation type: no training phase
CN111444713A (en) Method and device for extracting entity relationship in news event
Lin et al. NL2API: A framework for bootstrapping service recommendation using natural language queries
Skaggs et al. Topic modeling for wikipedia link disambiguation
Nakashole et al. Real-time population of knowledge bases: opportunities and challenges
Hakimov et al. Combining textual and graph-based features for named entity disambiguation using undirected probabilistic graphical models
Zhao et al. Generating multi-turn clarification for web information seeking
CN111026866B (en) Domain-oriented text information extraction clustering method, device and storage medium
Churchill et al. Using topic-noise models to generate domain-specific topics across data sources
Xiao et al. RETRACTED: Enhancing large language models with evolutionary fine-tuning for news summary generation
Tan et al. Synthesizing privacy-preserving text data via finetuning without finetuning billion-scale llms
de Melo et al. Taxonomic data integration from multilingual Wikipedia editions
Zou et al. Assessing software quality through web comment search and analysis
Grigorov Harnessing Python 3.11 and Python Libraries for LLM Development
Muthukrishnan et al. Simultaneous similarity learning and feature-weight learning for document clustering

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant