CN114385950A - Method and device, electronic device and storage medium for distinguishing internal and external links of target website - Google Patents

Abstract

The application relates to the technical field of internal and external chain distinguishing, and discloses a method for distinguishing internal and external chains of a target website, which comprises the following steps: acquiring first ICP filing information of a target website; acquiring URL links to be distinguished of a target website; and distinguishing whether the URL link to be distinguished is an internal link or an external link of the target website according to the first ICP record information. Therefore, misjudgment caused by the relation among the main domain name of the target website, the IP address of the target website, the main domain name of the URL link to be distinguished and the IP address of the URL link to be distinguished is not needed to be considered, the URL link to be distinguished is the inner link or the outer link of the target website is distinguished by utilizing the first ICP record information of the target website, and the accuracy of distinguishing the inner link and the outer link of the target website is improved. The application also discloses a device for distinguishing the internal link and the external link of the target website, electronic equipment and a storage medium.

Description

Method and device, electronic device and storage medium for distinguishing internal and external links of target website

technical field

The present application relates to the technical field of distinguishing internal and external links, for example, to a method and device, electronic device, and storage medium for distinguishing internal and external links of a target website.

Background technique

The links of the website are divided into internal links and external links. Internal links are links to internal pages of this website, while external links are links to other website pages. In some webpage-related applications, after collecting the links under the website, it may be necessary to identify whether the link is an internal link or an external link, so as to do different processing. However, cloud deployment of business and applications has become the main direction of current website construction, which is conducive to rapid deployment, cost reduction and distributed operation, especially for non-operating websites such as governments and large enterprises, in order to strengthen management and improve data sharing capabilities , have carried out the intensive construction of websites, built a unified data center and business platform, and centralized cloud deployment of websites of various types and departments. The intensive construction of such websites blurs the boundaries between the internal and external links of the website, and also changes the connotation of the internal and external links of the website.

In the process of implementing the embodiments of the present disclosure, it is found that there are at least the following problems in the related art: the URL identification method is used in the prior art to compare the main domain name or IP address of the target website with the main domain name or IP address linked by the URL. In this way, the accuracy of determining the URL link as the internal link or external link of the target website is low, and it is easy to appear that the external link with the same IP address and the same main domain name is judged as the internal link, and the IP address is different and the main domain name is not exactly the same. The internal link is judged to be an external link and other misjudgments.

SUMMARY OF THE INVENTION

In order to provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. This summary is not intended to be an extensive review, nor to identify key/critical elements or delineate the scope of protection of these embodiments, but rather serves as a prelude to the detailed description that follows.

Embodiments of the present disclosure provide a method and apparatus, electronic device, and storage medium for distinguishing internal and external links of a target website, so as to improve the accuracy of distinguishing internal and external links of a target website.

In some embodiments, the method for distinguishing internal and external links of a target website includes: obtaining the first ICP filing information of the target website; obtaining the URL links to be distinguished of the target website; distinguishing the URL links to be distinguished according to the first ICP filing information is Internal or external links to the target website.

In some embodiments, the device for distinguishing internal and external links of a target website includes: a first acquisition module configured to acquire first ICP filing information of the target website; a second acquisition module configured to acquire the target website The URL link to be distinguished; the distinguishing module is configured to distinguish whether the URL link to be distinguished is an internal link or an external link of the target website according to the first ICP filing information.

In some embodiments, the apparatus for distinguishing between internal and external links of a target website includes: a processor and a memory storing program instructions, the processor is configured to execute the above-mentioned program instructions when running the program instructions. A method of distinguishing between internal and external links of the target website.

In some embodiments, the electronic device includes the above-mentioned apparatus for distinguishing internal and external links of the target website.

In some embodiments, the storage medium stores program instructions, and when the program instructions are running, the above-mentioned method for distinguishing internal and external links of a target website is executed.

The method and device, electronic device, and storage medium for distinguishing internal and external links of a target website provided by the embodiments of the present disclosure can achieve the following technical effects: by obtaining the first ICP filing information of the target website, the URL links to be distinguished of the target website are obtained, Then, according to the first ICP filing information, it is distinguished whether the URL link to be distinguished is an internal link or an external link of the target website. In this way, there is no need to consider the misjudgment caused by the relationship between the main domain name of the target website, the IP address of the target website, the main domain name of the URL link to be distinguished, and the IP address of the URL link to be distinguished. By using the first ICP record of the target website Information Distinction The URL link to be distinguished is the internal link or external link of the target website, which improves the accuracy of distinguishing the internal and external links of the target website.

The foregoing general description and the following description are exemplary and explanatory only and are not intended to limit the application.

Description of drawings

One or more embodiments are exemplified by the accompanying drawings, which are not intended to limit the embodiments, and elements with the same reference numerals in the drawings are shown as similar elements, The drawings do not constitute a limitation of scale, and in which:

1 is a schematic diagram of a method for distinguishing internal and external links of a target website provided by an embodiment of the present disclosure;

2 is a schematic diagram of another method for distinguishing internal and external links of a target website provided by an embodiment of the present disclosure;

3 is a schematic diagram of another method for distinguishing internal and external links of a target website provided by an embodiment of the present disclosure;

4 is a schematic diagram of another method for distinguishing internal and external links of a target website provided by an embodiment of the present disclosure;

5 is a schematic diagram of an apparatus for distinguishing internal and external links of a target website provided by an embodiment of the present disclosure;

FIG. 6 is a schematic diagram of another apparatus for distinguishing internal and external links of a target website provided by an embodiment of the present disclosure.

Detailed ways

In order to understand the features and technical contents of the embodiments of the present disclosure in more detail, the implementation of the embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings, which are for reference only and are not intended to limit the embodiments of the present disclosure. In the following technical description, for the convenience of explanation, numerous details are provided to provide a thorough understanding of the disclosed embodiments. However, one or more embodiments may be practiced without these details. In other instances, well-known structures and devices may be shown simplified in order to simplify the drawings.

The terms "first", "second" and the like in the description and claims of the embodiments of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data so used may be interchanged under appropriate circumstances for the purposes of implementing the embodiments of the disclosure described herein. Furthermore, the terms "comprising" and "having", and any variations thereof, are intended to cover non-exclusive inclusion.

Unless stated otherwise, the term "plurality" means two or more.

In the embodiment of the present disclosure, the character "/" indicates that the preceding and following objects are in an "or" relationship. For example, A/B means: A or B.

The term "and/or" is an associative relationship describing objects, indicating that three relationships can exist. For example, A and/or B, means: A or B, or, A and B three relationships.

The term "correspondence" may refer to an association relationship or a binding relationship, and the correspondence between A and B refers to an association relationship or a binding relationship between A and B.

The technical solutions of the embodiments of the present disclosure can be applied to intelligent terminals or servers. In some embodiments, the smart terminal includes a device capable of accessing a website, such as a smart phone, a tablet, or a computer.

In the embodiment of the present disclosure, the intelligent terminal or server is used to distinguish the URL links of the target website, so that when the intelligent terminal or server accesses the target website, it can determine that the URL link of the target website to be distinguished is the target website through the ICP filing information of the target website. The internal or external link of the website, so as to facilitate the processing of the link.

1, an embodiment of the present disclosure provides a method for distinguishing internal and external links of a target website, including:

In step S101, the electronic device obtains the first ICP (Internet Content Provider, website content provider) filing information of the target website.

Step S102, the electronic device acquires the URL link of the target website to be distinguished.

Step S103, the electronic device distinguishes whether the URL link to be distinguished is an internal link or an external link of the target website according to the first ICP filing information.

Using the method for distinguishing internal and external links of a target website provided by the embodiment of the present disclosure, by obtaining the first ICP filing information of the target website, obtaining the URL links to be distinguished of the target website, and then distinguishing the URL links to be distinguished according to the first ICP filing information. Internal or external links to the target website. In this way, there is no need to consider the misjudgment caused by the relationship between the main domain name of the target website, the IP address of the target website, the main domain name of the URL link to be distinguished, and the IP address of the URL link to be distinguished. By using the first ICP record of the target website Information Distinction The URL link to be distinguished is the internal link or external link of the target website, which improves the accuracy of distinguishing the internal and external links of the target website.

Optionally, the target website is a non-commercial website.

Optionally, obtaining the first ICP filing information of the target website by the electronic device includes: accessing the first website homepage of the target website by the electronic device; extracting the content of the first website homepage by the electronic device; obtaining the electronic device from the content of the first website homepage The first ICP filing information of the target website. In this way, the first website homepage of the target website is accessed through the electronic device, and the first ICP filing information of the target website is obtained from the content of the first website homepage, so as to distinguish the URL links to be distinguished from the target website according to the first ICP filing information. Internal or external links do not need to consider the relationship between the main domain name of the target website, the IP address of the target website, the main domain name of the URL link to be distinguished, and the IP address of the URL link to be distinguished. The first ICP filing information distinguishes whether the URL link to be distinguished is the internal link or external link of the target website, which improves the accuracy of distinguishing the internal and external links of the target website.

Optionally, accessing the first website homepage of the target website by the electronic device includes: obtaining the URL link of the target website by the electronic device; obtaining the homepage address of the URL link of the target website by the electronic device; accessing the first website homepage corresponding to the homepage address by the electronic device . Optionally, the home page address of the URL link of the target website is the website address corresponding to the host field of the URL link of the target website.

In some embodiments, the electronic device accesses the first website homepage of the target website, then the electronic device extracts the content of the first website homepage through a crawler, and the electronic device obtains the first ICP filing information of the target website from the content of the first website homepage.

Optionally, the first ICP filing information of the target website is the ICP filing number of the homepage of the first website of the target website.

In some embodiments, according to relevant policies and regulations, a non-commercial Internet information service provider shall record the website information before the website is opened, and obtain the ICP record information, that is, the ICP record number. Then place the ICP record number at the bottom of the homepage of the website for the public to check and check, then it can be confirmed that the ICP recordal information is the public exclusive attribute field on the content of the page on the homepage of the website. In this way, the ICP record number is especially suitable for the distinction between internal and external links of non-commercial websites. It does not need to consider the main domain name of the target website, the IP address of the target website, the main domain name of the URL link to be distinguished, and the IP address of the URL link to be distinguished. For misjudgment caused by the relationship, by using the first ICP filing information of the target website to distinguish whether the URL link to be distinguished is the internal link or external link of the non-operating website, the accuracy of distinguishing the internal and external links of the non-operating website is improved. At the same time, using the unique attributes of non-commercial websites, only by analyzing a common attribute of the ICP filing information in the page content, it is possible to complete the distinction between internal and external links of the website, which improves the simplicity, efficiency and accuracy of distinguishing between internal and external links of the target website. sex.

Optionally, the electronic device obtains the first ICP filing information of the target website from the content of the homepage of the first website, including: the electronic device performs format matching on the content of the homepage of the first website, and the electronic device matches the format to the same as the preset format. In the case of the field, the field is determined as the first ICP filing information of the target website.

Optionally, the preset format is the format of the ICP record number.

In some embodiments, the format of the ICP record number is: "province abbreviation + ICP record number" + "subject ICP record number" + "website serial number"; or, the format of the ICP record number is: "ICP record number" + "subject record number" ICP record number" + "Website serial number".

Optionally, the electronic device extracts the URL link to be distinguished of the target website in the homepage of the first website without obtaining the first ICP filing information of the target website; the electronic device utilizes the URL identification method to distinguish the URL link to be distinguished as the target. Internal or external links to the website.

Optionally, obtaining the URL link to be distinguished of the target website by the electronic device includes: when the electronic device obtains the first ICP filing information of the target website, the electronic device extracts the URL link to be distinguished of the target website from the home page of the first website. . In this way, when the first ICP filing information of the target website is obtained, the electronic device extracts the URL link to be differentiated of the target website from the home page of the first website, so as to distinguish the URL link to be differentiated as the target according to the first ICP filing information The internal link or external link of the website does not need to consider the relationship between the main domain name of the target website, the IP address of the target website, the main domain name of the URL link to be distinguished, and the IP address of the URL link to be distinguished. The first ICP filing information of the website distinguishes whether the URL link to be distinguished is the internal link or external link of the target website, which improves the accuracy of distinguishing the internal and external links of the target website.

Optionally, the electronic device extracts the URL link of the target website from the home page of the first website, including: the electronic device performs format matching on the content of the home page of the first website; In the case of , this field is determined as the URL link of the target website to be distinguished.

Optionally, the URL links to be distinguished include secondary links of the target website, tertiary links of the target website, and the like.

Optionally, the electronic device distinguishes that the URL link to be distinguished is an internal link or an external link of the target website according to the first ICP filing information, including: the electronic device obtains the first host field of the home page of the first website; the electronic device obtains the URL link to be distinguished. The second host field; when the first host field is the same as the second host field, the electronic device determines the URL link to be differentiated as the internal link of the target website; In this case, according to the first ICP filing information, the URL link to be distinguished is an internal link or an external link of the target website. In this way, when the first host field is the same as the second host field, the URL link to be distinguished is determined as the internal link of the target website, and when the first host field is different from the second host field, according to the 1. ICP filing information distinguishes whether the URL link to be discriminated is the internal link or external link of the target website, and does not need to consider the main domain name of the target website, the IP address of the target website, the main domain name of the URL link to be discriminated, and the IP address of the URL link to be discriminated. The misjudgment caused by the relationship between them improves the accuracy of distinguishing between internal and external links of the target website.

In some embodiments, the URL link includes: a host field, a path field, and a file field. For example: www.aaa.com/a/b/files/202111/index.html; where www.aaa.com is the host field; a/b/files/202111 is the path field; index.html is the file field; aaa .com is the domain name field.

With reference to FIG. 2, an embodiment of the present disclosure provides another method for distinguishing internal and external links of a target website, including:

Step S201, the electronic device accesses the first website homepage of the target website.

Step S202, the electronic device extracts the content of the home page of the first website.

Step S203, the electronic device acquires the first ICP filing information of the target website in the content of the homepage of the first website.

Step S204, the electronic device obtains the URL link of the target website to be distinguished.

Step S205, the electronic device acquires the first host field of the home page of the first website.

Step S206, the electronic device acquires the second host field of the URL link to be distinguished.

Step S207, in the case that the first host field is the same as the second host field, the electronic device determines the URL link to be distinguished as the internal link of the target website.

Step S208, when the first host field is different from the second host field, the electronic device distinguishes whether the URL link to be distinguished is an internal link or an external link of the target website according to the first ICP filing information.

Using the method for distinguishing internal and external links of a target website provided by the embodiments of the present disclosure, the first ICP filing information of the target website is obtained through the first website homepage of the target website, and the URL link to be distinguished of the target website is obtained on the first website homepage, and then According to the first host field, the second host field and the first ICP filing information, it is distinguished whether the URL link to be distinguished is an internal link or an external link of the target website. In this way, there is no need to consider the misjudgment caused by the relationship between the main domain name of the target website, the IP address of the target website, the main domain name of the URL link to be distinguished, and the IP address of the URL link to be distinguished. The host field and the first ICP filing information of the target website distinguish whether the URL link to be distinguished is the internal link or external link of the target website, which improves the accuracy of distinguishing the internal and external links of the target website.

With reference to FIG. 3 , an embodiment of the present disclosure provides another method for distinguishing internal and external links of a target website, including:

Step S301, the electronic device accesses the first website homepage of the target website.

Step S302, the electronic device extracts the content of the home page of the first website.

Step S303, the electronic device acquires the first ICP filing information of the target website from the content of the homepage of the first website.

Step S304, when the electronic device obtains the first ICP filing information of the target website, it extracts the URL link to be distinguished of the target website from the home page of the first website.

Step S305, the electronic device acquires the first host field of the home page of the first website.

Step S306, the electronic device obtains the second host field of the URL link to be distinguished.

Step S307, in the case that the first host field is the same as the second host field, the electronic device determines the URL link to be distinguished as the internal link of the target website.

Step S308, when the first host field is different from the second host field, the electronic device distinguishes whether the URL link to be distinguished is an internal link or an external link of the target website according to the first ICP filing information.

Using the method for distinguishing internal and external links of the target website provided by the embodiments of the present disclosure, the first ICP filing information of the target website is obtained through the first website homepage of the target website, and when the first ICP filing information of the target website is obtained, Extract the URL link to be distinguished of the target website from the homepage of the first website, and then distinguish whether the URL link to be distinguished is an internal link or an external link of the target website according to the first host field, the second host field and the first ICP filing information. In this way, there is no need to consider the misjudgment caused by the relationship between the main domain name of the target website, the IP address of the target website, the main domain name of the URL link to be distinguished, and the IP address of the URL link to be distinguished. In the case of filing information, by using the first host field, the second host field and the first ICP filing information of the target website to distinguish whether the URL link to be distinguished is an internal link or an external link of the target website, the accuracy of distinguishing the internal and external links of the target website is improved. Spend.

Optionally, when the first host field and the second host field are different, the electronic device distinguishes according to the first ICP filing information that the URL link to be distinguished is an internal link or an external link of the target website, including: the electronic device is in the first host. When the field is different from the second host field, the electronic device accesses the second website homepage linked by the URL to be distinguished according to the second host field; the electronic device extracts the content of the second website homepage; the electronic device is in the content of the second website homepage Obtain the second ICP filing information of the URL link to be distinguished; the electronic device distinguishes whether the URL link to be distinguished is the internal link or the external link of the target website according to the first ICP filing information and the second ICP filing information. In this way, when the first host field is different from the second host field, the second ICP filing information of the URL link to be differentiated is obtained according to the second host field, and the first ICP filing information and the second ICP filing information are used to distinguish the ICP filing information. It is not necessary to consider the relationship between the main domain name of the target website, the IP address of the target website, the main domain name of the URL link to be distinguished, and the IP address of the URL link to be distinguished. It improves the accuracy of distinguishing internal and external links of the target website.

Optionally, the electronic device accessing the second website homepage of the URL link to be distinguished according to the second host field includes: the electronic device accessing the second website homepage of the URL link to be distinguished corresponding to the second host field.

Optionally, the electronic device obtains the second ICP filing information of the URL link to be differentiated in the content of the home page of the second website, including: the electronic device performs format matching on the content of the home page of the second website; In the case of fields with the same format, this field is determined as the second ICP filing information of URL links to be distinguished.

In some embodiments, when the first host field is different from the second host field, the electronic device accesses the second website home page linked by the URL to be distinguished corresponding to the second host field, and then the electronic device extracts the first page through a crawler. The content of the homepage of the second website, the electronic device matches the second ICP filing information of the URL link to be distinguished in the content of the homepage of the second website through the format.

Optionally, the electronic device distinguishes according to the first ICP filing information and the second ICP filing information that the URL link to be differentiated is an internal link or an external link of the target website, including: the electronic device is the same in the first ICP filing information and the second ICP filing information In this case, determine that the URL link to be distinguished is an internal link of the target website; and/or, the electronic device determines that the URL link to be distinguished is an external link of the target website when the first ICP filing information and the second ICP filing information are different. chain. In this way, when the first ICP filing information and the second ICP filing information are the same, it is determined that the URL link to be distinguished is the internal link of the target website, and when the first ICP filing information and the second ICP filing information are different, It is determined that the URL link to be differentiated is an external link of the target website, and there is no need to consider the misjudgment caused by the relationship between the main domain name of the target website, the IP address of the target website, the main domain name of the URL link to be distinguished, and the IP address of the URL link to be distinguished , which improves the accuracy of distinguishing the internal and external links of the target website.

In some embodiments, the first ICP filing is determined under the condition that the "province abbreviation" field, the "subject ICP filing number" field, and the "website serial number" field of the first ICP filing information and the second ICP filing information are all the same The information is the same as the second ICP filing information.

In some embodiments, if any of the "province abbreviation" field, the "subject ICP record number" field, and the "website serial number" field of the first ICP record information and the second ICP record information are different, determine the first ICP record information. The first ICP filing information and the second ICP filing information are different.

Optionally, after acquiring the first filing information and the second filing information, the electronic device stores the first filing information and the second filing information.

With reference to FIG. 4 , an embodiment of the present disclosure provides another method for distinguishing internal and external links of a target website, including:

Step S401, the electronic device accesses the first website homepage of the target website.

Step S402, the electronic device extracts the content of the home page of the first website.

Step S403, the electronic device obtains the first ICP filing information of the target website from the content of the first website homepage.

Step S404, when the electronic device obtains the first ICP filing information of the target website, it extracts the URL link to be distinguished of the target website from the home page of the first website.

Step S405, the electronic device acquires the first host field of the home page of the first website.

Step S406, the electronic device obtains the second host field of the URL link to be distinguished.

Step S407, the electronic device determines whether the first host field and the second host field are the same; if the first host field and the second host field are the same, go to step S412; if the first host field and the second host field are different, go to step S408 .

Step S408, the electronic device accesses the home page of the second website linked by the URL to be distinguished according to the second host field.

Step S409, the electronic device extracts the content of the home page of the second website.

Step S410, the electronic device obtains the second ICP filing information of the URL link to be distinguished from the content of the home page of the second website.

Step S411, the electronic device determines whether the first ICP filing information and the second ICP filing information are the same; if the first ICP filing information and the second ICP filing information are the same, perform step S412; if the first ICP filing information and the second ICP filing information If not, step S413 is executed.

Step S412, the electronic device determines that the URL link to be distinguished is an internal link of the target website.

Step S413, the electronic device determines that the URL link to be distinguished is an external link of the target website.

Using the method for distinguishing internal and external links of the target website provided by the embodiments of the present disclosure, the first ICP filing information of the target website is obtained through the first website homepage of the target website, and when the first ICP filing information of the target website is obtained, Extract the URL link of the target website from the home page of the first website, and then determine the URL link as the internal link of the target website when the first host field and the second host field are the same, and the first host field is in the second host field. If the fields are not the same, obtain the second ICP filing information connected by the URL through the home page of the second website connected by the URL, so as to distinguish whether the URL link to be distinguished is the internal link of the target website or the second ICP filing information according to the first ICP filing information and the second ICP filing information. External link. In this way, there is no need to consider the misjudgment caused by the relationship between the main domain name of the target website, the IP address of the target website, the main domain name of the URL link to be distinguished, and the IP address of the URL link to be distinguished. In the case of filing information, by using the first host field, the second host field, the first ICP filing information and the second ICP filing information to distinguish whether the URL link to be differentiated is an internal link or an external link of the target website, it improves the ability to distinguish between inside and outside the target website. chain accuracy.

In some embodiments, in the case of determining internal links and external links for the target website www.xxx1.gov.cn, the obtained URL links of the target website to be distinguished include URL1: "www.xxx1.gov.cn /hudong/hdjl/......" and URL2: "jw.xxx1.gov.cn/xxgk/zfxxgkml/......", according to the URL identification method to distinguish URL1 and URL2, the main domain name of the target website It is xxx1.gov.cn, the main domain name of URL1 is xxx1.gov.cn, and the main domain name of URL2 is xxx1.gov.cn. The main domain names of the three are the same, and they have a common IP address through domain name resolution: 111.13. x.x, according to the URL identification method, it is determined that both URL1 and URL2 are internal links of the website. However, the obtained target website is the same as the ICP filing information of the URL link URL1 to be distinguished, and the ICP filing information of the target website is different from the URL link URL2 to be distinguished. Therefore, the method for distinguishing the internal and external links of the target website in this scheme is used to distinguish The URL links are differentiated between internal and external links, and it is determined that URL1 is the internal link of the target website, and URL2 is the external link of the target website. By determining the organizer or organizer of the target website, URL1 and URL2, the organizer to obtain the target website and URL1 is the government of xx1 city xx2, and the organizer of URL2 is the committee of xx1 city xx3, that is, URL2 is the external link of the target website. It can be seen that this scheme can use the ICP filing information of the target website to be able to judge the external links with the same IP address and the same main domain name as internal links, which improves the accuracy of distinguishing between internal and external links of the target website.

In some embodiments, in the case of determining internal links and external links for the target website www.xxx2.gov.cn, the obtained URL links of the target website to be distinguished include URL3 "www.xxx2.gov.cn/ col/col80524/index.html" and URL4 "www.xxx2.cn/col/col80524/index.html", according to the URL identification method to distinguish URL3 and URL4, the main domain name of the target website is xxx2.gov.cn, the main domain name of URL3 The domain name is xxx2.gov.cn, and the primary domain name of URL4 is xxx2.cn. The main domain name of the target website is the same as the main domain name of URL3, and both have the same IP address through domain name resolution, 119.188.x.x, then URL3 is the internal link of the target website. The main domain name of the target website is different from the main domain name of URL4, and the IP address of URL4 resolved through the domain name is 202.110.x.x, which is different from the IP address of the target website, then URL4 is the external link of the target website. However, the obtained target website is the same as the ICP filing information of URL3 and URL4 to be distinguished. Therefore, the method for distinguishing internal and external links of the target website is adopted to distinguish between internal and external links of URL links, and it is determined that both URL3 and URL4 are It is the internal link of the target website. By determining the sponsor or organizer of the target website, URL3 and URL4, the sponsor to obtain the target website, URL3 and URL4 is the government of xx3 city xx4, that is, both URL3 and URL4 are internal links of the target website. It can be seen that this scheme can avoid internal links with different IP addresses and different primary domain names from being judged as external links by using the ICP filing information of the target website, which improves the accuracy of distinguishing internal and external links of the target website.

In some embodiments, in the scenario of cloud service and intensive website construction, the URL identification method cannot accurately distinguish between internal and external links. The embodiments of the present disclosure provide the introduction of ICP filing information to distinguish URL links to be distinguished, which can distinguish whether the URL links to be distinguished are internal or external links of the target website from the perspective of the management domain, and improve the accuracy of distinguishing URL links to be distinguished.

With reference to FIG. 5 , an embodiment of the present disclosure provides an apparatus for distinguishing internal and external links of a target website, including a first obtaining module 1 , a second obtaining module 2 , and a distinguishing module 3 . The first acquisition module 1 is configured to acquire the first ICP record-filing information of the target website; the second acquisition module 2 is configured to acquire the URL link to be distinguished of the target website; the distinguishing module 3 is configured to distinguish the to-be-differentiated according to the first ICP record-filing information URL links are internal or external links to the target website.

Using the device for distinguishing internal and external links of a target website provided by the embodiment of the present disclosure, by obtaining the first ICP filing information of the target website, the URL links to be distinguished of the target website are obtained, and then the URL links to be distinguished are distinguished according to the first ICP filing information. Internal or external links to the target website. In this way, there is no need to consider the misjudgment caused by the relationship between the main domain name of the target website, the IP address of the target website, the main domain name of the URL link to be distinguished, and the IP address of the URL link to be distinguished, by using the first ICP record of the target website Information Distinction The URL link to be distinguished is the internal link or external link of the target website, which improves the accuracy of distinguishing the internal and external links of the target website.

Optionally, the first obtaining module is configured to obtain the first ICP filing information of the target website through the following methods: visit the first website homepage of the target website; extract the content of the first website homepage; obtain from the content of the first website homepage The first ICP filing information of the target website.

Optionally, the second obtaining module is configured to obtain the URL link to be distinguished of the target website by the following method: in the case of obtaining the first ICP filing information of the target website, extract the to-be-differentiated URL of the target website from the home page of the first website. URL link.

Optionally, the distinguishing module is configured to distinguish whether the URL link to be distinguished is an internal link or an external link of the target website according to the first ICP filing information by the following methods: obtain the first host field of the homepage of the first website; obtain the URL link to be distinguished. The second host field; when the first host field is the same as the second host field, the URL link to be distinguished is determined as the internal link of the target website; when the first host field is different from the second host field, according to The first ICP filing information distinguishes whether the URL link to be distinguished is an internal link or an external link of the target website.

Optionally, the distinguishing module is configured to distinguish whether the URL link to be distinguished is an internal link or external link of the target website according to the first ICP filing information when the first host field is different from the second host field by the following method: When the first host field is different from the second host field, access the home page of the second website linked by the URL to be distinguished according to the second host field; extract the content of the home page of the second website; obtain the URL to be distinguished from the content of the home page of the second website Linked second ICP filing information; according to the first ICP filing information and the second ICP filing information, the URL link to be distinguished is the internal link or external link of the target website.

Optionally, the distinguishing module is configured to distinguish whether the URL link to be distinguished is an internal link or an external link of the target website according to the first ICP filing information and the second ICP filing information by the following method: in the first ICP filing information and the second ICP filing information In the case of the same information, it is determined that the URL link to be distinguished is an internal link of the target website; and/or, when the first ICP filing information and the second ICP filing information are different, it is determined that the URL link to be distinguished is an external link of the target website. chain.

With reference to FIG. 6 , an embodiment of the present disclosure provides an apparatus for distinguishing internal and external links of a target website, including a processor (processor) 100 and a memory (memory) 101 . Optionally, the apparatus may further include a communication interface (Communication Interface) 102 and a bus 103 . The processor 100 , the communication interface 102 , and the memory 101 can communicate with each other through the bus 103 . Communication interface 102 may be used for information transfer. The processor 100 may call the logic instructions in the memory 101 to execute the method for distinguishing internal and external links of the target website in the above-mentioned embodiments.

In addition, the above-mentioned logic instructions in the memory 101 can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product.

As a computer-readable storage medium, the memory 101 can be used to store software programs and computer-executable programs, such as program instructions/modules corresponding to the methods in the embodiments of the present disclosure. The processor 100 executes the function application and data processing by executing the program instructions/modules stored in the memory 101, that is, the method for distinguishing the internal and external links of the target website in the above-mentioned embodiment is implemented.

The memory 101 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal device, and the like. In addition, the memory 101 may include high-speed random access memory, and may also include non-volatile memory.

Using the device for distinguishing internal and external links of a target website provided by the embodiment of the present disclosure, the URL links to be distinguished of the target website can be obtained by obtaining the first ICP filing information of the target website, and then the URL links to be distinguished can be distinguished according to the first ICP filing information. It is the internal or external link of the target website. In this way, there is no need to consider the misjudgment caused by the relationship between the main domain name of the target website, the IP address of the target website, the main domain name of the URL link to be distinguished, and the IP address of the URL link to be distinguished, by using the first ICP record of the target website Information Distinction The URL link to be distinguished is the internal link or external link of the target website, which improves the accuracy of distinguishing the internal and external links of the target website.

An embodiment of the present disclosure provides an electronic device, including the above-mentioned apparatus for distinguishing internal and external links of a target website.

Using the electronic device provided by the embodiment of the present disclosure, by obtaining the first ICP filing information of the target website, the URL link to be distinguished of the target website is obtained, and then according to the first ICP filing information, it is distinguished whether the URL link to be distinguished is the internal link or the external link of the target website. chain. In this way, there is no need to consider the misjudgment caused by the relationship between the main domain name of the target website, the IP address of the target website, the main domain name of the URL link to be distinguished, and the IP address of the URL link to be distinguished, by using the first ICP record of the target website Information Distinction The URL link to be distinguished is the internal link or external link of the target website, which improves the accuracy of distinguishing the internal and external links of the target website.

Optionally, the electronic device includes an intelligent terminal or a server. Optionally, the smart terminal includes a device capable of accessing a website, such as a smart phone, a tablet, or a computer.

An embodiment of the present disclosure provides a storage medium storing computer-executable instructions, where the computer-executable instructions are configured to execute the above method for distinguishing internal and external links of a target website.

An embodiment of the present disclosure provides a computer program product, where the computer program product includes a computer program stored on a computer-readable storage medium, and the computer program includes program instructions that, when executed by a computer, cause all The computer executes the above-mentioned method for distinguishing internal and external links of the target website.

The above-mentioned computer-readable storage medium may be a transient computer-readable storage medium, and may also be a non-transitory computer-readable storage medium.

The technical solutions of the embodiments of the present disclosure may be embodied in the form of software products, and the computer software products are stored in a storage medium and include one or more instructions to enable a computer device (which may be a personal computer, a server, or a network equipment, etc.) to execute all or part of the steps of the methods described in the embodiments of the present disclosure. The aforementioned storage medium may be a non-transitory storage medium, including: U disk, removable hard disk, Read-Only Memory (ROM, Read-Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk, etc. A medium that can store program codes, and can also be a transient storage medium.

The foregoing description and drawings sufficiently illustrate the embodiments of the present disclosure to enable those skilled in the art to practice them. Other embodiments may include structural, logical, electrical, process, and other changes. The examples represent only possible variations. Unless expressly required, individual components and functions are optional and the order of operations may vary. Portions and features of some embodiments may be included in or substituted for those of other embodiments. Also, the terms used in this application are used to describe the embodiments only and not to limit the claims. As used in the description of the embodiments and the claims, the singular forms "a" (a), "an" (an) and "the" (the) are intended to include the plural forms as well, unless the context clearly dictates otherwise. . Similarly, the term "and/or" as used in this application is meant to include any and all possible combinations of one or more of the associated listings. Additionally, when used in this application, the term "comprise" and its variations "comprises" and/or including and/or the like refer to stated features, integers, steps, operations, elements, and/or The presence of a component does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and/or groupings of these. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, or device that includes the element. Herein, each embodiment may focus on the differences from other embodiments, and the same and similar parts between the various embodiments may refer to each other. For the methods, products, etc. disclosed in the embodiments, if they correspond to the method section disclosed in the embodiments, reference may be made to the description of the method section for relevant parts.

Those skilled in the art can realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software may depend on the specific application and design constraints of the technical solution. Skilled artisans may use different methods for implementing the described functionality for each particular application, but such implementations should not be considered beyond the scope of the disclosed embodiments. The skilled person can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described systems, devices and units can refer to the corresponding processes in the foregoing method embodiments, and details are not repeated here.

In the embodiments disclosed herein, the disclosed methods and products (including but not limited to apparatuses, devices, etc.) may be implemented in other ways. For example, the apparatus embodiments described above are only illustrative. For example, the division of the units may only be a logical function division. In actual implementation, there may be other division methods, for example, multiple units or components may be combined Either it can be integrated into another system, or some features can be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms. The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. This embodiment may be implemented by selecting some or all of the units according to actual needs. In addition, each functional unit in the embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more functions for implementing the specified logical function(s) executable instructions. In some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. In the descriptions corresponding to the flowcharts and block diagrams in the accompanying drawings, operations or steps corresponding to different blocks may also occur in different sequences than those disclosed in the description, and sometimes there is no specific relationship between different operations or steps. order. For example, two consecutive operations or steps may, in fact, be performed substantially concurrently, or they may sometimes be performed in the reverse order, depending upon the functionality involved. Each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented in special purpose hardware-based systems that perform the specified functions or actions, or special purpose hardware implemented in combination with computer instructions.

Claims (10)

1. A method for distinguishing between internal and external links of a target website, comprising:

acquiring first ICP filing information of a target website;

acquiring URL links to be distinguished of the target websites;

and distinguishing whether the URL link to be distinguished is an internal link or an external link of the target website according to the first ICP record information.

2. The method of claim 1, wherein obtaining first ICP docket information for a target web site comprises:

accessing a first website home page of the target website;

extracting the content of the first website home page;

and acquiring first ICP filing information of the target website from the content of the first website home page.

3. The method of claim 2, wherein obtaining the URL link to be distinguished of the target website comprises:

and under the condition of acquiring the first ICP filing information of the target website, extracting the URL link to be distinguished of the target website from the first website homepage.

4. The method according to claim 2 or 3, wherein distinguishing whether the URL link to be distinguished is an in-link or an out-link of the target website according to the first ICP docket information comprises:

acquiring a first host field of the first website home page;

acquiring a second host field of the URL link to be distinguished;

under the condition that the first host field is the same as the second host field, determining the URL link to be distinguished as an inner chain of the target website;

and under the condition that the first host field is different from the second host field, distinguishing that the URL link to be distinguished is an internal link or an external link of the target website according to the first ICP record information.

5. A method according to claim 4, wherein distinguishing whether the URL link to be distinguished is an in-chain or an out-chain of the target web site according to the first ICP docketing information if the first host field and the second host field are not the same comprises:

under the condition that the first host field is different from the second host field, accessing a second website home page linked with the URL to be distinguished according to the second host field;

extracting the content of the home page of the second website;

acquiring second ICP filing information of the URL link to be distinguished from the content of the home page of the second website;

and distinguishing whether the URL link to be distinguished is an internal link or an external link of the target website according to the first ICP record information and the second ICP record information.

6. The method according to claim 5, wherein distinguishing whether the URL link to be distinguished is an in-link or an out-link of a target website according to the first ICP inventory information and the second ICP inventory information comprises:

under the condition that the first ICP record information is the same as the second ICP record information, determining that the URL link to be distinguished is an inner chain of the target website; and/or the presence of a gas in the gas,

and under the condition that the first ICP record information is different from the second ICP record information, determining that the URL link to be distinguished is an external link of the target website.

7. An apparatus for distinguishing between an inside and an outside link of a destination web site, comprising:

the first acquisition module is configured to acquire first ICP filing information of a target website;

the second acquisition module is configured to acquire the URL link to be distinguished of the target website;

and the distinguishing module is configured to distinguish whether the URL link to be distinguished is an internal link or an external link of the target website according to the first ICP record information.

8. An apparatus for distinguishing between internal and external links of a destination web site, comprising a processor and a memory storing program instructions, wherein the processor is configured to perform the method for distinguishing between internal and external links of a destination web site as claimed in any one of claims 1 to 6 when executing the program instructions.

9. An electronic device comprising the apparatus for distinguishing between an inside and an outside link of a destination web site as claimed in claim 9.

10. A storage medium storing program instructions which, when executed, perform the method for distinguishing between an inside and an outside of a destination web site according to any one of claims 1 to 6.

Images