CN114722321A - Webpage content processing method and device, electronic equipment and storage medium - Google Patents

Abstract

The embodiment of the application discloses a webpage content processing method, a device, electronic equipment and a storage medium; the method includes the steps that webpage content to be processed of a webpage is obtained, wherein the webpage content to be processed comprises webpage content units and webpage labels thereof, and the webpage content comprises content characters and identification labels corresponding to the content characters; according to the webpage label and the identification label, the position information of the content character in the webpage can be identified, so that the processing type of the content character is determined; when the content characters are of a canvas drawing type, drawing the content characters on a preset canvas, and when the content characters are of a label processing type, adding identification labels corresponding to the content characters into a preset label set according to a preset rule; and then, target webpage content of the webpage is generated and output according to the current canvas and the current tag set, so that the crawler can be effectively prevented from capturing the content on the webpage, and the safety of the webpage content is improved.

Description

Web content processing method, apparatus, electronic device and storage medium

technical field

The present application relates to the field of computer technologies, and in particular, to a method, apparatus, electronic device, and storage medium for processing webpage content.

Background technique

With the development of Internet technology, the Internet has penetrated into every corner of social daily life and economic life. Among them, web pages have become an important way of information transmission. People browse information through web pages, and enterprises conduct production and marketing through web pages. different activities.

However, when using webpages to browse information, such as reading e-books through webpages, since the content on the webpage is easy to be crawled by the crawler, the crawler only needs to wait for the content on the webpage to be loaded, and then the script program can obtain the content displayed on the webpage. This results in lower security of web content.

SUMMARY OF THE INVENTION

The embodiments of the present application provide a method, apparatus, electronic device, and storage medium for processing webpage content, which can improve the security of webpage content.

The embodiment of the present application provides a web content processing method, including:

Obtaining the to-be-processed web page content of the web page, the to-be-processed web page content includes at least one web page content unit and a web page label corresponding to the web page content unit, wherein the web page content unit includes at least one content character and an identification label corresponding to the content character;

Identifying the location information of the content character in the webpage according to the webpage label corresponding to the webpage content unit and the identification label corresponding to the content character;

For each content character in the webpage content, determine the processing type of the content character according to the position information of the content character in the webpage;

When the processing type of the content character is a canvas drawing type, the content character is drawn on a preset canvas;

When the processing type of the content characters is a label processing type, adding the identification tags corresponding to the content characters to the preset tag set according to a preset order;

When the preset content generation conditions are met, the target web page content of the web page is generated and output according to the current canvas and the current tag set.

Correspondingly, the embodiment of the present application also provides a webpage content processing device, including:

an acquisition unit, configured to acquire the to-be-processed webpage content of the webpage, the to-be-processed webpage content includes at least one webpage content unit and a webpage tag corresponding to the webpage content unit, wherein the webpage content unit includes at least one content character and the corresponding content character the identification label;

an identification unit, configured to identify the location information of the content character in the webpage according to the webpage label corresponding to the webpage content unit and the identification label corresponding to the content character;

a determining unit, configured to, for each content character in the webpage content, determine the processing type of the content character according to the position information of the content character in the webpage;

a drawing unit, used to draw the content character on a preset canvas when the processing type of the content character is a canvas drawing type;

An adding unit, configured to add the identification tags corresponding to the content characters to a preset tag set according to a preset order when the processing type of the content characters is a tag processing type;

The generating unit is configured to generate and output the target web page content of the web page according to the current canvas and the current tag set when the preset content generation condition is satisfied.

In one embodiment, before the obtaining unit, further includes:

an acquiring subunit, configured to acquire initial web page content of the web page, where the initial web page content includes at least one web page tag and sub-web page content corresponding to the web page tag, wherein the sub-web page content includes at least one content character;

Splitting subunits, used for splitting the content characters in the content of the sub-web page, to obtain an initial web page content unit, where the initial web page content unit includes at least one content character;

A subunit is added for adding identification tags to the content characters in the initial web page content unit to obtain a web page content unit.

Among them, adding subunits can be used to:

determining the number of content characters in the initial web page content unit;

Determine the identification tags corresponding to the content characters in the initial webpage content unit according to the number of content characters in the initial webpage content unit;

According to the identification tag, an identification tag is added to the content characters in the initial webpage content unit to obtain a webpage content unit.

In one embodiment, the determining unit includes:

a comparison subunit, configured to compare the position information of the content character in the webpage with the preset position information for each content character in the webpage content to obtain a comparison result;

A determination subunit, configured to determine the processing type of the content character according to the comparison result.

In one embodiment, the drawing unit includes:

Determining a subunit for determining a drawing function for drawing the content character when the processing type of the content character is a canvas drawing type;

The drawing subunit is configured to draw the content characters on the positions corresponding to the preset canvas according to the drawing function and the position information of the content characters in the webpage.

In one embodiment, the adding unit includes:

Determining a subunit, for determining a corresponding label order setting function according to a preset order when the processing type of the content character is a label processing type;

The adding subunit is used for adding the identification tags corresponding to the content characters to the preset tag set according to the preset order by using the tag order setting function.

In one embodiment, the generating unit includes:

Inserting a subunit for inserting the current canvas into the corresponding position of the web page according to the position information of the content characters on the current canvas in the web page when the preset content generation conditions are met;

The output subunit is configured to output the content characters corresponding to the identification tags to the corresponding positions of the webpage according to the sequence of the identification tags in the current tag set.

Embodiments of the present application also provide a computer program product or computer program, where the computer program product or computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the methods provided in various optional manners of the above aspect.

Correspondingly, the embodiments of the present application further provide a computer-readable storage medium, where the computer-readable storage medium stores instructions, and when the instructions are executed by a processor, implement the webpage content processing method provided in any of the embodiments of the present application.

The embodiment of the present application acquires the to-be-processed webpage content of the webpage, the to-be-processed webpage content includes at least one webpage content unit and a webpage label corresponding to the webpage content unit, wherein the webpage content unit includes at least one content character and the corresponding content character identification label; according to the webpage label corresponding to the webpage content unit and the identification label corresponding to the content character, identify the position information of the content character in the webpage; for each content character in the webpage content, according to the The position information of the content characters in the webpage determines the processing type of the content characters; when the processing type of the content characters is a canvas drawing type, the content characters are drawn on a preset canvas; When the processing type is the label processing type, the identification labels corresponding to the content characters are added to the preset label set according to the preset order; when the preset content generation conditions are met, the current canvas and the current label set are generated and output. The page's landing page content. In this solution, the content characters whose processing type is canvas drawing type are drawn on the preset canvas, and the identification tags of the content characters whose processing type is label processing type are added to the preset tag set in a preset order, which can effectively Prevent crawlers from crawling content on web pages, thereby improving the security of web content.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained from these drawings without creative effort.

FIG. 1 is a schematic diagram of a scenario of a web page content processing method provided by an embodiment of the present application;

2a is a schematic flowchart of a method for processing web page content provided by an embodiment of the present application;

FIG. 2b is a schematic diagram of another scenario of the webpage content processing method provided by the embodiment of the present application;

FIG. 2c is a schematic diagram of webpage content provided by an embodiment of the present application;

FIG. 2d is another schematic diagram of webpage content provided by an embodiment of the present application;

2e is a schematic diagram of position information of content characters provided by an embodiment of the present application;

FIG. 2f is a schematic diagram of another scenario of a web page content processing method provided by an embodiment of the present application;

3a is another schematic flowchart of a network content processing method provided by an embodiment of the present application;

3b is a schematic diagram of another scenario of the web content processing method provided by the embodiment of the present application;

4a is a schematic structural diagram of a network content processing apparatus provided by an embodiment of the present application;

FIG. 4b is another schematic structural diagram of a network content processing apparatus provided by an embodiment of the present application;

FIG. 5 is a schematic structural diagram of a network device provided by an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work fall within the protection scope of the present application.

Embodiments of the present application provide a web content processing method, apparatus, electronic device, and computer-readable storage medium. Wherein, the webpage content processing apparatus may be integrated in an electronic device, and the electronic device may be a server or a terminal or other device. The terminal may be an electronic device, such as a notebook computer, a desktop computer, and a tablet computer (PC, Personal Computer), which is provided with a storage unit and installed with a microprocessor.

For example, the description is given by taking the example that the webpage content processing apparatus is integrated in the terminal. As shown in FIG. 1, first, the terminal obtains the to-be-processed webpage content of the webpage, the to-be-processed webpage content includes at least one webpage content unit and a webpage tag corresponding to the webpage content unit, wherein the webpage content unit includes at least one content character and identification tags corresponding to the content characters; then, the terminal can identify the location information of the content characters in the webpage according to the webpage tags corresponding to the webpage content units and the identification tags corresponding to the content characters; For each content character, the terminal can determine the processing type of the content character according to the position information of the content character in the webpage; when the processing type of the content character is canvas drawing type, the terminal can The characters are drawn on the preset canvas; when the processing type of the content characters is the label processing type, the terminal adds the identification tags corresponding to the content characters to the preset tag set according to the preset order; when the preset content generation conditions are met , the terminal generates and outputs the target webpage content of the webpage according to the current canvas and the current label set.

The following detailed descriptions are provided respectively. It should be noted that the description order of the following embodiments does not limit the preferred order of the embodiments.

The embodiments of the present application will be described from the perspective of a webpage content processing apparatus. The webpage content processing apparatus may be integrated in an electronic device, and the electronic device may be a server or a terminal or other equipment.

As shown in Figure 2a, a method for processing web page content is provided, and the specific process includes:

101. Acquire to-be-processed webpage content of the webpage, where the to-be-processed webpage content includes at least one webpage content unit and a webpage label corresponding to the webpage content unit, wherein the webpage content unit includes at least one content character and an identification label corresponding to the content character.

Wherein, the content of the webpage to be processed may include content displayed through a browser. For example, the web page content to be processed may include browser documents and the like. The browser document may be a document that can be recognized by the browser and rendered on the web page for display.

There may be multiple language formats of the content of the webpage to be processed.

For example, the content of the webpage to be processed may be a document written in Hyper Text Markup Language (Hyper Text Markup Language, HTML). Wherein, the HTML document can be read by various web browsers to generate a document capable of delivering various types of inquiries. While HTML can be a markup language, it includes a series of tags that define the meaning and structure of web page content.

For another example, the content of the web page to be processed may be a document embedded in a script language such as JavaScript in HTML. Among them, JavaScript is an advanced scripting language applied to web development. JavaScript can add various dynamic functions to web pages, thereby making the presentation effect of web page content on the browser smoother and more beautiful. Embedding documents in a scripting language such as JavaScript in HTML can affect the behavior of web pages.

For another example, the content of the web page to be processed may be a document embedded in HTML such as a JavaScript scripting language and Cascading Style Sheets (CSS). Among them, CSS is a language that defines style structures such as fonts, colors, positions, etc. It is used to describe the way information on web pages is formatted and displayed, which can affect the appearance and layout of content presented in web pages.

In one embodiment, there may be multiple content types of the webpage content to be processed. For example, the content of the webpage to be processed may be one or more of text, pictures, tables, animations, and even music.

In an embodiment, the webpage content to be processed may include at least one webpage content unit and a webpage label corresponding to the webpage unit, wherein the webpage content unit may include at least one content character and an identification label corresponding to the content character.

Among them, the web page tag can be a tag used to construct the web page structure, web page layout and bearing content, that is, through the web page tag, the browser can generate the web page structure and layout corresponding to the web page tag and identify the content information of the web page tag identification, and according to the web page The location information of the tag in the content of the webpage to be processed is rendered, and the content identified by the webpage tag is rendered to the corresponding position of the webpage, so that the content identified by the webpage tag is presented on the webpage.

For example, in HTML, a web page tag can be a tag consisting of "<" and ">" and block-level elements enclosed by "<", ">". Among them, block-level elements can be used to build network architecture, web page layout and host content. For example, block-level elements can include head, div, p, body, and so on. Therefore, web page tags can be <head>, <div>, <p>, <body> and so on.

In one embodiment, the webpage tags have their corresponding functions. For example, some webpage tags may define the style of the content identified by the browser when rendered, and some webpage tags may define the rendering format of the identified content in the browser, and so on. For example, in HTML, the <head> tag can define the information of the webpage content to be processed, such as the encoding format of the webpage content to be processed in the browser, etc.; the <div> tag can define the section in the webpage content to be processed; <p > tags can define paragraphs; <body> tags can define topics, and so on.

In one embodiment, a webpage tag may include a start tag and an end tag, and the content wrapped by the start tag and the end tag is the content presented on the web page, and the content wrapped by the start tag and the end tag may be presented in the function of the tag. on the webpage. For example, in an HTML document, the <p> tag can include the opening tag <p> and the closing tag is </p>, and the content identified by the <p> tag can be the content between <p> and </p> , the content between <p> and </p> can be presented on the web page in the form of paragraphs.

For example, as shown in Figure 2b, in an HTML1 document, the content wrapped in the opening <p> and closing </p> tags of the <p> tag is "this is the first paragraph", while <p> and < The content between /p> can be presented on the webpage in the form of paragraphs, so "this is the first paragraph" will be presented on the webpage in the form of paragraphs.

As another example, the <title> tag can define the title in the HTML document. As shown in Figure 2b, in an HTML1 document, the content wrapped in the opening tag <title> and closing tag </title> of the <title> tag is "example", so the content wrapped in the </title> tag is "example" ” can be presented on a web page as a title.

In one embodiment, the webpage tags may be used alone. For example, an <input> tag can appear alone, which defines an input control.

In one embodiment, web tags can be used nested within each other. For example, as shown in Figure 2b, the <p> tag can be embedded within the <body> tag.

In one embodiment, the identification tag may be a content-bearing tag. Through the identification tag, the browser can identify the content identified by the identification tag and the location information of the identified content, and render the content identified by the identification tag to the corresponding position of the web page.

For example, in HTML, a web page tag can consist of "<" and ">" and inline elements wrapped in "<" and ">". Among them, the inline element can be a basic element based on the semantic level. For example, inline elements can include span, strong, em, etc. Therefore, the identification tags can be <span>, <em>, <strong> and other tags. Wherein, each identification tag can identify the content information and location information of the identified web page content.

In one embodiment, the identification tag may include a start tag and an end tag, and the content wrapped by the start tag and the end tag may be content presented on a web page, and the content wrapped by the start tag and the end tag may be presented on the page according to the function of the tag. on the webpage. For example, in an HTML document, the <span> tags can be paired, with the opening tag being <span> and the closing tag being </span>, and the content identified by the <span> tag can be between <span> and </span>. </span> content.

In one embodiment, the identification tag may be used alone. For example, the <img> tag can be used alone, and the content it identifies is an image.

In one embodiment, the identification tag can be embedded in the webpage tag for use, and the identification tag further identifies the content identified in the webpage tag. For example, as shown in Figure 2c, the <span> tag can be used embedded within the <p> tag.

When the identification tag is nested into the webpage tag, the browser can not only identify the content and position information of the webpage tag, but also the content and position information of the identification tag embedded in the webpage tag. For example, as shown in Figure 2c, when the browser identifies the webpage content, it first identifies the content wrapped in the webpage tag <div>, and then identifies the content identified in the two webpage tags <p>. Among them, when recognizing the first web page tag <p>, the browser can recognize that the identified content is "What kind of people are written in this book?" and the location of the identified content in the web page. When recognizing the second webpage tag <p>, the browser can not only identify the content and location information identified by the browser, but also identify the content and location information identified by the identification tag of the second webpage tag <p>. For example, the browser can identify the content identified by the first identification tag <span> "This is a group of forgotten people." and its location information, and can also identify the content identified by the second identification tag <span> "Yes" and its location information.

In one embodiment, the webpage content unit may be a content unit in the webpage content. For example, the webpage content unit may be the smallest content unit in the webpage content. For example, taking text content as an example, web content units may be paragraphs, sentences, phrases, characters, and so on. For another example, taking picture content as an example, the webpage content unit may be a picture or the like.

In one embodiment, a web page content unit may include content characters. Among them, the content characters can be various symbols. For example, the content characters may be characters used in various countries, may be relational symbols that define the relationship between characters, or may be self-created symbols, and so on. For example, the content characters may be Chinese characters, English letters, Arabic numerals, punctuation marks, Japanese, and so on.

In an embodiment, in order to facilitate the processing of content characters in the webpage content, the webpage content unit may be formed by combining content characters and identification tags. For example, an identification tag may include an opening tag and an closing tag, and the opening and closing tags and the content characters enclosed by the opening and closing tags may constitute a web page content unit. For example, as shown in Figure 2c, "<span>has</span>" may constitute a web page content unit. As another example, "<span>This is a group of forgotten people.</span>" can also constitute a web content unit.

In one embodiment, the webpage content to be processed may be stored in a storage carrier with a storage function. For example, the web page content to be processed may be stored in a local server or in the memory of the terminal. When the webpage content to be processed needs to be obtained, it can be obtained directly from the local server or the storage of the terminal. For another example, the web page content to be processed may be stored in a non-local server or memory of a terminal. When you need to obtain the content of the webpage to be processed, you can first request the browser to obtain the content of the webpage to be processed, and then the browser will obtain the content of the webpage to be processed from a non-local server or terminal, and load the content of the webpage to be processed in the browser. At this point, the content of the to-be-processed webpage can be obtained through the browser.

In one embodiment, before acquiring the content of the webpage to be processed, the content of the webpage to be processed may be preprocessed by using the word splitting method, thereby improving the efficiency of subsequent processing of the content of the webpage to be processed. Specifically, before the step "obtaining the content of the web page to be processed", it further includes:

acquiring initial web page content of the web page, the initial web page content includes at least one web page tag and sub-web page content corresponding to the web page tag, wherein the sub-web page content includes at least one content character;

splitting the content characters in the content of the sub-web page to obtain an initial web page content unit, where the initial web page content unit includes at least one content character;

An identification tag is added to the content characters in the initial webpage content unit to obtain a webpage content unit.

Wherein, the initial webpage content may be the webpage content obtained before the preprocessing of the webpage content to be processed, and the initial webpage content may be the obtained webpage content without any processing. For example, as shown in FIG. 2d, the initial webpage content may be webpage content whose content characters do not have corresponding identification tags.

Wherein, the language format of the initial web page content may also have multiple formats. For example, the browser document may be an HTML document, a document embedded in HTML such as a JavaScript scripting language, or a document embedded in HTML such as a JavaScript scripting language and CSS, and so on.

In one embodiment, the initial web page content may be stored in a storage carrier with a storage function. For example, the initial web page content may be stored locally on the server or in the terminal's memory. When the webpage content to be processed needs to be obtained, it can be obtained directly from the local server or the storage of the terminal. As another example, the initial web page content may be stored in a non-local server or memory of the terminal. When it is necessary to obtain the content of the initial web page, you can first request the browser to obtain the content of the initial web page, and then the browser will obtain the content of the initial web page from a non-local server or terminal, and load the content of the initial web page in the browser. The initial web page content can be obtained through a browser.

In one embodiment, the initial webpage content may include at least one webpage tag and sub-page content corresponding to the webpage tag, wherein the sub-page content includes at least one content character.

Wherein, the content of the sub-web page corresponding to the web page tag may be a content character field with only the web page tag identifier but no corresponding identification tag. For example, as shown in Figure 2d, in the initial webpage content, the content "How are you?" identified by the webpage tag <p> can be a sub-page content, and the content identified by another webpage tag <p> "I'm fine. " can also be a subpage content.

In one embodiment, after the sub-page content is acquired, the content characters in the sub-page content need to be split, so as to obtain the initial webpage content unit.

Among them, before the characters in the sub-page content are split, the number of content characters in the sub-page content can be identified first, the split processing rules are determined according to the number of content characters in the sub-page content, and then according to the split processing rules The content characters of the sub-page content are split. Specifically, the step of "splitting the content characters in the content of the sub-page to obtain the initial webpage content unit" includes:

determining the number of content characters in the content of the sub-page;

Determine the split processing rule according to the number of content characters in the content of the sub-page;

According to the splitting processing rule, splitting processing is performed on the content characters in the content of the sub-page to obtain the initial webpage content unit.

For example, when there is only one content character in the content of the sub-page, the content characters in the content of the sub-page can be directly split to obtain the initial webpage content unit.

For example, when the number of content characters in the sub-page content is multiple, each content character may be split according to the number of content characters in the sub-page content to obtain the initial webpage content unit. It is also possible to split the content characters in pairs to obtain initial web page content units, and so on.

In one embodiment, after the initial webpage content unit is obtained, identification tags may be added to the content characters in the initial webpage content unit to obtain the webpage content unit.

Wherein, before adding identification tags to the content characters in the initial webpage content unit, the number of content characters in the initial webpage content unit can be determined first, then the identification tags are determined according to the number of content characters in the initial webpage content units, and finally the identification tags Added to the initial web content unit. Specifically, the step of "adding identification tags to the content characters in the initial webpage content unit to obtain the webpage content unit" includes:

determining the number of content characters in the initial web page content unit;

determining, according to the number of content characters in the initial web page content unit, an identification label corresponding to the content characters in the initial web page content unit;

According to the identification tag, an identification tag is added to the content characters in the initial webpage content unit to obtain a webpage content unit.

For example, when the content character in the initial webpage content unit is one, the identification tag may be a browser identification tag capable of identifying the location information of the content character in the initial webpage content unit. For example, <span> tags, <strong> tags, <em> tags, etc.

For example, when there are multiple content characters in the initial webpage content unit, the identification tag may be a browser identification tag capable of identifying the location information of each content character in the initial webpage content unit.

In one embodiment, the preprocessed initial web page content may be loaded and rendered on a browser, so as to obtain the web page content to be processed.

102. Identify the position information of the content characters in the webpage according to the webpage tags corresponding to the webpage content and the identification tags corresponding to the content characters.

The location information may include information describing the location of characters in the content. For example, the position information of the content characters in the web page may include positioning information and size information, and so on. The positioning information may include coordinate information of the content characters in the web page, etc., and the size information may include the length, width, and height of the content characters. The location information may include multiple location parameters. Wherein, the position parameter may include a parameter describing the position of the content character. For example, the position information of the content character in the webpage includes the width and height of the content character of the content character, wherein the length of the content character corresponds to one position parameter, and the height of the content character corresponds to another position parameter.

In one embodiment, the web page can be set to a rectangular coordinate system, then the position information of the content characters in the web page can be represented by the coordinate information on the coordinate axis, wherein, any point in the web page can be taken as the origin of the rectangular coordinate system. .

For example, the upper left corner of the web page can be taken as the origin of the coordinate system, for example, as shown by 1021 in FIG. 2e. The position information of the content characters in the webpage may be represented by a rectangle (Rectangle, Rect) object. The Rect object corresponding to each content character may include four position parameters, namely (x, y, width, height). Among them, x can represent the abscissa of the upper left corner of the rectangle, that is, the abscissa of the content character in the web page; y can represent the ordinate of the upper left corner of the rectangle, that is, the ordinate of the content character in the web page; width can represent the width of the rectangle; height Can represent the height of the rectangle.

The position information of the content characters in the web page can be determined according to the set coordinate system. For example, as shown in Figure 2e, the web page is set to a rectangular coordinate system, wherein the value range of the x-axis is 0-50000, the y-axis The value range of the axis is 0～30000. At this time, the location information of "set" may be (100, 28000, 20, 35).

For another example, the center of the web page may be taken as the origin of the coordinate system, for example, as shown by 1022 in FIG. 2e. The value range of the x-axis may be -25000 to 25000, and the value range of the y-axis may be -15000 to 15000. At this time, the position information of "bit" may be (-24980, 14000, 20, 35), the position information of "set" may be (24980, -1400, 20, 35), and so on.

In one embodiment, the webpage tag corresponding to the webpage content and the identification tag corresponding to the content character can identify the content and location information of the identified content character, so the position information of the content character in the webpage can be identified through the webpage tag and the identification tag. For example, by traversing the content in the content of the web page to be processed, the content of the content characters and the position information in the web page can be determined according to the traversed network tags and identification tags.

For example, in an HTML document, a document object model (Document Object Model, DOM) traversal can be performed on the webpage content to be processed, and the network tags and identification tags in the webpage content to be processed and the content characters corresponding to the network tags and identification tags can be obtained through DOM traversal. content and location information.

For example, as shown in FIG. 2e, through DOM traversal, the content characters identified by the network tag and the identification tag are "location" and the location information of "location" in the webpage, respectively.

In an embodiment, the content of the content characters and the position information in the webpage obtained by traversing can be stored in a preset storage space.

For example, in a browser document embedded in a script language such as JavaScript in HTML, an array can be established to store the content information of the content characters obtained by traversal and the position information in the web page.

103. For each content character in the webpage content, determine the processing type of the content character according to the position information of the content character in the webpage.

Among them, the processing type may represent the division of processing types for the content characters. For example, the processing types of content characters may include canvas drawing type and label processing type. Wherein, when the processing type of the content characters is the canvas type, the content characters can be drawn on the preset canvas; when the processing type of the content characters is the label processing type, the identification tags corresponding to the content characters can be added to the preset order. Set of preset labels. In one embodiment, the processing type of the content character can be directly determined according to the position information of each content character in the webpage.

For example, when the positional parameters of the content character are all positive numbers, the type of the content character is the canvas drawing type; otherwise, the type of the content character is the label processing type. For example, when the web page is set to a Cartesian coordinate system, and the center of the web page is a Cartesian coordinate system, as shown by 1022 in FIG. 2e. The position information of "bit" may be (-24980, 14000, 20, 35), and the position information of "set" may be (24980, -1400, 20, 35). Since there are negative numbers in the positional parameters of "bit" and "set", the types of "bit" and "set" are label processing type.

For another example, when a certain position parameter in the content character position information is a positive number, the type of the content character is the canvas drawing type; otherwise, the type of the content character is the label processing type. For example, the type of the content character can be determined according to the parameter corresponding to the content character on the abscissa. At this time, the type of "bit" is the label processing type, and the processing type of "set" is the canvas drawing type.

In one embodiment, when the position parameter of the content character includes the width of the content character and the height of the content character, the height and width of the content character may be compared to determine the type of the content character. For example, when the width of the content character is greater than the height, the type of the content character is the canvas drawing type, when the width of the content character is less than or equal to the height, the type of the content character is the label processing type, and so on.

In one embodiment, the position information of each content character in the webpage can be compared with the preset position information, and then the processing type of the content character is determined according to the comparison result. Specifically, the step "for each content character in the webpage content, according to the position information of the content character in the webpage, determine the processing type of the content character", including:

For each content character in the webpage content, compare the position information of the content character in the webpage with the preset position information to obtain a comparison result;

The processing type of the content character is determined according to the comparison result.

The location information may include several location parameters, and the preset location information may also include several preset location parameters, which may be based on one or more location parameters in the location information and one or more preset location parameters corresponding to the preset location information. Set the position parameter to compare, get the comparison result, and then determine the processing type of the content character according to the comparison result.

For example, when the web page is set to a Cartesian coordinate system, where the upper left corner of the web page is the origin of the Cartesian coordinate system, the location information of the content characters can be (x, y, width, height), and the preset location information can be (x1 , y1). Then, x and x1 can be compared to determine the processing type of the content character; y and y1 can also be compared to determine the processing type of the content character. Wherein, x1 may be a certain value within the range of the ordinate, and y1 may be a certain value within the range of the abscissa.

For example, the webpage is set as a rectangular coordinate system, wherein the value range of the x-axis is 0-50000, and the value range of the y-axis is 0-30000. The y1 in the preset position information can be set to 8000, and then the value y corresponding to the ordinate of each content character in the web page coordinate system is compared with 8000 to determine the processing type of the content character.

In one embodiment, determining the processing type of the content character according to the comparison result may be that when the position parameter in the position information is greater than or equal to the preset position parameter in the preset position information, the processing type of the content character is a canvas drawing type; When the position parameter in the position information is smaller than the preset position parameter in the preset position information, the processing type of the content character is the label processing type.

For example, y1 in the preset position information can be set to 8000. When the y corresponding to the content character is greater than 8000, the processing type of the content character can be the canvas drawing type; when the y corresponding to the content character is less than or equal to 8000, the content character The processing type can be a label processing type.

In one embodiment, determining the processing type of the content character according to the comparison result may be that when the position parameter in the position information is greater than or equal to the preset position parameter in the preset position information, the processing type of the content character is the label processing type; When the position parameter in the position information is smaller than the preset position parameter in the preset position information, the processing type of the content character is the canvas drawing type.

For example, y1 in the preset position information can be set to 8000. When the y corresponding to the content character is greater than or equal to 8000, the processing type of the content character can be the label processing type; when the y corresponding to the content character is less than 8000, the content character The processing type can be a canvas draw type.

In one embodiment, after comparing the position information of each content character with the preset position information, the processing type of the content character may be determined according to the current comparison result.

For example, the position information corresponding to the content characters stored in the array can be extracted one by one and compared with the preset position information, and then the processing type of the content characters can be determined according to the current comparison result.

In one embodiment, after comparing the position information of each content character with preset position information, each content character is grouped according to the comparison result, and then the processing type is determined for the grouped content characters.

For example, the position information corresponding to the content characters stored in the array can be extracted and compared with the preset position information, and then the content characters can be divided into the first content character group and the second content character group according to the comparison result. Wherein, the content characters in the first content character group may be of the canvas drawing type, and the content characters in the second content character group may be of the label processing type; or the content characters in the first content character group may be of the label processing type, and the second content character group may be of the label processing type. The content characters in the content character group are of the canvas draw type.

104. When the processing type of the content character is the canvas drawing type, draw the content character on the preset canvas.

The canvas can be an image container in a browser document, and all image information in the browser document can be stored in the canvas. For example, in HTML, a canvas can be created with the <canvas> tag. Among them, the <canvas> tag has several built-in setting parameters, and the created canvas can be customized by setting the built-in parameters in the <canvas> tag, so that the created canvas can be adapted to the web page. For example, the built-in parameters of <canvas> include Width and Height, where Width can be the width of the canvas and Height can be the height of the canvas. By setting the Width and Height, a canvas with a certain width and height is generated.

In one embodiment, when the processing type of the content character is the canvas drawing type, a drawing function can be used to draw the content character on a preset canvas. Specifically, the step "when the processing type of the content character is the canvas drawing type, draw the content character on the preset canvas" includes:

When the processing type of the content character is the canvas drawing type, determine the drawing function used for the content character drawing;

According to the drawing function and the position information of the content character in the webpage, the content character is drawn on the position corresponding to the preset canvas.

The drawing function may be an operation function for drawing the content characters on the preset canvas. For example, in HTML, the drawing function can be the fillText() function or the strokeText() function, etc. Among them, the fillText() function can be used to draw fill content characters, and the strokeText() function can be used to draw stroke content characters.

Among them, several setting parameters are built in the drawing function, and the style and position of the content characters drawn on the preset canvas can be adjusted by setting the parameters in the drawing function. For example, the fillText() function can be fillText(content character, X, Y), where the parameter X can indicate that the content character is drawn on the horizontal axis of the web page at the position corresponding to X, and the parameter Y can indicate that the content character is drawn on the On the vertical axis of the web page and the position corresponding to Y. Specifically, X can correspond to the position information parameter x of the content character on the webpage, and Y can correspond to the position information parameter y of the content character on the webpage. For example, the fillText() function can be set to fillText(content character, x, y ). By setting the setting function of the drawing function, the content character can be drawn on the position corresponding to the preset canvas.

The preset canvas may be a pre-generated canvas. For example, in HTML, you can create a canvas in advance through the <canvas> tag, and then draw the content characters on the preset canvas.

In one embodiment, before drawing the content characters on the preset canvas, the drawing environment on the preset canvas should also be acquired, so as to avoid errors when drawing the content characters on the preset canvas. Specifically, an environment obtaining function may be used to obtain the drawing environment on the preset canvas. For example, in HTML, you can use an environment acquisition function such as getContext() to obtain an environment for drawing content characters on a preset canvas.

105. When the processing type of the content characters is the label processing type, add the identification tags corresponding to the content characters to the preset tag set according to a preset order.

In one embodiment, when the processing type of the content characters is a label processing type, a sequence setting function for setting the sequence of the identification labels can be determined according to a preset sequence, and then the sequence setting function is used to add the identification labels corresponding to the content characters in a preset sequence. to the preset label set. Specifically, the step "when the processing type of the content characters is the label processing type, add the identification tags corresponding to the content characters to the preset tag set according to the preset order", including:

When the processing type of the content character is the label processing type, determine the corresponding label order setting function according to the preset order;

The identification tags corresponding to the content characters are added to the preset tag set in a preset order by using the tag order setting function.

The preset sequence may be the sequence in which the identification tags are added to the preset tag set. Among them, there may be various order ways in which the identification tags are added to the preset tag set. For example, the identification tags may be added to the preset tag set in a random order, or the identification tags may be added in a regular manner. to the preset label set.

Wherein, the label order setting function may be a function determined according to a preset order.

For example, when the identification tags are added to the preset tag set in a random order, the tag order setting function may be a random function. For example, in a document embedded in a scripting language such as JavaScript in HTML, the tag order setting function may be a function such as Math.random().

For example, when the identification tags are added to the preset tag set in a regular manner, the tag preset order function may be a function with preset rules.

The preset label set may be a storage space capable of storing identification labels. For example, in a browser document embedded in a scripting language such as JavaScript in an HTML document, the preset tag set may be an array, and the identification tags may be added to the array in a preset order.

106. When the preset content generation condition is satisfied, generate and output the target webpage content of the shown webpage according to the current canvas and the current tag set.

The preset content generation condition may be that the to-be-processed content satisfies the condition for being output to the webpage after the subsequent processing steps.

For example, the preset content generation condition may be that all content characters in the content to be processed have been processed, wherein the processing may be that when the processing type of the content characters is canvas drawing type, the content characters are drawn on the preset canvas; When the processing type is the tag processing type, the identification tags corresponding to the content characters are added to the preset tag set according to the preset order.

Wherein, the current canvas may be a canvas carrying all content characters whose processing type is canvas drawing type. The current tag set may be a tag set that stores all content characters whose processing type is the tag processing type.

In one embodiment, the step of “generating and outputting the target web page content of the web page according to the current canvas and the current tag set when the preset content generation conditions are met” includes:

When the preset content generation conditions are met, insert the current canvas into the corresponding position of the webpage according to the position information of the content characters on the current canvas in the webpage;

According to the sequence of the identification tags in the current tag set, the content characters corresponding to the identification tags are output to the corresponding positions of the webpage.

For example, the content characters on the current canvas include "I", "very", "good", and ".", wherein the position information of the content characters in the webpage is within the range of ordinate values 8975-8940 and abscissa values 200-280 , so the canvas is inserted into that extent.

In one embodiment, when the content characters are output to the web page according to the sequence of the identification tags in the tag set, the sequence of the content characters on the web page will change, thereby causing the content corresponding to the content characters to change. For example, as shown in FIG. 2f, when the processing type is selected, the identification tags of the content characters are added to the preset tag set according to the preset order, and then the webpage is directly generated according to the identification tags in the tag set. At this point, the order of the content on the web page will change, thereby affecting the meaning of the original content.

Therefore, in one embodiment, a positioning function for outputting the content characters corresponding to the identification tags to the positions corresponding to the web pages can be determined according to the sequence of the identification tags in the current tag set, and then the positioning function is used to output the content characters corresponding to the identification tags to the webpage in the corresponding position.

The positioning function in the original order may be added to the preset label set to identify the function for positioning the label to the original position according to the original order. For example, in documents in which HTML is embedded in scripting languages such as JavaScript and CSS, the positioning function may be the positioning mechanism in CSS. Using the positioning mechanism in CSS, it is possible to locate where an identifying tag should appear relative to its original position.

In the above-mentioned method for processing web page content, after acquiring the content to be processed of the web page, the position information of the content character in the web page can be identified according to the web page label corresponding to the web page content unit in the web page content and the identification label corresponding to the content character; The position information of the characters in the webpage determines the processing type of the content characters; when the processing type of the content characters is the canvas drawing type, the content characters are drawn on the preset canvas; when the content characters are the label processing type, the content characters are The identification tags corresponding to the content characters are added to the preset tag set; finally, the target webpage content of the webpage is generated and output according to the current canvas and the current tag set, which can effectively prevent the crawler from crawling the content on the webpage, thereby improving the security of the webpage content sex.

According to the methods described in the above embodiments, the following examples will be used for further detailed description.

In the embodiment of the present application, the method of the embodiment of the present application will be described by taking an example that a webpage content processing apparatus is integrated on a terminal.

As shown in Figure 3a, a method for processing webpage content, the specific process is as follows:

201. The terminal acquires initial webpage content of a webpage, where the initial webpage content includes at least one webpage tag and sub-page content corresponding to the webpage tag, wherein the sub-page content includes at least one content character.

Wherein, the initial webpage content may be the webpage content obtained before the preprocessing of the webpage content to be processed, that is, the initial webpage content may be the obtained webpage content without any processing. For example, as shown in FIG. 3b, the initial web page content may be web page content that does not contain an identification tag.

Wherein, the language format of the initial web page content may also have multiple formats. For example, the browser document may be an HTML document, a document embedded in HTML such as a JavaScript scripting language, or a document embedded in HTML such as a JavaScript scripting language and CSS, and so on.

In one embodiment, the initial webpage content may include at least one webpage tag and sub-page content corresponding to the webpage tag, wherein the sub-page content includes at least one content character.

Wherein, the webpage tag may be a tag used to construct the webpage structure, webpage layout and bearing content. For example, in HTML, a web page tag can be a tag composed of block-level elements. For example, as shown, web page tags can be <body> tags, <div> tags, and <p> tags.

Through the web page tag, the browser can generate the web page structure and layout corresponding to the web page tag and the content information identified by the web page tag, and according to the position information of the web page tag in the content of the web page to be processed, the content identified by the web page tag can be rendered to the corresponding web page. position, so that the content identified by the webpage tag is presented on the webpage.

Among them, the content characters can be various symbols. For example, the content characters may be characters used in various countries, may be relational symbols that define the relationship between characters, or may be self-created symbols, and so on. For example, the content characters may be Chinese characters, English letters, Arabic numerals, punctuation marks, Japanese, and so on. For example, as shown in Figure 3b, in an HTML document, "you" is a content character, and "?" is also a content character.

Wherein, the content of the sub-page may be a content field only identified by a webpage tag. For example, as shown in Figure 3b, the sub-page content identified by the <body> tags and <div> tags is "How are you?" and "I'm fine.", while the sub-page content identified by the first <p> tag is "How are you?", and the second <p> tag identifies the sub-page content as "I'm fine.".

In one embodiment, the initial web page content may be stored in a storage carrier with a storage function. For example, the initial web page content may be stored locally on the server or in the terminal's memory. When the webpage content to be processed needs to be obtained, it can be obtained directly from the local server or the storage of the terminal. For another example, the initial web page content may be stored in a non-local server or memory of the terminal. When it is necessary to obtain the content of the initial web page, you can first request the browser to obtain the content of the initial web page, and then the browser will obtain the content of the initial web page from a non-local server or terminal, and load the content of the initial web page in the browser. The initial web page content can be obtained through a browser.

202. The terminal preprocesses the content characters in the content of the sub-page, and obtains the content of the webpage to be processed, wherein the content of the webpage to be processed includes at least one webpage tag and the content of the sub-page corresponding to the webpage tag, wherein the content of the sub-page includes at least one content characters.

Wherein, the identification tag may be a tag carrying content. Through the identification tag, the browser can identify the content identified by the identification tag and the location information of the identified content, and render the content identified by the identification tag to the corresponding position of the web page. For example, in HTML, an identifying tag can be a tag consisting of inline elements. For example, identifying tags can be tags such as <span>, <em>, or <strong>.

Wherein, the identification tag may include a start tag and an end tag, and the start tag and the end tag and the content wrapped by the start tag and the end tag may constitute a webpage content unit.

For example, as shown in Figure 3b, the opening tag of the <span> tag is <span>, the closing tag is </span>, and "you" is wrapped between <span> and </span>, so <span>you </span> constitutes a unit of web content. Similarly, <span>good</span> also constitutes a web content unit and so on.

In an embodiment, the terminal preprocessing the content characters in the content of the sub-page may include the terminal splitting the content characters in the content of the sub-page to obtain an initial webpage content unit, wherein the initial content unit includes at least one content character. . Then, adding identification tags to the content characters in the initial webpage content unit to obtain the webpage content unit. Finally, the to-be-processed webpage content of the webpage is obtained according to the webpage content unit.

In one embodiment, the number of content characters in the content of the sub-page may be identified before the characters in the content of the sub-page are split, and the split processing rule is determined according to the number of the content characters in the content of the sub-page, and then The rule splits the content characters of the sub-web page content to obtain the initial web page content unit.

For example, when there is only one content character in the content of the sub-page, the content characters in the content of the sub-page can be directly split to obtain the initial webpage content unit.

For example, when the number of content characters in the sub-page content is multiple, each content character may be split according to the number of content characters in the sub-page content to obtain the initial webpage content unit. It is also possible to split the content characters in pairs to obtain initial web page content units, and so on.

For example, as shown in Fig. 3b, the number of content characters in the sub-page contents "How are you?" and "I'm fine." are both recognized as four. When the content characters in the content of the sub-page are divided, the content characters in the content of the sub-page can be divided one by one. That is, split "how are you?" and "I'm fine." into "you", "good", "are you", "?" and "me", "very good", "good", and ".". Wherein, each split content character constitutes an initial web page unit. For example, "you", "how are you", "are you", and "?" are a complete initial web page unit respectively.

In one embodiment, after the initial webpage content unit is obtained, the number of content characters in the initial webpage content unit can be confirmed. Then, according to the number of content characters in the initial webpage content unit, the identification tags corresponding to the content characters in the initial webpage content unit are determined. Finally, identification tags are added to the content characters in the initial webpage content, so as to obtain the webpage content unit.

For example, when the content character in the initial webpage content unit is one, the identification tag may be a browser identification tag capable of identifying the location information of the content character in the initial webpage content unit. For example, <span> tags, <strong> tags, <em> tags, etc.

For example, when there are multiple content characters in the initial webpage content unit, the identification tag may be a browser identification tag capable of identifying the location information of each content character in the initial webpage content unit.

For example, the content character in the sub-page content has only one "you", so the identification tag <span> can be added to the content character "you" in the sub-page content, so as to obtain the corresponding webpage content unit <span>you</span >.

In an example, the to-be-processed webpage content of the webpage is obtained according to the webpage content unit, and the terminal may load the webpage content including the webpage content unit into the browser for rendering, thereby obtaining the to-be-processed webpage content.

203. The terminal identifies the location information of the content characters in the webpage according to the webpage tags corresponding to the webpage content and the identification tags corresponding to the content characters.

For example, in an HTML document, a document object model (Document Object Model, DOM) traversal can be performed on the webpage content to be processed, and the network tags and identification tags in the webpage content to be processed and the content characters corresponding to the network tags and identification tags can be obtained through DOM traversal. content and location information.

The position information of the content characters in the webpage may be information indicating the positions of the content characters in the webpage.

In one embodiment, the web page can be set to a rectangular coordinate system, wherein the lower left corner of the web page can be the origin of the coordinate system, so that the position information of the content characters in the web page obtained by traversal can be based on the coordinate information on the coordinate axis. express. For example, as shown in FIG. 3b, the position information of the content characters in the webpage obtained through DOM traversal can be represented by a rectangle (Rectangle, Rect) object. The Rect object corresponding to each content character may include four parameters, namely (x, y, width, height). Among them, x can represent the abscissa of the upper left corner of the rectangle, that is, the abscissa of the content character in the webpage; y can represent the ordinate of the upper left corner of the rectangle, that is, the ordinate of the content character in the webpage; width can represent the width of the rectangle, height Can represent the height of the rectangle. The position information of the content characters in the web page can be obtained through the Rect object.

For example, the webpage is set as a rectangular coordinate system, wherein the value range of the x-axis is 0-50000, and the value range of the y-axis is 0-30000. Wherein, the position information of the content characters "you", "good", "are you", "?" can be (200, 9000, 20, 35), (220, 9000, 20, 35), (240, 9000, 20, 35) respectively ) and (260, 9000, 20, 35). The position information of the content characters "I", "Very", "Good", "." can be (200, 8975, 20, 35), (220, 8975, 20, 35), (240, 8975, 35) and (260, 8975, 20, 35).

The content of the content characters and the position information in the webpage obtained by traversing can be stored in a preset storage space.

For example, in an HTML document embedded in a browser document such as a JavaScript scripting language, an array can be established to store the content of the content characters obtained by traversal and the position information in the web page.

204. The terminal determines, for each content character in the webpage content, the processing type of the content character according to the position information of the content character in the webpage.

In one embodiment, the position information of each content character in the webpage can be compared with the preset position information, and then the processing type of the content character is determined according to the comparison result.

The location information may include several location parameters, and the preset location information may also include several preset location parameters, which may be based on one or more location parameters in the location information and one or more preset location parameters corresponding to the preset location information. Set the position parameter to compare, get the comparison result, and then determine the processing type of the content character according to the comparison result.

For example, when the web page is set to a Cartesian coordinate system, where the lower left corner of the web page is the origin of the Cartesian coordinate system, the position information of the content characters can be (x, y, width, height), and the preset position information can be (x1 , y1). Then, x and x1 can be compared to determine the processing type of the content character; y and y1 can also be compared to determine the processing type of the content character. Wherein, x1 may be a certain value within the range of the ordinate, and y1 may be a certain value within the range of the abscissa.

In one embodiment, the terminal determines the processing type of the content character according to the comparison result, which may be that when the position parameter in the position information is smaller than the preset position parameter in the preset position information, the processing type of the content character is the canvas drawing type; when When the position parameter in the position information is greater than or equal to the preset position parameter in the preset position information, the processing type of the content character is the label processing type.

For example, as shown in Figure 3b, when y1 in the preset position information is set to 8980, the y corresponding to the content characters "you", "good", "do" and "?" is greater than 8980, so the content characters "you" "good" The processing type of ""?" and "?" can be label processing type; the content characters "I" "very" "good" "." The corresponding y is less than 8980, so the content characters "I" "very" "good"". " can be a canvas draw type.

The terminal can extract the position information corresponding to the content characters stored in the array one by one and compare them with the preset position information, and then directly determine the processing type of the content characters according to the comparison result.

205. When the processing type of the content character is the canvas drawing type, the terminal draws the content character on the preset canvas.

In one embodiment, when the processing type of the content character is the canvas drawing type, a drawing function can be used to draw the content character on a preset canvas. The drawing function may be an operation function for drawing the content characters on the preset canvas. For example, the drawing function can be the fillText() function or the like.

Among them, several setting parameters are built in the drawing function, and the style and position of the content characters drawn on the preset canvas can be adjusted by setting the parameters in the drawing function.

For example, the fillText() function can be fillText(content character, X, Y), where the parameter X can indicate that the content character is drawn on the horizontal axis of the web page at the position corresponding to X, and the parameter Y can indicate that the content character is drawn on the On the vertical axis of the web page and the position corresponding to Y. Specifically, X can correspond to the position information parameter x of the content character on the webpage, and Y can correspond to the position information parameter y of the content character on the webpage. For example, the fillText() function can be set to fillText(content character, x, y ). By setting the setting function of the drawing function, the content character can be drawn on the position corresponding to the preset canvas.

For example, when the processing type is canvas drawing and the content characters are "I", "very", "good", ".", the terminal can use the fillText() function to draw the content characters on the corresponding positions of the preset canvas. For example, when "I" is drawn on the canvas, the fillText() function can be set to fillText(I, 200, 8970); when "I" is drawn on the canvas, the fillText() function can be set to fillText(Very , 220, 8970).

206. When the processing type of the content characters is the label processing type, the terminal adds the identification tags corresponding to the content characters to the preset tag set according to the preset order.

In one embodiment, when the processing type of the content characters is a label processing type, a sequence setting function for setting the sequence of the identification labels can be determined according to a preset sequence, and then the sequence setting function is used to add the identification labels corresponding to the content characters in a preset sequence. to the preset label set.

The preset sequence may be the sequence in which the identification tags are added to the preset tag set. For example, the terminal may add identification tags to the preset tag set in random order.

For example, when the identification tags are added to the preset tag set in a random order, the order setting function may be a random function. For example, in an HTML document embedded in a document in a scripting language such as JavaScript, the order setting function may be the Math.random() function.

For example, when the processing type is the label processing type and the content characters are "you", "good", "do", "?", the terminal can use Math.random() to convert the content characters "you", "good", "do", "?" The corresponding identification tag <span> is randomly added to the preset tag set.

The preset label set may be a storage space capable of storing identification labels. For example, in a browser document embedded in an HTML document in a scripting language such as JavaScript, the preset tag set may be an array.

207. When the preset content generation condition is satisfied, the terminal generates and outputs the target webpage content of the shown webpage according to the current canvas and the current tag set.

The preset content generation condition may be that the to-be-processed content satisfies the condition for being output to the webpage after the subsequent processing steps.

For example, the preset content generation condition may be that all content characters in the content to be processed have been processed, wherein the processing may be that when the processing type of the content characters is canvas drawing type, the content characters are drawn on the preset canvas; When the processing type is the tag processing type, the identification tags corresponding to the content characters are added to the preset tag set according to the preset order.

Wherein, the current canvas may be a canvas on which all content characters whose processing type is the canvas drawing type are drawn. For example, the current canvas may be a canvas on which the content characters "I", "very", "good" and "." are drawn.

The current tag set may be a tag set that stores all content characters whose processing type is the tag processing type. For example, the current tag set may be a tag set that stores the identification tags <span> corresponding to the content characters "you", "how are you", "are you", and "?".

In one embodiment, the current canvas may be inserted into the corresponding position of the web page according to the position information of the content characters on the current canvas in the web page.

For example, the content characters on the current canvas include "I", "very", "good", and ".", wherein the position information of the content characters in the webpage is within the range of ordinate values 8975-8940 and abscissa values 200-280 , so the canvas is inserted into that extent.

In one embodiment, a positioning function for obtaining the original sequence of identification tags may be determined according to a preset order, and then the terminal uses the positioning function to output the content characters corresponding to identification tags in the current tag set to the corresponding position of the webpage.

Wherein, the original order of the identification tags may be the order in which the identification tags have not been added to the preset tag set according to the preset order.

The location function of the original order may be a function of positioning the identification labels added to the preset label set to the original position in the original order according to the original order of the identification labels. For example, in HTML documents embedded in documents such as JavaScript scripting languages and CSS, the positioning function may be the positioning mechanism in CSS. Using the positioning mechanism in CSS, it is possible to locate where an identifying tag should appear relative to its original position.

In the webpage content processing method described above, the terminal obtains the initial webpage content of the webpage, wherein the initial webpage content includes at least one webpage label and the sub-page content corresponding to the webpage label, and the sub-page content includes at least one content character; to process the content characters in the webpage to obtain the to-be-processed webpage content of the webpage, wherein the webpage content to be processed includes the webpage content unit and the webpage label corresponding to the webpage content, and the webpage content unit includes the content character and the identification label corresponding to the content character; The position information of the characters in the webpage determines the processing type of the content characters; when the processing type of the content characters is the canvas drawing type, the terminal draws the content characters on the preset canvas; when the processing type of the content characters is the label processing type, the terminal The identification tags corresponding to the content characters are added to the preset tag set according to the preset order; finally, when the preset content generation conditions are met, the terminal generates and outputs the target webpage content of the webpage according to the current canvas and the current tag set; through the above method, It can effectively prevent the crawler from crawling the content on the webpage, thereby improving the security of the webpage content.

In order to better implement the webpage content processing method provided by the embodiments of the present application, an embodiment further provides a webpage content processing apparatus, and the webpage content processing apparatus may be integrated into a terminal or a server. The meanings of the nouns are the same as those in the above web content processing method, and the specific implementation details may refer to the descriptions in the method embodiments.

In one embodiment, a webpage content processing apparatus is provided, and the webpage content processing apparatus can be integrated in a terminal such as a webpage content processing terminal. As shown in FIG. 4a, the webpage content processing apparatus includes: an acquisition unit 301 and an identification unit 302. , determining unit 303, drawing unit 304, adding unit 305, generating unit 306, as follows:

The obtaining unit 301 is configured to obtain the to-be-processed webpage content of the webpage, the to-be-processed webpage content includes at least one webpage content unit and a webpage tag corresponding to the webpage content unit, wherein the webpage content unit includes at least one content character and content character the corresponding identification label;

An identification unit 302, configured to identify the location information of the content character in the webpage according to the webpage label corresponding to the webpage content unit and the identification label corresponding to the content character;

a determining unit 303, configured to, for each content character in the webpage content, determine the processing type of the content character according to the position information of the content character in the webpage;

A drawing unit 304 for drawing the content characters on a preset canvas when the processing type of the content characters is a canvas drawing type;

The adding unit 305 is configured to add the identification tags corresponding to the content characters to a preset tag set according to a preset order when the processing type of the content characters is a tag processing type;

The generating unit 306 is configured to generate and output the target web page content of the web page according to the current canvas and the current tag set when the preset content generation condition is satisfied.

In one embodiment, as shown in FIG. 4b, the determining unit 303 may include:

The comparison subunit 3031 is configured to compare the position information of the content character in the webpage with the preset position information for each content character in the webpage content to obtain a comparison result;

A determination subunit 3032, configured to determine the processing type of the content character according to the comparison result.

In one embodiment, as shown in FIG. 4b, the drawing unit 304 may include:

Determining subunit 3041, for determining a drawing function for drawing content characters when the processing type of the content characters is a canvas drawing type;

The drawing subunit 3042 is configured to draw the content character on the position corresponding to the preset canvas according to the drawing function and the position information of the content character in the webpage.

In one embodiment, as shown in FIG. 4b, the adding unit 305 may include:

Determining subunit 3051 is used to determine the corresponding label order setting function according to the preset order when the processing type of the content character is the label processing type;

The adding subunit 3052 is configured to use the label order setting function to add the identification labels corresponding to the content characters to the preset label set in a preset order.

In one embodiment, as shown in FIG. 4b, the generating unit 306 may include:

Insertion subunit 3061 is used to insert the current canvas into the corresponding position of the webpage according to the position information of the content characters on the current canvas in the webpage when the preset content generation conditions are met;

The output subunit 3062 is configured to output the content characters corresponding to the identification tags to the corresponding positions of the webpage according to the sequence of the identification tags in the current tag set.

During specific implementation, the above units can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities. The specific implementation of the above units can refer to the previous method embodiments, which will not be repeated here.

The above-mentioned webpage content processing apparatus can effectively prevent the crawler from crawling the content on the webpage.

The embodiment of the present application also provides a computer device, which may include a terminal or a server. For example, the computer device may be used as a web content processing terminal, and the terminal may be a mobile phone, a tablet computer, etc.; for example, the computer device may be a server, Such as web content processing server and so on. As shown in Figure 5, the to-be-processed web page content of the web page is obtained, the to-be-processed web page content includes at least one web page content unit and a web page tag corresponding to the web page content unit, wherein the web page content unit includes at least one content character and the identification corresponding to the content character Label;

Identifying the location information of the content character in the webpage according to the webpage label corresponding to the webpage content unit and the identification label corresponding to the content character;

For each content character in the webpage content, determine the processing type of the content character according to the position information of the content character in the webpage;

When the processing type of the content character is a canvas drawing type, the content character is drawn on a preset canvas;

When the processing type of the content characters is a label processing type, adding the identification tags corresponding to the content characters to the preset tag set according to a preset order;

When the preset content generation conditions are met, the target web page content of the web page is generated and output according to the current canvas and the current tag set.

As shown in FIG. 5 , it shows a schematic structural diagram of a terminal involved in an embodiment of the present application, specifically:

The computer device may include a processor 401 of one or more processing cores, a memory 402 of one or more computer-readable storage media, a power supply 403 and an input unit 404 and other components. Those skilled in the art can understand that the computer device structure shown in FIG. 5 does not constitute a limitation on the computer device, and may include more or less components than the one shown, or combine some components, or arrange different components. in:

The processor 401 is the control center of the computer equipment, uses various interfaces and lines to connect various parts of the entire computer equipment, runs or executes the software programs and/or modules stored in the memory 402, and invokes the software programs stored in the memory 402. Data, perform various functions of computer equipment and process data, so as to conduct overall monitoring of computer equipment. Optionally, the processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc. , the modem processor mainly deals with wireless communication. It can be understood that, the above-mentioned modulation and demodulation processor may not be integrated into the processor 401.

The memory 402 can be used to store software programs and modules, and the processor 401 executes various functional applications and data processing by running the software programs and modules stored in the memory 402 . The memory 402 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required for at least one function, and the like; Data created by the use of computer equipment, etc. Additionally, memory 402 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, memory 402 may also include a memory controller to provide processor 401 access to memory 402 .

The computer equipment also includes a power supply 403 for supplying power to various components. Preferably, the power supply 403 can be logically connected to the processor 401 through a power management system, so as to manage charging, discharging, and power consumption management functions through the power management system. Power source 403 may also include one or more DC or AC power sources, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and any other components.

The computer device may also include an input unit 404 that may be operable to receive input numerical or character information and generate keyboard, mouse, joystick, optical, or trackball signal input related to user settings and functional control.

Although not shown, the computer device may also include a display unit and the like, which will not be described herein again. Specifically in this embodiment, the processor 401 in the computer device will load the executable files corresponding to the processes of one or more application programs into the memory 402 according to the following instructions, and the processor 401 will run the executable files stored in the memory 402 . The application program in the memory 402, thereby realizing various functions, as follows:

It can be seen from the above that the terminal provided by the embodiment of the present application can effectively prevent the crawler from crawling the content on the webpage, thereby improving the security of the webpage content.

For the specific implementation of the above operations, reference may be made to the foregoing embodiments, and details are not described herein again.

Wherein, the storage medium may include: a read only memory (ROM, Read Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and the like.

Since the instructions stored in the storage medium can execute the steps in any of the webpage content processing methods provided in the embodiments of the present application, it is possible to realize the capabilities of any webpage content processing methods provided in the embodiments of the present application. For the beneficial effects achieved, see the foregoing embodiments for details, which will not be repeated here.

In addition, embodiments of the present application provide a computer program product or computer program, where the computer program product or computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the methods provided in various optional manners of the above aspect.

For example, the computer program may perform the following steps:

Obtaining the to-be-processed web page content of the web page, the to-be-processed web page content includes at least one web page content unit and a web page label corresponding to the web page content unit, wherein the web page content unit includes at least one content character and an identification label corresponding to the content character;

Identifying the location information of the content character in the webpage according to the webpage label corresponding to the webpage content unit and the identification label corresponding to the content character;

For each content character in the webpage content, determine the processing type of the content character according to the position information of the content character in the webpage;

When the processing type of the content character is a canvas drawing type, the content character is drawn on a preset canvas;

When the processing type of the content characters is a label processing type, adding the identification tags corresponding to the content characters to the preset tag set according to a preset order;

When the preset content generation conditions are met, the target web page content of the web page is generated and output according to the current canvas and the current tag set.

The web content processing method, device, electronic device and storage medium provided by the embodiments of the present application have been described in detail above. The principles and implementations of the present application are described with specific examples in this article. The description of the above embodiments It is only used to help understand the method of the present application and its core idea; meanwhile, for those skilled in the art, according to the idea of the present application, there will be changes in the specific embodiments and application scope. In conclusion, this specification The content should not be construed as a limitation on this application.

Claims (10)

1. a web content processing method, is characterized in that, comprises: Obtaining the to-be-processed web page content of the web page, the to-be-processed web page content includes at least one web page content unit and a web page label corresponding to the web page content unit, wherein the web page content unit includes at least one content character and an identification label corresponding to the content character; Identifying the location information of the content character in the webpage according to the webpage label corresponding to the webpage content unit and the identification label corresponding to the content character; For each content character in the webpage content, determine the processing type of the content character according to the position information of the content character in the webpage; When the processing type of the content character is a canvas drawing type, the content character is drawn on a preset canvas; When the processing type of the content characters is a label processing type, adding the identification tags corresponding to the content characters to the preset tag set according to a preset order; When the preset content generation conditions are met, the target web page content of the web page is generated and output according to the current canvas and the current tag set. 2. The webpage content processing method according to claim 1, wherein, for each content character in the webpage content, the processing type of the content character is determined according to the position information of the content character in the webpage, include: For each content character in the webpage content, compare the position information of the content character in the webpage with the preset position information to obtain a comparison result; The processing type of the content character is determined according to the comparison result. 3. The webpage content processing method according to claim 1, wherein when the processing type of the content character is a canvas drawing type, the content character is drawn on a preset canvas, comprising: When the processing type of the content character is the canvas drawing type, determine the drawing function used for the content character drawing; According to the drawing function and the position information of the content character in the webpage, the content character is drawn on the position corresponding to the preset canvas. 4. The webpage content processing method according to claim 1, wherein when the processing type of the content characters is a label processing type, the identification tags corresponding to the content characters are added to the preset tags according to a preset order set, including: When the processing type of the content character is the label processing type, determine the corresponding label order setting function according to the preset order; The identification tags corresponding to the content characters are added to the preset tag set in a preset order by using the tag order setting function. 5. The method for processing webpage content according to claim 1, wherein before acquiring the webpage content to be processed of the webpage, the method further comprises: acquiring initial web page content of the web page, the initial web page content includes at least one web page tag and sub-web page content corresponding to the web page tag, wherein the sub-web page content includes at least one content character; splitting the content characters in the content of the sub-web page to obtain an initial web page content unit, where the initial web page content unit includes at least one content character; An identification tag is added to the content characters in the initial webpage content unit to obtain a webpage content unit. 6. The webpage content processing method according to claim 5, wherein, adding identification tags to the content characters in the initial webpage content unit to obtain the webpage content unit, comprising: determining the number of content characters in the initial web page content unit; Determine the identification tags corresponding to the content characters in the initial webpage content unit according to the number of content characters in the initial webpage content unit; According to the identification tag, an identification tag is added to the content characters in the initial webpage content unit to obtain a webpage content unit. 7. The webpage content processing method according to claim 1, wherein, when a preset content generation condition is met, generating and outputting the target webpage content of the webpage according to the current canvas and the current tag set, comprising: When the preset content generation conditions are met, insert the current canvas into the corresponding position of the webpage according to the position information of the content characters on the current canvas in the webpage; According to the sequence of the identification tags in the current tag set, the content characters corresponding to the identification tags are output to the corresponding positions of the webpage. 8. A webpage content processing device, comprising: an acquisition unit, configured to acquire the to-be-processed webpage content of the webpage, the to-be-processed webpage content includes at least one webpage content unit and a webpage tag corresponding to the webpage content unit, wherein the webpage content unit includes at least one content character and the corresponding content character the identification label; an identification unit, configured to identify the location information of the content character in the webpage according to the webpage label corresponding to the webpage content unit and the identification label corresponding to the content character; a determining unit, configured to, for each content character in the webpage content, determine the processing type of the content character according to the position information of the content character in the webpage; a drawing unit, used to draw the content character on a preset canvas when the processing type of the content character is a canvas drawing type; An adding unit, configured to add the identification tags corresponding to the content characters to a preset tag set according to a preset order when the processing type of the content characters is a tag processing type; The generating unit is configured to generate and output the target web page content of the web page according to the current canvas and the current tag set when the preset content generation condition is satisfied. 9. An electronic device, characterized in that it comprises a memory and a processor; the memory stores an application program, and the processor is used to run the application program in the memory to execute any one of claims 1 to 7. operations in the web content processing method described above. 10. A computer-readable storage medium, wherein the computer-readable storage medium stores a plurality of instructions, and the instructions are adapted to be loaded by a processor to execute the method according to any one of claims 1 to 7. Steps in a web content processing method.

Images