CN111475697A - Network video information acquisition method and equipment - Google Patents

Abstract

The embodiment of the invention provides a method and equipment for acquiring network video information, wherein the method comprises the following steps: crawling the information of bloggers on a video platform; crawling the rewarding information of the bloggers, and screening the bloggers with rewarding functions; and acquiring the video information of the video of the blogger with the opening and appreciation function. The method and the device for playing the video generally start from the information of the video blogger, acquire the opening condition of the appreciation according to the information of the video blogger, and acquire the video of interest according to the opening condition. Thus, the amount of crawled data and the amount of analyzed data are greatly reduced, and the obtained crawl is more targeted.

Description

A kind of network video information acquisition method and device

technical field

The present invention relates to the technical field of video acquisition, in particular to a method and device for acquiring network video information.

Background technique

Short video is a new form of information dissemination that has emerged with the popularization of smartphones and the rapid development of the mobile Internet in recent years. It is considered by the industry to be the outlet of the Internet field, and has become an important means and approach for media innovation in the era of mobile communication. It is also an important development direction of current information dissemination.

At present, institutions headed by BAT are investing heavily to accelerate the deployment of short video platforms. Talents and funds are entering the short video field on a large scale. Among them, Toutiao, Tencent, and Miaopai have invested 1 billion yuan to support short video content entrepreneurs. Different platforms have different reward methods for bloggers who publish videos, and the relationship between video information and the publisher’s earnings can not only help predict the publisher’s earnings, but also study the audience’s preference for different videos. Therefore, How to effectively obtain all the video information of the bloggers who have enabled the tipping function in the online video platform is of great significance.

In the prior art, obtaining all video information of bloggers who have enabled the tipping function in online videos is mainly by traversing all the videos on the video platform on a large scale, and then screening out the videos with the tipping function enabled from all the videos and collecting the videos. The blogger information of the blogger and the method of all the video information of the blogger. However, since the prior art needs to traverse all the videos on the video platform, this causes the problem of low efficiency and long time consuming when collecting all the video information of the bloggers who have enabled the tipping function in the online video platform.

Therefore, how to provide a method for acquiring network video information with high efficiency and short time consumption is an urgent problem to be solved in the industry at present.

SUMMARY OF THE INVENTION

Embodiments of the present invention provide a method and device for acquiring online video information, which are used to solve the problems of low efficiency and long time consumption in the prior art when collecting all video information of bloggers who have enabled the tipping function in an online video platform.

In a first aspect, an embodiment of the present invention provides a method for acquiring network video information, including:

Crawl the information of video platform bloggers;

Crawl the tipping information of the bloggers, and filter out bloggers who have enabled the tipping function;

Obtain the video information of the video of the blogger who has enabled the tipping function.

Optionally, the information of the bloggers of the video platform for crawling specifically includes,

Information of bloggers who crawl videos within the preset time range of the video platform; or information of bloggers who crawl all videos on the video platform.

Optionally, the information of the bloggers of the video platform for crawling specifically includes,

Based on the number of the video on the video platform, the basic information of the video is crawled; based on the basic information of the video, the information of the blogger of the video is obtained.

Optionally, crawl the reward information of the blogger, and filter out the bloggers who have enabled the reward function, which specifically includes,

Based on the blogger's information, crawling the blogger's reward information;

Based on the crawled tip information of the bloggers, the bloggers who have enabled the tipping function are screened out.

Optionally, the number of the video based on the video platform, crawl the basic information of the video; based on the basic information of the video, obtain the information of the blogger of the video, specifically including,

Obtain the number of the video of the video platform based on the interface of the video platform, and calculate the number of videos according to the number of the video;

Create a first thread pool including no less than 1 thread, and divide the number of the video equal to the number of threads in the first thread pool according to the number of the videos each time while crawling the basic information of the video;

The information of the blogger of the video is acquired based on the basic information of the video.

Optionally, crawling the reward information of the blogger based on the information of the blogger, specifically includes,

Calculate the number of the bloggers according to the crawled information of the bloggers;

Create a second thread pool including no less than 1 thread, and divide the blogger's information equal to the number of threads in the second thread pool according to the number of bloggers each time, and crawl the blogger's information at the same time. Reward information, if the reward information of the blogger is crawled, the blogger is a blogger who has enabled the reward function; if the reward information of the blogger is not crawled, the blogger is For bloggers who have not opened the reward function.

Optionally, the acquiring the video information of the video of the blogger who has enabled the tipping function, specifically includes,

Calculate the number of the bloggers who have opened the tipping function;

Create a third thread pool including no less than 1 thread, and divide the bloggers with the tipping function equal to the number of threads in the third thread pool each time according to the number of the bloggers who have enabled the tipping function. At the same time, crawl the video information of the video of the blogger who has enabled the tipping function.

In a second aspect, an embodiment of the present invention provides a video output mode switching device, including:

The first crawling module is used to crawl the information of video platform bloggers;

The second crawling module is used to crawl the tip information of the bloggers, and filter out the bloggers who have enabled the tipping function;

An obtaining module is used to obtain the video information of the videos of the bloggers who have enabled the tipping function.

In a third aspect, an embodiment of the present invention provides an electronic device, including:

A memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that, when the processor executes the program, the acquisition of network video information according to any one of the first aspects is realized steps of the method.

In a fourth aspect, an embodiment of the present invention provides a non-transitory computer-readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the implementation is as described in any one of the first aspect. The steps of a method for acquiring network video information.

The method and device for acquiring network video information provided by the embodiments of the present invention scrape the blogger's reward information according to the blogger's information and screen out the bloggers who have enabled the reward function according to the blogger's reward information. The information of the bloggers with the tipping function is targeted to obtain the video information of the videos of the bloggers who have opened the tipping function. This application generally starts from the information of the video bloggers, obtains the information of the video bloggers, obtains the status of the opening of rewards according to the information of the video bloggers, and obtains the videos of interest according to the information of the video bloggers. In this way, the amount of data crawled and analyzed is greatly reduced, and the obtained crawling is more targeted.

Description of drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained according to these drawings without creative efforts.

1 is a flowchart of an embodiment of a method for acquiring network video information according to the present invention;

2 is a schematic structural diagram of an embodiment of an apparatus for obtaining network video information according to the present invention;

FIG. 3 is a schematic diagram of a physical structure of an electronic device according to an embodiment of the present invention.

Detailed ways

In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments These are some embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

Different from crawling all videos in the prior art, the video information of interest is obtained according to the reward information in the video; this application generally starts from the information of the video bloggers, and obtains the information of the video bloggers, according to the information of the video bloggers. , to get the status of the opening of the reward, according to the status of the opening, or the video of interest. In this way, the amount of data crawled and analyzed is greatly reduced, and the obtained crawling is more targeted.

FIG. 1 is a flowchart of an embodiment of a method for acquiring network video information based on an embodiment of the present invention. include:

Step 101, crawl the information of video platform bloggers;

Specifically, there are various crawling methods for crawling the information of video platform bloggers. Those skilled in the art can choose different programming languages, algorithms and programs according to the specific situation. For example, languages such as JAVA and Python can be selected. For example, libraries such as beautifulsoup and requests can be selected in the video, so the method for crawling basic video information is not unique, which is not limited in this embodiment of the present invention. Video platforms refer to Internet websites, mobile applications, etc., where video bloggers can upload videos. Video platforms all provide interfaces to access the video platforms. The number of the video in the interface to crawl the basic information of different videos. According to the basic information of the video, the user can obtain different video information contents including the information of the bloggers of the video platform, such as the blogger id.

For example, taking the Bilibili (hereinafter referred to as Bilibili) video website as an example, Bilibili provides an interface for obtaining basic video information: https://api.bilibili.com/x/web-interface/view? aid=

After the aid of the interface, add the av number of the video to access the video of a specific serial number and obtain the basic information of the video. The video information fields in station B are shown in Table 1, such as the video av number, video partition, release time, Up main mid, the total number of plays, the number of coins tossed, the cumulative number of barrages in history, the number of comments, the number of favorites, the number of shares, the number of likes, etc. The up main mid is the most basic blogger's information. Therefore, according to the interface provided by station B, users can crawl the basic information of the video by changing the av number of the video after aid, and obtain the information of the blogger according to the basic information of the video, such as the up main mid.

Table 1 Description of video information fields

Step 102, crawling the reward information of the bloggers, and screening out the bloggers who have enabled the rewarding function;

Specifically, video platforms usually have a tipping function. The bloggers of the video platform can choose to enable the tipping function or not. When the bloggers of the video platform enable the tipping function, the users of the video platform can Reward bloggers by electronic payment cash or platform currency. The specific reward information, such as the number of people who have been rewarded this month and the number of people who have been rewarded cumulatively, can be accessed through the interface provided by the video platform. Therefore, users can crawl the tip information of bloggers according to the blogger information of the video platform and the interface of the video platform. The reward information that arrives will filter out the bloggers who have enabled the reward function.

For example, the access interface provided by station B that can be used to obtain UP main charging information is: https://elec.bilibili.com/api/query.rank.do? mid=, where adding the mid of the UP master after the interface mid can access the charging information of the corresponding UP master. The charging information of the UP master is shown in Table 2, including the number of people who have been charged this month and the number of people who have been charged in history. Therefore, the user can crawl the tip information of the UP master according to the UP master mid and charging information access interface. If the UP master does not enable the tipping function, the tip information will not be crawled. Reward information, you can filter out the UP masters who have enabled the reward function.

Table 2 UP main charging information field description

Step 103, acquiring video information of the video of the blogger who has enabled the tipping function.

Specifically, each blogger in the video platform usually uploads a lot of videos. The video platform usually provides an interface that can directly access the video information of the blogger. By changing the information of the blogger in the interface, different blogs can be crawled in a targeted manner. main video information. Therefore, the user can crawl the video information of the video corresponding to the blogger according to the interface provided by the video platform and the information of the blogger who has enabled the reward function.

For example, the access interface provided by station B for obtaining UP main video information is: https://api.bilibili.com/x/space/arc/search? mid=17819768&pn=1&ps=25&jsonp=jsonp, this interface can obtain the video information of different UP masters by modifying the mid, while the ps is to control the number of videos accessed at one time. By trying, if the ps is modified, it is extremely easy to trigger Bilibili. Platform security protocol, so it is generally obtained according to the standard of 25, and pn controls the number of pages of each video access. Therefore, the user can obtain the video information of the video of the UP host with the charging function enabled according to the up host mid and the access interface of the UP host with the charging function enabled. The total number of plays, the cumulative number of barrages in history, the number of comments, the length of the video, the release time, etc.

Table 3 Description of the video information fields on the UP home page

As an optional embodiment, the information about crawling video platform bloggers specifically includes:

Information of bloggers who crawl videos within the preset time range of the video platform; or information of bloggers who crawl all videos on the video platform.

Specifically, due to the huge number of videos on the video platform, it takes a lot of time to crawl all the videos of bloggers on the video platform, and there are many inactive bloggers who have not uploaded for a long time. The information collection value is relatively low. The main message gives two options. One is to crawl only the blogger information of videos uploaded by the video platform within a preset time range, for example, it can be 1 year, half a year, etc., which is usually suitable for situations where the number of videos on the video platform is huge; the other solution is to crawl the video platform. The blogger information of all videos is usually suitable for situations where the number of videos on the video platform is not too large or detailed information on all bloggers is required.

For example, the Bilibili platform has about 500 million users. It takes too long to traverse and cannot meet the requirements of monthly on-time statistical information in the later period, and many of them are inactive UP masters. Crawling all the main information is bound to be time-consuming and labor-intensive, adding unnecessary workload. Therefore, the information of bloggers within a certain period of time can be crawled in a targeted manner. For example, the preset time can be one year. Only crawling the information of bloggers within one year can cover most of the active UP masters in a targeted manner. , without causing too much analysis and calculation. We selected nearly 30 million pieces of video information from December 31, 2018 to October 15, 2019, and noticed that due to the particularity of the platform, the av number of each video in station B is sorted according to its release time, that is, av The bigger the number, the later the video will be released. So through this feature, you can find an av number sequence of about one year, the video av number sequence is [39454972, 71185529], the crawling speed is about 2 million/day, and it takes a total of two weeks.

As an optional embodiment, the information about crawling video platform bloggers specifically includes:

Based on the number of the video on the video platform, the basic information of the video is crawled; based on the basic information of the video, the information of the blogger of the video is obtained.

Specifically, in order to access the basic information of the video in the video platform, it is usually necessary to pass the video number provided in the video platform. Different videos in the video platform have different video numbers, and the video numbers of each video are different. By changing the video number in the interface, you can access the basic information of different videos. The basic information of a video usually includes the video video number, video division, release time, blogger's information, total number of plays, historical accumulative number of barrages, number of comments, number of favorites, number of shares, number of likes, etc. The information also includes the id of the blogger and so on. According to the basic information of the video, the information of the blogger in the basic information of the video can be obtained.

For example, according to the interface given by station B and the av number of the video, the user can access the basic information of the video corresponding to the av number, usually including the video video av number, video partition, release time, mid of the UP master, total playback Count, number of coins, cumulative number of barrages in history, number of comments, number of favorites, number of shares, number of likes, etc. And the information of the UP master of the video can be further obtained according to the obtained basic information of the video.

As an optional embodiment, the tipping information of the blogger is crawled, and the bloggers who have enabled the tipping function are screened out, which specifically includes:

Based on the blogger's information, crawling the blogger's reward information;

Based on the crawled tip information of the bloggers, the bloggers who have enabled the tipping function are screened out.

Specifically, according to the interface provided by the video platform, the tip information of bloggers can be obtained, and the tip information of different bloggers can be obtained by changing the information of bloggers in the interface, but if the blogger does not have the tip function enabled, it will not be crawled. To the blogger's reward information. Therefore, if the blogger's tipping information is crawled, the blogger has enabled the tipping function. If the blogger's tipping information is not crawled, the blogger has not enabled the tipping function. According to the crawled reward information, all the bloggers who have enabled the reward function can be screened out.

For example, according to the UP master's mid and B station interfaces, you can obtain the UP master's reward information, including the number of people who have been charged this month and the number of people who have been charged in the past; and if the UP owner's reward information can be crawled, the UP owner's reward information can be obtained. The main is to open the charging (rewarding) function, otherwise the UP main does not open the charging (rewarding) function. Finally, all UP masters who have opened the reward function are screened out.

As an optional embodiment, the number of the video based on the video platform, the basic information of the video is crawled; based on the basic information of the video; the information of the blogger of the video is obtained, specifically including:

Obtain the number of the video of the video platform based on the interface of the video platform, and calculate the number of videos according to the number of the video;

Create a first thread pool including no less than 1 thread, and divide the number of the video equal to the number of threads in the first thread pool according to the number of the videos each time while crawling the basic information of the video;

The information of the blogger of the video is acquired based on the basic information of the video.

Specifically, when crawling the basic information of videos through the video platform interface, multi-threading technology can be used to create a first thread pool with no less than one thread, and the number of threads in the thread pool can be reasonably set according to the number of videos. For example, when the number of videos is large, the number of threads is also larger, and when the number of videos is small, the number of threads is correspondingly smaller. The basic information of the video is simultaneously crawled through the threads in the first thread pool, and the video number that is the same as the number of threads in the first thread pool is split out each time. And obtain the information of the blogger of the video from the basic information of the crawled video.

For example, we want to crawl the information of bloggers with 30 million videos. Since the basic information of the videos is crawled according to the av number of the UP master's video, the amount of video data is 30 million, which takes a long time. Therefore, A first thread pool is set in the crawler, and there are no less than 1 thread in the thread pool, for example, 100 threads. When crawling the basic information of the video, 100 video av numbers are divided from the total number of 30 million videos each time, and the basic information of 100 videos is simultaneously crawled through 100 threads in the thread pool. Finally, we got the information of 3 million UP masters, including 3 million UP master mids.

As an optional embodiment, the crawling of the blogger's reward information based on the blogger's information specifically includes:

Calculate the number of the bloggers according to the crawled information of the bloggers;

Create a second thread pool including no less than 1 thread, and divide the blogger's information equal to the number of threads in the second thread pool according to the number of bloggers each time, and crawl the blogger's information at the same time. Reward information, if the reward information of the blogger is crawled, the blogger is a blogger who has enabled the reward function; if the reward information of the blogger is not crawled, the blogger is For bloggers who have not opened the reward function.

Specifically, when crawling the video blogger's reward information through the video platform interface, multi-threading technology can be used to create a second thread pool with no less than one thread, and reasonably set the thread pool according to the number of bloggers. The number of threads, for example, when the number of bloggers is large, the number of threads is also larger, and when the number of bloggers is small, the number of threads is correspondingly smaller. Each time the information of the bloggers with the same number of threads as in the second thread pool is crawled simultaneously through the threads in the second thread pool to crawl the blogger's reward information. The master has not enabled the reward function.

For example, when crawling the UP main reward information according to the B station interface and the UP main mid, we also set a second thread pool in the program, and also set no less than 1 thread in the thread pool. For example, we 100 threads are set. Each time we separate 100 UP master mids from the 3 million UP master mids, and crawl the UP master's reward information through 100 threads at the same time. If the reward information is not climbed, the UP master has not opened the reward information. , and finally we crawled from the 3 million UP masters to 400,000 UP masters with the charging function enabled.

As an optional embodiment, the crawling video information of the videos of the bloggers who have enabled the tipping function based on the information of the bloggers who have enabled the tipping function, specifically includes:

Calculate the number of the bloggers who have opened the tipping function;

Create a third thread pool including no less than 1 thread, and divide the bloggers with the tipping function equal to the number of threads in the third thread pool each time according to the number of the bloggers who have enabled the tipping function. At the same time, crawl the video information of the video of the blogger who has enabled the tipping function.

Specifically, when crawling the video information of the blogger's video through the video platform interface, multi-threading technology can be used to create a third thread pool with no less than one thread, and according to the number of bloggers who have enabled the reward function Set the number of threads in the thread pool reasonably. For example, when the number of bloggers who have enabled the tipping function is large, the number of threads will be larger. When the number of bloggers who have enabled the tipping function is small, the number of threads will be correspondingly smaller. Each time the information of the bloggers with the same number of threads as in the third thread pool with the tipping function enabled, the video information of the videos of the bloggers with the tipping function enabled is simultaneously crawled through the threads in the third thread pool.

For example, when crawling the video information of the UP master with the charging function enabled according to the interface of station B and crawling, we also create a third thread pool, which also has no less than 1 thread, such as 100 threads. From the 400,000 UP masters with the charging function enabled, we divided 100 UP master mids each time and crawled the video information of the UP master's video.

However, station B has very strict control over this interface. If the number of threads opened at one time is too large, the security protocol of the Bilibili platform will be triggered, and the same IP cannot access this interface for nearly an hour, so we can use a proxy IP crawling.

It should be noted that the monitoring of each interface on the Bilibili platform is inconsistent. For example, the monitoring of the interface to obtain video information through the UP main home page is extremely strict, while the monitoring of the UP main charging information is relatively loose, so for this problem, we use To solve the problem by purchasing proxy IP, use proxy IP and adjust the number of threads in the thread pool to ensure the stability of the capture for the interface with strict monitoring, and use a larger number of threads for the interface with loose monitoring to ensure the capture. take efficiency.

In addition, for the charging information and video information of the UP master, we do not need to frequently add, delete, modify and check it. So we choose to sacrifice the convenience of data reading and use the CSV file format for storage.

FIG. 2 is a structural diagram of an embodiment of an apparatus for obtaining network video information based on an embodiment of the present invention. include:

The first crawling module 201 is used to crawl the information of video platform bloggers;

Specifically, the video platform refers to the Internet website, mobile application App, etc. where video bloggers can upload videos. The video platform provides an interface for accessing the video platform. According to the interface provided by the video platform and by changing different video information fields in the interface, Users can obtain different video information content including the information of video platform bloggers.

The second crawling module 202 is used for crawling the tipping information of the bloggers, and filtering out bloggers who have enabled the tipping function;

Specifically, video platforms usually have a tipping function. The bloggers of the video platform can choose to enable the tipping function or not. When the bloggers of the video platform enable the tipping function, the users of the video platform can Reward bloggers by electronic payment cash or platform currency. The specific reward information, such as the number of people who have been rewarded this month and the number of people who have been rewarded cumulatively, can be accessed through the interface provided by the video platform. Therefore, the user can crawl the tipping information of the bloggers according to the blogger information of the video platform and the interface of the video platform, and screen out the bloggers who have enabled the tipping function according to the scraped tipping information.

The obtaining module 203 is configured to obtain the video information of the video of the blogger who has enabled the tipping function.

Specifically, each blogger in the video platform usually uploads a lot of videos. The video platform usually provides an interface that can directly access the video information of the blogger. By changing the information of the blogger in the interface, different bloggers can be accessed in a targeted manner. video information. Therefore, the user can crawl the video information of the video corresponding to the blogger according to the interface provided by the video platform and the information of the blogger who has enabled the reward function.

FIG. 3 is a physical structure diagram of an electronic device based on an embodiment of the present invention. include:

A memory, a processor, and a computer program stored on the memory and running on the processor, characterized in that, when the processor executes the program, the acquisition of network video information as described in any one of the embodiments of the present invention is realized steps of the method.

An example is as follows:

FIG. 3 illustrates a schematic diagram of the physical structure of an electronic device. As shown in FIG. 3 , the electronic device may include: a processor (processor) 301, a communication interface (Communications Interface) 303, a memory (memory) 302, and a communication bus 304, The processor 301 , the communication interface 303 , and the memory 302 communicate with each other through the communication bus 304 . The processor 301 can call the logic instruction in the memory 302 to perform the following method: crawl the blogger's tipping information according to the blogger's information and screen out the bloggers who have opened the tipping function according to the blogger's tipping information, and finally according to the blogger's tipping information. The information of the bloggers who have enabled the tipping function is targeted to obtain the video information of the videos of the bloggers who have enabled the tipping function.

In addition, the above-mentioned logic instructions in the memory 302 can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solution of the present invention can be embodied in the form of a software product in essence, or the part that contributes to the prior art or the part of the technical solution. The computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, Read-Only Memory (ROM, Read-Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes .

On the other hand, an embodiment of the present invention further provides a non-transitory computer-readable storage medium on which a computer program is stored, and the computer program is implemented by a processor to execute the transmission method provided by the above embodiments, for example, including : Crawling the blogger's reward information according to the blogger's information and screen out the bloggers who have enabled the reward function according to the blogger's reward information, and finally obtain targeted access according to the information of the bloggers who have opened the reward function. The video information of the video of the blogger with the tipping function.

The device embodiments described above are only illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed over multiple network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment. Those of ordinary skill in the art can understand and implement it without creative effort.

From the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and certainly can also be implemented by hardware. Based on this understanding, the above-mentioned technical solutions can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products can be stored in computer-readable storage media, such as ROM/RAM, magnetic A disc, an optical disc, etc., includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform the methods described in various embodiments or some parts of the embodiments.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, but not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that it can still be The technical solutions described in the foregoing embodiments are modified, or some technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (10)

1. A network video information acquisition method is characterized by comprising the following steps,

crawling the information of bloggers on a video platform;

crawling the rewarding information of the bloggers, and screening the bloggers with rewarding functions;

and acquiring the video information of the video of the blogger with the opening and appreciation function.

2. The method for acquiring network video information according to claim 1, wherein the crawling of the information of the blogger on the video platform specifically comprises,

crawling the information of bloggers of the video within a preset time range of a video platform; or

And crawling all video blogger information of the video platform.

3. The method for acquiring network video information according to claim 1, wherein the crawling of the information of the blogger on the video platform specifically comprises,

crawling basic information of a video based on the number of the video of a video platform;

and acquiring the information of the blogger of the video based on the basic information of the video.

4. The method for acquiring network video information according to claim 1, wherein crawling the reward information of the blogger and screening the blogger who activates the reward function comprises,

crawling the reward information of the blogger based on the information of the blogger;

and screening out the bloggers with the reward opening function based on the crawled reward information of the bloggers.

5. The method according to claim 3, wherein the basic information of the video is crawled based on the number of the video platform; acquiring information of a blogger of the video based on the basic information of the video, specifically comprising,

acquiring the number of the video platform based on the interface of the video platform, and calculating the number of the video according to the number of the video;

creating a first thread pool comprising not less than 1 thread, and according to the number of the videos, dividing the number of the videos equal to the number of the threads in the first thread pool every time and simultaneously crawling the basic information of the videos;

and acquiring the information of the blogger of the video based on the basic information of the video.

6. The method according to claim 4, wherein the crawling of the reward information of the blogger based on the information of the blogger specifically comprises,

calculating the number of the bloggers according to the crawled information of the bloggers;

the method comprises the steps of establishing a second thread pool which comprises at least 1 thread, according to the number of the bloggers, dividing information which is equal to the number of the threads in the second thread pool every time, crawling the reward information of the bloggers, enabling the bloggers to have a reward function if the reward information of the bloggers is crawled, and enabling the bloggers not to have the reward function if the reward information of the bloggers is not crawled.

7. The method according to claim 1, wherein the step of obtaining video information of the video of the blogger with the reward function includes,

calculating the number of the bloggers with the reward opening function;

and creating a third thread pool comprising at least 1 thread, and according to the number of the bloggers opening the reward function, dividing the information of the bloggers opening the reward function, which is equal to the number of the threads in the third thread pool, every time and simultaneously crawling the video information of the video of the bloggers opening the reward function.

8. A network video information acquisition device is characterized by comprising,

the first crawling module is used for crawling information of bloggers on the video platform;

the second crawling module is used for crawling the rewarding information of the bloggers and screening the bloggers with rewarding functions;

and the acquisition module is used for acquiring the video information of the video of the blogger with the reward function.

9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor executes the program to implement the steps of the network video information acquisition method according to any one of claims 1 to 7.

10. A non-transitory computer readable storage medium, having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of a network video information acquisition method according to any one of claims 1 to 7.

Images