[Python detection Script] do you know that your friends block you? Do you know the end of shielding others? (Lahai, all Lahai)
preface
π Author: "programmer pear"
π ** Article introduction * *: This article mainly explains how to use Python to find out those people who block me in QQ space, and put them in
The whole process of pulling black.
π ** Article source code acquisition * *: in order to thank everyone for paying attention to my little cu ...
Added by yong on Tue, 18 Jan 2022 17:12:46 +0200
What is a crawler? What is the principle of Python crawler
preface In short, the Internet is a large network composed of sites and network devices. We visit sites through the browser, and the site returns HTML, JS and CSS codes to the browser. These codes are parsed and rendered by the browser to present colorful web pages in front of us;
1, What is a reptile? If we compare the Internet to a large spi ...
Added by raku on Tue, 18 Jan 2022 09:18:43 +0200
Beginner level skills of reptile
1. Parse robots Txt file
There are some sites in robots Txt file is set to prohibit the proxy user from browsing the site. Since the target site has such a rule, we should follow it.
Use urllib's robot parser module to parse robots Txt file to avoid downloading the url prohibited from crawling, and then through can_fetch() function to determi ...
Added by afrancis on Tue, 18 Jan 2022 07:36:05 +0200
python helps the iron pillar next door find the missing underwear
cause
It's July 10th. It's time for college students to go home after the holiday. Our major went back later because of practical training. I went back later because of special circumstances. It happened that Tiezhu didn't go back either. Early in the morning, Tiezhu came to our dormitory with his head in his mouth...
Tiezhu: all gone? ( ...
Added by ldtiw on Tue, 18 Jan 2022 07:32:58 +0200
Simple QQ music crawling
The crawler function is realized bit by bit. If we want to crawl qq music, we must first crawl one of the songs.
We open the official website of qq music, randomly find a song, enter the playback page, and then press F12 to enter the detection interface.
If no data appears, refresh the page. Then we find the file with the size of a song her ...
Added by zab329 on Mon, 17 Jan 2022 03:14:48 +0200
Python beginner crawler - climb UIBE Academic Affairs Office (requests+bs4)
The most basic crawler -- Python requests+bs4 crawling UIBE Academic Affairs Office
1. Use tools
1.Python 3.x
2. Third party library requests,bs4
3. Browser
2. Specific ideas
The website of UIBE academic affairs office is highly open and has no anti crawler measures. It only needs to use the most basic crawler means. Use the requests libr ...
Added by isam4m on Sun, 16 Jan 2022 19:02:27 +0200
Network security is based on the sketch framework and selenium and openpyxl libraries to crawl the epidemic statistics and summary information of foreign countries
Network security is based on the sketch framework and selenium and openpyxl libraries to crawl the epidemic statistics and summary information of foreign countries
data sources https://voice.baidu.com/act/newpneumonia/newpneumonia/
thinking Because the data in the target page is dynamically loaded, the response obtained by directly initiatin ...
Added by visionmaster on Sun, 16 Jan 2022 10:08:54 +0200
60000 word summary of Python basic knowledge points, liver explosion, staying up late in a week [recommended collection]
Hello, I'm spicy.
Today, I'll bring you a summary of the basic knowledge of Python. It's no exaggeration to say that I didn't finish it in a week. This is the first play. If you like to remember three in a row, I'll quickly update the next play and strive to finish this series. I hope you can support me.
catalogue
notes
variable
output
in ...
Added by sanchan on Sun, 16 Jan 2022 07:33:53 +0200
Ten thousand words blog teaches you the necessary Beautiful Soup library for python crawlers. I won't give you all my girlfriends after reading it[ β€οΈ Recommended collection β€οΈ]
β π»π» I believe many friends have learned the requests library from entering the pit to meeting through the repeated bombing of my two ten thousand word blog posts, and can independently develop their own small crawler projectsββ The reptile road is endless~ π»π» β
β chapter I reptile entering the pit: A ten thousand w ...
Added by contex on Sun, 16 Jan 2022 01:48:16 +0200
Python crawler: want to listen to list songs? It only takes 14 lines of code to use the beautiful soup library
Beautiful soup Library
Although XPath is more convenient than regular expressions, it is not the most convenient, only more convenient. Our beautiful soup library can make it easier to crawl what you want.
Installing the BeautifulSoup Library
Before use, it is the old rule to install the BeautifulSoup library. The instructions are as fol ...
Added by psd99 on Sun, 16 Jan 2022 01:39:53 +0200