Detailed explanation of parent-child, brother and adjacent node positioning methods of selenium

Share the positioning methods of parent-child, brother and adjacent nodes in selenium. In practical applications, many people will encounter the problem that the node they want to locate cannot be directly located and needs to be relatively located through nearby nodes. However, it is easy to locate the child node from the parent node. It is im ...

Added by cjosephson on Sat, 18 Dec 2021 02:58:18 +0200

A little trick makes it easy for Selenium to deal with scrollbars and element focus

01. JS processing scroll bar Execute via webdriver_ The script () method executes the JS script operation scroll bar Right scroll bar Firefox browser and Chrome browser use different syntax. It is listed in the following area. It looks like Google browser 71 general Firefox # Firefox browser scrolls to the bottom js = "var q=document.docume ...

Added by freaka on Tue, 07 Dec 2021 15:11:09 +0200

JavaScript dynamic rendering page crawling -- Based on Selenium

1, Installing Selenium There are usually two methods to crawl data using Ajax interface: One is to dig deep into the logic, find out the construction logic of the parameters required by the request, and use Python code to reproduce and construct Ajax requests;The other is to directly simulate the operation of the browser and bypass this p ...

Added by subnet_rx on Tue, 07 Dec 2021 08:10:19 +0200

Python Selenium crawls boss direct recruitment information

hello, everyone~ Another full day~ Since you are full of vitality, do you want to do something, for example, climb the recruitment data of "Boss direct employment"~ Let's go. Let's do it~ Target determination We use Selenium to capture data this time. The information obtained includes title, salary, company name, company ...

Added by SWI03 on Sat, 04 Dec 2021 06:39:23 +0200

[data collection] crawl Dangdang Merchants Network & selenium to obtain the data of Dongfang finance and economics network

🎉 Fan welfare book: Java multithreading and big data processing practice🎉 give the thumbs-up 👍 Collection ⭐ Leaving a message. 📝 You can participate in the lucky draw to send books 🎉 At 20:00 p.m. next Tuesday (November 17), a fan will be selected in the [praise area and comment area] to send the book of Peking University Press~ 🙉🎉 Pl ...

Added by jonorr1 on Fri, 12 Nov 2021 21:21:59 +0200

Using python+selenium super eagle to crack the image recognition verification code

When you are a crawler, you will certainly encounter many verification code columns, such as image recognition mentioned in this paper:   When I was climbing the dragnet, I was too often jumped to the verification system. It was really annoying url=Secure access verification - pull hookhttps://sec.lagou.com/verify.html?e=2&f=https: ...

Added by djdon11 on Sat, 30 Oct 2021 10:04:03 +0300

Selenium 3 automatic test [27] operation of Frame

Abstract of this article "explain how Python 3 + selenium 3 handles Frame forms" Frame form When we use Selenium to locate page elements, we sometimes encounter the problem that we can't locate them. The elements we see on the page can be seen by the developer tools of the browser, but the code can't locate them when running. When ...

Added by discofreakboot on Mon, 25 Oct 2021 06:20:08 +0300

Python Selenium.WebDriverWait Browser Startup Parameter Settings "How Edge Uses Startup Parameters"

Python Selenium.WebDriverWait Browser Startup Parameter Settings "How Edge Uses Startup Parameters" 1. Browser Startup Parameter Settings 🍿 When you create a WebDriver instance, you can configure its startup parameters to make some initial settings that will take effect throughout the lifecycle of the WebDriver The parameters ...

Added by xudzh on Sat, 23 Oct 2021 19:45:55 +0300

In order to get her started with Python in 10 minutes, I stayed up late and wrote 7 cases and this article

preface Recently, I systematically studied the basic knowledge of python once, and thought of whether there was a way to master knowledge quickly. The general normal logic is to practice cases while reading basic knowledge, which is a process from thick to thin. But now the pace is so fast, especially Internet companies. Excluding the time to ...

Added by cillosis on Fri, 22 Oct 2021 14:34:20 +0300

Use python+Selenium to dynamically crawl the account information of the treasure house of the land

         This article demonstrates how to use Selenium to crawl the account information of the treasure Pavilion (number of generals, name of generals, number of tactics, number of treasures, price, number of collections, etc.) of the land of lead. Because different information needs various clicks to obt ...

Added by kumarsatishn on Sat, 11 Sep 2021 09:20:49 +0300