Scrapy Crawler Framework
1. Scrapy Crawler Framework
1. Scrapy is not a function library, but a crawler framework
A crawler framework is a collection of software structures and functional components that implement the crawler function
The crawler framework is a semi-finished product that helps users achieve professional web crawling
2.'5+2'structure
(1) Engine (no use ...
Added by cpjok on Thu, 19 Mar 2020 06:55:57 +0200
Python crawler subprocess library practice -- continuous output and fast scanning port
Python crawler (15)
Learning Python crawler experience in the process and knowledge point arrangement, convenient for my own search, also hope to be able to communicate with you.
——Thread library practice continuous output and fast scan port——
Article directory
Python craw ...
Added by misteraven on Sat, 14 Mar 2020 13:03:32 +0200
Using pure Java to implement a websssh project
Preface
Recently, due to the needs of the project, the project needs to realize the function of websh connecting the terminal. Because of the first time to do this type of function, I first went to GitHub to find out if there is any ready-made wheel that can be used directly. At that time, I saw many projects in this area, such as GateOne, webs ...
Added by ColdFusion on Sat, 14 Mar 2020 09:04:25 +0200
Comparison of data structure and algorithm
Introduction:
There are two kinds of comparison algorithms, one is comparison algorithm, the other is non comparison algorithm.
Comparison algorithms are: bubble sort, select sort, insert sort, merge sort, heap sort, fast sort, Hill sort.
Non comparison algorithms are: count sort, cardinality sort, bucket sort.
https://gitee.com/linqiank ...
Added by joecrack on Fri, 13 Mar 2020 09:02:27 +0200
adb command in selfie tutorial 42 read system version information with one key
Android system test,
Before starting the test, we need to confirm whether the tested system version is correct,
When reporting bug s, you need to provide specific system version information for development.
And the system printing time,
Different versions fix different bug s and incorporate different new functions,
If the system version tested ...
Added by Elarion on Thu, 12 Mar 2020 14:47:12 +0200
Python 3 standard library: os.path platform independent file name management
1. Independent file name management of os.path platform
It is easy to write code to deal with files on multiple platforms by using the functions contained in the os.path module. Even if the program does not intend to migrate between platforms, os.path should be used to complete reliable file name resolution.
1.1 resolution path
The first set of ...
Added by Divine Winds on Wed, 11 Mar 2020 04:13:50 +0200
Can I create a remote warehouse on GitHub from CLI without opening a browser?
I created a new local Git Repository:
~$ mkdir projectname
~$ cd projectname
~$ git init
~$ touch file1
~$ git add file1
~$ git commit -m 'first commit'
Is there any git command to create a new remote warehouse and push my submission to GitHub from there? I know to launch the browser and turn to Create a new repository It's no big deal, b ...
Added by info@ipfaces.org on Sun, 08 Mar 2020 12:19:42 +0200
Sorting algorithm -- hill and fast sorting
1. Hill sorting
1.1 problems in simple insertion sorting
Let's look at the possible problems with simple insertion sorting
Array arr = {2,3,4,5,6,1} at this time, the number 1 to be inserted (minimum) is as follows:
{2,3,4,5,6,6}
{2,3,4,5,5,6}
{2,3,4,4,5,6}
{2,3,3,4,5,6}
{2,2,3,4,5,6}
{1,2,3,4,5,6}
...
Added by acirilo on Fri, 21 Feb 2020 08:08:54 +0200
MySQL Shell: 02 deploy InnoDB ReplicaSet
The following article is from universal repair laboratory, Mr. Gong
In January 2020, in addition to the coronavirus whose source information is like a mystery story, MySQL officially released a new version of 8.0.19, and the biggest highlight is the ReplicaSet function.
InnoDBReplicaSet consists of a primary database and multiple secondary da ...
Added by rosieraz on Tue, 18 Feb 2020 09:52:20 +0200
Multilingual Hill sort
brief introduction
Shell's sort is Insertion sort One of them, also known as "reducing increment sort", is a more efficient version of the direct insertion sort algorithm. Hill sort is an unstable sort algorithm. This method was named after D.L.Shell in 1959.
Excerpts from: Baidu Encyclopedia
Code
algorithm analysis
private static fin ...
Added by mattyvx on Sat, 01 Feb 2020 02:35:25 +0200