docker quickly builds distributed crawler pyspider
brief introduction
pyspider is a powerful Web crawler framework in Python, and supports distributed architecture.
Why use docker to build pyspider
When installing pyspider, you have crawled through some pits. For example, when using pip install pyspider, the version of Python is required to be 3.6 or less, because async is already the keyword ...
Added by uniboy86 on Mon, 18 Nov 2019 20:48:04 +0200
Spring Series-Actual Text-Development Based on mongodb
1. Preface
In our enterprise development, the most commonly used are relational databases (oracle, mysql, sqlserver, etc.). These jdbc-Based data interaction methods can be achieved by integrating mybatis in spring, which is explained in this series of articles "Spring Series - Actual Warfare (4) - How you know MyBatis".
However, for ...
Added by celsoendo on Sun, 17 Nov 2019 12:00:46 +0200
Query data in MySQL database, filter duplicate data and keep one piece of data -- (implementation method of row Ou number in MySQL)
From: http://www.maomao365.com/?p=10564 Abstract:
The following describes how to keep only one piece of data when MySQL database queries duplicate dataImplementation ideas: There is no row Ou number function in MySQL database, so we need to change direction to implement this function.
--1.View basic data table
mysql> select * from ...
Added by Mirge on Sat, 16 Nov 2019 16:09:02 +0200
Pay attention to Spring transactions to avoid large transactions
background
This article mainly shares some problems found in the high concurrency of pressure measurement. The previous two articles have described some summarization and optimization of the message queue and database connection pool under the condition of high concurrency. Don't talk too much, get to the point.
Transactions, presumably, are no ...
Added by austine_power007 on Fri, 15 Nov 2019 04:56:55 +0200
The use of general mapper combined with mybatis generator in springboot
Reading catalogue
pom file
generatorConfig.properties
generatorConfig.xml
IBaseMapper (let the generated mapper interface inherit this class)
General mapper refers to the package of tk.mybatis. This is a general mapper, which means that the auto generated dao layer needs to inherit the mapper class provided by this frame ...
Added by Javizy on Wed, 13 Nov 2019 20:12:29 +0200
Web backstage service development -- a simple select for database query
Article from Geek Forum
Step 1: create module s and service s
Execute the following command at the command line to create the module and service named Person.
nest g module person
nest g service person
In this case, the directory named person will be generated automatically
Step 2 create entity
Create the file person.en ...
Added by Nytemare on Wed, 13 Nov 2019 19:53:28 +0200
Thinking and comparison in the application of Spring WebFlux
This paper is based on Spring Cloud Finchley SR4
Through several questions, this paper analyzes the best practice of Spring WebFlux usage and compares it with another framework Vertx
1. Whether you must use the default web container, whether you can use your own web container, and whether you can have web and webplus at the same time
Yes, thi ...
Added by cedtech23 on Tue, 12 Nov 2019 12:50:24 +0200
PHP Swoole long connection FAQ
Connection failureExampleAmong them, the common errors reported by Redis are:
Configuration item: timeoutError while reading line from the serverRedis can configure that if the client does not send data to the redis server after several seconds, the connection will be close d.
Common MySQL errors:
Configuration item: wait & Interactive time ...
Added by Doom87 on Mon, 11 Nov 2019 11:47:31 +0200
pod status always shows ContainerCreating
Today, when learning kubernetes, I started an msyql service and ran the command
[root@liuxuchong kubernetes]# kubectl create -f mysql-rc.yaml
replicationcontroller "mysql" created
[root@liuxuchong kubernetes]# kubectl get all
NAME DESIRED CURRENT READY AGE
rc/mysql 1 1 0 6m
NAME CLUSTER-IP ...
Added by tjohnson_nb on Sun, 10 Nov 2019 17:22:12 +0200
MySQL 5.6 created data table 1071 error, cause analysis and Solutions
Zero. Background of the problem
When you first learned SpringBoot + Angular, the database software still used MySQL, except that this time the MySQL service was no longer built using XAMPP, but a more convenient Docker was used to provide the service.
1. Reproduction of Problems
When you configure your database, after you've set up your envi ...
Added by JRS on Sat, 09 Nov 2019 09:25:54 +0200