docker quickly builds distributed crawler pyspider

brief introduction pyspider is a powerful Web crawler framework in Python, and supports distributed architecture. Why use docker to build pyspider When installing pyspider, you have crawled through some pits. For example, when using pip install pyspider, the version of Python is required to be 3.6 or less, because async is already the keyword ...

Added by uniboy86 on Mon, 18 Nov 2019 20:48:04 +0200

Spring Series-Actual Text-Development Based on mongodb

1. Preface In our enterprise development, the most commonly used are relational databases (oracle, mysql, sqlserver, etc.). These jdbc-Based data interaction methods can be achieved by integrating mybatis in spring, which is explained in this series of articles "Spring Series - Actual Warfare (4) - How you know MyBatis". However, for ...

Added by celsoendo on Sun, 17 Nov 2019 12:00:46 +0200

Query data in MySQL database, filter duplicate data and keep one piece of data -- (implementation method of row Ou number in MySQL)

From: http://www.maomao365.com/?p=10564 Abstract: The following describes how to keep only one piece of data when MySQL database queries duplicate dataImplementation ideas: There is no row Ou number function in MySQL database, so we need to change direction to implement this function.  --1.View basic data table mysql> select * from ...

Added by Mirge on Sat, 16 Nov 2019 16:09:02 +0200

Pay attention to Spring transactions to avoid large transactions

background This article mainly shares some problems found in the high concurrency of pressure measurement. The previous two articles have described some summarization and optimization of the message queue and database connection pool under the condition of high concurrency. Don't talk too much, get to the point. Transactions, presumably, are no ...

Added by austine_power007 on Fri, 15 Nov 2019 04:56:55 +0200

The use of general mapper combined with mybatis generator in springboot

Reading catalogue pom file generatorConfig.properties generatorConfig.xml IBaseMapper (let the generated mapper interface inherit this class)   General mapper refers to the package of tk.mybatis. This is a general mapper, which means that the auto generated dao layer needs to inherit the mapper class provided by this frame ...

Added by Javizy on Wed, 13 Nov 2019 20:12:29 +0200

Web backstage service development -- a simple select for database query

Article from Geek Forum Step 1: create module s and service s Execute the following command at the command line to create the module and service named Person. nest g module person nest g service person In this case, the directory named person will be generated automatically Step 2 create entity Create the file person.en ...

Added by Nytemare on Wed, 13 Nov 2019 19:53:28 +0200

Thinking and comparison in the application of Spring WebFlux

This paper is based on Spring Cloud Finchley SR4 Through several questions, this paper analyzes the best practice of Spring WebFlux usage and compares it with another framework Vertx 1. Whether you must use the default web container, whether you can use your own web container, and whether you can have web and webplus at the same time Yes, thi ...

Added by cedtech23 on Tue, 12 Nov 2019 12:50:24 +0200

PHP Swoole long connection FAQ

Connection failureExampleAmong them, the common errors reported by Redis are: Configuration item: timeoutError while reading line from the serverRedis can configure that if the client does not send data to the redis server after several seconds, the connection will be close d. Common MySQL errors: Configuration item: wait & Interactive time ...

Added by Doom87 on Mon, 11 Nov 2019 11:47:31 +0200

pod status always shows ContainerCreating

Today, when learning kubernetes, I started an msyql service and ran the command [root@liuxuchong kubernetes]# kubectl create -f mysql-rc.yaml replicationcontroller "mysql" created [root@liuxuchong kubernetes]# kubectl get all NAME DESIRED CURRENT READY AGE rc/mysql 1 1 0 6m NAME CLUSTER-IP ...

Added by tjohnson_nb on Sun, 10 Nov 2019 17:22:12 +0200

MySQL 5.6 created data table 1071 error, cause analysis and Solutions

Zero. Background of the problem When you first learned SpringBoot + Angular, the database software still used MySQL, except that this time the MySQL service was no longer built using XAMPP, but a more convenient Docker was used to provide the service. 1. Reproduction of Problems When you configure your database, after you've set up your envi ...

Added by JRS on Sat, 09 Nov 2019 09:25:54 +0200