docker quickly builds distributed crawler pyspider

brief introduction pyspider is a powerful Web crawler framework in Python, and supports distributed architecture. Why use docker to build pyspider When installing pyspider, you have crawled through some pits. For example, when using pip install pyspider, the version of Python is required to be 3.6 or less, because async is already the keyword ...

Added by uniboy86 on Mon, 18 Nov 2019 20:48:04 +0200

Redis cache and spring cache

http://120.79.167.88:4444/articles/2019/05/12/1557661499842.html Record the difference between Redis cache and spring cache 1.Redis is a third-party cache, so the cache data still exists after the project is restarted 2. Spring cache is built on the JVM for caching, so the cache will disappear automatically after the project i ...

Added by tabs on Tue, 12 Nov 2019 22:35:20 +0200

PHP Framework websocket Active Message Push

Laravel combines swoole to implement a function that actively triggers message pushing, which allows you to send custom messages to all members of the template message, instead of sending messages through the client, and listens to the messages sent in the message on the service side for business logic. Active Message Push ImplementationNormall ...

Added by neptun on Tue, 12 Nov 2019 05:17:24 +0200

Remember the pit encountered in using Shiro redis open source plug-in once

Shiro redis is an open-source plug-in of Daniel on the Internet (github address: https://github.com/alexxiyang/shiro-redis )Recently, the following errors are always reported when using it (version 3.1.0): We need a field to identify this Cache Object in Redis. So you need to defined an id field which you can get unique id to id ...

Added by philhale on Mon, 11 Nov 2019 20:54:45 +0200

Install and configure Redis service under CentOS7

Official website: https://redis.io Download: https://redis.io/download 1. Installation dependency ➜ yum install -y gcc gcc-c++ kernel-devel 2. Download the source package # It is recommended to store the source code of each software in this directory ➜ cd /usr/local/src # Download the specified version ➜ wget http://download.redis.io/rele ...

Added by mcl on Mon, 11 Nov 2019 18:04:03 +0200

PHP Swoole long connection FAQ

Connection failureExampleAmong them, the common errors reported by Redis are: Configuration item: timeoutError while reading line from the serverRedis can configure that if the client does not send data to the redis server after several seconds, the connection will be close d. Common MySQL errors: Configuration item: wait & Interactive time ...

Added by Doom87 on Mon, 11 Nov 2019 11:47:31 +0200

The use of redis in yii2.0

Add redis cache to the project 1.composer installs redis composer require "yiisoft/yii2-redis" 2. Settings in the project configuration file: import cache and link redis server common/config/main.php: 'components' => [ 'cache' => [ // 'class' => 'yii\caching\FileCache', ...

Added by gacon on Sun, 10 Nov 2019 23:33:26 +0200

Spring boot integrates redis to cache some knowledge points

Preface Recently, we are working on a smart home platform. Considering that the control of home needs fast response, we plan to use redis cache. On the one hand, it can reduce the pressure of database, on the other hand, it can improve the response speed. The technology stack used in the project is basically the familiar springboot family buck ...

Added by colby.anderson on Sat, 09 Nov 2019 11:46:04 +0200

Night Light Lectures Opentcs Framework and Actual AGV Scheme

Preamble to Night Light:       A little more persistence, a little more effort, and what seemed hopeless failure may turn to glorious success A little more perseverance and a little more effort will turn a seemingly hopeless failure into a brilliant success.                   Text:   Communication between dispat ...

Added by JackSevelle on Thu, 07 Nov 2019 23:17:30 +0200

Redis optimizes high and fast performance

Content of this article Using Redis to optimize interface performance in high concurrency scenarios Database optimistic lock With the approaching of the double 11, all kinds of promotional activities began to become popular, and the mainstream ones are seckill, coupons, and so on. The main scenarios involving high concurrency competing for th ...

Added by nOw on Tue, 29 Oct 2019 12:06:26 +0200