docker quickly builds distributed crawler pyspider
brief introduction
pyspider is a powerful Web crawler framework in Python, and supports distributed architecture.
Why use docker to build pyspider
When installing pyspider, you have crawled through some pits. For example, when using pip install pyspider, the version of Python is required to be 3.6 or less, because async is already the keyword ...
Added by uniboy86 on Mon, 18 Nov 2019 20:48:04 +0200
Redis cache and spring cache
http://120.79.167.88:4444/articles/2019/05/12/1557661499842.html
Record the difference between Redis cache and spring cache
1.Redis is a third-party cache, so the cache data still exists after the project is restarted
2. Spring cache is built on the JVM for caching, so the cache will disappear automatically after the project i ...
Added by tabs on Tue, 12 Nov 2019 22:35:20 +0200
PHP Framework websocket Active Message Push
Laravel combines swoole to implement a function that actively triggers message pushing, which allows you to send custom messages to all members of the template message, instead of sending messages through the client, and listens to the messages sent in the message on the service side for business logic.
Active Message Push ImplementationNormall ...
Added by neptun on Tue, 12 Nov 2019 05:17:24 +0200
Remember the pit encountered in using Shiro redis open source plug-in once
Shiro redis is an open-source plug-in of Daniel on the Internet (github address: https://github.com/alexxiyang/shiro-redis )Recently, the following errors are always reported when using it (version 3.1.0):
We need a field to identify this Cache Object in Redis. So you need to defined an id field which you can get unique id to id ...
Added by philhale on Mon, 11 Nov 2019 20:54:45 +0200
Install and configure Redis service under CentOS7
Official website: https://redis.io
Download: https://redis.io/download
1. Installation dependency
➜ yum install -y gcc gcc-c++ kernel-devel
2. Download the source package
# It is recommended to store the source code of each software in this directory
➜ cd /usr/local/src
# Download the specified version
➜ wget http://download.redis.io/rele ...
Added by mcl on Mon, 11 Nov 2019 18:04:03 +0200
PHP Swoole long connection FAQ
Connection failureExampleAmong them, the common errors reported by Redis are:
Configuration item: timeoutError while reading line from the serverRedis can configure that if the client does not send data to the redis server after several seconds, the connection will be close d.
Common MySQL errors:
Configuration item: wait & Interactive time ...
Added by Doom87 on Mon, 11 Nov 2019 11:47:31 +0200
The use of redis in yii2.0
Add redis cache to the project
1.composer installs redis
composer require "yiisoft/yii2-redis"
2. Settings in the project configuration file: import cache and link redis server
common/config/main.php:
'components' => [
'cache' => [
// 'class' => 'yii\caching\FileCache',
...
Added by gacon on Sun, 10 Nov 2019 23:33:26 +0200
Spring boot integrates redis to cache some knowledge points
Preface
Recently, we are working on a smart home platform. Considering that the control of home needs fast response, we plan to use redis cache. On the one hand, it can reduce the pressure of database, on the other hand, it can improve the response speed. The technology stack used in the project is basically the familiar springboot family buck ...
Added by colby.anderson on Sat, 09 Nov 2019 11:46:04 +0200
Night Light Lectures Opentcs Framework and Actual AGV Scheme
Preamble to Night Light:
A little more persistence, a little more effort, and what seemed hopeless failure may turn to glorious success
A little more perseverance and a little more effort will turn a seemingly hopeless failure into a brilliant success.
Text:
Communication between dispat ...
Added by JackSevelle on Thu, 07 Nov 2019 23:17:30 +0200
Redis optimizes high and fast performance
Content of this article
Using Redis to optimize interface performance in high concurrency scenarios
Database optimistic lock
With the approaching of the double 11, all kinds of promotional activities began to become popular, and the mainstream ones are seckill, coupons, and so on.
The main scenarios involving high concurrency competing for th ...
Added by nOw on Tue, 29 Oct 2019 12:06:26 +0200