Python command line parameter parsing
1. Introduction of argparse module
argparse is a python standard library used to process command line parameters.
In most cases, scripts may need multiple parameters, and each parameter type has different uses. It is very useful to add labels before parameters to indicate the type and use of paramete ...
Added by GreenUser on Mon, 22 Jul 2019 11:03:38 +0300
Large Data Migration
Preface:
The company is facing restructuring with around 4 million data.The database design tables of the old and new systems have changed, and the relationships between tables have changed. Some even require a third-party interface to obtain data.
Dependency:
php7
laravel 5.5+
redis
Migrati ...
Added by laflair13 on Sat, 20 Jul 2019 05:11:07 +0300
session sharing based on redis 5: [research on redis 5.x cluster application]
Build a session sharing module based on spring session. Here, a redis-based cluster (Redis-5.0.3 version) is designed as a POM component, which is directly configured as dependency in the pom.xml file in order to meet the need of sharing sessions among the subsystems of the entire Internet of Things platform and facilitate the use of each subsy ...
Added by jboy6t9 on Fri, 19 Jul 2019 06:55:59 +0300
Reducing Redis Memory Occupancy
1. Advantages of reducing redis memory usage
1. Help reduce the time required to create and load snapshots
2. Improving the efficiency of loading and rewriting AOF files
3. Shorten the time required to synchronize from the server
4. Allowing redis to store more data without adding additional hardware
2. Short structure
Redis provides a se ...
Added by breath18 on Tue, 16 Jul 2019 21:56:30 +0300
Scheduler of Crawler Framework WebMagic Source Code Analysis
Scheduler is a url scheduler in Webmagic. It collects URLs (target Requests of Page) that need to be crawled from Spider processing and poll s the URLs to be processed to Spider. Scheduler is also responsible for error retry and de-processing of url judgment, as well as statistics of total pages and remaining pages.
Main interface:
Scheduler d ...
Added by Krik on Tue, 16 Jul 2019 03:32:54 +0300
11. Use of Redis in Spring Boot
Reprinted: http://www.cnblogs.com/ityouknow/p/5748830.html
Besides the support of common database by spring boot, nosql database is also encapsulated and automated.
Introduction to redis
Redis is the most widely used memory data storage in the industry. Redis supports richer data structures than memcached, such as hashes, lists, se ...
Added by kf on Sat, 13 Jul 2019 03:38:29 +0300
Application of redis, conference assistant for WeChat Enterprise Number
Now that I've built a general project structure, I'm starting to write some necessary tool classes. Today I'll start with the redis application that I use.Redis has many applications in some projects, so I'm going to talk about spring's String RedisTemplate today.The function redis uses in this project is to cache some information about WeChat ...
Added by Poolie on Tue, 09 Jul 2019 20:58:42 +0300
springboot+redis+Interceptor+custom annotation to realize automatic idempotent interface
Foreword: In actual development projects, an exposed interface often faces many requests. Let's explain the concept of idempotency: the impact of any multiple execution is the same as that of a single execution. According to this meaning, the ultimate meaning is that the impact on the database can only be one-time and can not be repeated. How t ...
Added by seanrock on Sat, 06 Jul 2019 22:13:47 +0300
Redis Performance Test Record
Although Redis itself also provides redis-benchmark tools to test Redis's performance, in order to customize the test dimension freely, we still test it by writing our own scripts.
Redis's official documentation also mentions that simply starting a loop and then sending operation commands to Redis in the loop is not a performance test for Red ...
Added by mbh23 on Sat, 06 Jul 2019 22:04:05 +0300
Redis RDB Persistence Details
Redis is an in-memory database that stores data in memory and is much faster to read and write than traditional databases that store data on disk.However, once the process exits, Redis's data will be lost.
To solve this problem, Redis provides two persistence schemes, RDB and AOF, to save in-memory data to disk and avoid data loss.
In Redis Per ...
Added by fizix on Sat, 06 Jul 2019 19:35:02 +0300