scrapy simple distributed crawler

Links to the original text: https://www.jianshu.com/u/8f2987e2f9fb Although scrapy can do a lot of things, it is hard to achieve large-scale distributed applications. A capable person changes the queue scheduling of scrapy, separates the sta ...

Added by Arc on Wed, 14 Aug 2019 11:01:18 +0300

The common syntax of redis in php [recommendation]

Redis is a C/S structure type of service, C refers to the client, S refers to the server, the client and the server can communicate through the network. For redis, redis services need to be installed on the server side. What about the client side? In fact, redis provides API s for many languages. It can ...

Added by kirannalla on Tue, 13 Aug 2019 13:08:22 +0300

Performance comparison between jdk and json serialization of Redis

There are two serialization strategies adopted by redis by default, one is String's serialization strategy and the other is JDK's serialization strategy. There are several serialization tool classes: GenericToStringSerializer: Any objec ...

Added by Lateuk on Mon, 12 Aug 2019 07:16:46 +0300

Redis Introduction, Installation, and Data Structure

Introduction to Redis What is Redis Redis is an open source (BSD licensed) high-performance key-value memory database developed in C that can be used as a database, cache, and messaging middleware.It is a NoSQL (NOT-Only Sql, generically referred to as a non-relational database) database Excellent performance, data in memory, very fast read a ...

Added by davey10101 on Sun, 11 Aug 2019 22:57:35 +0300

Spring Boot@EnableAutoConfiguration parsing

When doing back-end development, the first contact is the basic spring. In order to provide bean s by referring to two-party packages, we need to add the corresponding package < context: component-scan base-package= "xxxx" /> or add the annotation @ComponentScan ({"xxx"}). At that time, I thought it was urgly, but I di ...

Added by razvypp on Sat, 10 Aug 2019 11:00:34 +0300

Using PowerShell to Realize Unattended Installation of Server Common Software

Operating system: Windows Server 2016, Windows Server 2019 Software environment: type Name Edition   system function TelnetClien       IIS   Enable Asp.net 4.7   Hyper-V   Enabling Management Common Software Winrar 5.0     FireFox 67 CHS     SqlServer 2016 Enabling TCP 1436   Microsoft SQL Server Management Studio 14 ...

Added by xpherism on Fri, 09 Aug 2019 14:10:52 +0300

KeyExpiration Event MessageListener Key Overdue Monitoring Events, Business Problems in Service Cluster

The project has a business scenario in which a message notification is sent to the user's public number at a fixed point in time.~ Because the time point is not fixed, there is no timed task. The idea of using redis key failure listener is to save keys. Calculate the time interval between the current an ...

Added by Ayon on Thu, 08 Aug 2019 13:35:43 +0300

Summary of imitation development of mall

Articles Catalogue Project introduction system architecture Project module Application Technology Points Dubbox Distributed Service Framework Front-end framework Angular JS Spring Security FastDFS Redis Application in Home Page Advertising Application in Search Application in Registration Applicati ...

Added by Seas.Comander on Thu, 08 Aug 2019 13:01:01 +0300

Principle of Spring-boot Automatic Configuration

First, create the spring boot project in Spring Initializr mode and view the main configuration class of spring boot: @SpringBootApplication public class SpringBootAutoconfigurationYuanliApplication { Click into the SpringBoot Application annotation @SpringBootConfiguration @EnableAutoConfiguration pub ...

Added by stewb on Tue, 06 Aug 2019 13:16:22 +0300

. net core implements task scheduling based on cron expression

Intro Last time we implemented a simple Timer-based timing task. Details can be seen This article. However, it may not be appropriate to use this method slowly. Some tasks may only want to execute in a certain period of time. It is not so flexible to use timer only. We hope that we can specify a cron expression like quartz to specify the execu ...

Added by Das Capitolin on Sun, 04 Aug 2019 18:46:26 +0300