Programming VIP

Drois introduction Doris is an interactive SQL data warehouse based on MPP, which is mainly used to solve the problems of reports and multidimensional analysis Noun interpretation Frontend (FE): metadata and scheduling node of Doris system. In the import process, it is mainly responsible for the scheduling of import tasks. Backend (BE): th ...

  DataX is an open source version of Alibaba cloud DataWorks data integration. It is an offline data synchronization tool / platform widely used in Alibaba group. DataX implements efficient data synchronization between various heterogeneous data sources, including MySQL, Oracle, SqlServer, Postgre, HDFS, Hive, ADS, HBase, TableStore(OTS), MaxC ...

insert overwrite implementation of Doris partition bucket table (1) Real time project If it is real-time, we should pay attention to timeliness. Directly select the unique key model table and select the non repeatable columns as unique keys A simple example of creating a single partition table CREATE TABLE order_tab ( orderid BIGINT, ...

Spark Doris Connector is a new feature introduced by Doris in version 0.12. Users can use this function to directly read and write the data stored in Doris through spark, and support SQL, Dataframe, RDD and other methods. From the perspective of Doris, introducing its data into Spark can use a series of rich ecological products of Spark, bro ...

​ 1. Introduction In some usage scenarios, the user will partition the table by day and perform routine tasks regularly every day. At this time, the user needs to manually manage the partition. Otherwise, the data import may fail because the user does not create a partition, which brings additional maintenance costs to the user. Through the ...