Tan Anlin: Big Data in the application of intelligent outbound system

... Welcome to Tencent Cloud+Community, get more Tencent massive technical practice dry goods~ 谭安林, Tencent senior engineer, join Tencent in 2015, 8 years Experience in the Internet industry, engaged in big data platform and product development related work; has participated in product...


Under the CDH5.14 cluster, Phoenix4.14.0 installation

... 痛点 & 目: Hbase As a NoSQL database, the syntax is particularly difficult to use, in order to facilitate the use of standard SQL query Hbase data. Phoenix supports DDL and DML additions, deletions and changes. Interface Impala to an externally supplied difficult to improve concurrency...


Spark task execution process

... This is the official map given by Spark. The approximate meaning is: 四步 1. Build DAG (Directed Acyclic Graph) (call the method on RDD) ) 2. DAGScheduler divides the DAG into a Stage (the basis of the segmentation is Shuffle), and the Task generated in the Stage is given to the...


Hadoop for Big Data Development----Configure yarn and mapreduce

... In the previous blog, we have completed the deployment of hdfs, and now we are deploying yarn. We first use the jps command to view the current java-related processes: Here NameNode is referred to as NN, DataNode is referred to as DN, and SecondaryNameNodel is referred to as SNN. We...


BAT's huge platform advantage, what opportunities does a startup have to do big data?

... With the goal of big data commercialization, customers from all industries have a simple experience to share with us our current big data experience. First, the accumulation of thin hair: talk about the advantages of the BAT platform Big data is a good platform for this. Personally, A...


Super installation kubernetes cluster

... 2, install rpm package Yum install -y /tmp/docker*.rpm && rm -f /tmp/docker*.rpm 3, specify the accelerator to use Docker China Plus Echo ‘{“registry-mirrors”:[“https://registry.docker-cn.com”]}’ > /etc/docker/daemon.json 2, install kubernetes1.11.0 1, ready a, modify the...


0 basic introduction to learn big data 4 steps

... The current big data industry is extremely hot, many people are full of interest in big data, most of them have never been exposed to big data, how to learn big The data is foggy. Big data learning is not inscrutable, although it is not so simple, but through hard work, friends who want...


Elasticsearch index template index template and index alias index alias

... Why do I need an index template? In the actual work, you need to use multiple index libraries for a large amount of data storage. If you manually specify the configuration information (settings and mappings) of each index library, it is very troublesome. So, at this time, there is a...


Spark 2.X study notes

... 一 Course Guide 1 Course Objective Goal: Familiar with Spark related concepts Goal: Build a Spark cluster Goal: Write a simple Spark application 2 Spark Overview What is Spark (official website: http://spark.apache.org) Why learn Spark? Spark features Fast Easy to use General purpose...


General usage of MFC listcontrol

... ListCtrl style LVS_ICON: display a large icon for each item LVS_SMALLICON: Show small icons for each item LVS_LIST: Display a list of items with small icons LVS_REPORT: Display item details Intuitive understanding: Windows Explorer, "Large icons, small icons, lists, details" under the ...