Big data learning, how to choose the right development language

... 大数据 rapid development today, many people choose to join the big data learning camp, where to start class, how to choose the right development language to do big data-related things This topic should plague many newcomers to big data learning. How do you choose when you are faced with a...


Hadoop shuffer and Spark shuffer difference

... Hadoop shuffer stage is divided into mapshuffer stage, reduceshuffer stage two stages Before you understand, you need to know what shuffer means, mapreduce task flow, you can understand and further study In the next stage, Figures 1 and 2 are good mapreduce task flow diagrams I have...


Big Data Study Notes (14)--hadoop

... Table of Contents HDFS storage model architecture model copy layout summary ​ Hadoop introduction HDFS storage model Explanation : The reason why the uploaded block size cannot be changed is that each block is the same size. Changing one other will also change, and changing another...


Titan Graph Database Structure Overview

... 结构概要 titan is a graphical database engine. Titan itself focuses on compact graphics serialization, rich graphical data modeling, and efficient query execution. In addition, Titan uses Hadoop for graphics analysis and batch map processing. Titan provides a robust, modular interface for...


CPU virtualization technology and advantages

... (mainly explaining virtualization technology, one of the core technologies of cloud computing technology, the course first explains the main role of virtualization technology and common implementation methods, and focuses on the virtualization technology commonly used in hardware. (CPU,...


The National Day is approaching, it is time to make a summary of the Q3 quarter~

... In a few days, I will go to the National Day. This holiday is very meaningful for the friends of Guanyuan. 国庆 means the end of the Q3 quarter. Under the joint efforts of everyone Q3 quarter view data has been strongly supported and recognized by the industry During this period, we...


c# About obtaining the exe path

... C# The method to get the program path (version 1) The methods for obtaining the running program path are mainly the following seven types: System.Diagnostics.Process. GetCurrentProcess().MainModule.FileName He gets the file name of the Module. If you are in the debugging environment of...


Using CentOS6.8 to build a Hadoop cluster

... Overview: Cluster cluster, can distribute many processes to multiple computers; through the joint use of multiple computer storage and computing resources to complete larger tasks. In order to achieve unlimited storage and computing power, clusters must be used in production...


Remember that the yarn caused cpu 飙 high abnormal troubleshooting experience

... yarn will not be introduced first, this crater experience is still rewarding, from the log to the stack information to the source code , very interesting Listen to me below 问题描述: Cluster a NodeManager cpu load is high. Process is still there but the log is no longer sending a heartbeat...


Cluster management - caffe multi-chip gpu nccl configuration, according to the official link document operation and installation

... NCCL is Nvidia Collective multi-GPU Communication Library For short, it is a multi-GPU collective communication (all-gather, reduce, broadcast) library, Nvidia has done a lot of optimization to achieve higher communication speed on PCIe, Nvlink, InfiniBand. Before we used digits5, we...