Several interview questions related to MapReduce (1)

... Today, I will introduce you to several MapReduce-related interview questions. These questions are encountered by me or others during the interview process. See if you can answer a few words, tomorrow. Give the answer to everyone. 题1 : The existing 100TB user query words (extracted from...


Cmake compile static library dynamic library specify output path

... cmake_minimum_required(VERSION 3.11) Define_source_files() Project(CmakeTest) Aux_source_directory(. src) #add_executable(project1 ${src}) #Compile to an executable #add_library(project1 ${src}) #Compile to a static library #add_library(project1 SHARED ${src}) #Compile as a dynamic link...


How is data analysis & big data analysis applied to the e-commerce industry?

... There are more and more people who want to do e-commerce and enter the e-commerce industry in recent years. Whether it is their own Taobao shop or micro shop, you will find yourself in the circle of friends. Several are already doing e-commerce. E-commerce is so hot, what is the most...


Impala's introduction and the difference with hive

... Recently read several articles about impala, this conscience is good: https://www.biaodianfu.com/impala.html (this article intercepts some content) Impala is a new query system developed by Cloudera. It provides SQL semantics and can query PB-level big data stored in Hadoop's HDFS and...


Ten years of JAVA architecture experience summary: These points are especially critical!

... 蓦然回首自做的发展的有有有十的了, I have gained a lot in the past ten years, technical ability, training, going abroad, big company experience, and A lot of good friends. But think again, I have been wasting at least five years in this decade. This five years is enough to make myself a good programmer....


Kafka common operation command

... Create theme $ > bin/kafka-topics.sh --create --zookeeper hadoop05:2181 \ --replication-factor 3 --partitions 3 --topic test View topic list $ > bin/kafka-topics.sh --list --zookeeper hadoop05:2181 View a topic details $ > bin/kafka-topics.sh --topic test --describe --zookeeper...


Some concepts about the quantum field

... recently discussed a quantum problem with classmates, which is incredible. The question is why B changes after A changes, or A knows the state of B. Therefore, to query and understand some knowledge about quantum, here is a summary. 一, Pan Jianwei's team of quantum communication results...


Play big data! Hadoop's position in big data is so high?

... 马云 once said: "The biggest resource in the future is data. If you don't participate in big data, you will regret it after ten years!" Hadoop was first born in 2006 and became the top Apache project in 2008. At the beginning, Hadoop was in China. Basically no one noticed it. Until the...


Ali Yunyun products universal vouchers

... can refer to the enterprise-level cloud hosting discount link https://promotion.aliyun.com/ntms/act/enterprise-discount.html?userCode=it4zza32#/ Before Ali cloud still has activities, 2 core 4g memory and discounts, Ali cloud 2 core 4G 1M bandwidth 40G high efficiency cloud disk ¥ 269 /...


Quickly read the data in hive through spark-sql

... 1 Configure and start 1.1 Create and configure hive-site.xml You need to use Hive Metastore in running Spark SQL CLI, so you need Add its uris in Spark. The specific method is to copy the HIVE_CONF/hive-site.xml to the SPARK_CONF directory, and then add the hive.metastore.uris attribute...