cloudera-manager

Where are the start/stop hadoop hdfs/mapred scripts on CDH5

此生再无相见时 提交于 2019-12-13 16:59:05
问题 The documentation for CDH4 refers to the /etc/init.d/hadoop-* scripts, but these no longer exist in CDH5. I have waded into the documentation but was not successful in finding/understanding what is the CDH5 equivalent. Closest I could find was for the SCM manager: http://www.cloudera.com/content/cloudera-content/cloudera-docs/CM5/latest/Cloudera-Manager-Administration-Guide/cm5ag_agents.html Pointers to and explanation of the new process(/es) would be appreciated. 回答1: I received a response

Cloudera Manager Express Wizard Does Not Detect EC2

99封情书 提交于 2019-12-13 04:50:33
问题 I am attempting to install Cloudera Manager on an EC2 instance following these directions. They indicate that once I have installed Manager and navigated to the EC2 host page at port 7180, it will automatically detect that it is running on an EC2 instance and allow me to have it deploy and configure my hadoop cluster. The docs mention an EC2 related warning message on the welcome screen. Instead I get a different welcome screen that doesn't mention EC2: When I click continue I get a second

Spark : check your cluster UI to ensure that workers are registered

被刻印的时光 ゝ 提交于 2019-12-12 07:25:09
问题 I have a simple program in Spark: /* SimpleApp.scala */ import org.apache.spark.SparkContext import org.apache.spark.SparkContext._ import org.apache.spark.SparkConf object SimpleApp { def main(args: Array[String]) { val conf = new SparkConf().setMaster("spark://10.250.7.117:7077").setAppName("Simple Application").set("spark.cores.max","2") val sc = new SparkContext(conf) val ratingsFile = sc.textFile("hdfs://hostname:8020/user/hdfs/mydata/movieLens/ds_small/ratings.csv") //first get the

restart jobtracker through cloudera manager API

爱⌒轻易说出口 提交于 2019-12-12 04:06:43
问题 I am trying to restart Mapreduce Jobtracker through Cloudera Manager API. Stats for Jobtracker is as follows : local-iMac-399:$ curl -u 'admin:admin' 'http://hadoop-namenode.dev.com:7180/api/v6/clusters/Cluster%201/services/mapreduce/roles/mapreduce-JOBTRACKER-0675ebab2b87e3869e0d90167cf4bf86' { "name" : "mapreduce-JOBTRACKER-0675ebab2b87e3869e0d90167cf4bf86", "type" : "JOBTRACKER", "serviceRef" : { "clusterName" : "cluster", "serviceName" : "mapreduce" }, "hostRef" : { "hostId" : "24259373

Cloudera Manager isn't opening

你离开我真会死。 提交于 2019-12-11 17:08:04
问题 I have an VM: cloudera-quickstart-vm-5.13.0-0-virtualbox , run now. But the Cloudera Manager's Page isn't being shown. The message: 'Attempting to connect to Cloudera Manager...' is being shown the all day. How Can I solve this problem? 回答1: Cloudera manager has to be restarted separately in the quickstart VM. You can run the below command and see it works: /home/cloudera/cloudera-manager --force --express 来源: https://stackoverflow.com/questions/56474423/cloudera-manager-isnt-opening

SSH connection issue Cloudera Manager on Google Compute Engine

有些话、适合烂在心里 提交于 2019-12-11 13:43:16
问题 I have installed Cloudera Manager on a Google Compute Engine VM and successfully logged in to CM. I am trying to create a 3 node Hadoop (YARN) cluster there. However, on the ssh credentials page, where I am providing my username without password, the process is failing ( error: Exhausted available authentication methods ). I tried creating password less ssh login manually. Created the id_rsa and copied id_rsa.pub to authorized_host . I was able to ssh to the same machine but not to other

dfs_hosts_allow in Cloudera Manager

夙愿已清 提交于 2019-12-11 09:16:59
问题 I am trying to setup HDFS & Cloudera Manager via the Cloudera Manager API. However I am stuck at a specific point: I setup all the HDFS roles, but the NameNode refuses to communicate with the data nodes. The relevant error from the DataNode log: Initialization failed for Block pool BP-1653676587-172.168.215.10-1435054001015 (Datanode Uuid null) service to master.adastragrp.com/172.168.215.10:8022 Datanode denied communication with namenode because the host is not in the include-list:

Spark Standalone Mode: Worker not starting properly in cloudera

会有一股神秘感。 提交于 2019-12-11 08:17:40
问题 I am new to the spark, After installing the spark using parcels available in the cloudera manager. I have configured the files as shown in the below link from cloudera enterprise: http://www.cloudera.com/content/cloudera-content/cloudera-docs/CM4Ent/4.8.1/Cloudera-Manager-Installation-Guide/cmig_spark_installation_standalone.html After this setup, I have started all the nodes in the spark by running /opt/cloudera/parcels/SPARK/lib/spark/sbin/start-all.sh. But I couldn't run the worker nodes

No package oracle-j2sdk1.7 available?

人走茶凉 提交于 2019-12-09 16:45:14
问题 I am running following command for cloudera installation ./cloudera-manager-installer.bin After accepting oracle license i getting error installation failed for logs go to 2.install-oracle-j2sdk1.7.log following is contents of the log file Loaded plugins: fastestmirror, priorities, refresh-packagekit, security Loading mirror speeds from cached hostfile * base: mirrors.syringanetworks.net * extras: mirror.sanctuaryhost.com * updates: centos.corenetworks.net Setting up Install Process No

Cloudera Manager Failed to authenticate : Exhausted available authentication methods

落花浮王杯 提交于 2019-12-04 19:41:14
问题 I am currently trying to learn how can I install and configure Cloudera before using it. So I install in VirtualBox, Ubuntu 14.04, Cloudera Manager. I would like to try it on a pseudo single node (only my computer: no cluster). I manage to finish the installation. Then to Specify hosts for your CDH cluster installation ; localhost 127.0.0.1 My problem is on the "Provide SSH login credentials." step Root access to your hosts is required to install the Cloudera packages. This installer will