metastore

Kerberos java to hive keytab authentication, login failure UserGroupInformation.loginUserFromKeytab

∥☆過路亽.° 提交于 2019-12-07 18:14:39
问题 I am trying to get kerberos keytab authentication work from java to Hive and not finding solution to fix the issue. org.apache.hadoop.conf.Configuration conf = new org.apache.hadoop.conf.Configuration(); conf.set("hadoop.security.authentication", "kerberos"); conf.set(HiveClientFactory.HIVE_METASTORE_URIS,"thrift://{URL}"); UserGroupInformation.setConfiguration(conf); UserGroupInformation.loginUserFromKeytab(krbPrincipal, keyTabPath); java.io.IOException: Login failure for {krbPrincipal} from

How to set configuration in Hive-Site.xml file for hive metastore connection?

醉酒当歌 提交于 2019-12-06 05:01:16
问题 I want to connect MetaStore using the java code. I have no idea how to set configuration setting in Hive-Site.xml file and where I'll post the Hive-Site.xml file. Please help. import java.sql.Connection; import java.sql.DriverManager; import java.sql.ResultSet; import java.sql.Statement; import org.apache.hadoop.fs.Path; import org.apache.hadoop.hive.conf.HiveConf; import org.apache.hadoop.hive.conf.HiveConf.ConfVars; public class HiveMetastoreJDBCTest { public static void main(String[] args)

Kerberos java to hive keytab authentication, login failure UserGroupInformation.loginUserFromKeytab

百般思念 提交于 2019-12-06 04:06:13
I am trying to get kerberos keytab authentication work from java to Hive and not finding solution to fix the issue. org.apache.hadoop.conf.Configuration conf = new org.apache.hadoop.conf.Configuration(); conf.set("hadoop.security.authentication", "kerberos"); conf.set(HiveClientFactory.HIVE_METASTORE_URIS,"thrift://{URL}"); UserGroupInformation.setConfiguration(conf); UserGroupInformation.loginUserFromKeytab(krbPrincipal, keyTabPath); java.io.IOException: Login failure for {krbPrincipal} from keytab {keyTabPath} at org.apache.hadoop.security.UserGroupInformation.loginUserFromKeytab

Where an Avro schema is stored when I create a hive table with 'STORED AS AVRO' clause?

南笙酒味 提交于 2019-12-04 22:51:09
问题 There are at least two different ways of creating a hive table backed with Avro data: 1) Creating a table based on an Avro schema (in this example stored in hdfs): CREATE TABLE users_from_avro_schema ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe' STORED AS INPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat' OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat' TBLPROPERTIES ('avro.schema.url'='hdfs:///user/root/avro/schema/user.avsc')

How to set configuration in Hive-Site.xml file for hive metastore connection?

北慕城南 提交于 2019-12-04 07:08:49
I want to connect MetaStore using the java code. I have no idea how to set configuration setting in Hive-Site.xml file and where I'll post the Hive-Site.xml file. Please help. import java.sql.Connection; import java.sql.DriverManager; import java.sql.ResultSet; import java.sql.Statement; import org.apache.hadoop.fs.Path; import org.apache.hadoop.hive.conf.HiveConf; import org.apache.hadoop.hive.conf.HiveConf.ConfVars; public class HiveMetastoreJDBCTest { public static void main(String[] args) throws Exception { Connection conn = null; try { HiveConf conf = new HiveConf(); conf.addResource(new

Unable to start hive metastore service or hive-shell after configuring mysql with hive

心不动则不痛 提交于 2019-12-02 04:56:44
I know this question asked already but those answers are not helping in any way. I am spending more time to configure mysql with hive, Every time I encounter errors and I don't understand where it goes wrong ..... as you can see in this link , hive-site.xml configuration can be seen here in the link Here is file-structure So is the reason creating this question.... Hoping this helps me to resolve. I followed these links https://dzone.com/articles/how-configure-mysql-metastore hive-site.xml path in hive0.13.1 https://cwiki.apache.org/confluence/display/Hive/AdminManual+Configuration How to set

is there any metadata store like 'hive metastore' in BigQuery?

主宰稳场 提交于 2019-11-30 18:32:29
问题 I am new to BigQuery. I just want to know, whether do we have anything like hive metastore (metadata about all tables, columns and their description) in BigQuery? 回答1: BigQuery offers some special tables whose contents represent metadata, such as the list of tables and views in a dataset. The "meta-tables" are read-only. To access metadata about the tables and views in a dataset, use the __TABLES_SUMMARY__ meta-table in a query's SELECT statement. You can run the query using the BigQuery web

Get Table Properties out of Hive using Java API

瘦欲@ 提交于 2019-11-28 14:21:17
I'm trying to get table properties like table db, name, owner, and hdfs location out of the hive metastore using the metastore client in java. I think I can get the table databases and names okay, but I can't figure out how to grab things like owner and hdfs location. Is it possible? I've been searching the doc and internet for a couple hours now and no dice. Could be something like that: org.apache.hadoop.hive.metastore.api.Table table=..........; org.apache.hadoop.hive.metastore.api.StorageDescriptor sd=table.getSd(); String loc=sd.getLocation(); String own=sd.getOwner(); https://hive.apache

Get Table Properties out of Hive using Java API

断了今生、忘了曾经 提交于 2019-11-27 08:33:25
问题 I'm trying to get table properties like table db, name, owner, and hdfs location out of the hive metastore using the metastore client in java. I think I can get the table databases and names okay, but I can't figure out how to grab things like owner and hdfs location. Is it possible? I've been searching the doc and internet for a couple hours now and no dice. 回答1: Could be something like that: org.apache.hadoop.hive.metastore.api.Table table=..........; org.apache.hadoop.hive.metastore.api