Authentication Mechanisms

To connect to a Spark server, you must configure the Simba Apache Spark ODBC Connector to use the authentication mechanism that matches the access requirements of the server and provides the necessary credentials. To determine the authentication settings that your Spark server requires, check the server configuration and then refer to the corresponding section below.

Shark Server

You must use No Authentication as the authentication mechanism. Shark Server instances do not support authentication.

Spark Thrift Server on an HDInsight Distribution

If you are connecting to HDInsight Emulator running in Windows Azure, then you must use the Windows Azure HDInsight Emulator mechanism.

If you are connecting to HDInsight Service running in Windows Azure, then you must use the Windows Azure HDInsight Service mechanism.

Spark Thrift Server on a non-HDInsight Distribution

Note: Most default configurations of Spark Thrift Server on non-HDInsight distributions require User Name authentication.

Configuring authentication for a connection to a Spark Thrift Server instance on a non-HDInsight Distribution involves setting the authentication mechanism, the Thrift transport protocol, and SSL support. To determine the settings that you need to use, check the following three properties in the hive-site.xml file in the Spark server that you are connecting to:

  • hive.server2.authentication
  • hive.server2.transport.mode
  • hive.server2.use.SSL

Use the following table to determine the authentication mechanism that you need to configure, based on the hive.server2.authentication value in the hive-site.xml file:

hive.server2.authentication Authentication Mechanism

NOSASL

No Authentication

KERBEROS

Using Kerberos

NONE

Using User Name

LDAP

User Name and Password
SAML SAML 2.0

Use the following table to determine the Thrift transport protocol that you need to configure, based on the hive.server2.authentication and hive.server2.transport.mode values in the hive-site.xml file:

hive.server2.authentication hive.server2.transport.mode Thrift Transport Protocol

NOSASL

binary

Binary

KERBEROS

binary or http

SASL or HTTP

NONE

binary or http

SASL or HTTP

LDAP

binary or http

SASL or HTTP

SAML  http HTTP

To determine whether SSL should be enabled or disabled for your connection, check the hive.server2.use.SSL value in the hive-site.xml file. If the value is true, then you must enable and configure SSL in your connection. If the value is false, then you must disable SSL in your connection.