使用Sqoop与AS400建立SSL安全连接方案咨询

Hey there, let's get your Sqoop import working over a secure SSL connection to AS400. Here's how to adjust your command and key considerations:

1. Update the JDBC Connection String #

First, enable SSL directly in your JDBC URL by adding the sslConnection=true parameter. Depending on your AS400's SSL setup, you might also want to specify the SSL protocol (like TLSv1.2) to ensure compatibility with the server's configuration.

Modified connection URL:

jdbc:as400://as400servername/dbname;sslConnection=true;sslProtocol=TLSv1.2

2. Configure Truststore (If Required) #

If your AS400 uses a self-signed certificate or one not recognized by Java's default truststore, you'll need to point Sqoop to a custom truststore that includes the AS400's certificate. You can set this via the SQOOP_OPTS environment variable before running your import command:

export SQOOP_OPTS="-Djavax.net.ssl.trustStore=/path/to/your/truststore.jks -Djavax.net.ssl.trustStorePassword=your-truststore-password"

3. Full Modified Sqoop Command #

Putting all the pieces together, here's your updated command (with truststore configuration included where needed):

# Set truststore config if using a custom certificate
export SQOOP_OPTS="-Djavax.net.ssl.trustStore=/path/to/truststore.jks -Djavax.net.ssl.trustStorePassword=trustpass"

sqoop import \
--driver com.ibm.as400.access.AS400JDBCDriver \
--connect jdbc:as400://as400servername/dbname;sslConnection=true;sslProtocol=TLSv1.2 \
--username xxxxxxxx \
--password xxxxxxxx \
--query 'SELECT * FROM <table_name> where $CONDITIONS' \
--hive-import \
--hive-table table_name \
--target-dir /user/hdfs/example \
--fields-terminated-by '\01' \
--split-by <id> \
-m 4;

Additional Security Tips #

• Avoid Plaintext Passwords: Replace --password xxxxxxxx with --password-file /path/to/secure-password-file (ensure the file has strict permissions like chmod 400 to restrict access).
• Validate Driver Version: Use a recent version of the IBM AS400 JDBC driver to ensure full SSL support and compatibility.
• Confirm AS400 SSL Setup: Make sure your AS400 server has SSL enabled and is listening on the appropriate port (the default SSL port for AS400 JDBC is 9471, though the driver may auto-negotiate it if not specified).

内容的提问来源于stack exchange，提问作者Anup