Copying Data between a Secure and an Insecure Cluster using DistCp and WebHDFS
You can use DistCp and WebHDFS to copy data between a secure cluster and an insecure cluster by doing the following:
- Set ipc.client.fallback-to-simple-auth-allowed to true in core-site.xml on the secure cluster side:
<property> <name>ipc.client.fallback-to-simple-auth-allowed</name> <value>true</value> </property>
- Use commands such as the following from the secure cluster side only:
distcp webhdfs://insecureCluster webhdfs://secureCluster distcp webhdfs://secureCluster webhdfs://insecureCluster
Page generated July 8, 2016.
<< Copying Data Between Two Clusters Using Distcp | ©2016 Cloudera, Inc. All rights reserved | Post-migration Verification >> |
Terms and Conditions Privacy Policy |