This is the documentation for Cloudera Enterprise 5.8.x. Documentation for other versions is available at Cloudera Documentation.

Copying Data between a Secure and an Insecure Cluster using DistCp and WebHDFS

You can use DistCp and WebHDFS to copy data between a secure cluster and an insecure cluster by doing the following:
  1. Set ipc.client.fallback-to-simple-auth-allowed to true in core-site.xml on the secure cluster side:
    <property> 
      <name>ipc.client.fallback-to-simple-auth-allowed</name>
      <value>true</value> 
    </property>
  2. Use commands such as the following from the secure cluster side only:
    distcp webhdfs://insecureCluster webhdfs://secureCluster 
    distcp webhdfs://secureCluster webhdfs://insecureCluster 
Page generated July 8, 2016.