The Teradata Connector for Hadoop (TDCH) provides scalable, high performance bi-directional data movement between the Teradata database system and Hadoop system.
Some new features included in this release include:
- Support access lock options for import job to improve concurrency. User could choose to use lock for access. If so, the import job will not block export or other operation on same table.
- Support importing data into existing hive partitioned table.
- Support the hive configuration file specified by -hiveconf parameter locates at HDFS or Local File System so that the user can run hive import or export job at any client node or data node in the hadoop cluster (for more information see section 8.5 of the readme file).
Some problems fixed in this release include:
- Refined the exception reported for query-based import. Only split by partition method supports the import source to be a query. The exception will be thrown once non split by partition import job issued with "sourcequery" parameter.
- Fixed path finding bug when the user on client side is different from the login user of hadoop. Before the bug fixing, if the templeton user is different from hadoop user, the exception will occurred.
- Fixed time-out issue when the Teradata database prepares data for mapper. All the mappers will wait for database to return data.
- Fixed time-out issue for internal fast load export job. The mapper with data transfer task finished will wait for other mappers. All the mappers will end at the same time.
- Fixed the limitation that the user should have authorization to access local directory.
- Fixed the case sensitive problems for parameters: -jobtype,-fileformat -method
Need Help?
For more detailed information on the Teradata Connector for Hadoop, please see the Tutorial document in the Teradata Connector for Hadoop Now Available article as well as the README file in the appropriate TDCH download packages. The Tutorial document mainly discusses the TDCH (Command Line Edition). The download packages are for use on commodity hardware. For Teradata appliance hardware, it will be distributed with the appliance. TDCH is supported by Teradata CS in certain situations where the user is a Teradata customer.
For more information about Hadoop Product Management (PM), Teradata employees can go to Teradata Connections Hadoop PM.
