Hadoop* samples included with the Intel® Data Analytics Acceleration Library (Intel® DAAL) are designed to show how to use this library on the Hadoop cluster in a Java application.

Unzip Intel DAAL samples archive to your working directory (<sample_dir>)

System Requirements

You can use Intel® DAAL Hadoop samples on Linux* operating systems. For a detailed list of Intel DAAL hardware and software requirements, refer to Intel DAAL release notes.

Hadoop implementations against which Intel® DAAL has been validated:

Note: Intel® DAAL is expected to work on many more Hadoop distributions as well. Let us know if you have any troubles with the distribution you are using.

Preparation Before Build

Setting Up the Build Environment 

Before you build the sample, you must set certain environment variables that define the location of related libraries. The Intel® DAAL includes the daalvars scripts that you can run to set environment variables

For more information about setting environment variables for different product suites, refer to product user guide 

Build and Run Instructions

On Linux* and OS X*

To build Intel® DAAL Hadoop Java samples, go to the Java Hadoop samples directory:

cd <sample_dir>/java/hadoop

Execute the ./launcher.sh {ia32|intel64} script to run the following algorithms on your Hadoop cluster:

You can manage the list of running samples by changing the Hadoop_samples_list variable in the ./launcher.sh script.

From the {ia32|intel64} parameters, select the one that matches the architecture parameter you provided to the daalvars.sh script. If no parameters are defined, the Intel® 64 architecture is used by default.

The command creates the /Hadoop/<sample_name> and /Hadoop/Libraries directories, builds and runs <sample_name>.class executables.

For each algorithm, the results are stored in the /_results/<sample_name>/part-r-00000 sequence file.

Legal Information

Intel, and the Intel logo are trademarks of Intel Corporation in the U.S. and/or other countries.

*Other names and brands may be claimed as the property of others.

© Copyright 2016, Intel Corporation

Optimization Notice

Intel's compilers may or may not optimize to the same degree for non-Intel microprocessors for optimizations that are not unique to Intel microprocessors. These optimizations include SSE2, SSE3, and SSSE3 instruction sets and other optimizations. Intel does not guarantee the availability, functionality, or effectiveness of any optimization on microprocessors not manufactured by Intel. Microprocessor-dependent optimizations in this product are intended for use with Intel microprocessors. Certain optimizations not specific to Intel microarchitecture are reserved for Intel microprocessors. Please refer to the applicable product User and Reference Guides for more information regarding the specific instruction sets covered by this notice.

Notice revision #20110804