Bitnami Hadoop Stack 3.1.1-1 ==================================== 1. OVERVIEW The Bitnami Project was created to help spread the adoption of freely available, high quality open source web applications. Bitnami aims to make it easier than ever to discover, download and install Open Source software such as document and content management systems, wikis and blogging software. You can learn more about Bitnami at https://bitnami.com The Bitnami Hadoop Stack is an installer that greatly simplifies the installation of Hadoop and runtime dependencies. It includes ready-to-run versions of Apache and Java. It is distributed for free under the Apache 2.0 license. Please see the appendix for the specific licenses of all Open Source components included. You can learn more about Bitnami Stacks at https://bitnami.com/stacks/ 2. FEATURES - Easy to Install Bitnami Stacks are built with one goal in mind: to make it as easy as possible to install open source software. Our installers completely automate the process of installing and configuring all of the software included in each Stack, so you can have everything up and running in just a few clicks. - Independent Bitnami Stacks are completely self-contained, and therefore do not interfere with any software already installed on your system. For example, you can upgrade your system's Apache without fear of 'breaking' your Bitnami Stack. - Integrated By the time you click the 'finish' button on the installer, the whole stack will be integrated, configured and ready to go. - Relocatable Bitnami Stacks can be installed in any directory. This allows you to have multiple instances of the same stack, without them interfering with each other. 3. COMPONENTS Bitnami Apache Hadoop Stack ships with the following software versions: - Hadoop 3.1.1 - Apache 2.4.35 4. REQUIREMENTS To install Bitnami Hadoop Stack you will need: - Intel x86 or compatible processor - Minimum of 4 GB RAM - Minimum of 650 MB hard drive space - TCP/IP protocol support - Compatible operating systems: - An Linux operating system. 5. INSTALLATION The Bitnami Hadoop Stack is distributed as a binary executable installer. It can be downloaded from: https://bitnami.com/stacks/ The downloaded file will be named something similar to: bitnami-hadoop-3.1.1-1-linux-installer.run on Linux or bitnami-hadoop-3.1.1-1-linux-x64-installer.run on Linux 64 bit or On Linux, you will need to give it executable permissions: chmod 755 bitnami-hadoop-3.1.1-1-linux-installer.run To begin the installation process, invoke from a shell or double-click on the file you have downloaded, and you will be greeted by the 'Welcome' screen. Next you will be asked to choose the installation folder. If the destination directory does not exist, it will be created as part of the installation. The default listening port for Apache is 8080 and for Hadoop Resource manager is 8088. Additionally, the default listening port for Hadoop NameNode web UI is 50070, the default listening port for Hadoop Timeline Server is 8111 and the default listening port for Hadoop Job History Server is 10020. If those ports are already in use by other applications, you will be prompted for alternate ports to use. Once the installation process has been completed, you will see the 'Installation Finished' page. You can choose to launch Bitnami Hadoop Stack at this point. If you do so, your default web browser will point you to the Bitnami local site. If you receive an error message during installation, please refer to the Troubleshooting section. The Apache server is connected to the Apache Hadoop server using a Proxy connector. The rest of this guide assumes that you installed Bitnami Hadoop Stack in /home/user/hadoop-3.1.1-1 on Linux and you use port 8080 for Hadoop and 8088 for Hadoop Resource Manager. 6. STARTING AND STOPPING BITNAMI HADOOP STACK To start/stop/restart application on Linux you can use the included ctlscript.sh utility, as shown below: ./ctlscript.sh (start|stop|restart) ./ctlscript.sh (start|stop|restart) apache ./ctlscript.sh (start|stop|restart) hadoop_hdfs ./ctlscript.sh (start|stop|restart) hadoop_yarn ./ctlscript.sh (start|stop|restart) hadoop_timelineserver ./ctlscript.sh (start|stop|restart) hadoop_historyserver start - start the service(s) stop - stop the service(s) restart - restart or start the service(s) Once started, you can open your browser and access the following URL: http://127.0.0.1:8080 If you selected an alternate port during installation, for example 18080, the URL will look like: http://127.0.0.1:18080 7. DIRECTORY STRUCTURE The installation process will create several subfolders under the main installation directory: apache2/: Apache server. hadoop/: Hadoop files. java/: Java SE Development Kit. 8. TROUBLESHOOTING In addition to the resources provided below, we encourage you to post your questions and suggestions at: https://community.bitnami.com/ We also encourage you to sign up for our newsletter, which we'll use to announce new releases and new stacks. To do so, just register at: https://bitnami.com/newsletter. 9.1 Installer # Installer Payload Error If you get the following error while trying to run the installer from the command line: "Installer payload initialization failed. This is likely due to an incomplete or corrupt downloaded file" The installer binary is not complete, likely because the file was not downloaded correctly. You will need to download the file and repeat the installation process. # Installer execution error on Linux If you get the following error while trying to run the installer: "Cannot open bitnami-hadoop-3.1.1-1-linux.run: No application suitable for automatic installation is available for handling this kind of file." In some operatings systems you can change permissions with right click -> properties -> permissions -> execution enable. Or from the command line: $ chmod 755 bitnami-hadoop-3.1.1-1-linux.run 9.2 Hadoop If you find any problem starting Hadoop, the first place you should look at is the error log file that will be created at hadoop-3.1.1-1/hadoop/logs/. There you will likely find useful information to determine what the problem is. For issues not covered in this Quick Start guide, please refer to the Bitnami forums and to the Hadoop documentation, which is located at https://hadoop.apache.org/docs/current/. 10. LICENSES Apache Web Server is distributed under the Apache License v2.0, which is located at http://www.apache.org/licenses/LICENSE-2.0 Hadoop is distributed under the Apache License v2.0, which is located at http://www.apache.org/licenses/LICENSE-2.0 Java and related libraries are distributed under the Oracle Binary Code License Agreement, Version 1.0, wich is located at http://java.com/license.