Flume# Flume Introduction What is Flume? Architecture Flume Event Flume Agent Data Flow References Flume Environment Installing Flume Configuring Flume Verifying the Installation References Flume Configuration Naming the Components Describing the Source Describing the Sink Describing the Channel Binding the Source and the Sink to the Channel Starting a Flume Agent References Flume Sequence Generator Source Prerequisites Configuring Flume Sequence Generator Source Memory Channel HDFS Sink Example – Configuration File Execution Verifying the HDFS Verifying the Contents of the File Results References Flume NetCat Source Prerequisites Configuring Flume NetCat Source Channel Logger Sink Example Configuration File Execution Passing Data to the Source References Flume Fetching Twitter Data Creating a Twitter Application Starting HDFS Configuring Flume Twitter 1% Firehose Source Setting the classpath Channel HDFS Sink Example – Configuration File Execution Verifying HDFS Tips References