Uses of Class
org.apache.hadoop.conf.Configuration

Packages that use Configuration

org.apache.hadoop.conf	Configuration of system parameters.
org.apache.hadoop.dfs	A distributed implementation of FileSystem.
org.apache.hadoop.filecache
org.apache.hadoop.fs	An abstract file system API.
org.apache.hadoop.fs.s3	A distributed implementation of FileSystem that uses Amazon S3.
org.apache.hadoop.io	Generic i/o code for use when reading and writing data to the network, to databases, and to files.
org.apache.hadoop.io.compress
org.apache.hadoop.ipc	Tools to help define network clients and servers.
org.apache.hadoop.mapred	A system for scalable, fault-tolerant, distributed computation over large data collections.
org.apache.hadoop.streaming
org.apache.hadoop.tools
org.apache.hadoop.util	Common utilities.

Uses of Configuration in org.apache.hadoop.conf

Methods in org.apache.hadoop.conf that return Configuration

Configuration	Configurable.getConf() Return the configuration used by this object.
Configuration	Configured.getConf()

Methods in org.apache.hadoop.conf with parameters of type Configuration

void	Configurable.setConf(Configuration conf) Set the configuration to be used by this object.
void	Configured.setConf(Configuration conf)

Constructors in org.apache.hadoop.conf with parameters of type Configuration

Configuration(Configuration other)
A new configuration with the same settings cloned from another.

Configured(Configuration conf)
Construct a Configured.

Uses of Configuration in org.apache.hadoop.dfs

Methods in org.apache.hadoop.dfs with parameters of type Configuration

static void	NameNode.format(Configuration conf) Format a new filesystem.
static DataNode	DataNode.run(Configuration conf) Start datanode daemon.

Constructors in org.apache.hadoop.dfs with parameters of type Configuration

DFSck(Configuration conf)
Filesystem checker.

DistributedFileSystem(InetSocketAddress namenode, Configuration conf)
Deprecated.

NameNode(Configuration conf)
Start NameNode.

NameNode(String bindAddress, int port, Configuration conf)
Create a NameNode at the specified location and start it.

NamenodeFsck(Configuration conf, NameNode nn, Map<String,String[]> pmap, javax.servlet.http.HttpServletResponse response)
Filesystem checker.

SecondaryNameNode(Configuration conf)
Create a connection to the primary namenode.

Uses of Configuration in org.apache.hadoop.filecache

Methods in org.apache.hadoop.filecache with parameters of type Configuration

static void	DistributedCache.addArchiveToClassPath(Path archive, Configuration conf) Add an archive path to the current set of classpath entries.
static void	DistributedCache.addCacheArchive(URI uri, Configuration conf) Add a archives to be localized to the conf
static void	DistributedCache.addCacheFile(URI uri, Configuration conf) Add a file to be localized to the conf
static void	DistributedCache.addFileToClassPath(Path file, Configuration conf) Add an file path to the current set of classpath entries It adds the file to cache as well.
static void	DistributedCache.createAllSymlink(Configuration conf, File jobCacheDir, File workDir) This method create symlinks for all files in a given dir in another directory
static byte[]	DistributedCache.createMD5(URI cache, Configuration conf) Returns md5 of the checksum file for a given dfs file.
static void	DistributedCache.createSymlink(Configuration conf) This method allows you to create symlinks in the current working directory of the task to all the cache files/archives
static Path[]	DistributedCache.getArchiveClassPaths(Configuration conf) Get the archive entries in classpath as an array of Path
static String[]	DistributedCache.getArchiveMd5(Configuration conf) Get the md5 checksums of the archives
static URI[]	DistributedCache.getCacheArchives(Configuration conf) Get cache archives set in the Configuration
static URI[]	DistributedCache.getCacheFiles(Configuration conf) Get cache files set in the Configuration
static Path[]	DistributedCache.getFileClassPaths(Configuration conf) Get the file entries in classpath as an array of Path
static String[]	DistributedCache.getFileMd5(Configuration conf) Get the md5 checksums of the files
static Path	DistributedCache.getLocalCache(URI cache, Configuration conf, Path baseDir, boolean isArchive, String md5, Path currentWorkDir)
static Path[]	DistributedCache.getLocalCacheArchives(Configuration conf) Return the path array of the localized caches
static Path[]	DistributedCache.getLocalCacheFiles(Configuration conf) Return the path array of the localized files
static boolean	DistributedCache.getSymlink(Configuration conf) This method checks to see if symlinks are to be create for the localized cache files in the current working directory
static void	DistributedCache.releaseCache(URI cache, Configuration conf) This is the opposite of getlocalcache.
static void	DistributedCache.setArchiveMd5(Configuration conf, String md5) This is to check the md5 of the archives to be localized
static void	DistributedCache.setCacheArchives(URI[] archives, Configuration conf) Set the configuration with the given set of archives
static void	DistributedCache.setCacheFiles(URI[] files, Configuration conf) Set the configuration with the given set of files
static void	DistributedCache.setFileMd5(Configuration conf, String md5) This is to check the md5 of the files to be localized
static void	DistributedCache.setLocalArchives(Configuration conf, String str) Set the conf to contain the location for localized archives
static void	DistributedCache.setLocalFiles(Configuration conf, String str) Set the conf to contain the location for localized files

Uses of Configuration in org.apache.hadoop.fs

Methods in org.apache.hadoop.fs that return Configuration

Configuration

FilterFileSystem.getConf()

Methods in org.apache.hadoop.fs with parameters of type Configuration

static boolean	FileUtil.copy(File src, FileSystem dstFS, Path dst, boolean deleteSource, Configuration conf) Copy local files to a FileSystem.
static boolean	FileUtil.copy(FileSystem srcFS, Path src, File dst, boolean deleteSource, Configuration conf) Copy FileSystem files to local files.
static boolean	FileUtil.copy(FileSystem srcFS, Path src, FileSystem dstFS, Path dst, boolean deleteSource, Configuration conf) Copy files between FileSystems.
void	FsShell.copy(String srcf, String dstf, Configuration conf) Copy files that match the file pattern srcf to a destination file.
static boolean	FileUtil.copyMerge(FileSystem srcFS, Path srcDir, FileSystem dstFS, Path dstFile, boolean deleteSource, Configuration conf, String addString) Copy all files in a directory to one output file (merge).
static FileSystem	FileSystem.get(Configuration conf) Returns the configured filesystem implementation.
static FileSystem	FileSystem.get(URI uri, Configuration conf) Returns the FileSystem for this URI's scheme and authority.
FileSystem	Path.getFileSystem(Configuration conf) Return the FileSystem that owns this Path.
static LocalFileSystem	FileSystem.getLocal(Configuration conf) Get the local file syste
Path	LocalDirAllocator.getLocalPathForWrite(String pathStr, Configuration conf) Get a path from the local FS.
Path	LocalDirAllocator.getLocalPathForWrite(String pathStr, long size, Configuration conf) Get a path from the local FS.
Path	LocalDirAllocator.getLocalPathToRead(String pathStr, Configuration conf) Get a path from the local FS for reading.
static FileSystem	FileSystem.getNamed(String name, Configuration conf) Deprecated. call #get(URI,Configuration) instead.
void	FilterFileSystem.initialize(URI name, Configuration conf) Called after a new FileSystem instance is constructed.
void	RawLocalFileSystem.initialize(URI uri, Configuration conf)
abstract void	FileSystem.initialize(URI name, Configuration conf) Called after a new FileSystem instance is constructed.
static FileSystem	FileSystem.parseArgs(String[] argv, int i, Configuration conf) Parse the cmd-line args, starting at i.

Constructors in org.apache.hadoop.fs with parameters of type Configuration

DF(File path, Configuration conf)

FSDataInputStream(FSInputStream in, Configuration conf)

FSDataOutputStream(OutputStream out, Configuration conf)

InMemoryFileSystem(URI uri, Configuration conf)

Trash(Configuration conf)
Construct a trash can accessor.

Uses of Configuration in org.apache.hadoop.fs.s3

Methods in org.apache.hadoop.fs.s3 with parameters of type Configuration

void	FileSystemStore.initialize(URI uri, Configuration conf)
void	S3FileSystem.initialize(URI uri, Configuration conf)
void	MigrationTool.initialize(URI uri, Configuration conf)

Uses of Configuration in org.apache.hadoop.io

Methods in org.apache.hadoop.io that return Configuration

Configuration

ObjectWritable.getConf()

Methods in org.apache.hadoop.io with parameters of type Configuration

static SequenceFile.Writer	SequenceFile.createWriter(Configuration conf, FSDataOutputStream out, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, CompressionCodec codec) Construct the preferred type of 'raw' SequenceFile Writer.
static SequenceFile.Writer	SequenceFile.createWriter(Configuration conf, FSDataOutputStream out, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, CompressionCodec codec, SequenceFile.Metadata metadata) Construct the preferred type of 'raw' SequenceFile Writer.
static SequenceFile.Writer	SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass) Construct the preferred type of SequenceFile Writer.
static SequenceFile.Writer	SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType) Construct the preferred type of SequenceFile Writer.
static SequenceFile.Writer	SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, CompressionCodec codec) Construct the preferred type of SequenceFile Writer.
static SequenceFile.Writer	SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, CompressionCodec codec, Progressable progress) Construct the preferred type of SequenceFile Writer.
static SequenceFile.Writer	SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, CompressionCodec codec, Progressable progress, SequenceFile.Metadata metadata) Construct the preferred type of SequenceFile Writer.
static SequenceFile.Writer	SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, Progressable progress) Construct the preferred type of SequenceFile Writer.
static long	MapFile.fix(FileSystem fs, Path dir, Class keyClass, Class valueClass, boolean dryrun, Configuration conf) This method attempts to fix a corrupt MapFile by re-creating its index.
static Class	WritableName.getClass(String name, Configuration conf) Return the class for a name.
static SequenceFile.CompressionType	SequenceFile.getCompressionType(Configuration job) Get the compression type for the reduce outputs
static Writable	WritableFactories.newInstance(Class c, Configuration conf) Create a new instance of a class with a defined factory.
static Object	ObjectWritable.readObject(DataInput in, Configuration conf) Read a Writable, String, primitive type, or an array of the preceding.
static Object	ObjectWritable.readObject(DataInput in, ObjectWritable objectWritable, Configuration conf) Read a Writable, String, primitive type, or an array of the preceding.
static void	SequenceFile.setCompressionType(Configuration job, SequenceFile.CompressionType val) Set the compression type for sequence files.
void	ObjectWritable.setConf(Configuration conf)
static void	ObjectWritable.writeObject(DataOutput out, Object instance, Class declaredClass, Configuration conf) Write a Writable, String, primitive type, or an array of the preceding.

Constructors in org.apache.hadoop.io with parameters of type Configuration

ArrayFile.Reader(FileSystem fs, String file, Configuration conf)
Construct an array reader for the named file.

ArrayFile.Writer(Configuration conf, FileSystem fs, String file, Class valClass)
Create the named file for values of the named class.

ArrayFile.Writer(Configuration conf, FileSystem fs, String file, Class valClass, SequenceFile.CompressionType compress, Progressable progress)
Create the named file for values of the named class.

MapFile.Reader(FileSystem fs, String dirName, Configuration conf)
Construct a map reader for the named map.

MapFile.Reader(FileSystem fs, String dirName, WritableComparator comparator, Configuration conf)
Construct a map reader for the named map using the named comparator.

MapFile.Writer(Configuration conf, FileSystem fs, String dirName, Class keyClass, Class valClass)
Create the named map for keys of the named class.

MapFile.Writer(Configuration conf, FileSystem fs, String dirName, Class keyClass, Class valClass, SequenceFile.CompressionType compress)
Create the named map for keys of the named class.

MapFile.Writer(Configuration conf, FileSystem fs, String dirName, Class keyClass, Class valClass, SequenceFile.CompressionType compress, Progressable progress)
Create the named map for keys of the named class.

MapFile.Writer(Configuration conf, FileSystem fs, String dirName, WritableComparator comparator, Class valClass)
Create the named map using the named key comparator.

MapFile.Writer(Configuration conf, FileSystem fs, String dirName, WritableComparator comparator, Class valClass, SequenceFile.CompressionType compress)
Create the named map using the named key comparator.

MapFile.Writer(Configuration conf, FileSystem fs, String dirName, WritableComparator comparator, Class valClass, SequenceFile.CompressionType compress, Progressable progress)
Create the named map using the named key comparator.

SequenceFile.Reader(FileSystem fs, Path file, Configuration conf)
Open the named file.

SequenceFile.Sorter(FileSystem fs, Class keyClass, Class valClass, Configuration conf)
Sort and merge files containing the named classes.

SequenceFile.Sorter(FileSystem fs, WritableComparator comparator, Class valClass, Configuration conf)
Sort and merge using an arbitrary WritableComparator.

SequenceFile.Writer(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass)
Create the named file.

SequenceFile.Writer(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, Progressable progress, SequenceFile.Metadata metadata)
Create the named file with write-progress reporter.

SetFile.Reader(FileSystem fs, String dirName, Configuration conf)
Construct a set reader for the named set.

SetFile.Reader(FileSystem fs, String dirName, WritableComparator comparator, Configuration conf)
Construct a set reader for the named set using the named comparator.

SetFile.Writer(Configuration conf, FileSystem fs, String dirName, Class keyClass, SequenceFile.CompressionType compress)
Deprecated. Create a set naming the element class and compression type.

SetFile.Writer(Configuration conf, FileSystem fs, String dirName, WritableComparator comparator, SequenceFile.CompressionType compress)
Deprecated. Create a set naming the element comparator and compression type.

Uses of Configuration in org.apache.hadoop.io.compress

Methods in org.apache.hadoop.io.compress that return Configuration

Configuration	LzoCodec.getConf()
Configuration	DefaultCodec.getConf()

Methods in org.apache.hadoop.io.compress with parameters of type Configuration

static List<Class>	CompressionCodecFactory.getCodecClasses(Configuration conf) Get the list of codecs listed in the configuration
static void	CompressionCodecFactory.setCodecClasses(Configuration conf, List<Class> classes) Sets a list of codec classes in the configuration.
void	LzoCodec.setConf(Configuration conf)
void	DefaultCodec.setConf(Configuration conf)

Constructors in org.apache.hadoop.io.compress with parameters of type Configuration

CompressionCodecFactory(Configuration conf)
Find the codecs specified in the config value io.compression.codecs and register them.

Uses of Configuration in org.apache.hadoop.ipc

Methods in org.apache.hadoop.ipc with parameters of type Configuration

static Object[]	RPC.call(Method method, Object[][] params, InetSocketAddress[] addrs, Configuration conf) Expert: Make multiple, parallel calls to a set of servers.
static VersionedProtocol	RPC.getProxy(Class protocol, long clientVersion, InetSocketAddress addr, Configuration conf) Construct a client-side proxy object that implements the named protocol, talking to a server at the named address.
static RPC.Server	RPC.getServer(Object instance, String bindAddress, int port, Configuration conf) Construct a server for a protocol implementation instance listening on a port and address.
static RPC.Server	RPC.getServer(Object instance, String bindAddress, int port, int numHandlers, boolean verbose, Configuration conf) Construct a server for a protocol implementation instance listening on a port and address.
static VersionedProtocol	RPC.waitForProxy(Class protocol, long clientVersion, InetSocketAddress addr, Configuration conf)

Constructors in org.apache.hadoop.ipc with parameters of type Configuration

Client(Class valueClass, Configuration conf)
Construct an IPC client whose values are of the given Writable class.

RPC.Server(Object instance, Configuration conf, String bindAddress, int port)
Construct an RPC server.

RPC.Server(Object instance, Configuration conf, String bindAddress, int port, int numHandlers, boolean verbose)
Construct an RPC server.

Server(String bindAddress, int port, Class paramClass, int handlerCount, Configuration conf)
Constructs a server listening on the named port and address.

Uses of Configuration in org.apache.hadoop.mapred

Subclasses of Configuration in org.apache.hadoop.mapred

class

JobConf A map/reduce job configuration.

Fields in org.apache.hadoop.mapred declared as Configuration

protected Configuration

SequenceFileRecordReader.conf

Methods in org.apache.hadoop.mapred that return Configuration

Configuration

SequenceFileInputFilter.FilterBase.getConf()

Methods in org.apache.hadoop.mapred with parameters of type Configuration

static InetSocketAddress	JobTracker.getAddress(Configuration conf)
static SequenceFile.Reader[]	SequenceFileOutputFormat.getReaders(Configuration conf, Path dir) Open the output generated by this format.
static MapFile.Reader[]	MapFileOutputFormat.getReaders(FileSystem ignored, Path dir, Configuration conf) Open the output generated by this format.
void	SequenceFileInputFilter.RegexFilter.setConf(Configuration conf) configure the Filter by checking the configuration
void	SequenceFileInputFilter.PercentFilter.setConf(Configuration conf) configure the filter by checking the configuration
void	SequenceFileInputFilter.MD5Filter.setConf(Configuration conf) configure the filter according to configuration
static void	SequenceFileInputFilter.setFilterClass(Configuration conf, Class filterClass) set the filter class
static void	SequenceFileInputFilter.PercentFilter.setFrequency(Configuration conf, int frequency) set the frequency and stores it in conf
static void	SequenceFileInputFilter.MD5Filter.setFrequency(Configuration conf, int frequency) set the filtering frequency in configuration
static void	SequenceFileInputFilter.RegexFilter.setPattern(Configuration conf, String regex) Define the filtering regex and stores it in conf
static void	JobTracker.startTracker(Configuration conf) Start the JobTracker with given configuration.

Constructors in org.apache.hadoop.mapred with parameters of type Configuration

JobClient(Configuration conf)

JobClient(InetSocketAddress jobTrackAddr, Configuration conf)
Build a job client, connect to the indicated job tracker.

JobConf(Configuration conf)
Construct a map/reduce job configuration.

JobConf(Configuration conf, Class exampleClass)
Construct a map/reduce job configuration.

KeyValueLineRecordReader(Configuration job, FileSplit split)

LineRecordReader(Configuration job, FileSplit split)

SequenceFileAsTextRecordReader(Configuration conf, FileSplit split)

SequenceFileRecordReader(Configuration conf, FileSplit split)

Uses of Configuration in org.apache.hadoop.streaming

Fields in org.apache.hadoop.streaming declared as Configuration

protected Configuration

StreamJob.config_

Constructors in org.apache.hadoop.streaming with parameters of type Configuration

StreamLineRecordReader(Configuration job, FileSplit split)
Deprecated.

StreamSequenceRecordReader(Configuration conf, FileSplit split)
Deprecated.

Uses of Configuration in org.apache.hadoop.tools

Methods in org.apache.hadoop.tools that return Configuration

Configuration

Logalyzer.LogComparator.getConf()

Methods in org.apache.hadoop.tools with parameters of type Configuration

void	Logalyzer.LogComparator.setConf(Configuration conf)

Uses of Configuration in org.apache.hadoop.util

Fields in org.apache.hadoop.util declared as Configuration

Configuration

ToolBase.conf

Methods in org.apache.hadoop.util that return Configuration

Configuration

ToolBase.getConf()

Methods in org.apache.hadoop.util with parameters of type Configuration

abstract void	CopyFiles.CopyFilesMapper.cleanup(Configuration conf, JobConf jobConf, String srcPath, String destPath) Interface to cleanup *distcp* specific resources
void	CopyFiles.FSCopyFilesMapper.cleanup(Configuration conf, JobConf jobConf, String srcPath, String destPath)
void	CopyFiles.HTTPCopyFilesMapper.cleanup(Configuration conf, JobConf jobConf, String srcPath, String destPath)
static void	CopyFiles.copy(Configuration conf, String srcPath, String destPath, boolean srcAsList, boolean ignoreReadFailures) Driver to copy srcPath to destPath depending on required protocol.
int	ToolBase.doMain(Configuration conf, String[] args) Work as a main program: execute a command and handle exception if any
static Object	ReflectionUtils.newInstance(Class<?> theClass, Configuration conf) Create an object for the given class and initialize it from conf
void	ToolBase.setConf(Configuration conf)
void	CopyFiles.setConf(Configuration conf)
static void	ReflectionUtils.setConf(Object theObject, Configuration conf) Check and set 'configuration' if necessary.
abstract void	CopyFiles.CopyFilesMapper.setup(Configuration conf, JobConf jobConf, String[] srcPaths, String destPath, boolean ignoreReadFailures) Interface to initialize *distcp* specific map tasks.
void	CopyFiles.FSCopyFilesMapper.setup(Configuration conf, JobConf jobConf, String[] srcPaths, String destPath, boolean ignoreReadFailures) Initialize DFSCopyFileMapper specific job-configuration.
void	CopyFiles.HTTPCopyFilesMapper.setup(Configuration conf, JobConf jobConf, String[] srcPaths, String destPath, boolean ignoreReadFailures) Initialize HTTPCopyFileMapper specific job.