|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use FileSystem | |
---|---|
org.apache.hadoop.dfs | A distributed implementation of FileSystem . |
org.apache.hadoop.fs | An abstract file system API. |
org.apache.hadoop.fs.s3 | A distributed implementation of FileSystem that uses Amazon S3. |
org.apache.hadoop.io | Generic i/o code for use when reading and writing data to the network, to databases, and to files. |
org.apache.hadoop.mapred | A system for scalable, fault-tolerant, distributed computation over large data collections. |
org.apache.hadoop.mapred.lib | Library of generally useful mappers, reducers, and partitioners. |
org.apache.hadoop.streaming |
Uses of FileSystem in org.apache.hadoop.dfs |
---|
Subclasses of FileSystem in org.apache.hadoop.dfs | |
---|---|
class |
DistributedFileSystem
Implementation of the abstract FileSystem for the DFS system. |
Uses of FileSystem in org.apache.hadoop.fs |
---|
Subclasses of FileSystem in org.apache.hadoop.fs | |
---|---|
class |
ChecksumFileSystem
Abstract Checksumed FileSystem. |
class |
FilterFileSystem
A FilterFileSystem contains
some other file system, which it uses as
its basic file system, possibly transforming
the data along the way or providing additional
functionality. |
class |
InMemoryFileSystem
An implementation of the in-memory filesystem. |
class |
LocalFileSystem
Implement the FileSystem API for the checksumed local filesystem. |
class |
RawLocalFileSystem
Implement the FileSystem API for the raw local filesystem. |
Fields in org.apache.hadoop.fs declared as FileSystem | |
---|---|
protected FileSystem |
FilterFileSystem.fs
|
protected FileSystem |
FsShell.fs
|
Methods in org.apache.hadoop.fs that return FileSystem | |
---|---|
static FileSystem |
FileSystem.get(Configuration conf)
Returns the configured filesystem implementation. |
static FileSystem |
FileSystem.get(URI uri,
Configuration conf)
Returns the FileSystem for this URI's scheme and authority. |
FileSystem |
Path.getFileSystem(Configuration conf)
Return the FileSystem that owns this Path. |
static FileSystem |
FileSystem.getNamed(String name,
Configuration conf)
Deprecated. call #get(URI,Configuration) instead. |
FileSystem |
ChecksumFileSystem.getRawFileSystem()
get the raw file system |
static FileSystem |
FileSystem.parseArgs(String[] argv,
int i,
Configuration conf)
Parse the cmd-line args, starting at i. |
Methods in org.apache.hadoop.fs with parameters of type FileSystem | |
---|---|
static boolean |
FileUtil.copy(File src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy local files to a FileSystem. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
File dst,
boolean deleteSource,
Configuration conf)
Copy FileSystem files to local files. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy files between FileSystems. |
static boolean |
FileUtil.copyMerge(FileSystem srcFS,
Path srcDir,
FileSystem dstFS,
Path dstFile,
boolean deleteSource,
Configuration conf,
String addString)
Copy all files in a directory to one output file (merge). |
static void |
FileUtil.fullyDelete(FileSystem fs,
Path dir)
Recursively delete a directory. |
Constructors in org.apache.hadoop.fs with parameters of type FileSystem | |
---|---|
ChecksumFileSystem(FileSystem fs)
|
|
FilterFileSystem(FileSystem fs)
|
|
LocalFileSystem(FileSystem rawLocalFileSystem)
|
Uses of FileSystem in org.apache.hadoop.fs.s3 |
---|
Subclasses of FileSystem in org.apache.hadoop.fs.s3 | |
---|---|
class |
S3FileSystem
A FileSystem backed by Amazon S3. |
Uses of FileSystem in org.apache.hadoop.io |
---|
Methods in org.apache.hadoop.io with parameters of type FileSystem | |
---|---|
SequenceFile.Writer |
SequenceFile.Sorter.cloneFileAttributes(FileSystem ignoredFileSys,
Path inputFile,
Path outputFile,
Progressable prog)
Deprecated. call #cloneFileAttributes(Path,Path,Progressable) instead |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
Progressable progress)
Construct the preferred type of SequenceFile Writer. |
static void |
MapFile.delete(FileSystem fs,
String name)
Deletes the named map file. |
static long |
MapFile.fix(FileSystem fs,
Path dir,
Class keyClass,
Class valueClass,
boolean dryrun,
Configuration conf)
This method attempts to fix a corrupt MapFile by re-creating its index. |
static void |
MapFile.rename(FileSystem fs,
String oldName,
String newName)
Renames an existing map directory. |
Constructors in org.apache.hadoop.io with parameters of type FileSystem | |
---|---|
ArrayFile.Reader(FileSystem fs,
String file,
Configuration conf)
Construct an array reader for the named file. |
|
ArrayFile.Writer(Configuration conf,
FileSystem fs,
String file,
Class valClass)
Create the named file for values of the named class. |
|
ArrayFile.Writer(Configuration conf,
FileSystem fs,
String file,
Class valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Create the named file for values of the named class. |
|
MapFile.Reader(FileSystem fs,
String dirName,
Configuration conf)
Construct a map reader for the named map. |
|
MapFile.Reader(FileSystem fs,
String dirName,
WritableComparator comparator,
Configuration conf)
Construct a map reader for the named map using the named comparator. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class keyClass,
Class valClass)
Create the named map for keys of the named class. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compress)
Create the named map for keys of the named class. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Create the named map for keys of the named class. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass)
Create the named map using the named key comparator. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress)
Create the named map using the named key comparator. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Create the named map using the named key comparator. |
|
SequenceFile.Reader(FileSystem fs,
Path file,
Configuration conf)
Open the named file. |
|
SequenceFile.Sorter(FileSystem fs,
Class keyClass,
Class valClass,
Configuration conf)
Sort and merge files containing the named classes. |
|
SequenceFile.Sorter(FileSystem fs,
WritableComparator comparator,
Class valClass,
Configuration conf)
Sort and merge using an arbitrary WritableComparator . |
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Create the named file. |
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
Progressable progress,
SequenceFile.Metadata metadata)
Create the named file with write-progress reporter. |
|
SetFile.Reader(FileSystem fs,
String dirName,
Configuration conf)
Construct a set reader for the named set. |
|
SetFile.Reader(FileSystem fs,
String dirName,
WritableComparator comparator,
Configuration conf)
Construct a set reader for the named set using the named comparator. |
|
SetFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class keyClass,
SequenceFile.CompressionType compress)
Deprecated. Create a set naming the element class and compression type. |
|
SetFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
SequenceFile.CompressionType compress)
Deprecated. Create a set naming the element comparator and compression type. |
|
SetFile.Writer(FileSystem fs,
String dirName,
Class keyClass)
Deprecated. Create the named set for keys of the named class. |
Uses of FileSystem in org.apache.hadoop.mapred |
---|
Subclasses of FileSystem in org.apache.hadoop.mapred | |
---|---|
class |
PhasedFileSystem
Deprecated. PhasedFileSystem is no longer used
during speculative execution of tasks. |
Methods in org.apache.hadoop.mapred that return FileSystem | |
---|---|
FileSystem |
TaskTracker.getFileSystem()
Return the DFS filesystem |
FileSystem |
JobClient.getFs()
Get a filesystem handle. |
Methods in org.apache.hadoop.mapred with parameters of type FileSystem | |
---|---|
void |
OutputFormat.checkOutputSpecs(FileSystem ignored,
JobConf job)
Check whether the output specification for a job is appropriate. |
void |
OutputFormatBase.checkOutputSpecs(FileSystem ignored,
JobConf job)
|
static MapFile.Reader[] |
MapFileOutputFormat.getReaders(FileSystem ignored,
Path dir,
Configuration conf)
Open the output generated by this format. |
RecordWriter |
OutputFormat.getRecordWriter(FileSystem ignored,
JobConf job,
String name,
Progressable progress)
Construct a RecordWriter with Progressable. |
abstract RecordWriter |
OutputFormatBase.getRecordWriter(FileSystem ignored,
JobConf job,
String name,
Progressable progress)
|
RecordWriter |
MapFileOutputFormat.getRecordWriter(FileSystem ignored,
JobConf job,
String name,
Progressable progress)
|
RecordWriter |
SequenceFileOutputFormat.getRecordWriter(FileSystem ignored,
JobConf job,
String name,
Progressable progress)
|
RecordWriter |
TextOutputFormat.getRecordWriter(FileSystem ignored,
JobConf job,
String name,
Progressable progress)
|
protected boolean |
TextInputFormat.isSplitable(FileSystem fs,
Path file)
|
protected boolean |
FileInputFormat.isSplitable(FileSystem fs,
Path filename)
Is the given filename splitable? Usually, true, but if the file is stream compressed, it will not be. |
Constructors in org.apache.hadoop.mapred with parameters of type FileSystem | |
---|---|
PhasedFileSystem(FileSystem fs,
JobConf conf)
Deprecated. This Constructor is used to wrap a FileSystem object to a Phased FilsSystem. |
|
PhasedFileSystem(FileSystem fs,
String jobid,
String tipid,
String taskid)
Deprecated. This Constructor is used to wrap a FileSystem object to a Phased FilsSystem. |
Uses of FileSystem in org.apache.hadoop.mapred.lib |
---|
Methods in org.apache.hadoop.mapred.lib with parameters of type FileSystem | |
---|---|
void |
NullOutputFormat.checkOutputSpecs(FileSystem ignored,
JobConf job)
|
RecordWriter |
NullOutputFormat.getRecordWriter(FileSystem ignored,
JobConf job,
String name,
Progressable progress)
|
Uses of FileSystem in org.apache.hadoop.streaming |
---|
Constructors in org.apache.hadoop.streaming with parameters of type FileSystem | |
---|---|
StreamBaseRecordReader(FSDataInputStream in,
FileSplit split,
Reporter reporter,
JobConf job,
FileSystem fs)
|
|
StreamXmlRecordReader(FSDataInputStream in,
FileSplit split,
Reporter reporter,
JobConf job,
FileSystem fs)
|
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |