|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use Path | |
---|---|
org.apache.hadoop.conf | Configuration of system parameters. |
org.apache.hadoop.dfs | A distributed implementation of FileSystem . |
org.apache.hadoop.filecache | |
org.apache.hadoop.fs | An abstract file system API. |
org.apache.hadoop.fs.s3 | A distributed implementation of FileSystem that uses Amazon S3. |
org.apache.hadoop.io | Generic i/o code for use when reading and writing data to the network, to databases, and to files. |
org.apache.hadoop.io.compress | |
org.apache.hadoop.mapred | A system for scalable, fault-tolerant, distributed computation over large data collections. |
org.apache.hadoop.util | Common utilities. |
Uses of Path in org.apache.hadoop.conf |
---|
Methods in org.apache.hadoop.conf that return Path | |
---|---|
Path |
Configuration.getLocalPath(String dirsProp,
String path)
Returns a local file under a directory named in dirsProp with the given path. |
Methods in org.apache.hadoop.conf with parameters of type Path | |
---|---|
void |
Configuration.addDefaultResource(Path file)
Add a default resource. |
void |
Configuration.addFinalResource(Path file)
Add a final resource. |
Uses of Path in org.apache.hadoop.dfs |
---|
Methods in org.apache.hadoop.dfs with parameters of type Path | |
---|---|
long |
DistributedFileSystem.getContentLength(Path f)
|
boolean |
DistributedFileSystem.reportChecksumFailure(Path f,
FSDataInputStream in,
long inPos,
FSDataInputStream sums,
long sumsPos)
We need to find the blocks that didn't match. |
Uses of Path in org.apache.hadoop.filecache |
---|
Methods in org.apache.hadoop.filecache that return Path | |
---|---|
static Path[] |
DistributedCache.getArchiveClassPaths(Configuration conf)
Get the archive entries in classpath as an array of Path |
static Path[] |
DistributedCache.getFileClassPaths(Configuration conf)
Get the file entries in classpath as an array of Path |
static Path |
DistributedCache.getLocalCache(URI cache,
Configuration conf,
Path baseDir,
boolean isArchive,
String md5,
Path currentWorkDir)
|
static Path[] |
DistributedCache.getLocalCacheArchives(Configuration conf)
Return the path array of the localized caches |
static Path[] |
DistributedCache.getLocalCacheFiles(Configuration conf)
Return the path array of the localized files |
Methods in org.apache.hadoop.filecache with parameters of type Path | |
---|---|
static void |
DistributedCache.addArchiveToClassPath(Path archive,
Configuration conf)
Add an archive path to the current set of classpath entries. |
static void |
DistributedCache.addFileToClassPath(Path file,
Configuration conf)
Add an file path to the current set of classpath entries It adds the file to cache as well. |
static Path |
DistributedCache.getLocalCache(URI cache,
Configuration conf,
Path baseDir,
boolean isArchive,
String md5,
Path currentWorkDir)
|
Uses of Path in org.apache.hadoop.fs |
---|
Methods in org.apache.hadoop.fs that return Path | |
---|---|
Path |
ChecksumFileSystem.getChecksumFile(Path file)
Return the name of the checksum file associated with a file. |
Path[] |
InMemoryFileSystem.getFiles(PathFilter filter)
|
Path |
LocalDirAllocator.getLocalPathForWrite(String pathStr,
Configuration conf)
Get a path from the local FS. |
Path |
LocalDirAllocator.getLocalPathForWrite(String pathStr,
long size,
Configuration conf)
Get a path from the local FS. |
Path |
LocalDirAllocator.getLocalPathToRead(String pathStr,
Configuration conf)
Get a path from the local FS for reading. |
Path |
Path.getParent()
Returns the parent of a path or null if at root. |
Path |
FilterFileSystem.getWorkingDirectory()
Get the current working directory for the given file system |
Path |
RawLocalFileSystem.getWorkingDirectory()
|
abstract Path |
FileSystem.getWorkingDirectory()
Get the current working directory for the given file system |
Path[] |
FileSystem.globPaths(Path filePattern)
Return all the files that match filePattern and are not checksum files. |
Path[] |
FileSystem.globPaths(Path filePattern,
PathFilter filter)
glob all the file names that matches filePattern and is accepted by filter. |
Path[] |
FilterFileSystem.listPaths(Path f)
List files in a directory. |
Path[] |
RawLocalFileSystem.listPaths(Path f)
|
Path[] |
ChecksumFileSystem.listPaths(Path f)
Filter raw files in the given path using the default checksum filter. |
abstract Path[] |
FileSystem.listPaths(Path f)
List files in a directory. |
Path[] |
ChecksumFileSystem.listPaths(Path[] files)
Filter raw files in the given pathes using the default checksum filter. |
Path[] |
FileSystem.listPaths(Path[] files)
Filter files in the given pathes using the default checksum filter. |
Path[] |
FileSystem.listPaths(Path[] files,
PathFilter filter)
Filter files in a list directories using user-supplied path filter. |
Path[] |
FileSystem.listPaths(Path f,
PathFilter filter)
Filter files in a directory. |
Path |
FilterFileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem. |
Path |
FileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem. |
Path |
FilterFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to. |
Path |
RawLocalFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Path |
InMemoryFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Path |
ChecksumFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
abstract Path |
FileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to. |
Path |
Path.suffix(String suffix)
Adds a suffix to the final name in the path. |
Methods in org.apache.hadoop.fs with parameters of type Path | |
---|---|
boolean |
PathFilter.accept(Path path)
Tests whether or not the specified abstract pathname should be included in a pathname list. |
protected void |
FilterFileSystem.checkPath(Path path)
Check that a Path belongs to this FileSystem. |
protected void |
FileSystem.checkPath(Path path)
Check that a Path belongs to this FileSystem. |
void |
FilterFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Called when we're all done writing to the target. |
void |
RawLocalFileSystem.completeLocalOutput(Path fsWorkingFile,
Path tmpLocalFile)
|
void |
InMemoryFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
void |
ChecksumFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
abstract void |
FileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Called when we're all done writing to the target. |
static boolean |
FileUtil.copy(File src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy local files to a FileSystem. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
File dst,
boolean deleteSource,
Configuration conf)
Copy FileSystem files to local files. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy files between FileSystems. |
void |
LocalFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
|
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is on the local disk. |
void |
RawLocalFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
|
void |
InMemoryFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
copy/move operations are not supported |
void |
ChecksumFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
|
abstract void |
FileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is on the local disk. |
void |
FileSystem.copyFromLocalFile(Path src,
Path dst)
The src file is on the local disk. |
static boolean |
FileUtil.copyMerge(FileSystem srcFS,
Path srcDir,
FileSystem dstFS,
Path dstFile,
boolean deleteSource,
Configuration conf,
String addString)
Copy all files in a directory to one output file (merge). |
void |
LocalFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
|
void |
FilterFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is under FS, and the dst is on the local disk. |
void |
RawLocalFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
|
void |
InMemoryFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
|
void |
ChecksumFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is under FS, and the dst is on the local disk. |
abstract void |
FileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is under FS, and the dst is on the local disk. |
void |
FileSystem.copyToLocalFile(Path src,
Path dst)
The src file is under FS, and the dst is on the local disk. |
void |
ChecksumFileSystem.copyToLocalFile(Path src,
Path dst,
boolean copyCrc)
The src file is under FS, and the dst is on the local disk. |
FSDataOutputStream |
FileSystem.create(Path f)
Opens an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize)
Opens an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize)
Opens an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
FilterFileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
RawLocalFileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
|
FSDataOutputStream |
ChecksumFileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress reporting. |
abstract FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
FileSystem.create(Path f,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
FileSystem.create(Path f,
short replication)
Opens an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
FileSystem.create(Path f,
short replication,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress reporting. |
boolean |
FileSystem.createNewFile(Path f)
Creates the given Path as a brand-new zero-length file. |
boolean |
FilterFileSystem.delete(Path f)
Delete a file |
boolean |
RawLocalFileSystem.delete(Path p)
|
boolean |
ChecksumFileSystem.delete(Path f)
Get rid of Path f, whether a true file or dir. |
abstract boolean |
FileSystem.delete(Path f)
Delete a file |
boolean |
FilterFileSystem.exists(Path f)
Check if exists. |
boolean |
RawLocalFileSystem.exists(Path f)
|
abstract boolean |
FileSystem.exists(Path f)
Check if exists. |
static void |
FileUtil.fullyDelete(FileSystem fs,
Path dir)
Recursively delete a directory. |
long |
FilterFileSystem.getBlockSize(Path f)
Get the block size for a particular file. |
long |
RawLocalFileSystem.getBlockSize(Path filename)
|
abstract long |
FileSystem.getBlockSize(Path f)
Get the block size for a particular file. |
Path |
ChecksumFileSystem.getChecksumFile(Path file)
Return the name of the checksum file associated with a file. |
long |
ChecksumFileSystem.getChecksumFileLength(Path file,
long fileSize)
Return the length of the checksum file given the size of the actual file. |
long |
FileSystem.getContentLength(Path f)
Return the number of bytes of the given path If f is a file, return the size of the file; If f is a directory, return the size of the directory tree |
String[][] |
FilterFileSystem.getFileCacheHints(Path f,
long start,
long len)
Return a 2D array of size 1x1 or greater, containing hostnames where portions of the given file can be found. |
String[][] |
RawLocalFileSystem.getFileCacheHints(Path f,
long start,
long len)
Return 1x1 'localhost' cell if the file exists. |
abstract String[][] |
FileSystem.getFileCacheHints(Path f,
long start,
long len)
Return a 2D array of size 1x1 or greater, containing hostnames where portions of the given file can be found. |
long |
FilterFileSystem.getLength(Path f)
The number of bytes in a file. |
long |
RawLocalFileSystem.getLength(Path f)
|
abstract long |
FileSystem.getLength(Path f)
The number of bytes in a file. |
short |
FilterFileSystem.getReplication(Path src)
Get replication. |
short |
RawLocalFileSystem.getReplication(Path f)
Replication is not supported for the local file system. |
abstract short |
FileSystem.getReplication(Path src)
Get replication. |
Path[] |
FileSystem.globPaths(Path filePattern)
Return all the files that match filePattern and are not checksum files. |
Path[] |
FileSystem.globPaths(Path filePattern,
PathFilter filter)
glob all the file names that matches filePattern and is accepted by filter. |
static boolean |
ChecksumFileSystem.isChecksumFile(Path file)
Return true iff file is a checksum file name. |
boolean |
FilterFileSystem.isDirectory(Path f)
True iff the named path is a directory. |
boolean |
RawLocalFileSystem.isDirectory(Path f)
|
abstract boolean |
FileSystem.isDirectory(Path f)
True iff the named path is a directory. |
boolean |
FileSystem.isFile(Path f)
True iff the named path is a regular file. |
Path[] |
FilterFileSystem.listPaths(Path f)
List files in a directory. |
Path[] |
RawLocalFileSystem.listPaths(Path f)
|
Path[] |
ChecksumFileSystem.listPaths(Path f)
Filter raw files in the given path using the default checksum filter. |
abstract Path[] |
FileSystem.listPaths(Path f)
List files in a directory. |
Path[] |
ChecksumFileSystem.listPaths(Path[] files)
Filter raw files in the given pathes using the default checksum filter. |
Path[] |
FileSystem.listPaths(Path[] files)
Filter files in the given pathes using the default checksum filter. |
Path[] |
FileSystem.listPaths(Path[] files,
PathFilter filter)
Filter files in a list directories using user-supplied path filter. |
Path[] |
FileSystem.listPaths(Path f,
PathFilter filter)
Filter files in a directory. |
void |
FilterFileSystem.lock(Path f,
boolean shared)
Deprecated. FS does not support file locks anymore. |
void |
RawLocalFileSystem.lock(Path p,
boolean shared)
Deprecated. |
void |
ChecksumFileSystem.lock(Path f,
boolean shared)
|
abstract void |
FileSystem.lock(Path f,
boolean shared)
Deprecated. FS does not support file locks anymore. |
Path |
FilterFileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem. |
Path |
FileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem. |
boolean |
FilterFileSystem.mkdirs(Path f)
Make the given file and all non-existent parents into directories. |
boolean |
RawLocalFileSystem.mkdirs(Path f)
Creates the specified directory hierarchy. |
boolean |
ChecksumFileSystem.mkdirs(Path f)
|
abstract boolean |
FileSystem.mkdirs(Path f)
Make the given file and all non-existent parents into directories. |
void |
RawLocalFileSystem.moveFromLocalFile(Path src,
Path dst)
|
void |
FileSystem.moveFromLocalFile(Path src,
Path dst)
The src file is on the local disk. |
void |
FileSystem.moveToLocalFile(Path src,
Path dst)
The src file is under FS, and the dst is on the local disk. |
boolean |
Trash.moveToTrash(Path path)
Move a file or directory to the current trash directory. |
FSDataInputStream |
FileSystem.open(Path f)
Opens an FSDataInputStream at the indicated Path. |
FSDataInputStream |
FilterFileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path. |
FSDataInputStream |
RawLocalFileSystem.open(Path f,
int bufferSize)
|
FSDataInputStream |
ChecksumFileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path. |
abstract FSDataInputStream |
FileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path. |
File |
LocalFileSystem.pathToFile(Path path)
Convert a path to a File. |
File |
RawLocalFileSystem.pathToFile(Path path)
Convert a path to a File. |
void |
FilterFileSystem.release(Path f)
Deprecated. FS does not support file locks anymore. |
void |
RawLocalFileSystem.release(Path p)
Deprecated. |
void |
ChecksumFileSystem.release(Path f)
|
abstract void |
FileSystem.release(Path f)
Deprecated. FS does not support file locks anymore. |
boolean |
FilterFileSystem.rename(Path src,
Path dst)
Renames Path src to Path dst. |
boolean |
RawLocalFileSystem.rename(Path src,
Path dst)
|
boolean |
ChecksumFileSystem.rename(Path src,
Path dst)
Rename files/dirs |
abstract boolean |
FileSystem.rename(Path src,
Path dst)
Renames Path src to Path dst. |
boolean |
LocalFileSystem.reportChecksumFailure(Path p,
FSDataInputStream in,
long inPos,
FSDataInputStream sums,
long sumsPos)
Moves files to a bad file directory on the same device, so that their storage will not be reused. |
boolean |
ChecksumFileSystem.reportChecksumFailure(Path f,
FSDataInputStream in,
long inPos,
FSDataInputStream sums,
long sumsPos)
Report a checksum error to the file system. |
boolean |
InMemoryFileSystem.reserveSpaceWithCheckSum(Path f,
long size)
Register a file with its size. |
boolean |
FilterFileSystem.setReplication(Path src,
short replication)
Set replication for an existing file. |
boolean |
RawLocalFileSystem.setReplication(Path src,
short replication)
Set the replication of the given file |
boolean |
ChecksumFileSystem.setReplication(Path src,
short replication)
Set replication for an existing file. |
abstract boolean |
FileSystem.setReplication(Path src,
short replication)
Set replication for an existing file. |
void |
FilterFileSystem.setWorkingDirectory(Path newDir)
Set the current working directory for the given file system. |
void |
RawLocalFileSystem.setWorkingDirectory(Path newDir)
Set the working directory to the given directory. |
abstract void |
FileSystem.setWorkingDirectory(Path new_dir)
Set the current working directory for the given file system. |
Path |
FilterFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to. |
Path |
RawLocalFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Path |
InMemoryFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Path |
ChecksumFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
abstract Path |
FileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to. |
Constructors in org.apache.hadoop.fs with parameters of type Path | |
---|---|
Path(Path parent,
Path child)
Resolve a child path against a parent path. |
|
Path(Path parent,
String child)
Resolve a child path against a parent path. |
|
Path(String parent,
Path child)
Resolve a child path against a parent path. |
Uses of Path in org.apache.hadoop.fs.s3 |
---|
Methods in org.apache.hadoop.fs.s3 that return Path | |
---|---|
Path |
S3FileSystem.getWorkingDirectory()
|
Path[] |
S3FileSystem.listPaths(Path path)
|
Path |
S3FileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Methods in org.apache.hadoop.fs.s3 that return types with arguments of type Path | |
---|---|
Set<Path> |
FileSystemStore.listDeepSubPaths(Path path)
|
Set<Path> |
FileSystemStore.listSubPaths(Path path)
|
Methods in org.apache.hadoop.fs.s3 with parameters of type Path | |
---|---|
void |
S3FileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
void |
S3FileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
|
void |
S3FileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
|
FSDataOutputStream |
S3FileSystem.create(Path file,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
|
boolean |
S3FileSystem.delete(Path path)
|
void |
FileSystemStore.deleteINode(Path path)
|
boolean |
S3FileSystem.exists(Path path)
|
long |
S3FileSystem.getBlockSize(Path path)
|
String[][] |
S3FileSystem.getFileCacheHints(Path f,
long start,
long len)
Return 1x1 'localhost' cell if the file exists. |
long |
S3FileSystem.getLength(Path path)
|
short |
S3FileSystem.getReplication(Path path)
Replication is not supported for S3 file systems since S3 handles it for us. |
boolean |
FileSystemStore.inodeExists(Path path)
|
boolean |
S3FileSystem.isDirectory(Path path)
|
boolean |
S3FileSystem.isFile(Path path)
|
Set<Path> |
FileSystemStore.listDeepSubPaths(Path path)
|
Path[] |
S3FileSystem.listPaths(Path path)
|
Set<Path> |
FileSystemStore.listSubPaths(Path path)
|
void |
S3FileSystem.lock(Path path,
boolean shared)
Deprecated. |
boolean |
S3FileSystem.mkdirs(Path path)
|
FSDataInputStream |
S3FileSystem.open(Path path,
int bufferSize)
|
void |
S3FileSystem.release(Path path)
Deprecated. |
boolean |
S3FileSystem.rename(Path src,
Path dst)
|
INode |
FileSystemStore.retrieveINode(Path path)
|
boolean |
S3FileSystem.setReplication(Path path,
short replication)
Replication is not supported for S3 file systems since S3 handles it for us. |
void |
S3FileSystem.setWorkingDirectory(Path dir)
|
Path |
S3FileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
void |
FileSystemStore.storeINode(Path path,
INode inode)
|
Uses of Path in org.apache.hadoop.io |
---|
Methods in org.apache.hadoop.io with parameters of type Path | |
---|---|
SequenceFile.Writer |
SequenceFile.Sorter.cloneFileAttributes(FileSystem ignoredFileSys,
Path inputFile,
Path outputFile,
Progressable prog)
Deprecated. call #cloneFileAttributes(Path,Path,Progressable) instead |
SequenceFile.Writer |
SequenceFile.Sorter.cloneFileAttributes(Path inputFile,
Path outputFile,
Progressable prog)
Clones the attributes (like compression of the input file and creates a corresponding Writer |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
Progressable progress)
Construct the preferred type of SequenceFile Writer. |
static long |
MapFile.fix(FileSystem fs,
Path dir,
Class keyClass,
Class valueClass,
boolean dryrun,
Configuration conf)
This method attempts to fix a corrupt MapFile by re-creating its index. |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(List<SequenceFile.Sorter.SegmentDescriptor> segments,
Path tmpDir)
Merges the list of segments of type SegmentDescriptor |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
boolean deleteInputs,
int factor,
Path tmpDir)
Merges the contents of files passed in Path[] |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
boolean deleteInputs,
int factor,
Path tmpDir)
Merges the contents of files passed in Path[] |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
boolean deleteInputs,
Path tmpDir)
Merges the contents of files passed in Path[] using a max factor value that is already set |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
boolean deleteInputs,
Path tmpDir)
Merges the contents of files passed in Path[] using a max factor value that is already set |
void |
SequenceFile.Sorter.merge(Path[] inFiles,
Path outFile)
Merge the provided files. |
void |
SequenceFile.Sorter.merge(Path[] inFiles,
Path outFile)
Merge the provided files. |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
Path tempDir,
boolean deleteInputs)
Merges the contents of files passed in Path[] |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
Path tempDir,
boolean deleteInputs)
Merges the contents of files passed in Path[] |
void |
SequenceFile.Sorter.sort(Path[] inFiles,
Path outFile,
boolean deleteInput)
Perform a file sort from a set of input files into an output file. |
void |
SequenceFile.Sorter.sort(Path[] inFiles,
Path outFile,
boolean deleteInput)
Perform a file sort from a set of input files into an output file. |
void |
SequenceFile.Sorter.sort(Path inFile,
Path outFile)
The backwards compatible interface to sort. |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.sortAndIterate(Path[] inFiles,
Path tempDir,
boolean deleteInput)
Perform a file sort from a set of input files and return an iterator. |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.sortAndIterate(Path[] inFiles,
Path tempDir,
boolean deleteInput)
Perform a file sort from a set of input files and return an iterator. |
Constructors in org.apache.hadoop.io with parameters of type Path | |
---|---|
SequenceFile.Reader(FileSystem fs,
Path file,
Configuration conf)
Open the named file. |
|
SequenceFile.Sorter.SegmentDescriptor(long segmentOffset,
long segmentLength,
Path segmentPathName)
Constructs a segment |
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Create the named file. |
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
Progressable progress,
SequenceFile.Metadata metadata)
Create the named file with write-progress reporter. |
Uses of Path in org.apache.hadoop.io.compress |
---|
Methods in org.apache.hadoop.io.compress with parameters of type Path | |
---|---|
CompressionCodec |
CompressionCodecFactory.getCodec(Path file)
Find the relevant compression codec for the given file based on its filename suffix. |
Uses of Path in org.apache.hadoop.mapred |
---|
Methods in org.apache.hadoop.mapred that return Path | |
---|---|
Path[] |
JobConf.getInputPaths()
|
Path |
JobConf.getLocalPath(String pathString)
Constructs a local file name. |
Path |
JobConf.getOutputPath()
|
Path |
FileSplit.getPath()
The file containing this split's data. |
Path |
JobConf.getSystemDir()
|
Path |
JobConf.getWorkingDirectory()
Get the current working directory for the default file system. |
protected Path[] |
FileInputFormat.listPaths(JobConf job)
List input directories. |
protected Path[] |
SequenceFileInputFormat.listPaths(JobConf job)
|
Path |
PhasedFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Deprecated. |
Methods in org.apache.hadoop.mapred with parameters of type Path | |
---|---|
void |
PhasedFileSystem.abort(Path p)
Deprecated. Aborts a single file. |
void |
JobConf.addInputPath(Path dir)
|
void |
PhasedFileSystem.commit(Path fPath)
Deprecated. Commits a single file file to its final locations as passed in create* methods. |
void |
PhasedFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Deprecated. |
void |
PhasedFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
Deprecated. |
void |
PhasedFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
Deprecated. |
FSDataOutputStream |
PhasedFileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Deprecated. |
boolean |
PhasedFileSystem.delete(Path f)
Deprecated. |
String[][] |
PhasedFileSystem.getFileCacheHints(Path f,
long start,
long len)
Deprecated. |
static SequenceFile.Reader[] |
SequenceFileOutputFormat.getReaders(Configuration conf,
Path dir)
Open the output generated by this format. |
static MapFile.Reader[] |
MapFileOutputFormat.getReaders(FileSystem ignored,
Path dir,
Configuration conf)
Open the output generated by this format. |
protected boolean |
TextInputFormat.isSplitable(FileSystem fs,
Path file)
|
protected boolean |
FileInputFormat.isSplitable(FileSystem fs,
Path filename)
Is the given filename splitable? Usually, true, but if the file is stream compressed, it will not be. |
void |
PhasedFileSystem.lock(Path f,
boolean shared)
Deprecated. |
void |
PhasedFileSystem.release(Path f)
Deprecated. |
boolean |
PhasedFileSystem.rename(Path src,
Path dst)
Deprecated. |
void |
JobConf.setInputPath(Path dir)
|
void |
JobConf.setOutputPath(Path dir)
|
boolean |
PhasedFileSystem.setReplication(Path src,
short replication)
Deprecated. |
void |
JobConf.setWorkingDirectory(Path dir)
Set the current working directory for the default file system |
Path |
PhasedFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Deprecated. |
Constructors in org.apache.hadoop.mapred with parameters of type Path | |
---|---|
FileSplit(Path file,
long start,
long length,
JobConf conf)
Constructs a split. |
|
JobConf(Path config)
Construct a map/reduce configuration. |
Uses of Path in org.apache.hadoop.util |
---|
Methods in org.apache.hadoop.util that return Path | |
---|---|
static Path |
CopyFiles.CopyFilesMapper.makeRelative(Path root,
Path absPath)
Make a path relative with respect to a root path. |
static Path[] |
StringUtils.stringToPath(String[] str)
|
Methods in org.apache.hadoop.util with parameters of type Path | |
---|---|
static Path |
CopyFiles.CopyFilesMapper.makeRelative(Path root,
Path absPath)
Make a path relative with respect to a root path. |
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |