How to use
createAppDirs
method
in
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor

Best Java code snippets using org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.createAppDirs (Showing top 4 results out of 315)

Add the Codota plugin to your IDE and get smart completions

private void myMethod () {
 LocalDateTime l =new LocalDateTime()
LocalDateTime.now()
DateTimeFormatter formatter;String text;formatter.parseLocalDateTime(text)
Smart code suggestions by Tabnine
}

@Override
public void startLocalizer(Path nmPrivateContainerTokensPath,
  InetSocketAddress nmAddr, String user, String appId, String locId,
  LocalDirsHandlerService dirsHandler)
  throws IOException, InterruptedException {
 List<String> localDirs = dirsHandler.getLocalDirs();
 List<String> logDirs = dirsHandler.getLogDirs();
 
 createUserLocalDirs(localDirs, user);
 createUserCacheDirs(localDirs, user);
 createAppDirs(localDirs, user, appId);
 createAppLogDirs(appId, logDirs, user);
 // randomly choose the local directory
 Path appStorageDir = getWorkingDir(localDirs, user, appId);
 String tokenFn = String.format(ContainerLocalizer.TOKEN_FILE_NAME_FMT, locId);
 Path tokenDst = new Path(appStorageDir, tokenFn);
 copyFile(nmPrivateContainerTokensPath, tokenDst, user);
 LOG.info("Copying from " + nmPrivateContainerTokensPath + " to " + tokenDst);
 FileContext localizerFc = FileContext.getFileContext(
   lfs.getDefaultFileSystem(), getConf());
 localizerFc.setUMask(lfs.getUMask());
 localizerFc.setWorkingDirectory(appStorageDir);
 LOG.info("Localizer CWD set to " + appStorageDir + " = " 
   + localizerFc.getWorkingDirectory());
 ContainerLocalizer localizer =
   new ContainerLocalizer(localizerFc, user, appId, locId, 
     getPaths(localDirs), RecordFactoryProvider.getRecordFactory(getConf()));
 // TODO: DO it over RPC for maintaining similarity?
 localizer.runLocalization(nmAddr);
}

@Override
public void startLocalizer(Path nmPrivateContainerTokensPath,
  InetSocketAddress nmAddr, String user, String appId, String locId,
  LocalDirsHandlerService dirsHandler)
  throws IOException, InterruptedException {
 List<String> localDirs = dirsHandler.getLocalDirs();
 List<String> logDirs = dirsHandler.getLogDirs();
 
 createUserLocalDirs(localDirs, user);
 createUserCacheDirs(localDirs, user);
 createAppDirs(localDirs, user, appId);
 createAppLogDirs(appId, logDirs, user);
 // randomly choose the local directory
 Path appStorageDir = getWorkingDir(localDirs, user, appId);
 String tokenFn = String.format(ContainerLocalizer.TOKEN_FILE_NAME_FMT, locId);
 Path tokenDst = new Path(appStorageDir, tokenFn);
 copyFile(nmPrivateContainerTokensPath, tokenDst, user);
 LOG.info("Copying from " + nmPrivateContainerTokensPath + " to " + tokenDst);
 FileContext localizerFc = FileContext.getFileContext(
   lfs.getDefaultFileSystem(), getConf());
 localizerFc.setUMask(lfs.getUMask());
 localizerFc.setWorkingDirectory(appStorageDir);
 LOG.info("Localizer CWD set to " + appStorageDir + " = " 
   + localizerFc.getWorkingDirectory());
 ContainerLocalizer localizer =
   new ContainerLocalizer(localizerFc, user, appId, locId, 
     getPaths(localDirs), RecordFactoryProvider.getRecordFactory(getConf()));
 // TODO: DO it over RPC for maintaining similarity?
 localizer.runLocalization(nmAddr);
}

createAppDirs(localDirs, user, appId);
createAppLogDirs(appId, logDirs, user);

createAppDirs(localDirs, user, appId, userFolder);
createAppLogDirs(appId, logDirs, user, userFolder);

Javadoc

Initialize the local directories for a particular user.

$local.dir/usercache/$user/appcache/$appid

Popular methods of DefaultContainerExecutor

buildCommandExecutor
Create a new ShellCommandExecutor using the parameters.
containerIsAlive
Returns true if the process with the specified pid is alive.
copyFile
Copy a file using the #lfs FileContext.
createAppLogDirs
Create application log directories on all disks.
createContainerLogDirs
Create application log directories on all disks.
createDir
Use the #lfs FileContext to create the target directory.
createUserCacheDirs
Initialize the local cache directories for a particular user. * $local.dir/usercache/$user *
createUserLocalDirs
Initialize the local directories for a particular user. * * $local.dir/usercache/$user
getAppcacheDir
getApplicationDir
getConf
getDiskFreeSpace

Popular in Java

Parsing JSON documents to java classes using gson
setScale (BigDecimal)
startActivity (Activity)
scheduleAtFixedRate (ScheduledExecutorService)
GridBagLayout (java.awt)
The GridBagLayout class is a flexible layout manager that aligns components vertically and horizonta
FileOutputStream (java.io)
An output stream that writes bytes to a file. If the output file exists, it can be replaced or appen
Thread (java.lang)
A thread is a thread of execution in a program. The Java Virtual Machine allows an application to ha
ConcurrentHashMap (java.util.concurrent)
A plug-in replacement for JDK1.5 java.util.concurrent.ConcurrentHashMap. This version is based on or
BasicDataSource (org.apache.commons.dbcp)
Basic implementation of javax.sql.DataSource that is configured via JavaBeans properties. This is no
IOUtils (org.apache.commons.io)
General IO stream manipulation utilities. This class provides static utility methods for input/outpu
Top 12 Jupyter Notebook Extensions

How to use createAppDirsmethodin org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor

Best Java code snippets using org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.createAppDirs (Showing top 4 results out of 315)

How to use
createAppDirs
method
in
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor