<!DOCTYPE html>
<html>
  <head>

    <meta http-equiv="content-type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <p>Steve is right.  </p>
    <p><br>
    </p>
    <p>When I run `<span style="white-space: pre-wrap">ulimit </span><span
      style="white-space: pre-wrap">-Hn 1048576`, the memory allocation according to `strace` is greatly reduced, and the </span><span
      style="white-space: pre-wrap">nvidia-smi command completes immediately.</span></p>
    <p><span style="white-space: pre-wrap">
</span></p>
    <p><span style="white-space: pre-wrap">2301004 prlimit64(0, RLIMIT_NOFILE, NULL, {rlim_cur=1024, rlim_max=1024*1024}) = 0
2301004 mmap(NULL, 4198400, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f4702800000
2301004 mmap(NULL, 50335744, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f46ff600000
</span></p>
    <p><span style="white-space: pre-wrap">
</span></p>
    <p><span style="white-space: pre-wrap">4GB and 51GB became 4MB and 50MB.  So the memory usage (and initialization overhead?) scales with the max file descriptor limit.
</span></p>
    <p><span style="white-space: pre-wrap">
</span></p>
    <p><span style="white-space: pre-wrap">Thanks,</span></p>
    <p><span style="white-space: pre-wrap">Mark</span></p>
    <p><span style="white-space: pre-wrap">
</span></p>
  </body>
</html>