501_environment_variables.doxy 46 KB

1234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253545556575859606162636465666768697071727374757677787980818283848586878889909192939495969798991001011021031041051061071081091101111121131141151161171181191201211221231241251261271281291301311321331341351361371381391401411421431441451461471481491501511521531541551561571581591601611621631641651661671681691701711721731741751761771781791801811821831841851861871881891901911921931941951961971981992002012022032042052062072082092102112122132142152162172182192202212222232242252262272282292302312322332342352362372382392402412422432442452462472482492502512522532542552562572582592602612622632642652662672682692702712722732742752762772782792802812822832842852862872882892902912922932942952962972982993003013023033043053063073083093103113123133143153163173183193203213223233243253263273283293303313323333343353363373383393403413423433443453463473483493503513523533543553563573583593603613623633643653663673683693703713723733743753763773783793803813823833843853863873883893903913923933943953963973983994004014024034044054064074084094104114124134144154164174184194204214224234244254264274284294304314324334344354364374384394404414424434444454464474484494504514524534544554564574584594604614624634644654664674684694704714724734744754764774784794804814824834844854864874884894904914924934944954964974984995005015025035045055065075085095105115125135145155165175185195205215225235245255265275285295305315325335345355365375385395405415425435445455465475485495505515525535545555565575585595605615625635645655665675685695705715725735745755765775785795805815825835845855865875885895905915925935945955965975985996006016026036046056066076086096106116126136146156166176186196206216226236246256266276286296306316326336346356366376386396406416426436446456466476486496506516526536546556566576586596606616626636646656666676686696706716726736746756766776786796806816826836846856866876886896906916926936946956966976986997007017027037047057067077087097107117127137147157167177187197207217227237247257267277287297307317327337347357367377387397407417427437447457467477487497507517527537547557567577587597607617627637647657667677687697707717727737747757767777787797807817827837847857867877887897907917927937947957967977987998008018028038048058068078088098108118128138148158168178188198208218228238248258268278288298308318328338348358368378388398408418428438448458468478488498508518528538548558568578588598608618628638648658668678688698708718728738748758768778788798808818828838848858868878888898908918928938948958968978988999009019029039049059069079089099109119129139149159169179189199209219229239249259269279289299309319329339349359369379389399409419429439449459469479489499509519529539549559569579589599609619629639649659669679689699709719729739749759769779789799809819829839849859869879889899909919929939949959969979989991000100110021003100410051006100710081009101010111012101310141015101610171018101910201021102210231024102510261027102810291030103110321033103410351036103710381039104010411042104310441045104610471048104910501051105210531054105510561057105810591060106110621063106410651066106710681069107010711072107310741075107610771078107910801081108210831084108510861087108810891090109110921093109410951096109710981099110011011102110311041105110611071108110911101111111211131114111511161117111811191120112111221123112411251126112711281129113011311132113311341135113611371138113911401141114211431144114511461147114811491150115111521153115411551156115711581159116011611162116311641165116611671168116911701171117211731174117511761177117811791180118111821183118411851186118711881189119011911192119311941195119611971198119912001201120212031204120512061207120812091210121112121213121412151216121712181219122012211222122312241225122612271228122912301231123212331234123512361237123812391240124112421243124412451246124712481249125012511252125312541255125612571258125912601261126212631264126512661267126812691270127112721273127412751276127712781279128012811282128312841285128612871288128912901291129212931294129512961297129812991300130113021303130413051306130713081309131013111312131313141315131613171318131913201321132213231324132513261327132813291330
  1. /* StarPU --- Runtime system for heterogeneous multicore architectures.
  2. *
  3. * Copyright (C) 2011-2013,2015-2017 Inria
  4. * Copyright (C) 2010-2019 CNRS
  5. * Copyright (C) 2009-2011,2013-2019 Université de Bordeaux
  6. * Copyright (C) 2016 Uppsala University
  7. *
  8. * StarPU is free software; you can redistribute it and/or modify
  9. * it under the terms of the GNU Lesser General Public License as published by
  10. * the Free Software Foundation; either version 2.1 of the License, or (at
  11. * your option) any later version.
  12. *
  13. * StarPU is distributed in the hope that it will be useful, but
  14. * WITHOUT ANY WARRANTY; without even the implied warranty of
  15. * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
  16. *
  17. * See the GNU Lesser General Public License in COPYING.LGPL for more details.
  18. */
  19. /*! \page ExecutionConfigurationThroughEnvironmentVariables Execution Configuration Through Environment Variables
  20. The behavior of the StarPU library and tools may be tuned thanks to
  21. the following environment variables.
  22. \section ConfiguringWorkers Configuring Workers
  23. <dl>
  24. <dt>STARPU_NCPU</dt>
  25. <dd>
  26. \anchor STARPU_NCPU
  27. \addindex __env__STARPU_NCPU
  28. Specify the number of CPU workers (thus not including workers
  29. dedicated to control accelerators). Note that by default, StarPU will
  30. not allocate more CPU workers than there are physical CPUs, and that
  31. some CPUs are used to control the accelerators.
  32. </dd>
  33. <dt>STARPU_RESERVE_NCPU</dt>
  34. <dd>
  35. \anchor STARPU_RESERVE_NCPU
  36. \addindex __env__STARPU_RESERVE_NCPU
  37. Specify the number of CPU cores that should not be used by StarPU, so the
  38. application can use starpu_get_next_bindid() and starpu_bind_thread_on() to bind
  39. its own threads.
  40. This option is ignored if \ref STARPU_NCPU or starpu_conf::ncpus is set.
  41. </dd>
  42. <dt>STARPU_NCPUS</dt>
  43. <dd>
  44. \anchor STARPU_NCPUS
  45. \addindex __env__STARPU_NCPUS
  46. This variable is deprecated. You should use \ref STARPU_NCPU.
  47. </dd>
  48. <dt>STARPU_NCUDA</dt>
  49. <dd>
  50. \anchor STARPU_NCUDA
  51. \addindex __env__STARPU_NCUDA
  52. Specify the number of CUDA devices that StarPU can use. If
  53. \ref STARPU_NCUDA is lower than the number of physical devices, it is
  54. possible to select which CUDA devices should be used by the means of the
  55. environment variable \ref STARPU_WORKERS_CUDAID. By default, StarPU will
  56. create as many CUDA workers as there are CUDA devices.
  57. </dd>
  58. <dt>STARPU_NWORKER_PER_CUDA</dt>
  59. <dd>
  60. \anchor STARPU_NWORKER_PER_CUDA
  61. \addindex __env__STARPU_NWORKER_PER_CUDA
  62. Specify the number of workers per CUDA device, and thus the number of kernels
  63. which will be concurrently running on the devices. The default value is 1.
  64. </dd>
  65. <dt>STARPU_CUDA_THREAD_PER_WORKER</dt>
  66. <dd>
  67. \anchor STARPU_CUDA_THREAD_PER_WORKER
  68. \addindex __env__STARPU_CUDA_THREAD_PER_WORKER
  69. Specify whether the cuda driver should use one thread per stream (1) or to use
  70. a single thread to drive all the streams of the device or all devices (0), and
  71. \ref STARPU_CUDA_THREAD_PER_DEV determines whether is it one thread per device or one
  72. thread for all devices. The default value is 0. Setting it to 1 is contradictory
  73. with setting \ref STARPU_CUDA_THREAD_PER_DEV.
  74. </dd>
  75. <dt>STARPU_CUDA_THREAD_PER_DEV</dt>
  76. <dd>
  77. \anchor STARPU_CUDA_THREAD_PER_DEV
  78. \addindex __env__STARPU_CUDA_THREAD_PER_DEV
  79. Specify whether the cuda driver should use one thread per device (1) or to use a
  80. single thread to drive all the devices (0). The default value is 1. It does not
  81. make sense to set this variable if \ref STARPU_CUDA_THREAD_PER_WORKER is set to to 1
  82. (since \ref STARPU_CUDA_THREAD_PER_DEV is then meaningless).
  83. </dd>
  84. <dt>STARPU_CUDA_PIPELINE</dt>
  85. <dd>
  86. \anchor STARPU_CUDA_PIPELINE
  87. \addindex __env__STARPU_CUDA_PIPELINE
  88. Specify how many asynchronous tasks are submitted in advance on CUDA
  89. devices. This for instance permits to overlap task management with the execution
  90. of previous tasks, but it also allows concurrent execution on Fermi cards, which
  91. otherwise bring spurious synchronizations. The default is 2. Setting the value to 0 forces a synchronous
  92. execution of all tasks.
  93. </dd>
  94. <dt>STARPU_NOPENCL</dt>
  95. <dd>
  96. \anchor STARPU_NOPENCL
  97. \addindex __env__STARPU_NOPENCL
  98. OpenCL equivalent of the environment variable \ref STARPU_NCUDA.
  99. </dd>
  100. <dt>STARPU_OPENCL_PIPELINE</dt>
  101. <dd>
  102. \anchor STARPU_OPENCL_PIPELINE
  103. \addindex __env__STARPU_OPENCL_PIPELINE
  104. Specify how many asynchronous tasks are submitted in advance on OpenCL
  105. devices. This for instance permits to overlap task management with the execution
  106. of previous tasks, but it also allows concurrent execution on Fermi cards, which
  107. otherwise bring spurious synchronizations. The default is 2. Setting the value to 0 forces a synchronous
  108. execution of all tasks.
  109. </dd>
  110. <dt>STARPU_OPENCL_ON_CPUS</dt>
  111. <dd>
  112. \anchor STARPU_OPENCL_ON_CPUS
  113. \addindex __env__STARPU_OPENCL_ON_CPUS
  114. By default, the OpenCL driver only enables GPU and accelerator
  115. devices. By setting the environment variable \ref STARPU_OPENCL_ON_CPUS
  116. to 1, the OpenCL driver will also enable CPU devices.
  117. </dd>
  118. <dt>STARPU_OPENCL_ONLY_ON_CPUS</dt>
  119. <dd>
  120. \anchor STARPU_OPENCL_ONLY_ON_CPUS
  121. \addindex __env__STARPU_OPENCL_ONLY_ON_CPUS
  122. By default, the OpenCL driver enables GPU and accelerator
  123. devices. By setting the environment variable \ref STARPU_OPENCL_ONLY_ON_CPUS
  124. to 1, the OpenCL driver will ONLY enable CPU devices.
  125. </dd>
  126. <dt>STARPU_NMIC</dt>
  127. <dd>
  128. \anchor STARPU_NMIC
  129. \addindex __env__STARPU_NMIC
  130. MIC equivalent of the environment variable \ref STARPU_NCUDA, i.e. the number of
  131. MIC devices to use.
  132. </dd>
  133. <dt>STARPU_NMICTHREADS</dt>
  134. <dd>
  135. \anchor STARPU_NMICTHREADS
  136. \addindex __env__STARPU_NMICTHREADS
  137. Number of threads to use on the MIC devices.
  138. </dd>
  139. <dt>STARPU_NMPI_MS</dt>
  140. <dd>
  141. \anchor STARPU_NMPI_MS
  142. \addindex __env__STARPU_NMPI_MS
  143. MPI Master Slave equivalent of the environment variable \ref STARPU_NCUDA, i.e. the number of
  144. MPI Master Slave devices to use.
  145. </dd>
  146. <dt>STARPU_NMPIMSTHREADS</dt>
  147. <dd>
  148. \anchor STARPU_NMPIMSTHREADS
  149. \addindex __env__STARPU_NMPIMSTHREADS
  150. Number of threads to use on the MPI Slave devices.
  151. </dd>
  152. <dt>STARPU_MPI_MASTER_NODE</dt>
  153. <dd>
  154. \anchor STARPU_MPI_MASTER_NODE
  155. \addindex __env__STARPU_MPI_MASTER_NODE
  156. This variable allows to chose which MPI node (with the MPI ID) will be the master.
  157. </dd>
  158. <dt>STARPU_WORKERS_NOBIND</dt>
  159. <dd>
  160. \anchor STARPU_WORKERS_NOBIND
  161. \addindex __env__STARPU_WORKERS_NOBIND
  162. Setting it to non-zero will prevent StarPU from binding its threads to
  163. CPUs. This is for instance useful when running the testsuite in parallel.
  164. </dd>
  165. <dt>STARPU_WORKERS_CPUID</dt>
  166. <dd>
  167. \anchor STARPU_WORKERS_CPUID
  168. \addindex __env__STARPU_WORKERS_CPUID
  169. Passing an array of integers in \ref STARPU_WORKERS_CPUID
  170. specifies on which logical CPU the different workers should be
  171. bound. For instance, if <c>STARPU_WORKERS_CPUID = "0 1 4 5"</c>, the first
  172. worker will be bound to logical CPU #0, the second CPU worker will be bound to
  173. logical CPU #1 and so on. Note that the logical ordering of the CPUs is either
  174. determined by the OS, or provided by the library <c>hwloc</c> in case it is
  175. available. Ranges can be provided: for instance, <c>STARPU_WORKERS_CPUID = "1-3
  176. 5"</c> will bind the first three workers on logical CPUs #1, #2, and #3, and the
  177. fourth worker on logical CPU #5. Unbound ranges can also be provided:
  178. <c>STARPU_WORKERS_CPUID = "1-"</c> will bind the workers starting from logical
  179. CPU #1 up to last CPU.
  180. Note that the first workers correspond to the CUDA workers, then come the
  181. OpenCL workers, and finally the CPU workers. For example if
  182. we have <c>STARPU_NCUDA=1</c>, <c>STARPU_NOPENCL=1</c>, <c>STARPU_NCPU=2</c>
  183. and <c>STARPU_WORKERS_CPUID = "0 2 1 3"</c>, the CUDA device will be controlled
  184. by logical CPU #0, the OpenCL device will be controlled by logical CPU #2, and
  185. the logical CPUs #1 and #3 will be used by the CPU workers.
  186. If the number of workers is larger than the array given in
  187. \ref STARPU_WORKERS_CPUID, the workers are bound to the logical CPUs in a
  188. round-robin fashion: if <c>STARPU_WORKERS_CPUID = "0 1"</c>, the first
  189. and the third (resp. second and fourth) workers will be put on CPU #0
  190. (resp. CPU #1).
  191. This variable is ignored if the field
  192. starpu_conf::use_explicit_workers_bindid passed to starpu_init() is
  193. set.
  194. </dd>
  195. <dt>STARPU_MAIN_THREAD_BIND</dt>
  196. <dd>
  197. \anchor STARPU_MAIN_THREAD_BIND
  198. \addindex __env__STARPU_MAIN_THREAD_BIND
  199. When defined, this make StarPU bind the thread that calls starpu_initialize() to
  200. a reserved CPU, subtracted from the CPU workers.
  201. </dd>
  202. <dt>STARPU_MAIN_THREAD_CPUID</dt>
  203. <dd>
  204. \anchor STARPU_MAIN_THREAD_CPUID
  205. \addindex __env__STARPU_MAIN_THREAD_CPUID
  206. When defined, this make StarPU bind the thread that calls starpu_initialize() to
  207. the given CPU ID.
  208. </dd>
  209. <dt>STARPU_MPI_THREAD_CPUID</dt>
  210. <dd>
  211. \anchor STARPU_MPI_THREAD_CPUID
  212. \addindex __env__STARPU_MPI_THREAD_CPUID
  213. When defined, this make StarPU bind its MPI thread to the given CPU ID. Setting
  214. it to -1 (the default value) will use a reserved CPU, subtracted from the CPU
  215. workers.
  216. </dd>
  217. <dt>STARPU_WORKERS_CUDAID</dt>
  218. <dd>
  219. \anchor STARPU_WORKERS_CUDAID
  220. \addindex __env__STARPU_WORKERS_CUDAID
  221. Similarly to the \ref STARPU_WORKERS_CPUID environment variable, it is
  222. possible to select which CUDA devices should be used by StarPU. On a machine
  223. equipped with 4 GPUs, setting <c>STARPU_WORKERS_CUDAID = "1 3"</c> and
  224. <c>STARPU_NCUDA=2</c> specifies that 2 CUDA workers should be created, and that
  225. they should use CUDA devices #1 and #3 (the logical ordering of the devices is
  226. the one reported by CUDA).
  227. This variable is ignored if the field
  228. starpu_conf::use_explicit_workers_cuda_gpuid passed to starpu_init()
  229. is set.
  230. </dd>
  231. <dt>STARPU_WORKERS_OPENCLID</dt>
  232. <dd>
  233. \anchor STARPU_WORKERS_OPENCLID
  234. \addindex __env__STARPU_WORKERS_OPENCLID
  235. OpenCL equivalent of the \ref STARPU_WORKERS_CUDAID environment variable.
  236. This variable is ignored if the field
  237. starpu_conf::use_explicit_workers_opencl_gpuid passed to starpu_init()
  238. is set.
  239. </dd>
  240. <dt>STARPU_WORKERS_MICID</dt>
  241. <dd>
  242. \anchor STARPU_WORKERS_MICID
  243. \addindex __env__STARPU_WORKERS_MICID
  244. MIC equivalent of the \ref STARPU_WORKERS_CUDAID environment variable.
  245. This variable is ignored if the field
  246. starpu_conf::use_explicit_workers_mic_deviceid passed to starpu_init()
  247. is set.
  248. </dd>
  249. <dt>STARPU_WORKER_TREE</dt>
  250. <dd>
  251. \anchor STARPU_WORKER_TREE
  252. \addindex __env__STARPU_WORKER_TREE
  253. Define to 1 to enable the tree iterator in schedulers.
  254. </dd>
  255. <dt>STARPU_SINGLE_COMBINED_WORKER</dt>
  256. <dd>
  257. \anchor STARPU_SINGLE_COMBINED_WORKER
  258. \addindex __env__STARPU_SINGLE_COMBINED_WORKER
  259. If set, StarPU will create several workers which won't be able to work
  260. concurrently. It will by default create combined workers which size goes from 1
  261. to the total number of CPU workers in the system. \ref STARPU_MIN_WORKERSIZE
  262. and \ref STARPU_MAX_WORKERSIZE can be used to change this default.
  263. </dd>
  264. <dt>STARPU_MIN_WORKERSIZE</dt>
  265. <dd>
  266. \anchor STARPU_MIN_WORKERSIZE
  267. \addindex __env__STARPU_MIN_WORKERSIZE
  268. \ref STARPU_MIN_WORKERSIZE
  269. permits to specify the minimum size of the combined workers (instead of the default 2)
  270. </dd>
  271. <dt>STARPU_MAX_WORKERSIZE</dt>
  272. <dd>
  273. \anchor STARPU_MAX_WORKERSIZE
  274. \addindex __env__STARPU_MAX_WORKERSIZE
  275. \ref STARPU_MAX_WORKERSIZE
  276. permits to specify the minimum size of the combined workers (instead of the
  277. number of CPU workers in the system)
  278. </dd>
  279. <dt>STARPU_SYNTHESIZE_ARITY_COMBINED_WORKER</dt>
  280. <dd>
  281. \anchor STARPU_SYNTHESIZE_ARITY_COMBINED_WORKER
  282. \addindex __env__STARPU_SYNTHESIZE_ARITY_COMBINED_WORKER
  283. Let the user decide how many elements are allowed between combined workers
  284. created from hwloc information. For instance, in the case of sockets with 6
  285. cores without shared L2 caches, if \ref STARPU_SYNTHESIZE_ARITY_COMBINED_WORKER is
  286. set to 6, no combined worker will be synthesized beyond one for the socket
  287. and one per core. If it is set to 3, 3 intermediate combined workers will be
  288. synthesized, to divide the socket cores into 3 chunks of 2 cores. If it set to
  289. 2, 2 intermediate combined workers will be synthesized, to divide the the socket
  290. cores into 2 chunks of 3 cores, and then 3 additional combined workers will be
  291. synthesized, to divide the former synthesized workers into a bunch of 2 cores,
  292. and the remaining core (for which no combined worker is synthesized since there
  293. is already a normal worker for it).
  294. The default, 2, thus makes StarPU tend to building a binary trees of combined
  295. workers.
  296. </dd>
  297. <dt>STARPU_DISABLE_ASYNCHRONOUS_COPY</dt>
  298. <dd>
  299. \anchor STARPU_DISABLE_ASYNCHRONOUS_COPY
  300. \addindex __env__STARPU_DISABLE_ASYNCHRONOUS_COPY
  301. Disable asynchronous copies between CPU and GPU devices.
  302. The AMD implementation of OpenCL is known to
  303. fail when copying data asynchronously. When using this implementation,
  304. it is therefore necessary to disable asynchronous data transfers.
  305. </dd>
  306. <dt>STARPU_DISABLE_ASYNCHRONOUS_CUDA_COPY</dt>
  307. <dd>
  308. \anchor STARPU_DISABLE_ASYNCHRONOUS_CUDA_COPY
  309. \addindex __env__STARPU_DISABLE_ASYNCHRONOUS_CUDA_COPY
  310. Disable asynchronous copies between CPU and CUDA devices.
  311. </dd>
  312. <dt>STARPU_DISABLE_ASYNCHRONOUS_OPENCL_COPY</dt>
  313. <dd>
  314. \anchor STARPU_DISABLE_ASYNCHRONOUS_OPENCL_COPY
  315. \addindex __env__STARPU_DISABLE_ASYNCHRONOUS_OPENCL_COPY
  316. Disable asynchronous copies between CPU and OpenCL devices.
  317. The AMD implementation of OpenCL is known to
  318. fail when copying data asynchronously. When using this implementation,
  319. it is therefore necessary to disable asynchronous data transfers.
  320. </dd>
  321. <dt>STARPU_DISABLE_ASYNCHRONOUS_MIC_COPY</dt>
  322. <dd>
  323. \anchor STARPU_DISABLE_ASYNCHRONOUS_MIC_COPY
  324. \addindex __env__STARPU_DISABLE_ASYNCHRONOUS_MIC_COPY
  325. Disable asynchronous copies between CPU and MIC devices.
  326. </dd>
  327. <dt>STARPU_DISABLE_ASYNCHRONOUS_MPI_MS_COPY</dt>
  328. <dd>
  329. \anchor STARPU_DISABLE_ASYNCHRONOUS_MPI_MS_COPY
  330. \addindex __env__STARPU_DISABLE_ASYNCHRONOUS_MPI_MS_COPY
  331. Disable asynchronous copies between CPU and MPI Slave devices.
  332. </dd>
  333. <dt>STARPU_ENABLE_CUDA_GPU_GPU_DIRECT</dt>
  334. <dd>
  335. \anchor STARPU_ENABLE_CUDA_GPU_GPU_DIRECT
  336. \addindex __env__STARPU_ENABLE_CUDA_GPU_GPU_DIRECT
  337. Enable (1) or Disable (0) direct CUDA transfers from GPU to GPU, without copying
  338. through RAM. The default is Enabled.
  339. This permits to test the performance effect of GPU-Direct.
  340. </dd>
  341. <dt>STARPU_DISABLE_PINNING</dt>
  342. <dd>
  343. \anchor STARPU_DISABLE_PINNING
  344. \addindex __env__STARPU_DISABLE_PINNING
  345. Disable (1) or Enable (0) pinning host memory allocated through starpu_malloc, starpu_memory_pin
  346. and friends. The default is Enabled.
  347. This permits to test the performance effect of memory pinning.
  348. </dd>
  349. <dt>STARPU_MIC_SINK_PROGRAM_NAME</dt>
  350. <dd>
  351. \anchor STARPU_MIC_SINK_PROGRAM_NAME
  352. \addindex __env__STARPU_MIC_SINK_PROGRAM_NAME
  353. todo
  354. </dd>
  355. <dt>STARPU_MIC_SINK_PROGRAM_PATH</dt>
  356. <dd>
  357. \anchor STARPU_MIC_SINK_PROGRAM_PATH
  358. \addindex __env__STARPU_MIC_SINK_PROGRAM_PATH
  359. todo
  360. </dd>
  361. <dt>STARPU_MIC_PROGRAM_PATH</dt>
  362. <dd>
  363. \anchor STARPU_MIC_PROGRAM_PATH
  364. \addindex __env__STARPU_MIC_PROGRAM_PATH
  365. todo
  366. </dd>
  367. </dl>
  368. \section ConfiguringTheSchedulingEngine Configuring The Scheduling Engine
  369. <dl>
  370. <dt>STARPU_SCHED</dt>
  371. <dd>
  372. \anchor STARPU_SCHED
  373. \addindex __env__STARPU_SCHED
  374. Choose between the different scheduling policies proposed by StarPU: work
  375. random, stealing, greedy, with performance models, etc.
  376. Use <c>STARPU_SCHED=help</c> to get the list of available schedulers.
  377. </dd>
  378. <dt>STARPU_MIN_PRIO</dt>
  379. <dd>
  380. \anchor STARPU_MIN_PRIO_env
  381. \addindex __env__STARPU_MIN_PRIO
  382. Set the mininum priority used by priorities-aware schedulers.
  383. </dd>
  384. <dt>STARPU_MAX_PRIO</dt>
  385. <dd>
  386. \anchor STARPU_MAX_PRIO_env
  387. \addindex __env__STARPU_MAX_PRIO
  388. Set the maximum priority used by priorities-aware schedulers.
  389. </dd>
  390. <dt>STARPU_CALIBRATE</dt>
  391. <dd>
  392. \anchor STARPU_CALIBRATE
  393. \addindex __env__STARPU_CALIBRATE
  394. If this variable is set to 1, the performance models are calibrated during
  395. the execution. If it is set to 2, the previous values are dropped to restart
  396. calibration from scratch. Setting this variable to 0 disable calibration, this
  397. is the default behaviour.
  398. Note: this currently only applies to <c>dm</c> and <c>dmda</c> scheduling policies.
  399. </dd>
  400. <dt>STARPU_CALIBRATE_MINIMUM</dt>
  401. <dd>
  402. \anchor STARPU_CALIBRATE_MINIMUM
  403. \addindex __env__STARPU_CALIBRATE_MINIMUM
  404. Define the minimum number of calibration measurements that will be made
  405. before considering that the performance model is calibrated. The default value is 10.
  406. </dd>
  407. <dt>STARPU_BUS_CALIBRATE</dt>
  408. <dd>
  409. \anchor STARPU_BUS_CALIBRATE
  410. \addindex __env__STARPU_BUS_CALIBRATE
  411. If this variable is set to 1, the bus is recalibrated during intialization.
  412. </dd>
  413. <dt>STARPU_PREFETCH</dt>
  414. <dd>
  415. \anchor STARPU_PREFETCH
  416. \addindex __env__STARPU_PREFETCH
  417. Indicate whether data prefetching should be enabled (0 means
  418. that it is disabled). If prefetching is enabled, when a task is scheduled to be
  419. executed e.g. on a GPU, StarPU will request an asynchronous transfer in
  420. advance, so that data is already present on the GPU when the task starts. As a
  421. result, computation and data transfers are overlapped.
  422. Note that prefetching is enabled by default in StarPU.
  423. </dd>
  424. <dt>STARPU_SCHED_ALPHA</dt>
  425. <dd>
  426. \anchor STARPU_SCHED_ALPHA
  427. \addindex __env__STARPU_SCHED_ALPHA
  428. To estimate the cost of a task StarPU takes into account the estimated
  429. computation time (obtained thanks to performance models). The alpha factor is
  430. the coefficient to be applied to it before adding it to the communication part.
  431. </dd>
  432. <dt>STARPU_SCHED_BETA</dt>
  433. <dd>
  434. \anchor STARPU_SCHED_BETA
  435. \addindex __env__STARPU_SCHED_BETA
  436. To estimate the cost of a task StarPU takes into account the estimated
  437. data transfer time (obtained thanks to performance models). The beta factor is
  438. the coefficient to be applied to it before adding it to the computation part.
  439. </dd>
  440. <dt>STARPU_SCHED_GAMMA</dt>
  441. <dd>
  442. \anchor STARPU_SCHED_GAMMA
  443. \addindex __env__STARPU_SCHED_GAMMA
  444. Define the execution time penalty of a joule (\ref Energy-basedScheduling).
  445. </dd>
  446. <dt>STARPU_SCHED_READY</dt>
  447. <dd>
  448. \anchor STARPU_SCHED_READY
  449. \addindex __env__STARPU_SCHED_READY
  450. For a modular scheduler with sorted queues below the decision component, workers
  451. pick up a task which has most of its data already available. Setting this to 0
  452. disables this.
  453. </dd>
  454. <dt>STARPU_IDLE_POWER</dt>
  455. <dd>
  456. \anchor STARPU_IDLE_POWER
  457. \addindex __env__STARPU_IDLE_POWER
  458. Define the idle power of the machine (\ref Energy-basedScheduling).
  459. </dd>
  460. <dt>STARPU_PROFILING</dt>
  461. <dd>
  462. \anchor STARPU_PROFILING
  463. \addindex __env__STARPU_PROFILING
  464. Enable on-line performance monitoring (\ref EnablingOn-linePerformanceMonitoring).
  465. </dd>
  466. </dl>
  467. \section Extensions Extensions
  468. <dl>
  469. <dt>SOCL_OCL_LIB_OPENCL</dt>
  470. <dd>
  471. \anchor SOCL_OCL_LIB_OPENCL
  472. \addindex __env__SOCL_OCL_LIB_OPENCL
  473. THE SOCL test suite is only run when the environment variable
  474. \ref SOCL_OCL_LIB_OPENCL is defined. It should contain the location
  475. of the file <c>libOpenCL.so</c> of the OCL ICD implementation.
  476. </dd>
  477. <dt>OCL_ICD_VENDORS</dt>
  478. <dd>
  479. \anchor OCL_ICD_VENDORS
  480. \addindex __env__OCL_ICD_VENDORS
  481. When using SOCL with OpenCL ICD
  482. (https://forge.imag.fr/projects/ocl-icd/), this variable may be used
  483. to point to the directory where ICD files are installed. The default
  484. directory is <c>/etc/OpenCL/vendors</c>. StarPU installs ICD
  485. files in the directory <c>$prefix/share/starpu/opencl/vendors</c>.
  486. </dd>
  487. <dt>STARPU_COMM_STATS</dt>
  488. <dd>
  489. \anchor STARPU_COMM_STATS
  490. \addindex __env__STARPU_COMM_STATS
  491. Communication statistics for starpumpi (\ref MPIDebug)
  492. will be enabled when the environment variable \ref STARPU_COMM_STATS
  493. is defined to an value other than 0.
  494. </dd>
  495. <dt>STARPU_MPI_CACHE</dt>
  496. <dd>
  497. \anchor STARPU_MPI_CACHE
  498. \addindex __env__STARPU_MPI_CACHE
  499. Communication cache for starpumpi (\ref MPISupport) will be
  500. disabled when the environment variable \ref STARPU_MPI_CACHE is set
  501. to 0. It is enabled by default or for any other values of the variable
  502. \ref STARPU_MPI_CACHE.
  503. </dd>
  504. <dt>STARPU_MPI_COMM</dt>
  505. <dd>
  506. \anchor STARPU_MPI_COMM
  507. \addindex __env__STARPU_MPI_COMM
  508. Communication trace for starpumpi (\ref MPISupport) will be
  509. enabled when the environment variable \ref STARPU_MPI_COMM is set
  510. to 1, and StarPU has been configured with the option
  511. \ref enable-verbose "--enable-verbose".
  512. </dd>
  513. <dt>STARPU_MPI_CACHE_STATS</dt>
  514. <dd>
  515. \anchor STARPU_MPI_CACHE_STATS
  516. \addindex __env__STARPU_MPI_CACHE_STATS
  517. When set to 1, statistics are enabled for the communication cache (\ref MPISupport). For now,
  518. it prints messages on the standard output when data are added or removed from the received
  519. communication cache.
  520. </dd>
  521. <dt>STARPU_MPI_PRIORITIES</dt>
  522. <dd>
  523. \anchor STARPU_MPI_PRIORITIES
  524. \addindex __env__STARPU_MPI_PRIORITIES
  525. When set to 0, the use of priorities to order MPI communications is disabled
  526. (\ref MPISupport).
  527. </dd>
  528. <dt>STARPU_MPI_NDETACHED_SEND</dt>
  529. <dd>
  530. \anchor STARPU_MPI_NDETACHED_SEND
  531. \addindex __env__STARPU_MPI_NDETACHED_SEND
  532. This sets the number of send requests that StarPU-MPI will emit concurrently. The default is 10.
  533. </dd>
  534. <dt>STARPU_MPI_NREADY_PROCESS</dt>
  535. <dd>
  536. \anchor STARPU_MPI_NREADY_PROCESS
  537. \addindex __env__STARPU_MPI_NREADY_PROCESS
  538. This sets the number of requests that StarPU-MPI will submit to MPI before
  539. polling for termination of existing requests. The default is 10.
  540. </dd>
  541. <dt>STARPU_MPI_FAKE_SIZE</dt>
  542. <dd>
  543. \anchor STARPU_MPI_FAKE_SIZE
  544. \addindex __env__STARPU_MPI_FAKE_SIZE
  545. Setting to a number makes StarPU believe that there are as many MPI nodes, even
  546. if it was run on only one MPI node. This allows e.g. to simulate the execution
  547. of one of the nodes of a big cluster without actually running the rest.
  548. It of course does not provide computation results and timing.
  549. </dd>
  550. <dt>STARPU_MPI_FAKE_RANK</dt>
  551. <dd>
  552. \anchor STARPU_MPI_FAKE_RANK
  553. \addindex __env__STARPU_MPI_FAKE_RANK
  554. Setting to a number makes StarPU believe that it runs the given MPI node, even
  555. if it was run on only one MPI node. This allows e.g. to simulate the execution
  556. of one of the nodes of a big cluster without actually running the rest.
  557. It of course does not provide computation results and timing.
  558. </dd>
  559. <dt>STARPU_MPI_DRIVER_CALL_FREQUENCY</dt>
  560. <dd>
  561. \anchor STARPU_MPI_DRIVER_CALL_FREQUENCY
  562. \addindex __env__STARPU_MPI_DRIVER_CALL_FREQUENCY
  563. When set to a positive value, activates the interleaving of the execution of
  564. tasks with the progression of MPI communications (\ref MPISupport). The
  565. starpu_mpi_init_conf() function must have been called by the application
  566. for that environment variable to be used. When set to 0, the MPI progression
  567. thread does not use at all the driver given by the user, and only focuses on
  568. making MPI communications progress.
  569. </dd>
  570. <dt>STARPU_MPI_DRIVER_TASK_FREQUENCY</dt>
  571. <dd>
  572. \anchor STARPU_MPI_DRIVER_TASK_FREQUENCY
  573. \addindex __env__STARPU_MPI_DRIVER_TASK_FREQUENCY
  574. When set to a positive value, the interleaving of the execution of tasks with
  575. the progression of MPI communications mechanism to execute several tasks before
  576. checking communication requests again (\ref MPISupport). The
  577. starpu_mpi_init_conf() function must have been called by the application
  578. for that environment variable to be used, and the
  579. STARPU_MPI_DRIVER_CALL_FREQUENCY environment variable set to a positive value.
  580. </dd>
  581. <dt>STARPU_SIMGRID_TRANSFER_COST</dt>
  582. <dd>
  583. \anchor STARPU_SIMGRID_TRANSFER_COST
  584. \addindex __env__STARPU_SIMGRID_TRANSFER_COST
  585. When set to 1 (which is the default), data transfers (over PCI bus, typically) are taken into account
  586. in SimGrid mode.
  587. </dd>
  588. <dt>STARPU_SIMGRID_CUDA_MALLOC_COST</dt>
  589. <dd>
  590. \anchor STARPU_SIMGRID_CUDA_MALLOC_COST
  591. \addindex __env__STARPU_SIMGRID_CUDA_MALLOC_COST
  592. When set to 1 (which is the default), CUDA malloc costs are taken into account
  593. in SimGrid mode.
  594. </dd>
  595. <dt>STARPU_SIMGRID_CUDA_QUEUE_COST</dt>
  596. <dd>
  597. \anchor STARPU_SIMGRID_CUDA_QUEUE_COST
  598. \addindex __env__STARPU_SIMGRID_CUDA_QUEUE_COST
  599. When set to 1 (which is the default), CUDA task and transfer queueing costs are
  600. taken into account in SimGrid mode.
  601. </dd>
  602. <dt>STARPU_PCI_FLAT</dt>
  603. <dd>
  604. \anchor STARPU_PCI_FLAT
  605. \addindex __env__STARPU_PCI_FLAT
  606. When unset or set to 0, the platform file created for SimGrid will
  607. contain PCI bandwidths and routes.
  608. </dd>
  609. <dt>STARPU_SIMGRID_QUEUE_MALLOC_COST</dt>
  610. <dd>
  611. \anchor STARPU_SIMGRID_QUEUE_MALLOC_COST
  612. \addindex __env__STARPU_SIMGRID_QUEUE_MALLOC_COST
  613. When unset or set to 1, simulate within SimGrid the GPU transfer queueing.
  614. </dd>
  615. <dt>STARPU_MALLOC_SIMULATION_FOLD</dt>
  616. <dd>
  617. \anchor STARPU_MALLOC_SIMULATION_FOLD
  618. \addindex __env__STARPU_MALLOC_SIMULATION_FOLD
  619. Define the size of the file used for folding virtual allocation, in
  620. MiB. The default is 1, thus allowing 64GiB virtual memory when Linux's
  621. <c>sysctl vm.max_map_count</c> value is the default 65535.
  622. </dd>
  623. <dt>STARPU_SIMGRID_TASK_SUBMIT_COST</dt>
  624. <dd>
  625. \anchor STARPU_SIMGRID_TASK_SUBMIT_COST
  626. \addindex __env__STARPU_SIMGRID_TASK_SUBMIT_COST
  627. When set to 1 (which is the default), task submission costs are taken into
  628. account in SimGrid mode. This provides more accurate SimGrid predictions,
  629. especially for the beginning of the execution.
  630. </dd>
  631. <dt>STARPU_SIMGRID_FETCHING_INPUT_COST</dt>
  632. <dd>
  633. \anchor STARPU_SIMGRID_FETCHING_INPUT_COST
  634. \addindex __env__STARPU_SIMGRID_FETCHING_INPUT_COST
  635. When set to 1 (which is the default), fetching input costs are taken into
  636. account in SimGrid mode. This provides more accurate SimGrid predictions,
  637. especially regarding data transfers.
  638. </dd>
  639. <dt>STARPU_SIMGRID_SCHED_COST</dt>
  640. <dd>
  641. \anchor STARPU_SIMGRID_SCHED_COST
  642. \addindex __env__STARPU_SIMGRID_SCHED_COST
  643. When set to 1 (0 is the default), scheduling costs are taken into
  644. account in SimGrid mode. This provides more accurate SimGrid predictions,
  645. and allows studying scheduling overhead of the runtime system. However,
  646. it also makes simulation non-deterministic.
  647. </dd>
  648. </dl>
  649. \section MiscellaneousAndDebug Miscellaneous And Debug
  650. <dl>
  651. <dt>STARPU_HOME</dt>
  652. <dd>
  653. \anchor STARPU_HOME
  654. \addindex __env__STARPU_HOME
  655. Specify the main directory in which StarPU stores its
  656. configuration files. The default is <c>$HOME</c> on Unix environments,
  657. and <c>$USERPROFILE</c> on Windows environments.
  658. </dd>
  659. <dt>STARPU_PATH</dt>
  660. <dd>
  661. \anchor STARPU_PATH
  662. \addindex __env__STARPU_PATH
  663. Only used on Windows environments.
  664. Specify the main directory in which StarPU is installed
  665. (\ref RunningABasicStarPUApplicationOnMicrosoft)
  666. </dd>
  667. <dt>STARPU_PERF_MODEL_DIR</dt>
  668. <dd>
  669. \anchor STARPU_PERF_MODEL_DIR
  670. \addindex __env__STARPU_PERF_MODEL_DIR
  671. Specify the main directory in which StarPU stores its
  672. performance model files. The default is <c>$STARPU_HOME/.starpu/sampling</c>.
  673. </dd>
  674. <dt>STARPU_PERF_MODEL_HOMOGENEOUS_CPU</dt>
  675. <dd>
  676. \anchor STARPU_PERF_MODEL_HOMOGENEOUS_CPU
  677. \addindex __env__STARPU_PERF_MODEL_HOMOGENEOUS_CPU
  678. When this is set to 0, StarPU will assume that CPU devices do not have the same
  679. performance, and thus use different performance models for them, thus making
  680. kernel calibration much longer, since measurements have to be made for each CPU
  681. core.
  682. </dd>
  683. <dt>STARPU_PERF_MODEL_HOMOGENEOUS_CUDA</dt>
  684. <dd>
  685. \anchor STARPU_PERF_MODEL_HOMOGENEOUS_CUDA
  686. \addindex __env__STARPU_PERF_MODEL_HOMOGENEOUS_CUDA
  687. When this is set to 1, StarPU will assume that all CUDA devices have the same
  688. performance, and thus share performance models for them, thus allowing kernel
  689. calibration to be much faster, since measurements only have to be once for all
  690. CUDA GPUs.
  691. </dd>
  692. <dt>STARPU_PERF_MODEL_HOMOGENEOUS_OPENCL</dt>
  693. <dd>
  694. \anchor STARPU_PERF_MODEL_HOMOGENEOUS_OPENCL
  695. \addindex __env__STARPU_PERF_MODEL_HOMOGENEOUS_OPENCL
  696. When this is set to 1, StarPU will assume that all OPENCL devices have the same
  697. performance, and thus share performance models for them, thus allowing kernel
  698. calibration to be much faster, since measurements only have to be once for all
  699. OPENCL GPUs.
  700. </dd>
  701. <dt>STARPU_PERF_MODEL_HOMOGENEOUS_MIC</dt>
  702. <dd>
  703. \anchor STARPU_PERF_MODEL_HOMOGENEOUS_MIC
  704. \addindex __env__STARPU_PERF_MODEL_HOMOGENEOUS_MIC
  705. When this is set to 1, StarPU will assume that all MIC devices have the same
  706. performance, and thus share performance models for them, thus allowing kernel
  707. calibration to be much faster, since measurements only have to be once for all
  708. MIC GPUs.
  709. </dd>
  710. <dt>STARPU_PERF_MODEL_HOMOGENEOUS_MPI_MS</dt>
  711. <dd>
  712. \anchor STARPU_PERF_MODEL_HOMOGENEOUS_MPI_MS
  713. \addindex __env__STARPU_PERF_MODEL_HOMOGENEOUS_MPI_MS
  714. When this is set to 1, StarPU will assume that all MPI Slave devices have the same
  715. performance, and thus share performance models for them, thus allowing kernel
  716. calibration to be much faster, since measurements only have to be once for all
  717. MPI Slaves.
  718. </dd>
  719. <dt>STARPU_HOSTNAME</dt>
  720. <dd>
  721. \anchor STARPU_HOSTNAME
  722. \addindex __env__STARPU_HOSTNAME
  723. When set, force the hostname to be used when dealing performance model
  724. files. Models are indexed by machine name. When running for example on
  725. a homogenenous cluster, it is possible to share the models between
  726. machines by setting <c>export STARPU_HOSTNAME=some_global_name</c>.
  727. </dd>
  728. <dt>STARPU_OPENCL_PROGRAM_DIR</dt>
  729. <dd>
  730. \anchor STARPU_OPENCL_PROGRAM_DIR
  731. \addindex __env__STARPU_OPENCL_PROGRAM_DIR
  732. Specify the directory where the OpenCL codelet source files are
  733. located. The function starpu_opencl_load_program_source() looks
  734. for the codelet in the current directory, in the directory specified
  735. by the environment variable \ref STARPU_OPENCL_PROGRAM_DIR, in the
  736. directory <c>share/starpu/opencl</c> of the installation directory of
  737. StarPU, and finally in the source directory of StarPU.
  738. </dd>
  739. <dt>STARPU_SILENT</dt>
  740. <dd>
  741. \anchor STARPU_SILENT
  742. \addindex __env__STARPU_SILENT
  743. Allow to disable verbose mode at runtime when StarPU
  744. has been configured with the option \ref enable-verbose "--enable-verbose". Also
  745. disable the display of StarPU information and warning messages.
  746. </dd>
  747. <dt>STARPU_LOGFILENAME</dt>
  748. <dd>
  749. \anchor STARPU_LOGFILENAME
  750. \addindex __env__STARPU_LOGFILENAME
  751. Specify in which file the debugging output should be saved to.
  752. </dd>
  753. <dt>STARPU_FXT_PREFIX</dt>
  754. <dd>
  755. \anchor STARPU_FXT_PREFIX
  756. \addindex __env__STARPU_FXT_PREFIX
  757. Specify in which directory to save the trace generated if FxT is enabled. It needs to have a trailing '/' character.
  758. </dd>
  759. <dt>STARPU_FXT_TRACE</dt>
  760. <dd>
  761. \anchor STARPU_FXT_TRACE
  762. \addindex __env__STARPU_FXT_TRACE
  763. Specify whether to generate (1) or not (0) the FxT trace in /tmp/prof_file_XXX_YYY . The default is 1 (generate it)
  764. </dd>
  765. <dt>STARPU_LIMIT_CUDA_devid_MEM</dt>
  766. <dd>
  767. \anchor STARPU_LIMIT_CUDA_devid_MEM
  768. \addindex __env__STARPU_LIMIT_CUDA_devid_MEM
  769. Specify the maximum number of megabytes that should be
  770. available to the application on the CUDA device with the identifier
  771. <c>devid</c>. This variable is intended to be used for experimental
  772. purposes as it emulates devices that have a limited amount of memory.
  773. When defined, the variable overwrites the value of the variable
  774. \ref STARPU_LIMIT_CUDA_MEM.
  775. </dd>
  776. <dt>STARPU_LIMIT_CUDA_MEM</dt>
  777. <dd>
  778. \anchor STARPU_LIMIT_CUDA_MEM
  779. \addindex __env__STARPU_LIMIT_CUDA_MEM
  780. Specify the maximum number of megabytes that should be
  781. available to the application on each CUDA devices. This variable is
  782. intended to be used for experimental purposes as it emulates devices
  783. that have a limited amount of memory.
  784. </dd>
  785. <dt>STARPU_LIMIT_OPENCL_devid_MEM</dt>
  786. <dd>
  787. \anchor STARPU_LIMIT_OPENCL_devid_MEM
  788. \addindex __env__STARPU_LIMIT_OPENCL_devid_MEM
  789. Specify the maximum number of megabytes that should be
  790. available to the application on the OpenCL device with the identifier
  791. <c>devid</c>. This variable is intended to be used for experimental
  792. purposes as it emulates devices that have a limited amount of memory.
  793. When defined, the variable overwrites the value of the variable
  794. \ref STARPU_LIMIT_OPENCL_MEM.
  795. </dd>
  796. <dt>STARPU_LIMIT_OPENCL_MEM</dt>
  797. <dd>
  798. \anchor STARPU_LIMIT_OPENCL_MEM
  799. \addindex __env__STARPU_LIMIT_OPENCL_MEM
  800. Specify the maximum number of megabytes that should be
  801. available to the application on each OpenCL devices. This variable is
  802. intended to be used for experimental purposes as it emulates devices
  803. that have a limited amount of memory.
  804. </dd>
  805. <dt>STARPU_LIMIT_CPU_MEM</dt>
  806. <dd>
  807. \anchor STARPU_LIMIT_CPU_MEM
  808. \addindex __env__STARPU_LIMIT_CPU_MEM
  809. Specify the maximum number of megabytes that should be
  810. available to the application in the main CPU memory. Setting it enables allocation
  811. cache in main memory. Setting it to zero lets StarPU overflow memory.
  812. </dd>
  813. <dt>STARPU_LIMIT_CPU_NUMA_devid_MEM</dt>
  814. <dd>
  815. \anchor STARPU_LIMIT_CPU_NUMA_devid_MEM
  816. \addindex __env__STARPU_LIMIT_CPU_NUMA_devid_MEM
  817. Specify the maximum number of megabytes that should be
  818. available to the application on the NUMA node with the OS identifier <c>devid</c>.
  819. </dd>
  820. <dt>STARPU_MINIMUM_AVAILABLE_MEM</dt>
  821. <dd>
  822. \anchor STARPU_MINIMUM_AVAILABLE_MEM
  823. \addindex __env__STARPU_MINIMUM_AVAILABLE_MEM
  824. Specify the minimum percentage of memory that should be available in GPUs
  825. (or in main memory, when using out of core), below which a reclaiming pass is
  826. performed. The default is 0%.
  827. </dd>
  828. <dt>STARPU_TARGET_AVAILABLE_MEM</dt>
  829. <dd>
  830. \anchor STARPU_TARGET_AVAILABLE_MEM
  831. \addindex __env__STARPU_TARGET_AVAILABLE_MEM
  832. Specify the target percentage of memory that should be reached in
  833. GPUs (or in main memory, when using out of core), when performing a periodic
  834. reclaiming pass. The default is 0%.
  835. </dd>
  836. <dt>STARPU_MINIMUM_CLEAN_BUFFERS</dt>
  837. <dd>
  838. \anchor STARPU_MINIMUM_CLEAN_BUFFERS
  839. \addindex __env__STARPU_MINIMUM_CLEAN_BUFFERS
  840. Specify the minimum percentage of number of buffers that should be clean in GPUs
  841. (or in main memory, when using out of core), below which asynchronous writebacks will be
  842. issued. The default is 5%.
  843. </dd>
  844. <dt>STARPU_TARGET_CLEAN_BUFFERS</dt>
  845. <dd>
  846. \anchor STARPU_TARGET_CLEAN_BUFFERS
  847. \addindex __env__STARPU_TARGET_CLEAN_BUFFERS
  848. Specify the target percentage of number of buffers that should be reached in
  849. GPUs (or in main memory, when using out of core), when performing an asynchronous
  850. writeback pass. The default is 10%.
  851. </dd>
  852. <dt>STARPU_DIDUSE_BARRIER</dt>
  853. <dd>
  854. \anchor STARPU_DIDUSE_BARRIER
  855. \addindex __env__STARPU_DIDUSE_BARRIER
  856. When set to 1, StarPU will never evict a piece of data if it has not been used
  857. by at least one task. This avoids odd behaviors under high memory pressure, but
  858. can lead to deadlocks, so is to be considered experimental only.
  859. </dd>
  860. <dt>STARPU_DISK_SWAP</dt>
  861. <dd>
  862. \anchor STARPU_DISK_SWAP
  863. \addindex __env__STARPU_DISK_SWAP
  864. Specify a path where StarPU can push data when the main memory is getting
  865. full.
  866. </dd>
  867. <dt>STARPU_DISK_SWAP_BACKEND</dt>
  868. <dd>
  869. \anchor STARPU_DISK_SWAP_BACKEND
  870. \addindex __env__STARPU_DISK_SWAP_BACKEND
  871. Specify the backend to be used by StarPU to push data when the main
  872. memory is getting full. The default is unistd (i.e. using read/write functions),
  873. other values are stdio (i.e. using fread/fwrite), unistd_o_direct (i.e. using
  874. read/write with O_DIRECT), leveldb (i.e. using a leveldb database), and hdf5
  875. (i.e. using HDF5 library).
  876. </dd>
  877. <dt>STARPU_DISK_SWAP_SIZE</dt>
  878. <dd>
  879. \anchor STARPU_DISK_SWAP_SIZE
  880. \addindex __env__STARPU_DISK_SWAP_SIZE
  881. Specify the maximum size in MiB to be used by StarPU to push data when the main
  882. memory is getting full. The default is unlimited.
  883. </dd>
  884. <dt>STARPU_LIMIT_MAX_SUBMITTED_TASKS</dt>
  885. <dd>
  886. \anchor STARPU_LIMIT_MAX_SUBMITTED_TASKS
  887. \addindex __env__STARPU_LIMIT_MAX_SUBMITTED_TASKS
  888. Allow users to control the task submission flow by specifying
  889. to StarPU a maximum number of submitted tasks allowed at a given time, i.e. when
  890. this limit is reached task submission becomes blocking until enough tasks have
  891. completed, specified by \ref STARPU_LIMIT_MIN_SUBMITTED_TASKS.
  892. Setting it enables allocation cache buffer reuse in main memory.
  893. </dd>
  894. <dt>STARPU_LIMIT_MIN_SUBMITTED_TASKS</dt>
  895. <dd>
  896. \anchor STARPU_LIMIT_MIN_SUBMITTED_TASKS
  897. \addindex __env__STARPU_LIMIT_MIN_SUBMITTED_TASKS
  898. Allow users to control the task submission flow by specifying
  899. to StarPU a submitted task threshold to wait before unblocking task submission. This
  900. variable has to be used in conjunction with \ref STARPU_LIMIT_MAX_SUBMITTED_TASKS
  901. which puts the task submission thread to
  902. sleep. Setting it enables allocation cache buffer reuse in main memory.
  903. </dd>
  904. <dt>STARPU_TRACE_BUFFER_SIZE</dt>
  905. <dd>
  906. \anchor STARPU_TRACE_BUFFER_SIZE
  907. \addindex __env__STARPU_TRACE_BUFFER_SIZE
  908. Set the buffer size for recording trace events in MiB. Setting it to a big
  909. size allows to avoid pauses in the trace while it is recorded on the disk. This
  910. however also consumes memory, of course. The default value is 64.
  911. </dd>
  912. <dt>STARPU_GENERATE_TRACE</dt>
  913. <dd>
  914. \anchor STARPU_GENERATE_TRACE
  915. \addindex __env__STARPU_GENERATE_TRACE
  916. When set to <c>1</c>, indicate that StarPU should automatically
  917. generate a Paje trace when starpu_shutdown() is called.
  918. </dd>
  919. <dt>STARPU_GENERATE_TRACE_OPTIONS</dt>
  920. <dd>
  921. \anchor STARPU_GENERATE_TRACE_OPTIONS
  922. \addindex __env__STARPU_GENERATE_TRACE_OPTIONS
  923. When the variable \ref STARPU_GENERATE_TRACE is set to <c>1</c> to
  924. generate a Paje trace, this variable can be set to specify options (see
  925. <c>starpu_fxt_tool --help</c>).
  926. </dd>
  927. <dt>STARPU_ENABLE_STATS</dt>
  928. <dd>
  929. \anchor STARPU_ENABLE_STATS
  930. \addindex __env__STARPU_ENABLE_STATS
  931. When defined, enable gathering various data statistics (\ref DataStatistics).
  932. </dd>
  933. <dt>STARPU_MEMORY_STATS</dt>
  934. <dd>
  935. \anchor STARPU_MEMORY_STATS
  936. \addindex __env__STARPU_MEMORY_STATS
  937. When set to 0, disable the display of memory statistics on data which
  938. have not been unregistered at the end of the execution (\ref MemoryFeedback).
  939. </dd>
  940. <dt>STARPU_MAX_MEMORY_USE</dt>
  941. <dd>
  942. \anchor STARPU_MAX_MEMORY_USE
  943. \addindex __env__STARPU_MAX_MEMORY_USE
  944. When set to 1, display at the end of the execution the maximum memory used by
  945. StarPU for internal data structures during execution.
  946. </dd>
  947. <dt>STARPU_BUS_STATS</dt>
  948. <dd>
  949. \anchor STARPU_BUS_STATS
  950. \addindex __env__STARPU_BUS_STATS
  951. When defined, statistics about data transfers will be displayed when calling
  952. starpu_shutdown() (\ref Profiling).
  953. </dd>
  954. <dt>STARPU_WORKER_STATS</dt>
  955. <dd>
  956. \anchor STARPU_WORKER_STATS
  957. \addindex __env__STARPU_WORKER_STATS
  958. When defined, statistics about the workers will be displayed when calling
  959. starpu_shutdown() (\ref Profiling). When combined with the
  960. environment variable \ref STARPU_PROFILING, it displays the energy
  961. consumption (\ref Energy-basedScheduling).
  962. </dd>
  963. <dt>STARPU_STATS</dt>
  964. <dd>
  965. \anchor STARPU_STATS
  966. \addindex __env__STARPU_STATS
  967. When set to 0, data statistics will not be displayed at the
  968. end of the execution of an application (\ref DataStatistics).
  969. </dd>
  970. <dt>STARPU_WATCHDOG_TIMEOUT</dt>
  971. <dd>
  972. \anchor STARPU_WATCHDOG_TIMEOUT
  973. \addindex __env__STARPU_WATCHDOG_TIMEOUT
  974. When set to a value other than 0, allows to make StarPU print an error
  975. message whenever StarPU does not terminate any task for the given time (in µs),
  976. but lets the application continue normally. Should
  977. be used in combination with \ref STARPU_WATCHDOG_CRASH
  978. (see \ref DetectionStuckConditions).
  979. </dd>
  980. <dt>STARPU_WATCHDOG_CRASH</dt>
  981. <dd>
  982. \anchor STARPU_WATCHDOG_CRASH
  983. \addindex __env__STARPU_WATCHDOG_CRASH
  984. When set to a value other than 0, trigger a crash when the watch
  985. dog is reached, thus allowing to catch the situation in gdb, etc
  986. (see \ref DetectionStuckConditions)
  987. </dd>
  988. <dt>STARPU_WATCHDOG_DELAY</dt>
  989. <dd>
  990. \anchor STARPU_WATCHDOG_DELAY
  991. \addindex __env__STARPU_WATCHDOG_DELAY
  992. Delay the activation of the watchdog by the given time (in µs). This can
  993. be convenient for letting the application initialize data etc. before starting
  994. to look for idle time.
  995. </dd>
  996. <dt>STARPU_TASK_BREAK_ON_PUSH</dt>
  997. <dd>
  998. \anchor STARPU_TASK_BREAK_ON_PUSH
  999. \addindex __env__STARPU_TASK_BREAK_ON_PUSH
  1000. When this variable contains a job id, StarPU will raise SIGTRAP when the task
  1001. with that job id is being pushed to the scheduler, which will be nicely catched by debuggers
  1002. (see \ref DebuggingScheduling)
  1003. </dd>
  1004. <dt>STARPU_TASK_BREAK_ON_SCHED</dt>
  1005. <dd>
  1006. \anchor STARPU_TASK_BREAK_ON_SCHED
  1007. \addindex __env__STARPU_TASK_BREAK_ON_SCHED
  1008. When this variable contains a job id, StarPU will raise SIGTRAP when the task
  1009. with that job id is being scheduled by the scheduler (at a scheduler-specific
  1010. point), which will be nicely catched by debuggers.
  1011. This only works for schedulers which have such a scheduling point defined
  1012. (see \ref DebuggingScheduling)
  1013. </dd>
  1014. <dt>STARPU_TASK_BREAK_ON_POP</dt>
  1015. <dd>
  1016. \anchor STARPU_TASK_BREAK_ON_POP
  1017. \addindex __env__STARPU_TASK_BREAK_ON_POP
  1018. When this variable contains a job id, StarPU will raise SIGTRAP when the task
  1019. with that job id is being popped from the scheduler, which will be nicely catched by debuggers
  1020. (see \ref DebuggingScheduling)
  1021. </dd>
  1022. <dt>STARPU_TASK_BREAK_ON_EXEC</dt>
  1023. <dd>
  1024. \anchor STARPU_TASK_BREAK_ON_EXEC
  1025. \addindex __env__STARPU_TASK_BREAK_ON_EXEC
  1026. When this variable contains a job id, StarPU will raise SIGTRAP when the task
  1027. with that job id is being executed, which will be nicely catched by debuggers
  1028. (see \ref DebuggingScheduling)
  1029. </dd>
  1030. <dt>STARPU_DISABLE_KERNELS</dt>
  1031. <dd>
  1032. \anchor STARPU_DISABLE_KERNELS
  1033. \addindex __env__STARPU_DISABLE_KERNELS
  1034. When set to a value other than 1, it disables actually calling the kernel
  1035. functions, thus allowing to quickly check that the task scheme is working
  1036. properly, without performing the actual application-provided computation.
  1037. </dd>
  1038. <dt>STARPU_HISTORY_MAX_ERROR</dt>
  1039. <dd>
  1040. \anchor STARPU_HISTORY_MAX_ERROR
  1041. \addindex __env__STARPU_HISTORY_MAX_ERROR
  1042. History-based performance models will drop measurements which are really far
  1043. froom the measured average. This specifies the allowed variation. The default is
  1044. 50 (%), i.e. the measurement is allowed to be x1.5 faster or /1.5 slower than the
  1045. average.
  1046. </dd>
  1047. <dt>STARPU_RAND_SEED</dt>
  1048. <dd>
  1049. \anchor STARPU_RAND_SEED
  1050. \addindex __env__STARPU_RAND_SEED
  1051. The random scheduler and some examples use random numbers for their own
  1052. working. Depending on the examples, the seed is by default juste always 0 or
  1053. the current time() (unless SimGrid mode is enabled, in which case it is always
  1054. 0). \ref STARPU_RAND_SEED allows to set the seed to a specific value.
  1055. </dd>
  1056. <dt>STARPU_GLOBAL_ARBITER</dt>
  1057. <dd>
  1058. \anchor STARPU_GLOBAL_ARBITER
  1059. \addindex __env__STARPU_GLOBAL_ARBITER
  1060. When set to a positive value, StarPU will create a arbiter, which
  1061. implements an advanced but centralized management of concurrent data
  1062. accesses (see \ref ConcurrentDataAccess).
  1063. </dd>
  1064. <dt>STARPU_USE_NUMA</dt>
  1065. <dd>
  1066. \anchor STARPU_USE_NUMA
  1067. \addindex __env__STARPU_USE_NUMA
  1068. When defined, NUMA nodes are taking into account by StarPU. Otherwise, memory
  1069. is considered as only one node. This is experimental for now.
  1070. When enabled, STARPU_MAIN_MEMORY is a pointer to the NUMA node associated to the
  1071. first CPU worker if it exists, the NUMA node associated to the first GPU discovered otherwise.
  1072. If StarPU doesn't find any NUMA node after these step, STARPU_MAIN_MEMORY is the first NUMA node
  1073. discovered by StarPU.
  1074. </dd>
  1075. <dt>STARPU_IDLE_FILE</dt>
  1076. <dd>
  1077. \anchor STARPU_IDLE_FILE
  1078. \addindex __env__STARPU_IDLE_FILE
  1079. If the environment variable STARPU_IDLE_FILE is defined, a file named after its contents will be created at the end of the execution.
  1080. The file will contain the sum of the idle times of all the workers.
  1081. </dd>
  1082. <dt>STARPU_HWLOC_INPUT</dt>
  1083. <dd>
  1084. \anchor STARPU_HWLOC_INPUT
  1085. \addindex __env__STARPU_HWLOC_INPUT
  1086. If the environment variable STARPU_HWLOC_INPUT is defined to the path of an XML file, hwloc will be made to use it as input instead of detecting the current platform topology, which can save significant initialization time.
  1087. To produce this XML file, use <c>lstopo file.xml</c>
  1088. </dd>
  1089. <dt>STARPU_CATCH_SIGNALS</dt>
  1090. <dd>
  1091. \anchor STARPU_CATCH_SIGNALS
  1092. \addindex __env__STARPU_CATCH_SIGNALS
  1093. By default, StarPU catch signals SIGINT, SIGSEGV and SIGTRAP to
  1094. perform final actions such as dumping FxT trace files even though the
  1095. application has crashed. Setting this variable to a value other than 1
  1096. will disable this behaviour. This should be done on JVM systems which
  1097. may use these signals for their own needs.
  1098. The flag can also be set through the field starpu_conf::catch_signals.
  1099. </dl>
  1100. \section ConfiguringTheHypervisor Configuring The Hypervisor
  1101. <dl>
  1102. <dt>SC_HYPERVISOR_POLICY</dt>
  1103. <dd>
  1104. \anchor SC_HYPERVISOR_POLICY
  1105. \addindex __env__SC_HYPERVISOR_POLICY
  1106. Choose between the different resizing policies proposed by StarPU for the hypervisor:
  1107. idle, app_driven, feft_lp, teft_lp; ispeed_lp, throughput_lp etc.
  1108. Use <c>SC_HYPERVISOR_POLICY=help</c> to get the list of available policies for the hypervisor
  1109. </dd>
  1110. <dt>SC_HYPERVISOR_TRIGGER_RESIZE</dt>
  1111. <dd>
  1112. \anchor SC_HYPERVISOR_TRIGGER_RESIZE
  1113. \addindex __env__SC_HYPERVISOR_TRIGGER_RESIZE
  1114. Choose how should the hypervisor be triggered: <c>speed</c> if the resizing algorithm should
  1115. be called whenever the speed of the context does not correspond to an optimal precomputed value,
  1116. <c>idle</c> it the resizing algorithm should be called whenever the workers are idle for a period
  1117. longer than the value indicated when configuring the hypervisor.
  1118. </dd>
  1119. <dt>SC_HYPERVISOR_START_RESIZE</dt>
  1120. <dd>
  1121. \anchor SC_HYPERVISOR_START_RESIZE
  1122. \addindex __env__SC_HYPERVISOR_START_RESIZE
  1123. Indicate the moment when the resizing should be available. The value correspond to the percentage
  1124. of the total time of execution of the application. The default value is the resizing frame.
  1125. </dd>
  1126. <dt>SC_HYPERVISOR_MAX_SPEED_GAP</dt>
  1127. <dd>
  1128. \anchor SC_HYPERVISOR_MAX_SPEED_GAP
  1129. \addindex __env__SC_HYPERVISOR_MAX_SPEED_GAP
  1130. Indicate the ratio of speed difference between contexts that should trigger the hypervisor.
  1131. This situation may occur only when a theoretical speed could not be computed and the hypervisor
  1132. has no value to compare the speed to. Otherwise the resizing of a context is not influenced by the
  1133. the speed of the other contexts, but only by the the value that a context should have.
  1134. </dd>
  1135. <dt>SC_HYPERVISOR_STOP_PRINT</dt>
  1136. <dd>
  1137. \anchor SC_HYPERVISOR_STOP_PRINT
  1138. \addindex __env__SC_HYPERVISOR_STOP_PRINT
  1139. By default the values of the speed of the workers is printed during the execution
  1140. of the application. If the value 1 is given to this environment variable this printing
  1141. is not done.
  1142. </dd>
  1143. <dt>SC_HYPERVISOR_LAZY_RESIZE</dt>
  1144. <dd>
  1145. \anchor SC_HYPERVISOR_LAZY_RESIZE
  1146. \addindex __env__SC_HYPERVISOR_LAZY_RESIZE
  1147. By default the hypervisor resizes the contexts in a lazy way, that is workers are firstly added to a new context
  1148. before removing them from the previous one. Once this workers are clearly taken into account
  1149. into the new context (a task was poped there) we remove them from the previous one. However if the application
  1150. would like that the change in the distribution of workers should change right away this variable should be set to 0
  1151. </dd>
  1152. <dt>SC_HYPERVISOR_SAMPLE_CRITERIA</dt>
  1153. <dd>
  1154. \anchor SC_HYPERVISOR_SAMPLE_CRITERIA
  1155. \addindex __env__SC_HYPERVISOR_SAMPLE_CRITERIA
  1156. By default the hypervisor uses a sample of flops when computing the speed of the contexts and of the workers.
  1157. If this variable is set to <c>time</c> the hypervisor uses a sample of time (10% of an aproximation of the total
  1158. execution time of the application)
  1159. </dd>
  1160. </dl>
  1161. */