ChangeLog 36 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511512513514515516517518519520521522523524525526527528529530531532533534535536537538539540541542543544545546547548549550551552553554555556557558559560561562563564565566567568569570571572573574575576577578579580581582583584585586587588589590591592593594595596597598599600601602603604605606607608609610611612613614615616617618619620621622623624625626627628629630631632633634635636637638639640641642643644645646647648649650651652653654655656657658659660661662663664665666667668669670671672673674675676677678679680681682683684685686687688689690691692693694695696697698699700701702703704705706707708709710711712713714715716717718719720721722723724725726727728729730731732733734735736737738739740741742743744745746747748749750751752753754755756757758759760761762763764765766767768769770771772773774775776777778779780781782783784785786787
  1. # StarPU --- Runtime system for heterogeneous multicore architectures.
  2. #
  3. # Copyright (C) 2009-2015 Université de Bordeaux
  4. # Copyright (C) 2010, 2011, 2012, 2013, 2014, 2015 CNRS
  5. # Copyright (C) 2014 INRIA
  6. #
  7. # StarPU is free software; you can redistribute it and/or modify
  8. # it under the terms of the GNU Lesser General Public License as published by
  9. # the Free Software Foundation; either version 2.1 of the License, or (at
  10. # your option) any later version.
  11. #
  12. # StarPU is distributed in the hope that it will be useful, but
  13. # WITHOUT ANY WARRANTY; without even the implied warranty of
  14. # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
  15. #
  16. # See the GNU Lesser General Public License in COPYING.LGPL for more details.
  17. StarPU 1.3.0 (svn revision xxxx)
  18. ==============================================
  19. New features:
  20. * Enable anticipative writeback by default.
  21. * New scheduler with heterogeneous priorities
  22. * Support priorities for data transfers.
  23. Changes:
  24. * Vastly improve simgrid simulation time.
  25. StarPU 1.2.0 (svn revision xxxx)
  26. ==============================================
  27. New features:
  28. * MIC Xeon Phi support
  29. * SCC support
  30. * New function starpu_sched_ctx_exec_parallel_code to execute a
  31. parallel code on the workers of the given scheduler context
  32. * MPI:
  33. - New internal communication system : a unique tag called
  34. is now used for all communications, and a system
  35. of hashmaps on each node which stores pending receives has been
  36. implemented. Every message is now coupled with an envelope, sent
  37. before the corresponding data, which allows the receiver to
  38. allocate data correctly, and to submit the matching receive of
  39. the envelope.
  40. - New function
  41. starpu_mpi_irecv_detached_sequential_consistency which
  42. allows to enable or disable the sequential consistency for
  43. the given data handle (sequential consistency will be
  44. enabled or disabled based on the value of the function
  45. parameter and the value of the sequential consistency
  46. defined for the given data)
  47. - New functions starpu_mpi_task_build() and
  48. starpu_mpi_task_post_build()
  49. - New flag STARPU_NODE_SELECTION_POLICY to specify a policy for
  50. selecting a node to execute the codelet when several nodes
  51. own data in W mode.
  52. - New selection node policies can be un/registered with the
  53. functions starpu_mpi_node_selection_register_policy() and
  54. starpu_mpi_node_selection_unregister_policy()
  55. - New environment variable STARPU_MPI_COMM which enables
  56. basic tracing of communications.
  57. - New function starpu_mpi_init_comm() which allows to specify
  58. a MPI communicator.
  59. * New STARPU_COMMUTE flag which can be passed along STARPU_W or STARPU_RW to
  60. let starpu commute write accesses.
  61. * Out-of-core support, through registration of disk areas as additional memory
  62. nodes. It can be enabled programmatically or through the STARPU_DISK_SWAP*
  63. environment variables.
  64. * Reclaiming is now periodically done before memory becomes full. This can
  65. be controlled through the STARPU_*_AVAILABLE_MEM environment variables.
  66. * New hierarchical schedulers which allow the user to easily build
  67. its own scheduler, by coding itself each "box" it wants, or by
  68. combining existing boxes in StarPU to build it. Hierarchical
  69. schedulers have very interesting scalability properties.
  70. * Add STARPU_CUDA_ASYNC and STARPU_OPENCL_ASYNC flags to allow asynchronous
  71. CUDA and OpenCL kernel execution.
  72. * Add STARPU_CUDA_PIPELINE and STARPU_OPENCL_PIPELINE to specify how
  73. many asynchronous tasks are submitted in advance on CUDA and
  74. OpenCL devices. Setting the value to 0 forces a synchronous
  75. execution of all tasks.
  76. * Add CUDA concurrent kernel execution support through
  77. the STARPU_NWORKER_PER_CUDA environment variable.
  78. * Add CUDA and OpenCL kernel submission pipelining, to overlap costs and allow
  79. concurrent kernel execution on Fermi cards.
  80. * New locality work stealing scheduler (lws).
  81. * Add STARPU_VARIABLE_NBUFFERS to be set in cl.nbuffers, and nbuffers and
  82. modes field to the task structure, which permit to define codelets taking a
  83. variable number of data.
  84. * Add support for implementing OpenMP runtimes on top of StarPU
  85. * New performance model format to better represent parallel tasks.
  86. Used to provide estimations for the execution times of the
  87. parallel tasks on scheduling contexts or combined workers.
  88. * starpu_data_idle_prefetch_on_node and
  89. starpu_idle_prefetch_task_input_on_node allow to queue prefetches to be done
  90. only when the bus is idle.
  91. * Make starpu_data_prefetch_on_node not forcibly flush data out, introduce
  92. starpu_data_fetch_on_node for that.
  93. * Anticipative writeback, to flush dirty data asynchronously before the
  94. GPU device is full. Disabled by default. Use STARPU_MINIMUM_CLEAN_BUFFERS
  95. and STARPU_TARGET_CLEAN_BUFFERS to enable it.
  96. * Add starpu_data_wont_use to advise that a piece of data will not be used
  97. in the close future.
  98. * New scheduler 'dmdasd' that considers priority when deciding on
  99. which worker to schedule
  100. * Add data access arbiters, to improve parallelism of concurrent data
  101. accesses, notably with STARPU_COMMUTE.
  102. * Add the capability to define specific MPI datatypes for
  103. StarPU user-defined interfaces.
  104. * Add tasks.rec trace output to make scheduling analysis easier.
  105. * Add Fortran 90 module and example using it
  106. * New StarPU-MPI gdb debug functions
  107. * Generate animated html trace of modular schedulers.
  108. * Add asynchronous partition planning. It only supports coherency through
  109. the home node of data for now.
  110. Small features:
  111. * Tasks can now have a name (via the field const char *name of
  112. struct starpu_task)
  113. * New functions starpu_data_acquire_cb_sequential_consistency() and
  114. starpu_data_acquire_on_node_cb_sequential_consistency() which allows
  115. to enable or disable sequential consistency
  116. * New configure option --enable-fxt-lock which enables additional
  117. trace events focused on locks behaviour during the execution
  118. * Functions starpu_insert_task and starpu_mpi_insert_task are
  119. renamed in starpu_task_insert and starpu_mpi_task_insert. Old
  120. names are kept to avoid breaking old codes.
  121. * New configure option --enable-calibration-heuristic which allows
  122. the user to set the maximum authorized deviation of the
  123. history-based calibrator.
  124. * Allow application to provide the task footprint itself.
  125. * New function starpu_sched_ctx_display_workers() to display worker
  126. information belonging to a given scheduler context
  127. * The option --enable-verbose can be called with
  128. --enable-verbose=extra to increase the verbosity
  129. * Add codelet size, footprint and tag id in the paje trace.
  130. * Add STARPU_TAG_ONLY, to specify a tag for traces without making StarPU
  131. manage the tag.
  132. * On Linux x86, spinlocks now block after a hundred tries. This avoids
  133. typical 10ms pauses when the application thread tries to submit tasks.
  134. * New function char *starpu_worker_get_type_as_string(enum starpu_worker_archtype type)
  135. * Improve static scheduling by adding support for specifying the task
  136. execution order.
  137. * Add starpu_worker_can_execute_task_impl and
  138. starpu_worker_can_execute_task_first_impl to optimize getting the
  139. working implementations
  140. * Add STARPU_MALLOC_NORECLAIM flag to allocate without running a reclaim if
  141. the node is out of memory.
  142. * New flag STARPU_DATA_MODE_ARRAY for the function family
  143. starpu_task_insert to allow to define a array of data handles
  144. along with their access modes.
  145. * New configure option --enable-new-check to enable new testcases
  146. which are known to fail
  147. * Add starpu_memory_allocate and _deallocate to let the application declare
  148. its own allocation to the reclaiming engine.
  149. * Add STARPU_SIMGRID_CUDA_MALLOC_COST and STARPU_SIMGRID_CUDA_QUEUE_COST to
  150. disable CUDA costs simulation in simgrid mode.
  151. * Add starpu_memory_pin and starpu_memory_unpin to pin memory allocated
  152. another way than starpu_malloc.
  153. * Add STARPU_NOWHERE to create synchronization tasks with data.
  154. * Document how to switch between differents views of the same data.
  155. * Add STARPU_NAME to specify a task name from a starpu_task_insert call.
  156. * Add starpu_task_get_task_succs to get the list of children of a given
  157. task.
  158. * Add starpu_malloc_on_node_flags, starpu_free_on_node_flags, and
  159. starpu_malloc_on_node_set_default_flags to control the allocation flags
  160. used for allocations done by starpu.
  161. * Add configure option to disable fortran --disable-fortran
  162. * Add configure option to give path for smpirun executable --with-smpirun
  163. Changes:
  164. * Data interfaces (variable, vector, matrix and block) now define
  165. pack und unpack functions
  166. * StarPU-MPI: Fix for being able to receive data which have not yet
  167. been registered by the application (i.e it did not call
  168. starpu_data_set_tag(), data are received as a raw memory)
  169. * StarPU-MPI: Fix for being able to receive data with the same tag
  170. from several nodes (see mpi/tests/gather.c)
  171. * Remove the long-deprecated cost_model fields and task->buffers field.
  172. * Fix complexity of implicit task/data dependency, from quadratic to linear.
  173. Small changes:
  174. * Rename function starpu_trace_user_event() as
  175. starpu_fxt_trace_user_event()
  176. * Update starpu_task_build() to set starpu_task::cl_arg_free to 1 if
  177. some arguments of type ::STARPU_VALUE are given.
  178. * Simplify performance model loading API
  179. StarPU 1.1.5 (svn revision xxx)
  180. ==============================================
  181. The scheduling context release
  182. * Add starpu_memory_pin and starpu_memory_unpin to pin memory allocated
  183. another way than starpu_malloc.
  184. * Add starpu_task_wait_for_n_submitted() and
  185. STARPU_LIMIT_MAX_NSUBMITTED_TASKS/STARPU_LIMIT_MIN_NSUBMITTED_TASKS to
  186. easily control the number of submitted tasks by making task submission
  187. block.
  188. StarPU 1.1.4 (svn revision 14856)
  189. ==============================================
  190. The scheduling context release
  191. New features:
  192. * Fix and actually enable the cache allocation.
  193. * Enable allocation cache in main RAM when STARPU_LIMIT_CPU_MEM is set by
  194. the user.
  195. * New MPI functions starpu_mpi_issend and starpu_mpi_issend_detached
  196. to send data using a synchronous and non-blocking mode (internally
  197. uses MPI_Issend)
  198. * New data access mode flag STARPU_SSEND to be set when calling
  199. starpu_mpi_insert_task to specify the data has to be sent using a
  200. synchronous and non-blocking mode
  201. * New environment variable STARPU_PERF_MODEL_DIR which can be set to
  202. specify a directory where to store performance model files in.
  203. When unset, the files are stored in $STARPU_HOME/.starpu/sampling
  204. * MPI:
  205. - New function starpu_mpi_data_register_comm to register a data
  206. with another communicator than MPI_COMM_WORLD
  207. - New functions starpu_mpi_data_set_rank() and starpu_mpi_data_set_tag()
  208. which call starpu_mpi_data_register_comm()
  209. Small features:
  210. * Add starpu_memory_wait_available() to wait for a given size to become
  211. available on a given node.
  212. * New environment variable STARPU_RAND_SEED to set the seed used for random
  213. numbers.
  214. * New function starpu_mpi_cache_set() to enable or disable the
  215. communication cache at runtime
  216. * Add starpu_paje_sort which sorts Pajé traces.
  217. Changes:
  218. * Fix complexity of implicit task/data dependency, from quadratic to linear.
  219. StarPU 1.1.3 (svn revision 13450)
  220. ==============================================
  221. The scheduling context release
  222. New features:
  223. * One can register an existing on-GPU buffer to be used by a handle.
  224. * Add the starpu_paje_summary statistics tool.
  225. * Enable gpu-gpu transfers for matrices.
  226. * Let interfaces declare which transfers they allow with the can_copy
  227. methode.
  228. Small changes:
  229. * Lock performance model files while writing and reading them to avoid
  230. issues on parallel launches, MPI runs notably.
  231. * Lots of build fixes for icc on Windows.
  232. StarPU 1.1.2 (svn revision 13011)
  233. ==============================================
  234. The scheduling context release
  235. New features:
  236. * The reduction init codelet is automatically used to initialize temporary
  237. buffers.
  238. * Traces now include a "scheduling" state, to show the overhead of the
  239. scheduler.
  240. * Add STARPU_CALIBRATE_MINIMUM environment variable to specify the minimum
  241. number of calibration measurements.
  242. * Add STARPU_TRACE_BUFFER_SIZE environment variable to specify the size of
  243. the trace buffer.
  244. StarPU 1.1.1 (svn revision 12638)
  245. ==============================================
  246. The scheduling context release
  247. New features:
  248. * MPI:
  249. - New variable STARPU_MPI_CACHE_STATS to print statistics on
  250. cache holding received data.
  251. - New function starpu_mpi_data_register() which sets the rank
  252. and tag of a data, and also allows to automatically clear
  253. the MPI communication cache when unregistering the data. It
  254. should be called instead of both calling
  255. starpu_data_set_tag() and starpu_data_set_rank()
  256. * Use streams for all CUDA transfers, even initiated by CPUs.
  257. * Add paje traces statistics tools.
  258. * Use streams for GPUA->GPUB and GPUB->GPUA transfers.
  259. Small features:
  260. * New STARPU_EXECUTE_ON_WORKER flag to specify the worker on which
  261. to execute the task.
  262. * New STARPU_DISABLE_PINNING environment variable to disable host memory
  263. pinning.
  264. * New STARPU_DISABLE_KERNELS environment variable to disable actual kernel
  265. execution.
  266. * New starpu_memory_get_total function to get the size of a memory node.
  267. * New starpu_parallel_task_barrier_init_n function to let a scheduler decide
  268. a set of workers without going through combined workers.
  269. Changes:
  270. * Fix simgrid execution.
  271. * Rename starpu_get_nready_tasks_of_sched_ctx to starpu_sched_ctx_get_nready_tasks
  272. * Rename starpu_get_nready_flops_of_sched_ctx to starpu_sched_ctx_get_nready_flops
  273. * New functions starpu_pause() and starpu_resume()
  274. * New codelet specific_nodes field to specify explicit target nodes for data.
  275. * StarPU-MPI: Fix overzealous allocation of memory.
  276. * Interfaces: Allow interface implementation to change pointers at will, in
  277. unpack notably.
  278. Small changes:
  279. * Use big fat abortions when one tries to make a task or callback
  280. sleep, instead of just returning EDEADLCK which few people will test
  281. * By default, StarPU FFT examples are not compiled and checked, the
  282. configure option --enable-starpufft-examples needs to be specified
  283. to change this behaviour.
  284. StarPU 1.1.0 (svn revision 11960)
  285. ==============================================
  286. The scheduling context release
  287. New features:
  288. * OpenGL interoperability support.
  289. * Capability to store compiled OpenCL kernels on the file system
  290. * Capability to load compiled OpenCL kernels
  291. * Performance models measurements can now be provided explicitly by
  292. applications.
  293. * Capability to emit communication statistics when running MPI code
  294. * Add starpu_data_unregister_submit, starpu_data_acquire_on_node and
  295. starpu_data_invalidate_submit
  296. * New functionnality to wrapper starpu_insert_task to pass a array of
  297. data_handles via the parameter STARPU_DATA_ARRAY
  298. * Enable GPU-GPU direct transfers.
  299. * GCC plug-in
  300. - Add `registered' attribute
  301. - A new pass was added that warns about the use of possibly
  302. unregistered memory buffers.
  303. * SOCL
  304. - Manual mapping of commands on specific devices is now
  305. possible
  306. - SOCL does not require StarPU CPU tasks anymore. CPU workers
  307. are automatically disabled to enhance performance of OpenCL
  308. CPU devices
  309. * New interface: COO matrix.
  310. * Data interfaces: The pack operation of user-defined data interface
  311. defines a new parameter count which should be set to the size of
  312. the buffer created by the packing of the data.
  313. * MPI:
  314. - Communication statistics for MPI can only be enabled at
  315. execution time by defining the environment variable
  316. STARPU_COMM_STATS
  317. - Communication cache mechanism is enabled by default, and can
  318. only be disabled at execution time by setting the
  319. environment variable STARPU_MPI_CACHE to 0.
  320. - Initialisation functions starpu_mpi_initialize_extended()
  321. and starpu_mpi_initialize() have been made deprecated. One
  322. should now use starpu_mpi_init(int *, char ***, int). The
  323. last parameter indicates if MPI should be initialised.
  324. - Collective detached operations have new parameters, a
  325. callback function and a argument. This is to be consistent
  326. with the detached point-to-point communications.
  327. - When exchanging user-defined data interfaces, the size of
  328. the data is the size returned by the pack operation, i.e
  329. data with dynamic size can now be exchanged with StarPU-MPI.
  330. * Add experimental simgrid support, to simulate execution with various
  331. number of CPUs, GPUs, amount of memory, etc.
  332. * Add support for OpenCL simulators (which provide simulated execution time)
  333. * Add support for Temanejo, a task graph debugger
  334. * Theoretical bound lp output now includes data transfer time.
  335. * Update OpenCL driver to only enable CPU devices (the environment
  336. variable STARPU_OPENCL_ONLY_ON_CPUS must be set to a positive
  337. value when executing an application)
  338. * Add Scheduling contexts to separate computation resources
  339. - Scheduling policies take into account the set of resources corresponding
  340. to the context it belongs to
  341. - Add support to dynamically change scheduling contexts
  342. (Create and Delete a context, Add Workers to a context, Remove workers from a context)
  343. - Add support to indicate to which contexts the tasks are submitted
  344. * Add the Hypervisor to manage the Scheduling Contexts automatically
  345. - The Contexts can be registered to the Hypervisor
  346. - Only the registered contexts are managed by the Hypervisor
  347. - The Hypervisor can detect the initial distribution of resources of
  348. a context and constructs it consequently (the cost of execution is required)
  349. - Several policies can adapt dynamically the distribution of resources
  350. in contexts if the initial one was not appropriate
  351. - Add a platform to implement new policies of redistribution
  352. of resources
  353. * Implement a memory manager which checks the global amount of
  354. memory available on devices, and checks there is enough memory
  355. before doing an allocation on the device.
  356. * Discard environment variable STARPU_LIMIT_GPU_MEM and define
  357. instead STARPU_LIMIT_CUDA_MEM and STARPU_LIMIT_OPENCL_MEM
  358. * Introduce new variables STARPU_LIMIT_CUDA_devid_MEM and
  359. STARPU_LIMIT_OPENCL_devid_MEM to limit memory per specific device
  360. * Introduce new variable STARPU_LIMIT_CPU_MEM to limit memory for
  361. the CPU devices
  362. * New function starpu_malloc_flags to define a memory allocation with
  363. constraints based on the following values:
  364. - STARPU_MALLOC_PINNED specifies memory should be pinned
  365. - STARPU_MALLOC_COUNT specifies the memory allocation should be in
  366. the limits defined by the environment variables STARPU_LIMIT_xxx
  367. (see above). When no memory is left, starpu_malloc_flag tries
  368. to reclaim memory from StarPU and returns -ENOMEM on failure.
  369. * starpu_malloc calls starpu_malloc_flags with a value of flag set
  370. to STARPU_MALLOC_PINNED
  371. * Define new function starpu_free_flags similarly to starpu_malloc_flags
  372. * Define new public API starpu_pthread which is similar to the
  373. pthread API. It is provided with 2 implementations: a pthread one
  374. and a Simgrid one. Applications using StarPU and wishing to use
  375. the Simgrid StarPU features should use it.
  376. * Allow to have a dynamically allocated number of buffers per task,
  377. and so overwrite the value defined --enable-maxbuffers=XXX
  378. * Performance models files are now stored in a directory whose name
  379. include the version of the performance model format. The version
  380. number is also written in the file itself.
  381. When updating the format, the internal variable
  382. _STARPU_PERFMODEL_VERSION should be updated. It is then possible
  383. to switch easily between differents versions of StarPU having
  384. different performance model formats.
  385. * Tasks can now define a optional prologue callback which is executed
  386. on the host when the task becomes ready for execution, before getting
  387. scheduled.
  388. * Small CUDA allocations (<= 4MiB) are now batched to avoid the huge
  389. cudaMalloc overhead.
  390. * Prefetching is now done for all schedulers when it can be done whatever
  391. the scheduling decision.
  392. * Add a watchdog which permits to easily trigger a crash when StarPU gets
  393. stuck.
  394. * Document how to migrate data over MPI.
  395. * New function starpu_wakeup_worker() to be used by schedulers to
  396. wake up a single worker (instead of all workers) when submitting a
  397. single task.
  398. * The functions starpu_sched_set/get_min/max_priority set/get the
  399. priorities of the current scheduling context, i.e the one which
  400. was set by a call to starpu_sched_ctx_set_context() or the initial
  401. context if the function has not been called yet.
  402. * Fix for properly dealing with NAN on windows systems
  403. Small features:
  404. * Add starpu_worker_get_by_type and starpu_worker_get_by_devid
  405. * Add starpu_fxt_stop_profiling/starpu_fxt_start_profiling which permits to
  406. pause trace recording.
  407. * Add trace_buffer_size configuration field to permit to specify the tracing
  408. buffer size.
  409. * Add starpu_codelet_profile and starpu_codelet_histo_profile, tools which draw
  410. the profile of a codelet.
  411. * File STARPU-REVISION --- containing the SVN revision number from which
  412. StarPU was compiled --- is installed in the share/doc/starpu directory
  413. * starpu_perfmodel_plot can now directly draw GFlops curves.
  414. * New configure option --enable-mpi-progression-hook to enable the
  415. activity polling method for StarPU-MPI.
  416. * Permit to disable sequential consistency for a given task.
  417. * New macro STARPU_RELEASE_VERSION
  418. * New function starpu_get_version() to return as 3 integers the
  419. release version of StarPU.
  420. * Enable by default data allocation cache
  421. * New function starpu_perfmodel_directory() to print directory
  422. storing performance models. Available through the new option -d of
  423. the tool starpu_perfmodel_display
  424. * New batch files to execute StarPU applications under Microsoft
  425. Visual Studio (They are installed in path_to_starpu/bin/msvc)/
  426. * Add cl_arg_free, callback_arg_free, prologue_callback_arg_free fields to
  427. enable automatic free(cl_arg); free(callback_arg);
  428. free(prologue_callback_arg) on task destroy.
  429. * New function starpu_task_build
  430. * New configure options --with-simgrid-dir
  431. --with-simgrid-include-dir and --with-simgrid-lib-dir to specify
  432. the location of the SimGrid library
  433. Changes:
  434. * Rename all filter functions to follow the pattern
  435. starpu_DATATYPE_filter_FILTERTYPE. The script
  436. tools/dev/rename_filter.sh is provided to update your existing
  437. applications to use new filters function names.
  438. * Renaming of diverse functions and datatypes. The script
  439. tools/dev/rename.sh is provided to update your existing
  440. applications to use the new names. It is also possible to compile
  441. with the pkg-config package starpu-1.0 to keep using the old
  442. names. It is however recommended to update your code and to use
  443. the package starpu-1.1.
  444. * Fix the block filter functions.
  445. * Fix StarPU-MPI on Darwin.
  446. * The FxT code can now be used on systems other than Linux.
  447. * Keep only one hashtable implementation common/uthash.h
  448. * The cache of starpu_mpi_insert_task is fixed and thus now enabled by
  449. default.
  450. * Improve starpu_machine_display output.
  451. * Standardize objects name in the performance model API
  452. * SOCL
  453. - Virtual SOCL device has been removed
  454. - Automatic scheduling still available with command queues not
  455. assigned to any device
  456. - Remove modified OpenCL headers. ICD is now the only supported
  457. way to use SOCL.
  458. - SOCL test suite is only run when environment variable
  459. SOCL_OCL_LIB_OPENCL is defined. It should contain the location
  460. of the libOpenCL.so file of the OCL ICD implementation.
  461. * Fix main memory leak on multiple unregister/re-register.
  462. * Improve hwloc detection by configure
  463. * Cell:
  464. - It is no longer possible to enable the cell support via the
  465. gordon driver
  466. - Data interfaces no longer define functions to copy to and from
  467. SPU devices
  468. - Codelet no longer define pointer for Gordon implementations
  469. - Gordon workers are no longer enabled
  470. - Gordon performance models are no longer enabled
  471. * Fix data transfer arrows in paje traces
  472. * The "heft" scheduler no longer exists. Users should now pick "dmda"
  473. instead.
  474. * StarPU can now use poti to generate paje traces.
  475. * Rename scheduling policy "parallel greedy" to "parallel eager"
  476. * starpu_scheduler.h is no longer automatically included by
  477. starpu.h, it has to be manually included when needed
  478. * New batch files to run StarPU applications with Microsoft Visual C
  479. * Add examples/release/Makefile to test StarPU examples against an
  480. installed version of StarPU. That can also be used to test
  481. examples using a previous API.
  482. * Tutorial is installed in ${docdir}/tutorial
  483. * Schedulers eager_central_policy, dm and dmda no longer erroneously respect
  484. priorities. dmdas has to be used to respect priorities.
  485. * StarPU-MPI: Fix potential bug for user-defined datatypes. As MPI
  486. can reorder messages, we need to make sure the sending of the size
  487. of the data has been completed.
  488. * Documentation is now generated through doxygen.
  489. * Modification of perfmodels output format for future improvements.
  490. * Fix for properly dealing with NAN on windows systems
  491. * Function starpu_sched_ctx_create() now takes a variable argument
  492. list to define the scheduler to be used, and the minimum and
  493. maximum priority values
  494. * The functions starpu_sched_set/get_min/max_priority set/get the
  495. priorities of the current scheduling context, i.e the one which
  496. was set by a call to starpu_sched_ctx_set_context() or the initial
  497. context if the function was not called yet.
  498. * MPI: Fix of the livelock issue discovered while executing applications
  499. on a CPU+GPU cluster of machines by adding a maximum trylock
  500. threshold before a blocking lock.
  501. Small changes:
  502. * STARPU_NCPU should now be used instead of STARPU_NCPUS. STARPU_NCPUS is
  503. still available for compatibility reasons.
  504. * include/starpu.h includes all include/starpu_*.h files, applications
  505. therefore only need to have #include <starpu.h>
  506. * Active task wait is now included in blocked time.
  507. * Fix GCC plugin linking issues starting with GCC 4.7.
  508. * Fix forcing calibration of never-calibrated archs.
  509. * CUDA applications are no longer compiled with the "-arch sm_13"
  510. option. It is specifically added to applications which need it.
  511. * Explicitly name the non-sleeping-non-running time "Overhead", and use
  512. another color in vite traces.
  513. * Use C99 variadic macro support, not GNU.
  514. * Fix performance regression: dmda queues were inadvertently made
  515. LIFOs in r9611.
  516. StarPU 1.0.3 (svn revision 7379)
  517. ==============================================
  518. Changes:
  519. * Several bug fixes in the build system
  520. * Bug fixes in source code for non-Linux systems
  521. * Fix generating FXT traces bigger than 64MiB.
  522. * Improve ENODEV error detections in StarPU FFT
  523. StarPU 1.0.2 (svn revision 7210)
  524. ==============================================
  525. Changes:
  526. * Add starpu_block_shadow_filter_func_vector and an example.
  527. * Add tag dependency in trace-generated DAG.
  528. * Fix CPU binding for optimized CPU-GPU transfers.
  529. * Fix parallel tasks CPU binding and combined worker generation.
  530. * Fix generating FXT traces bigger than 64MiB.
  531. StarPU 1.0.1 (svn revision 6659)
  532. ==============================================
  533. Changes:
  534. * hwloc support. Warn users when hwloc is not found on the system and
  535. produce error when not explicitely disabled.
  536. * Several bug fixes
  537. * GCC plug-in
  538. - Add `#pragma starpu release'
  539. - Fix bug when using `acquire' pragma with function parameters
  540. - Slightly improve test suite coverage
  541. - Relax the GCC version check
  542. * Update SOCL to use new API
  543. * Documentation improvement.
  544. StarPU 1.0.0 (svn revision 6306)
  545. ==============================================
  546. The extensions-again release
  547. New features:
  548. * Add SOCL, an OpenCL interface on top of StarPU.
  549. * Add a gcc plugin to extend the C interface with pragmas which allows to
  550. easily define codelets and issue tasks.
  551. * Add reduction mode to starpu_mpi_insert_task.
  552. * A new multi-format interface permits to use different binary formats
  553. on CPUs & GPUs, the conversion functions being provided by the
  554. application and called by StarPU as needed (and as less as
  555. possible).
  556. * Deprecate cost_model, and introduce cost_function, which is provided
  557. with the whole task structure, the target arch and implementation
  558. number.
  559. * Permit the application to provide its own size base for performance
  560. models.
  561. * Applications can provide several implementations of a codelet for the
  562. same architecture.
  563. * Add a StarPU-Top feedback and steering interface.
  564. * Permit to specify MPI tags for more efficient starpu_mpi_insert_task
  565. Changes:
  566. * Fix several memory leaks and race conditions
  567. * Make environment variables take precedence over the configuration
  568. passed to starpu_init()
  569. * Libtool interface versioning has been included in libraries names
  570. (libstarpu-1.0.so, libstarpumpi-1.0.so,
  571. libstarpufft-1.0.so, libsocl-1.0.so)
  572. * Install headers under $includedir/starpu/1.0.
  573. * Make where field for struct starpu_codelet optional. When unset, its
  574. value will be automatically set based on the availability of the
  575. different XXX_funcs fields of the codelet.
  576. * Define access modes for data handles into starpu_codelet and no longer
  577. in starpu_task. Hence mark (struct starpu_task).buffers as
  578. deprecated, and add (struct starpu_task).handles and (struct
  579. starpu_codelet).modes
  580. * Fields xxx_func of struct starpu_codelet are made deprecated. One
  581. should use fields xxx_funcs instead.
  582. * Some types were renamed for consistency. when using pkg-config libstarpu,
  583. starpu_deprecated_api.h is automatically included (after starpu.h) to
  584. keep compatibility with existing software. Other changes are mentioned
  585. below, compatibility is also preserved for them.
  586. To port code to use new names (this is not mandatory), the
  587. tools/dev/rename.sh script can be used, and pkg-config starpu-1.0 should
  588. be used.
  589. * The communication cost in the heft and dmda scheduling strategies now
  590. take into account the contention brought by the number of GPUs. This
  591. changes the meaning of the beta factor, whose default 1.0 value should
  592. now be good enough in most case.
  593. Small features:
  594. * Allow users to disable asynchronous data transfers between CPUs and
  595. GPUs.
  596. * Update OpenCL driver to enable CPU devices (the environment variable
  597. STARPU_OPENCL_ON_CPUS must be set to a positive value when
  598. executing an application)
  599. * struct starpu_data_interface_ops --- operations on a data
  600. interface --- define a new function pointer allocate_new_data
  601. which creates a new data interface of the given type based on
  602. an existing handle
  603. * Add a field named magic to struct starpu_task which is set when
  604. initialising the task. starpu_task_submit will fail if the
  605. field does not have the right value. This will hence avoid
  606. submitting tasks which have not been properly initialised.
  607. * Add a hook function pre_exec_hook in struct starpu_sched_policy.
  608. The function is meant to be called in drivers. Schedulers
  609. can use it to be notified when a task is about being computed.
  610. * Add codelet execution time statistics plot.
  611. * Add bus speed in starpu_machine_display.
  612. * Add a STARPU_DATA_ACQUIRE_CB which permits to inline the code to be
  613. done.
  614. * Add gdb functions.
  615. * Add complex support to LU example.
  616. * Permit to use the same data several times in write mode in the
  617. parameters of the same task.
  618. Small changes:
  619. * Increase default value for STARPU_MAXCPUS -- Maximum number of
  620. CPUs supported -- to 64.
  621. * Add man pages for some of the tools
  622. * Add C++ application example in examples/cpp/
  623. * Add an OpenMP fork-join example.
  624. * Documentation improvement.
  625. StarPU 0.9 (svn revision 3721)
  626. ==============================================
  627. The extensions release
  628. * Provide the STARPU_REDUX data access mode
  629. * Externalize the scheduler API.
  630. * Add theoretical bound computation
  631. * Add the void interface
  632. * Add power consumption optimization
  633. * Add parallel task support
  634. * Add starpu_mpi_insert_task
  635. * Add profiling information interface.
  636. * Add STARPU_LIMIT_GPU_MEM environment variable.
  637. * OpenCL fixes
  638. * MPI fixes
  639. * Improve optimization documentation
  640. * Upgrade to hwloc 1.1 interface
  641. * Add fortran example
  642. * Add mandelbrot OpenCL example
  643. * Add cg example
  644. * Add stencil MPI example
  645. * Initial support for CUDA4
  646. StarPU 0.4 (svn revision 2535)
  647. ==============================================
  648. The API strengthening release
  649. * Major API improvements
  650. - Provide the STARPU_SCRATCH data access mode
  651. - Rework data filter interface
  652. - Rework data interface structure
  653. - A script that automatically renames old functions to accomodate with the new
  654. API is available from https://scm.gforge.inria.fr/svn/starpu/scripts/renaming
  655. (login: anonsvn, password: anonsvn)
  656. * Implement dependencies between task directly (eg. without tags)
  657. * Implicit data-driven task dependencies simplifies the design of
  658. data-parallel algorithms
  659. * Add dynamic profiling capabilities
  660. - Provide per-task feedback
  661. - Provide per-worker feedback
  662. - Provide feedback about memory transfers
  663. * Provide a library to help accelerating MPI applications
  664. * Improve data transfers overhead prediction
  665. - Transparently benchmark buses to generate performance models
  666. - Bind accelerator-controlling threads with respect to NUMA locality
  667. * Improve StarPU's portability
  668. - Add OpenCL support
  669. - Add support for Windows
  670. StarPU 0.2.901 aka 0.3-rc1 (svn revision 1236)
  671. ==============================================
  672. The asynchronous heterogeneous multi-accelerator release
  673. * Many API changes and code cleanups
  674. - Implement starpu_worker_get_id
  675. - Implement starpu_worker_get_name
  676. - Implement starpu_worker_get_type
  677. - Implement starpu_worker_get_count
  678. - Implement starpu_display_codelet_stats
  679. - Implement starpu_data_prefetch_on_node
  680. - Expose the starpu_data_set_wt_mask function
  681. * Support nvidia (heterogeneous) multi-GPU
  682. * Add the data request mechanism
  683. - All data transfers use data requests now
  684. - Implement asynchronous data transfers
  685. - Implement prefetch mechanism
  686. - Chain data requests to support GPU->RAM->GPU transfers
  687. * Make it possible to bypass the scheduler and to assign a task to a specific
  688. worker
  689. * Support restartable tasks to reinstanciate dependencies task graphs
  690. * Improve performance prediction
  691. - Model data transfer overhead
  692. - One model is created for each accelerator
  693. * Support for CUDA's driver API is deprecated
  694. * The STARPU_WORKERS_CUDAID and STARPU_WORKERS_CPUID env. variables make it possible to
  695. specify where to bind the workers
  696. * Use the hwloc library to detect the actual number of cores
  697. StarPU 0.2.0 (svn revision 1013)
  698. ==============================================
  699. The Stabilizing-the-Basics release
  700. * Various API cleanups
  701. * Mac OS X is supported now
  702. * Add dynamic code loading facilities onto Cell's SPUs
  703. * Improve performance analysis/feedback tools
  704. * Application can interact with StarPU tasks
  705. - The application may access/modify data managed by the DSM
  706. - The application may wait for the termination of a (set of) task(s)
  707. * An initial documentation is added
  708. * More examples are supplied
  709. StarPU 0.1.0 (svn revision 794)
  710. ==============================================
  711. First release.
  712. Status:
  713. * Only supports Linux platforms yet
  714. * Supported architectures
  715. - multicore CPUs
  716. - NVIDIA GPUs (with CUDA 2.x)
  717. - experimental Cell/BE support
  718. Changes:
  719. * Scheduling facilities
  720. - run-time selection of the scheduling policy
  721. - basic auto-tuning facilities
  722. * Software-based DSM
  723. - transparent data coherency management
  724. - High-level expressive interface
  725. # Local Variables:
  726. # mode: text
  727. # coding: utf-8
  728. # ispell-local-dictionary: "american"
  729. # End: