ChangeLog 23 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507
  1. # StarPU --- Runtime system for heterogeneous multicore architectures.
  2. #
  3. # Copyright (C) 2009-2013 Université de Bordeaux 1
  4. # Copyright (C) 2010, 2011, 2012, 2013 Centre National de la Recherche Scientifique
  5. #
  6. # StarPU is free software; you can redistribute it and/or modify
  7. # it under the terms of the GNU Lesser General Public License as published by
  8. # the Free Software Foundation; either version 2.1 of the License, or (at
  9. # your option) any later version.
  10. #
  11. # StarPU is distributed in the hope that it will be useful, but
  12. # WITHOUT ANY WARRANTY; without even the implied warranty of
  13. # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
  14. #
  15. # See the GNU Lesser General Public License in COPYING.LGPL for more details.
  16. StarPU 1.2.0 (svn revision xxxx)
  17. ==============================================
  18. New features:
  19. * Xeon Phi support
  20. * SCC support
  21. * New function starpu_sched_ctx_exec_parallel_code to execute a
  22. parallel code on the workers of the given scheduler context
  23. * MPI:
  24. - New internal communication system : a unique tag called
  25. is now used for all communications, and a system
  26. of hashmaps on each node which stores pending receives has been
  27. implemented. Every message is now coupled with an envelope, sent
  28. before the corresponding data, which allows the receiver to
  29. allocate data correctly, and to submit the matching receive of
  30. the envelope.
  31. * New STARPU_COMMUTE flag which can be passed along STARPU_W or STARPU_RW to
  32. let starpu commute write accesses.
  33. * Out-of-core support, through registration of disk areas as additional memory
  34. nodes.
  35. * StarPU-MPI: new function
  36. starpu_mpi_irecv_detached_sequential_consistency which allows to
  37. enable or disable the sequential consistency for the given data
  38. handle (sequential consistency will be enabled or disabled based
  39. on the value of the function parameter and the value of the
  40. sequential consistency defined for the given data)
  41. * Performance models files are now stored in a directory whose name
  42. include the version of the performance model format. The version
  43. number is also written in the file itself.
  44. When updating the format, the internal variable
  45. _STARPU_PERFMODEL_VERSION should be updated. It is then possible
  46. to switch easily between differents versions of StarPU having
  47. different performance model formats.
  48. * Tasks can now define a optional prologue callback which is executed
  49. on the host when the task becomes ready for execution, before getting
  50. scheduled.
  51. Small features:
  52. * New functions starpu_data_acquire_cb_sequential_consistency() and
  53. starpu_data_acquire_on_node_cb_sequential_consistency() which allows
  54. to enable or disable sequential consistency
  55. * New configure option --enable-fxt-lock which enables additional
  56. trace events focused on locks behaviour during the execution
  57. * New function starpu_perfmodel_directory() to print directory
  58. storing performance models. Available through the new option -d of
  59. the tool starpu_perfmodel_display
  60. * New batch files to execute StarPU applications under Microsoft
  61. Visual Studio (They are installed in path_to_starpu/bin/mvsc)/
  62. * Add cl_arg_free, callback_arg_free, prologue_callback_arg_free fields to
  63. enable automatic free(cl_arg); free(callback_arg);
  64. free(prologue_callback_arg) on task destroy.
  65. * New function starpu_init_task
  66. Changes:
  67. * Fix of the livelock issue discovered while executing applications
  68. on a CPU+GPU cluster of machines by adding a maximum trylock
  69. threshold before a blocking lock.
  70. * Data interfaces (variable, vector, matrix and block) now define
  71. pack und unpack functions
  72. * Fix for properly dealing with NAN on windows systems
  73. * StarPU-MPI: Fix for being able to receive data which have not yet
  74. been registered by the application (i.e it did not call
  75. starpu_data_set_tag(), data are received as a raw memory)
  76. * StarPU-MPI: Fix for being able to receive data with the same tag
  77. from several nodes (see mpi/tests/gather.c)
  78. StarPU 1.1.0 (svn revision xxxx)
  79. ==============================================
  80. New features:
  81. * OpenGL interoperability support.
  82. * Capability to store compiled OpenCL kernels on the file system
  83. * Capability to load compiled OpenCL kernels
  84. * Performance models measurements can now be provided explicitly by
  85. applications.
  86. * Capability to emit communication statistics when running MPI code
  87. * Add starpu_unregister_submit, starpu_data_acquire_on_node and
  88. starpu_data_invalidate_submit
  89. * New functionnality to wrapper starpu_insert_task to pass a array of
  90. data_handles via the parameter STARPU_DATA_ARRAY
  91. * Enable GPU-GPU direct transfers.
  92. * GCC plug-in
  93. - Add `registered' attribute
  94. - A new pass was added that warns about the use of possibly
  95. unregistered memory buffers.
  96. * SOCL
  97. - Manual mapping of commands on specific devices is now
  98. possible
  99. - SOCL does not require StarPU CPU tasks anymore. CPU workers
  100. are automatically disabled to enhance performance of OpenCL
  101. CPU devices
  102. * New interface: COO matrix.
  103. * Data interfaces: The pack operation of user-defined data interface
  104. defines a new parameter count which should be set to the size of
  105. the buffer created by the packing of the data.
  106. * MPI:
  107. - Communication statistics for MPI can only be enabled at
  108. execution time by defining the environment variable
  109. STARPU_COMM_STATS
  110. - Communication cache mechanism is enabled by default, and can
  111. only be disabled at execution time by setting the
  112. environment variable STARPU_MPI_CACHE to 0.
  113. - Initialisation functions starpu_mpi_initialize_extended()
  114. and starpu_mpi_initialize() have been made deprecated. One
  115. should now use starpu_mpi_init(int *, char ***, int). The
  116. last parameter indicates if MPI should be initialised.
  117. - Collective detached operations have new parameters, a
  118. callback function and a argument. This is to be consistent
  119. with the detached point-to-point communications.
  120. - When exchanging user-defined data interfaces, the size of
  121. the data is the size returned by the pack operation, i.e
  122. data with dynamic size can now be exchanged with StarPU-MPI.
  123. * Add experimental simgrid support, to simulate execution with various
  124. number of CPUs, GPUs, amount of memory, etc.
  125. * Add support for OpenCL simulators (which provide simulated execution time)
  126. * Add support for Temanejo, a task graph debugger
  127. * Theoretical bound lp output now includes data transfer time.
  128. * Update OpenCL driver to only enable CPU devices (the environment
  129. variable STARPU_OPENCL_ONLY_ON_CPUS must be set to a positive
  130. value when executing an application)
  131. * Add Scheduling contexts to separate computation resources
  132. - Scheduling policies take into account the set of resources corresponding
  133. to the context it belongs to
  134. - Add support to dynamically change scheduling contexts
  135. (Create and Delete a context, Add Workers to a context, Remove workers from a context)
  136. - Add support to indicate to which contexts the tasks are submitted
  137. * Add the Hypervisor to manage the Scheduling Contexts automatically
  138. - The Contexts can be registered to the Hypervisor
  139. - Only the registered contexts are managed by the Hypervisor
  140. - The Hypervisor can detect the initial distribution of resources of
  141. a context and constructs it consequently (the cost of execution is required)
  142. - Several policies can adapt dynamically the distribution of resources
  143. in contexts if the initial one was not appropriate
  144. - Add a platform to implement new policies of redistribution
  145. of resources
  146. * Implement a memory manager which checks the global amount of
  147. memory available on devices, and checks there is enough memory
  148. before doing an allocation on the device.
  149. * Discard environment variable STARPU_LIMIT_GPU_MEM and define
  150. instead STARPU_LIMIT_CUDA_MEM and STARPU_LIMIT_OPENCL_MEM
  151. * Introduce new variables STARPU_LIMIT_CUDA_devid_MEM and
  152. STARPU_LIMIT_OPENCL_devid_MEM to limit memory per specific device
  153. * Introduce new variable STARPU_LIMIT_CPU_MEM to limit memory for
  154. the CPU devices
  155. * New function starpu_malloc_flags to define a memory allocation with
  156. constraints based on the following values:
  157. - STARPU_MALLOC_PINNED specifies memory should be pinned
  158. - STARPU_MALLOC_COUNT specifies the memory allocation should be in
  159. the limits defined by the environment variables STARPU_LIMIT_xxx
  160. (see above). When no memory is left, starpu_malloc_flag tries
  161. to reclaim memory from StarPU and returns -ENOMEM on failure.
  162. * starpu_malloc calls starpu_malloc_flags with a value of flag set
  163. to STARPU_MALLOC_PINNED
  164. * Define new function starpu_free_flags similarly to starpu_malloc_flags
  165. * Define new public API starpu_pthread which is similar to the
  166. pthread API. It is provided with 2 implementations: a pthread one
  167. and a Simgrid one. Applications using StarPU and wishing to use
  168. the Simgrid StarPU features should use it.
  169. * Allow to have a dynamically allocated number of buffers per task,
  170. and so overwrite the value defined --enable-maxbuffers=XXX
  171. Small features:
  172. * Add starpu_worker_get_by_type and starpu_worker_get_by_devid
  173. * Add starpu_fxt_stop_profiling/starpu_fxt_start_profiling which permits to
  174. pause trace recording.
  175. * Add trace_buffer_size configuration field to permit to specify the tracing
  176. buffer size.
  177. * Add starpu_codelet_profile and starpu_codelet_histo_profile, tools which draw
  178. the profile of a codelet.
  179. * File STARPU-REVISION --- containing the SVN revision number from which
  180. StarPU was compiled --- is installed in the share/doc/starpu directory
  181. * starpu_perfmodel_plot can now directly draw GFlops curves.
  182. * New configure option --enable-mpi-progression-hook to enable the
  183. activity polling method for StarPU-MPI.
  184. * Permit to disable sequential consistency for a given task.
  185. * New macro STARPU_RELEASE_VERSION
  186. * New function starpu_get_version() to return as 3 integers the
  187. release version of StarPU.
  188. * Enable by default data allocation cache
  189. Changes:
  190. * Rename all filter functions to follow the pattern
  191. starpu_DATATYPE_filter_FILTERTYPE. The script
  192. tools/dev/rename_filter.sh is provided to update your existing
  193. applications to use new filters function names.
  194. * Renaming of diverse functions and datatypes. The script
  195. tools/dev/rename.sh is provided to update your existing
  196. applications to use the new names. It is also possible to compile
  197. with the pkg-config package starpu-1.0 to keep using the old
  198. names. It is however recommended to update your code and to use
  199. the package starpu-1.1.
  200. * Fix the block filter functions.
  201. * Fix StarPU-MPI on Darwin.
  202. * The FxT code can now be used on systems other than Linux.
  203. * Keep only one hashtable implementation common/uthash.h
  204. * The cache of starpu_mpi_insert_task is fixed and thus now enabled by
  205. default.
  206. * Improve starpu_machine_display output.
  207. * Standardize objects name in the performance model API
  208. * SOCL
  209. - Virtual SOCL device has been removed
  210. - Automatic scheduling still available with command queues not
  211. assigned to any device
  212. - Remove modified OpenCL headers. ICD is now the only supported
  213. way to use SOCL.
  214. - SOCL test suite is only run when environment variable
  215. SOCL_OCL_LIB_OPENCL is defined. It should contain the location
  216. of the libOpenCL.so file of the OCL ICD implementation.
  217. * Fix main memory leak on multiple unregister/re-register.
  218. * Improve hwloc detection by configure
  219. * Cell:
  220. - It is no longer possible to enable the cell support via the
  221. gordon driver
  222. - Data interfaces no longer define functions to copy to and from
  223. SPU devices
  224. - Codelet no longer define pointer for Gordon implementations
  225. - Gordon workers are no longer enabled
  226. - Gordon performance models are no longer enabled
  227. * Fix data transfer arrows in paje traces
  228. * The "heft" scheduler no longer exists. Users should now pick "dmda"
  229. instead.
  230. * StarPU can now use poti to generate paje traces.
  231. * Rename scheduling policy "parallel greedy" to "parallel eager"
  232. * starpu_scheduler.h is no longer automatically included by
  233. starpu.h, it has to be manually included when needed
  234. * New batch files to run StarPU applications with Microsoft Visual C
  235. * Add examples/release/Makefile to test StarPU examples against an
  236. installed version of StarPU. That can also be used to test
  237. examples using a previous API.
  238. * Tutorial is installed in ${docdir}/tutorial
  239. * Schedulers eager_central_policy, dm and dmda no longer erroneously respect
  240. priorities. dmdas has to be used to respect priorities.
  241. * Documentation is now generated through doxygen.
  242. Small changes:
  243. * STARPU_NCPU should now be used instead of STARPU_NCPUS. STARPU_NCPUS is
  244. still available for compatibility reasons.
  245. * include/starpu.h includes all include/starpu_*.h files, applications
  246. therefore only need to have #include <starpu.h>
  247. * Active task wait is now included in blocked time.
  248. * Fix GCC plugin linking issues starting with GCC 4.7.
  249. * Fix forcing calibration of never-calibrated archs.
  250. * CUDA applications are no longer compiled with the "-arch sm_13"
  251. option. It is specifically added to applications which need it.
  252. * Explicitly name the non-sleeping-non-running time "Overhead", and use
  253. another color in vite traces.
  254. * Use C99 variadic macro support, not GNU.
  255. * Fix performance regression: dmda queues were inadvertently made
  256. LIFOs in r9611.
  257. StarPU 1.0.3 (svn revision 7379)
  258. ==============================================
  259. Changes:
  260. * Several bug fixes in the build system
  261. * Bug fixes in source code for non-Linux systems
  262. * Fix generating FXT traces bigger than 64MiB.
  263. * Improve ENODEV error detections in StarPU FFT
  264. StarPU 1.0.2 (svn revision xxx)
  265. ==============================================
  266. Changes:
  267. * Add starpu_block_shadow_filter_func_vector and an example.
  268. * Add tag dependency in trace-generated DAG.
  269. * Fix CPU binding for optimized CPU-GPU transfers.
  270. * Fix parallel tasks CPU binding and combined worker generation.
  271. * Fix generating FXT traces bigger than 64MiB.
  272. StarPU 1.0.1 (svn revision 6659)
  273. ==============================================
  274. Changes:
  275. * hwloc support. Warn users when hwloc is not found on the system and
  276. produce error when not explicitely disabled.
  277. * Several bug fixes
  278. * GCC plug-in
  279. - Add `#pragma starpu release'
  280. - Fix bug when using `acquire' pragma with function parameters
  281. - Slightly improve test suite coverage
  282. - Relax the GCC version check
  283. * Update SOCL to use new API
  284. * Documentation improvement.
  285. StarPU 1.0.0 (svn revision 6306)
  286. ==============================================
  287. The extensions-again release
  288. New features:
  289. * Add SOCL, an OpenCL interface on top of StarPU.
  290. * Add a gcc plugin to extend the C interface with pragmas which allows to
  291. easily define codelets and issue tasks.
  292. * Add reduction mode to starpu_mpi_insert_task.
  293. * A new multi-format interface permits to use different binary formats
  294. on CPUs & GPUs, the conversion functions being provided by the
  295. application and called by StarPU as needed (and as less as
  296. possible).
  297. * Deprecate cost_model, and introduce cost_function, which is provided
  298. with the whole task structure, the target arch and implementation
  299. number.
  300. * Permit the application to provide its own size base for performance
  301. models.
  302. * Applications can provide several implementations of a codelet for the
  303. same architecture.
  304. * Add a StarPU-Top feedback and steering interface.
  305. * Permit to specify MPI tags for more efficient starpu_mpi_insert_task
  306. Changes:
  307. * Fix several memory leaks and race conditions
  308. * Make environment variables take precedence over the configuration
  309. passed to starpu_init()
  310. * Libtool interface versioning has been included in libraries names
  311. (libstarpu-1.0.so, libstarpumpi-1.0.so,
  312. libstarpufft-1.0.so, libsocl-1.0.so)
  313. * Install headers under $includedir/starpu/1.0.
  314. * Make where field for struct starpu_codelet optional. When unset, its
  315. value will be automatically set based on the availability of the
  316. different XXX_funcs fields of the codelet.
  317. * Define access modes for data handles into starpu_codelet and no longer
  318. in starpu_task. Hence mark (struct starpu_task).buffers as
  319. deprecated, and add (struct starpu_task).handles and (struct
  320. starpu_codelet).modes
  321. * Fields xxx_func of struct starpu_codelet are made deprecated. One
  322. should use fields xxx_funcs instead.
  323. * Some types were renamed for consistency. when using pkg-config libstarpu,
  324. starpu_deprecated_api.h is automatically included (after starpu.h) to
  325. keep compatibility with existing software. Other changes are mentioned
  326. below, compatibility is also preserved for them.
  327. To port code to use new names (this is not mandatory), the
  328. tools/dev/rename.sh script can be used, and pkg-config starpu-1.0 should
  329. be used.
  330. * The communication cost in the heft and dmda scheduling strategies now
  331. take into account the contention brought by the number of GPUs. This
  332. changes the meaning of the beta factor, whose default 1.0 value should
  333. now be good enough in most case.
  334. Small features:
  335. * Allow users to disable asynchronous data transfers between CPUs and
  336. GPUs.
  337. * Update OpenCL driver to enable CPU devices (the environment variable
  338. STARPU_OPENCL_ON_CPUS must be set to a positive value when
  339. executing an application)
  340. * struct starpu_data_interface_ops --- operations on a data
  341. interface --- define a new function pointer allocate_new_data
  342. which creates a new data interface of the given type based on
  343. an existing handle
  344. * Add a field named magic to struct starpu_task which is set when
  345. initialising the task. starpu_task_submit will fail if the
  346. field does not have the right value. This will hence avoid
  347. submitting tasks which have not been properly initialised.
  348. * Add a hook function pre_exec_hook in struct starpu_sched_policy.
  349. The function is meant to be called in drivers. Schedulers
  350. can use it to be notified when a task is about being computed.
  351. * Add codelet execution time statistics plot.
  352. * Add bus speed in starpu_machine_display.
  353. * Add a STARPU_DATA_ACQUIRE_CB which permits to inline the code to be
  354. done.
  355. * Add gdb functions.
  356. * Add complex support to LU example.
  357. * Permit to use the same data several times in write mode in the
  358. parameters of the same task.
  359. Small changes:
  360. * Increase default value for STARPU_MAXCPUS -- Maximum number of
  361. CPUs supported -- to 64.
  362. * Add man pages for some of the tools
  363. * Add C++ application example in examples/cpp/
  364. * Add an OpenMP fork-join example.
  365. * Documentation improvement.
  366. StarPU 0.9 (svn revision 3721)
  367. ==============================================
  368. The extensions release
  369. * Provide the STARPU_REDUX data access mode
  370. * Externalize the scheduler API.
  371. * Add theoretical bound computation
  372. * Add the void interface
  373. * Add power consumption optimization
  374. * Add parallel task support
  375. * Add starpu_mpi_insert_task
  376. * Add profiling information interface.
  377. * Add STARPU_LIMIT_GPU_MEM environment variable.
  378. * OpenCL fixes
  379. * MPI fixes
  380. * Improve optimization documentation
  381. * Upgrade to hwloc 1.1 interface
  382. * Add fortran example
  383. * Add mandelbrot OpenCL example
  384. * Add cg example
  385. * Add stencil MPI example
  386. * Initial support for CUDA4
  387. StarPU 0.4 (svn revision 2535)
  388. ==============================================
  389. The API strengthening release
  390. * Major API improvements
  391. - Provide the STARPU_SCRATCH data access mode
  392. - Rework data filter interface
  393. - Rework data interface structure
  394. - A script that automatically renames old functions to accomodate with the new
  395. API is available from https://scm.gforge.inria.fr/svn/starpu/scripts/renaming
  396. (login: anonsvn, password: anonsvn)
  397. * Implement dependencies between task directly (eg. without tags)
  398. * Implicit data-driven task dependencies simplifies the design of
  399. data-parallel algorithms
  400. * Add dynamic profiling capabilities
  401. - Provide per-task feedback
  402. - Provide per-worker feedback
  403. - Provide feedback about memory transfers
  404. * Provide a library to help accelerating MPI applications
  405. * Improve data transfers overhead prediction
  406. - Transparently benchmark buses to generate performance models
  407. - Bind accelerator-controlling threads with respect to NUMA locality
  408. * Improve StarPU's portability
  409. - Add OpenCL support
  410. - Add support for Windows
  411. StarPU 0.2.901 aka 0.3-rc1 (svn revision 1236)
  412. ==============================================
  413. The asynchronous heterogeneous multi-accelerator release
  414. * Many API changes and code cleanups
  415. - Implement starpu_worker_get_id
  416. - Implement starpu_worker_get_name
  417. - Implement starpu_worker_get_type
  418. - Implement starpu_worker_get_count
  419. - Implement starpu_display_codelet_stats
  420. - Implement starpu_data_prefetch_on_node
  421. - Expose the starpu_data_set_wt_mask function
  422. * Support nvidia (heterogeneous) multi-GPU
  423. * Add the data request mechanism
  424. - All data transfers use data requests now
  425. - Implement asynchronous data transfers
  426. - Implement prefetch mechanism
  427. - Chain data requests to support GPU->RAM->GPU transfers
  428. * Make it possible to bypass the scheduler and to assign a task to a specific
  429. worker
  430. * Support restartable tasks to reinstanciate dependencies task graphs
  431. * Improve performance prediction
  432. - Model data transfer overhead
  433. - One model is created for each accelerator
  434. * Support for CUDA's driver API is deprecated
  435. * The STARPU_WORKERS_CUDAID and STARPU_WORKERS_CPUID env. variables make it possible to
  436. specify where to bind the workers
  437. * Use the hwloc library to detect the actual number of cores
  438. StarPU 0.2.0 (svn revision 1013)
  439. ==============================================
  440. The Stabilizing-the-Basics release
  441. * Various API cleanups
  442. * Mac OS X is supported now
  443. * Add dynamic code loading facilities onto Cell's SPUs
  444. * Improve performance analysis/feedback tools
  445. * Application can interact with StarPU tasks
  446. - The application may access/modify data managed by the DSM
  447. - The application may wait for the termination of a (set of) task(s)
  448. * An initial documentation is added
  449. * More examples are supplied
  450. StarPU 0.1.0 (svn revision 794)
  451. ==============================================
  452. First release.
  453. Status:
  454. * Only supports Linux platforms yet
  455. * Supported architectures
  456. - multicore CPUs
  457. - NVIDIA GPUs (with CUDA 2.x)
  458. - experimental Cell/BE support
  459. Changes:
  460. * Scheduling facilities
  461. - run-time selection of the scheduling policy
  462. - basic auto-tuning facilities
  463. * Software-based DSM
  464. - transparent data coherency management
  465. - High-level expressive interface
  466. # Local Variables:
  467. # mode: text
  468. # coding: utf-8
  469. # ispell-local-dictionary: "american"
  470. # End: