ChangeLog 60 KB

12345678910111213141516171819202122232425262728293031323334353637383940414243444546474849505152535455565758596061626364656667686970717273747576777879808182838485868788899091929394959697989910010110210310410510610710810911011111211311411511611711811912012112212312412512612712812913013113213313413513613713813914014114214314414514614714814915015115215315415515615715815916016116216316416516616716816917017117217317417517617717817918018118218318418518618718818919019119219319419519619719819920020120220320420520620720820921021121221321421521621721821922022122222322422522622722822923023123223323423523623723823924024124224324424524624724824925025125225325425525625725825926026126226326426526626726826927027127227327427527627727827928028128228328428528628728828929029129229329429529629729829930030130230330430530630730830931031131231331431531631731831932032132232332432532632732832933033133233333433533633733833934034134234334434534634734834935035135235335435535635735835936036136236336436536636736836937037137237337437537637737837938038138238338438538638738838939039139239339439539639739839940040140240340440540640740840941041141241341441541641741841942042142242342442542642742842943043143243343443543643743843944044144244344444544644744844945045145245345445545645745845946046146246346446546646746846947047147247347447547647747847948048148248348448548648748848949049149249349449549649749849950050150250350450550650750850951051151251351451551651751851952052152252352452552652752852953053153253353453553653753853954054154254354454554654754854955055155255355455555655755855956056156256356456556656756856957057157257357457557657757857958058158258358458558658758858959059159259359459559659759859960060160260360460560660760860961061161261361461561661761861962062162262362462562662762862963063163263363463563663763863964064164264364464564664764864965065165265365465565665765865966066166266366466566666766866967067167267367467567667767867968068168268368468568668768868969069169269369469569669769869970070170270370470570670770870971071171271371471571671771871972072172272372472572672772872973073173273373473573673773873974074174274374474574674774874975075175275375475575675775875976076176276376476576676776876977077177277377477577677777877978078178278378478578678778878979079179279379479579679779879980080180280380480580680780880981081181281381481581681781881982082182282382482582682782882983083183283383483583683783883984084184284384484584684784884985085185285385485585685785885986086186286386486586686786886987087187287387487587687787887988088188288388488588688788888989089189289389489589689789889990090190290390490590690790890991091191291391491591691791891992092192292392492592692792892993093193293393493593693793893994094194294394494594694794894995095195295395495595695795895996096196296396496596696796896997097197297397497597697797897998098198298398498598698798898999099199299399499599699799899910001001100210031004100510061007100810091010101110121013101410151016101710181019102010211022102310241025102610271028102910301031103210331034103510361037103810391040104110421043104410451046104710481049105010511052105310541055105610571058105910601061106210631064106510661067106810691070107110721073107410751076107710781079108010811082108310841085108610871088108910901091109210931094109510961097109810991100110111021103110411051106110711081109111011111112111311141115111611171118111911201121112211231124112511261127112811291130113111321133113411351136113711381139114011411142114311441145114611471148114911501151115211531154115511561157115811591160116111621163116411651166116711681169117011711172117311741175117611771178117911801181118211831184118511861187118811891190119111921193119411951196119711981199120012011202120312041205120612071208120912101211121212131214121512161217121812191220122112221223122412251226122712281229123012311232123312341235123612371238123912401241124212431244124512461247124812491250125112521253125412551256125712581259126012611262126312641265126612671268126912701271127212731274127512761277127812791280
  1. # StarPU --- Runtime system for heterogeneous multicore architectures.
  2. #
  3. # Copyright (C) 2009-2020 Université de Bordeaux, CNRS (LaBRI UMR 5800), Inria
  4. #
  5. # StarPU is free software; you can redistribute it and/or modify
  6. # it under the terms of the GNU Lesser General Public License as published by
  7. # the Free Software Foundation; either version 2.1 of the License, or (at
  8. # your option) any later version.
  9. #
  10. # StarPU is distributed in the hope that it will be useful, but
  11. # WITHOUT ANY WARRANTY; without even the implied warranty of
  12. # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
  13. #
  14. # See the GNU Lesser General Public License in COPYING.LGPL for more details.
  15. #
  16. StarPU 1.4.0 (git revision xxxx)
  17. ==============================================
  18. New features:
  19. * Fault tolerance support with starpu_task_ft_failed().
  20. * Add get_max_size method to data interfaces for applications using data with
  21. variable size to express their maximal potential size.
  22. * New offline tool to draw graph showing elapsed time between sent
  23. or received data and their use by tasks
  24. * Add 4D tensor data interface.
  25. * New sched_tasks.rec trace file which monitors task scheduling push/pop actions
  26. * New STARPU_MPI_MEM_THROTTLE environment variable to throttle mpi
  27. submission according to memory use.
  28. * New number_events.data trace file which monitors number of events in trace
  29. files. This file can be parsed by the new script
  30. starpu_fxt_number_events_to_names.py to convert event keys to event names.
  31. Small changes:
  32. * Use the S4U interface of Simgrid instead of xbt and MSG.
  33. StarPU 1.3.4 (git revision xxx)
  34. ==============================================
  35. Small features:
  36. * New environment variables STARPU_BUS_STATS_FILE and
  37. STARPU_WORKER_STATS_FILE to specify files in which to display
  38. statistics about data transfers and workers.
  39. * Add starpu_bcsr_filter_vertical_block filtering function.
  40. * Add starpu_interface_copy2d, 3d, and 4d to easily request data copies from
  41. data interfaces.
  42. * Move optimized cuda 2d copy from interfaces to new
  43. starpu_cuda_copy2d_async_sync and starpu_cuda_copy3d_async_sync, and use
  44. them from starpu_interface_copy2d and 3d.
  45. * New function starpu_task_watchdog_set_hook to specify a function
  46. to be called when the watchdog is raised
  47. StarPU 1.3.3 (git revision 11afc5b007fe1ab1c729b55b47a5a98ef7f3cfad)
  48. ====================================================================
  49. New features:
  50. * New semantic for starpu_task_insert() and alike parameters
  51. STARPU_CALLBACK_ARG, STARPU_PROLOGUE_CALLBACK_ARG, and
  52. STARPU_PROLOGUE_CALLBACK_POP_ARG which set respectively
  53. starpu_task::callback_arg_free,
  54. starpu_task::prologue_callback_arg_free and
  55. starpu_task::prologue_callback_pop_arg_free to 1 when used.
  56. New parameters STARPU_CALLBACK_ARG_NFREE,
  57. STARPU_CALLBACK_WITH_ARG_NFREE, STARPU_PROLOGUE_CALLBACK_ARG_NFREE, and
  58. STARPU_PROLOGUE_CALLBACK_POP_ARG_NFREE which set the corresponding
  59. fields of starpu_task to 0.
  60. * starpufft: Support 3D.
  61. * New modular-eager-prio scheduler.
  62. * Add 'ready' heuristic to modular schedulers.
  63. * New modular-heteroprio scheduler.
  64. * Add STARPU_TASK_SCHED_DATA
  65. * Add support for staging schedulers.
  66. * New modular-heteroprio-heft scheduler.
  67. * New dmdap "data-aware performance model (priority)" scheduler
  68. Changes:
  69. * Modification in the Native Fortran interface of the functions
  70. fstarpu_mpi_task_insert, fstarpu_mpi_task_build and
  71. fstarpu_mpi_task_post_build to only take 1 parameter being the MPI
  72. communicator, the codelet and the various parameters for the task.
  73. Small features:
  74. * New starpu_task_insert() and alike parameter STARPU_TASK_WORKERIDS
  75. allowing to set the fields starpu_task::workerids_len and
  76. starpu_task::workerids
  77. * New starpu_task_insert() and alike parameters
  78. STARPU_SEQUENTIAL_CONSISTENCY, STARPU_TASK_NO_SUBMITORDER and
  79. STARPU_TASK_PROFILING_INFO
  80. * New function starpu_create_callback_task() which creates and
  81. submits an empty task with the specified callback
  82. Small changes:
  83. * Default modular worker queues to 2 tasks unless it's an heft
  84. scheduler
  85. * Separate out STATUS_SLEEPING_SCHEDULING state from
  86. STATUS_SLEEPING state
  87. When running the scheduler while being idle, workers do not go in
  88. the STATUS_SCHEDULING state, so that that time is considered as
  89. idle time instead of overhead.
  90. StarPU 1.3.2 (git revision af22a20fc00a37addf3cc6506305f89feed940b0)
  91. ====================================================================
  92. Small changes:
  93. * Improve OpenMP support to detect the environment is valid before
  94. launching OpenMP
  95. * Delete old code (drivers gordon, scc, starpu-top, and plugin gcc)
  96. and update authors file accordingly
  97. * Add Heteroprio documentation (including a simple example)
  98. * Add a progression hook, to be called when workers are idle, which
  99. is used in the NewMadeleine implementation of StarPU-MPI to ensure
  100. communications progress.
  101. StarPU 1.3.1 (git revision 01949488b4f8e6fe26d2c200293b8aae5876b038)
  102. ====================================================================
  103. Small features:
  104. * Add starpu_filter_nparts_compute_chunk_size_and_offset helper.
  105. * Add starpu_bcsr_filter_canonical_block_child_ops.
  106. Small changes:
  107. * Improve detection of NVML availability. Do not only check the
  108. library is available, also check the compiled code can be run.
  109. StarPU 1.3.0 (git revision 24ca83c6dbb102e1cfc41db3bb21c49662067062)
  110. ====================================================================
  111. New features:
  112. * New scheduler 'heteroprio' with heterogeneous priorities
  113. * Support priorities for data transfers.
  114. * Add support for multiple linear regression performance models
  115. - Bump performance model file format version to 45.
  116. * Add MPI Master-Slave support to use the cores of remote nodes. Use the
  117. --enable-mpi-master-slave option to activate it.
  118. * Add STARPU_CUDA_THREAD_PER_DEV environment variable to support driving all
  119. GPUs from only one thread when almost all kernels are asynchronous.
  120. * Add starpu_replay tool to replay tasks.rec files with Simgrid.
  121. * Add experimental support of NUMA nodes. Use STARPU_USE_NUMA to activate it.
  122. * Add a new set of functions to make Out-of-Core based on HDF5 Library.
  123. * Add a new implementation of StarPU-MPI on top of NewMadeleine
  124. * Add optional callbacks to notify an external resource manager
  125. about workers going to sleep and waking up
  126. * Add implicit support for asynchronous partition planning. This means one
  127. does not need to call starpu_data_partition_submit() etc. explicitly any
  128. more, StarPU will make the appropriate calls as needed.
  129. * Add starpu_task_notify_ready_soon_register() to be notified when it is
  130. determined when a task will be ready an estimated amount of time from now.
  131. * New StarPU-MPI initialization function (starpu_mpi_init_conf())
  132. which allows StarPU-MPI to manage reserving a core for the MPI thread, or
  133. merging it with CPU driver 0.
  134. * Add possibility to delay the termination of a task with the
  135. functions starpu_task_end_dep_add() which specifies the number of
  136. calls to the function starpu_task_end_dep_release() needed to
  137. trigger the task termination, or with starpu_task_declare_end_deps_array()
  138. and starpu_task_declare_end_deps() to just declare termination dependencies
  139. between tasks.
  140. * Add possibility to define the sequential consistency at the task level
  141. for each handle used by the task.
  142. * Add STARPU_SPECIFIC_NODE_LOCAL, STARPU_SPECIFIC_NODE_CPU, and
  143. STARPU_SPECIFIC_NODE_SLOW as generic values for codelet specific memory
  144. nodes which can be used instead of exact node numbers.
  145. * Add starpu_get_next_bindid() and starpu_bind_thread_on() to allow
  146. binding an application-started thread on a free core. Use it in
  147. StarPU-MPI to automatically bind the MPI thread on an available core.
  148. * Add STARPU_RESERVE_NCPU environment variable and
  149. starpu_config::reserve_ncpus field to make StarPU use a few cores
  150. less.
  151. * Add STARPU_MAIN_THREAD_BIND environment variable to make StarPU reserve a
  152. core for the main thread.
  153. * New StarPU-RM resource management module to share processor cores and
  154. accelerator devices with other parallel runtime systems. Use
  155. --enable-starpurm option to activate it.
  156. * New schedulers modular-gemm, modular-pheft, modular-prandom and
  157. modular-prandom-prio
  158. * Add STARPU_MATRIX_SET_NX/NY/LD and STARPU_VECTOR_SET_NX to change a matrix
  159. tile or vector size without reallocating the buffer.
  160. * Application can change the allocation used by StarPU with
  161. starpu_malloc_set_hooks()
  162. * XML output for starpu_perfmodel_display and starpu_perfmodel_dump_xml()
  163. function
  164. Small features:
  165. * Scheduling contexts may now be associated a user data pointer at creation
  166. time, that can later be recalled through starpu_sched_ctx_get_user_data().
  167. * New environment variables STARPU_SIMGRID_TASK_SUBMIT_COST and
  168. STARPU_SIMGRID_FETCHING_INPUT_COST to simulate the cost of task
  169. submission and data fetching in simgrid mode.
  170. This provides more accurate simgrid predictions, especially for the
  171. beginning of the execution and regarding data transfers.
  172. * New environment variable STARPU_SIMGRID_SCHED_COST to take into
  173. account the time to perform scheduling when running in SimGrid mode.
  174. * New configure option --enable-mpi-pedantic-isend (disabled by
  175. default) to acquire data in STARPU_RW (instead of STARPU_R) before
  176. performing MPI_Isend() call
  177. * New function starpu_worker_display_names() to display the names of
  178. all the workers of a specified type.
  179. * Arbiters now support concurrent read access.
  180. * Add a field starpu_task::where similar to starpu_codelet::where
  181. which allows to restrict where to execute a task. Also add
  182. STARPU_TASK_WHERE to be used when calling starpu_task_insert().
  183. * Add SubmitOrder trace field.
  184. * Add workerids and workerids_len task fields.
  185. * Add priority management to StarPU-MPI. Can be disabled with
  186. the STARPU_MPI_PRIORITIES environment variable.
  187. * Add STARPU_MAIN_THREAD_CPUID and STARPU_MPI_THREAD_CPUID environment
  188. variables.
  189. * Add disk to disk copy functions and support asynchronous full read/write
  190. in disk backends.
  191. * New starpu_task_insert() parameter STARPU_CL_ARGS_NFREE which allows
  192. to set codelet parameters but without freeing them.
  193. * New starpu_task_insert() parameter STARPU_TASK_DEPS_ARRAY which
  194. allows to declare task dependencies similarly to
  195. starpu_task_declare_deps_array()
  196. * Add dependency backward information in debugging mode for gdb's
  197. starpu-print-task
  198. * Add sched_data field in starpu_task structure.
  199. * New starpu_fxt_tool option -label-deps to label dependencies on
  200. the output graph
  201. * New environment variable STARPU_GENERATE_TRACE_OPTIONS to specify
  202. fxt options (to be used with STARPU_GENERATE_TRACE)
  203. * New function starpu_task_set() similar as starpu_task_build() but
  204. with a task object given as the first parameter
  205. * New functions
  206. starpu_data_partition_submit_sequential_consistency() and
  207. starpu_data_unpartition_submit_sequential_consistency()
  208. * Add a new value STARPU_TASK_SYNCHRONOUS to be used in
  209. starpu_task_insert() to define if the task is (or not) synchronous
  210. * Add memory states events in the traces.
  211. * Add starpu_sched_component_estimated_end_min_add() to fix termination
  212. estimations in modular schedulers.
  213. * New function starpu_data_partition_not_automatic() to disable the
  214. automatic partitioning of a data handle for which a asynchronous
  215. plan has previously been submitted
  216. * Add starpu_task_declare_deps()
  217. * New function starpu_data_unpartition_submit_sequential_consistency_cb()
  218. to specify a callback for the task submitting the unpartitioning
  219. * New tool starpu_mpi_comm_trace.py to draw heatmap of MPI
  220. communications
  221. * Support for ARM performance libraries
  222. * Add functionality to disable signal catching either through field
  223. starpu_conf::catch_signals or through the environment variable
  224. STARPU_CATCH_SIGNALS
  225. * Support for OpenMP Taskloop directive
  226. * Optional data interface init function (used by the vector and
  227. matrix interfaces)
  228. Changes:
  229. * Vastly improve simgrid simulation time.
  230. * Switch default scheduler to lws.
  231. * Add "to" parameter to pull_task and can_push methods of
  232. components.
  233. * Deprecate starpu_data_interface_ops::handle_to_pointer interface
  234. operation in favor of new starpu_data_interface_ops::to_pointer
  235. operation.
  236. * Sort data access requests by priority.
  237. * Cluster support is disabled by default, unless the configure
  238. option --enable-cluster is specified
  239. * For unpack operations, move the memory deallocation from
  240. starpu_data_unpack() to the interface function
  241. starpu_data_interface_ops::unpack_data(). Pack and unpack
  242. functions of predefined interfaces
  243. use public API starpu_malloc_on_node_flags() and
  244. starpu_free_on_node_flags() to allocate and de-allocate memory
  245. Small changes:
  246. * Use asynchronous transfers for task data fetches with were not prefetched.
  247. * Allow to call starpu_sched_ctx_set_policy_data on the main
  248. scheduler context
  249. * Fonction starpu_is_initialized() is moved to the public API.
  250. * Fix code to allow to submit tasks to empty contexts
  251. * STARPU_COMM_STATS also displays the bandwidth
  252. * Update data interfaces implementations to only use public API
  253. StarPU 1.2.9 (git revision 3aca8da3138a99e93d7f93905d2543bd6f1ea1df)
  254. ====================================================================
  255. Small changes:
  256. * Add STARPU_SIMGRID_TRANSFER_COST environment variable to easily disable
  257. data transfer costs.
  258. * New dmdap "data-aware performance model (priority)" scheduler
  259. * Modification in the Native Fortran interface of the functions
  260. fstarpu_mpi_task_insert, fstarpu_mpi_task_build and
  261. fstarpu_mpi_task_post_build to only take 1 parameter being the MPI
  262. communicator, the codelet and the various parameters for the task.
  263. StarPU 1.2.8 (git revision f66374c9ad39aefb7cf5dfc31f9ab3d756bcdc3c)
  264. ====================================================================
  265. Small features:
  266. * Minor fixes
  267. StarPU 1.2.7 (git revision 07cb7533c22958a76351bec002955f0e2818c530)
  268. ====================================================================
  269. Small features:
  270. * Add STARPU_HWLOC_INPUT environment variable to save initialization time.
  271. * Add starpu_data_set/get_ooc_flag.
  272. * Use starpu_mpi_tag_t (int64_t) for MPI communication tag
  273. StarPU 1.2.6 (git revision 23049adea01837479f309a75c002dacd16eb34ad)
  274. ====================================================================
  275. Small changes:
  276. * Fix crash for lws scheduler
  277. * Avoid making hwloc load PCI topology when CUDA is not enabled
  278. StarPU 1.2.5 (git revision 22f32916916d158e3420033aa160854d1dd341bd)
  279. ====================================================================
  280. Small features:
  281. * Add a new value STARPU_TASK_COLOR to be used in
  282. starpu_task_insert() to pick up the color of a task in dag.dot
  283. * Add starpu_data_pointer_is_inside().
  284. Changes:
  285. * Do not export -lcuda -lcudart -lOpenCL in *starpu*.pc.
  286. StarPU 1.2.4 (git revision 255cf98175ef462749780f30bfed21452b74b594)
  287. ====================================================================
  288. Small features:
  289. * Catch of signals SIGINT and SIGSEGV to dump fxt trace files.
  290. * New configure option --disable-icc to disable the compilation of
  291. specific ICC examples
  292. * Add starpu_codelet_pack_arg_init, starpu_codelet_pack_arg,
  293. starpu_codelet_pack_arg_fini for more fine-grain packing capabilities.
  294. * Add starpu_task_insert_data_make_room,
  295. starpu_task_insert_data_process_arg,
  296. starpu_task_insert_data_process_array_arg,
  297. starpu_task_insert_data_process_mode_array_arg
  298. * Do not show internal tasks in fxt dag by default. Allow to hide
  299. acquisitions too.
  300. * Add a way to choose the dag.dot colors.
  301. StarPU 1.2.3 (git revision 586ba6452a8eef99f275c891ce08933ae542c6c2)
  302. ====================================================================
  303. New features:
  304. * Add per-node MPI data.
  305. Small features:
  306. * When debug is enabled, starpu data accessors first check the
  307. validity of the data interface type
  308. * Print disk bus performances when STARPU_BUS_STATS is set
  309. * Add starpu_vector_filter_list_long filter.
  310. * Data interfaces now define a name through the struct starpu_data_interface_ops
  311. * StarPU-MPI :
  312. - allow predefined data interface not to define a mpi datatype and
  313. to be exchanged through pack/unpack operations
  314. - New function starpu_mpi_comm_get_attr() which allows to return
  315. the value of the attribute STARPU_MPI_TAG_UB, i.e the upper
  316. bound for tag value.
  317. - New configure option enable-mpi-verbose to manage the display of
  318. extra MPI debug messages.
  319. * Add STARPU_WATCHDOG_DELAY environment variable.
  320. * Add a 'waiting' worker status
  321. * Allow new value 'extra' for configure option --enable-verbose
  322. Small changes:
  323. * Add data_unregister event in traces
  324. * StarPU-MPI
  325. - push detached requests at the back of the testing list, so they
  326. are tested last since they will most probably finish latest
  327. * Automatically initialize handles on data acquisition when
  328. reduction methods are provided, and make sure a handle is
  329. initialized before trying to read it.
  330. StarPU 1.2.2 (git revision a0b01437b7b91f33fb3ca36bdea35271cad34464)
  331. ===================================================================
  332. New features:
  333. * Add starpu_data_acquire_try and starpu_data_acquire_on_node_try.
  334. * Add NVCC_CC environment variable.
  335. * Add -no-flops and -no-events options to starpu_fxt_tool to make
  336. traces lighter
  337. * Add starpu_cusparse_init/shutdown/get_local_handle for proper CUDA
  338. overlapping with cusparse.
  339. * Allow precise debugging by setting STARPU_TASK_BREAK_ON_PUSH,
  340. STARPU_TASK_BREAK_ON_SCHED, STARPU_TASK_BREAK_ON_POP, and
  341. STARPU_TASK_BREAK_ON_EXEC environment variables, with the job_id
  342. of a task. StarPU will raise SIGTRAP when the task is being
  343. scheduled, pushed, or popped by the scheduler.
  344. Small features:
  345. * New function starpu_worker_get_job_id(struct starpu_task *task)
  346. which returns the job identifier for a given task
  347. * Show package/numa topology in starpu_machine_display
  348. * MPI: Add mpi communications in dag.dot
  349. * Add STARPU_PERF_MODEL_HOMOGENEOUS_CPU environment variable to
  350. allow having one perfmodel per CPU core
  351. * Add starpu_perfmodel_arch_comb_fetch function.
  352. * Add starpu_mpi_get_data_on_all_nodes_detached function.
  353. Small changes:
  354. * Output generated through STARPU_MPI_COMM has been modified to
  355. allow easier automated checking
  356. * MPI: Fix reactivity of the beginning of the application, when a
  357. lot of ready requests have to be processed at the same time, we
  358. want to poll the pending requests from time to time.
  359. * MPI: Fix gantt chart for starpu_mpi_irecv: it should use the
  360. termination time of the request, not the submission time.
  361. * MPI: Modify output generated through STARPU_MPI_COMM to allow
  362. easier automated checking
  363. * MPI: enable more tests in simgrid mode
  364. * Use assumed-size instead of assumed-shape arrays for native
  365. fortran API, for better backward compatibility.
  366. * Fix odd ordering of CPU workers on CPUs due to GPUs stealing some
  367. cores
  368. StarPU 1.2.1 (git revision 473acaec8a1fb4f4c73d8b868e4f044b736b41ea)
  369. ====================================================================
  370. New features:
  371. * Add starpu_fxt_trace_user_event_string.
  372. * Add starpu_tasks_rec_complete tool to add estimation times in tasks.rec
  373. files.
  374. * Add STARPU_FXT_TRACE environment variable.
  375. * Add starpu_data_set_user_data and starpu_data_get_user_data.
  376. * Add STARPU_MPI_FAKE_SIZE and STARPU_MPI_FAKE_RANK to allow simulating
  377. execution of just one MPI node.
  378. * Add STARPU_PERF_MODEL_HOMOGENEOUS_CUDA/OPENCL/MIC/SCC to share performance
  379. models between devices, making calibration much faster.
  380. * Add modular-heft-prio scheduler.
  381. * Add starpu_cublas_get_local_handle helper.
  382. * Add starpu_data_set_name, starpu_data_set_coordinates_array, and
  383. starpu_data_set_coordinates to describe data, and starpu_iteration_push and
  384. starpu_iteration_pop to describe tasks, for better offline traces analysis.
  385. * New function starpu_bus_print_filenames() to display filenames
  386. storing bandwidth/affinity/latency information, available through
  387. tools/starpu_machine_display -i
  388. * Add support for Ayudame version 2.x debugging library.
  389. * Add starpu_sched_ctx_get_workers_list_raw, much less costly than
  390. starpu_sched_ctx_get_workers_list
  391. * Add starpu_task_get_name and use it to warn about dmda etc. using
  392. a dumb policy when calibration is not finished
  393. * MPI: Add functions to test for cached values
  394. Changes:
  395. * Fix performance regression of lws for small tasks.
  396. * Improve native Fortran support for StarPU
  397. Small changes:
  398. * Fix type of data home node to allow users to pass -1 to define
  399. temporary data
  400. * Fix compatibility with simgrid 3.14
  401. StarPU 1.2.0 (git revision 5a86e9b61cd01b7797e18956283cc6ea22adfe11)
  402. ====================================================================
  403. New features:
  404. * MIC Xeon Phi support
  405. * SCC support
  406. * New function starpu_sched_ctx_exec_parallel_code to execute a
  407. parallel code on the workers of the given scheduler context
  408. * MPI:
  409. - New internal communication system : a unique tag called
  410. is now used for all communications, and a system
  411. of hashmaps on each node which stores pending receives has been
  412. implemented. Every message is now coupled with an envelope, sent
  413. before the corresponding data, which allows the receiver to
  414. allocate data correctly, and to submit the matching receive of
  415. the envelope.
  416. - New function
  417. starpu_mpi_irecv_detached_sequential_consistency which
  418. allows to enable or disable the sequential consistency for
  419. the given data handle (sequential consistency will be
  420. enabled or disabled based on the value of the function
  421. parameter and the value of the sequential consistency
  422. defined for the given data)
  423. - New functions starpu_mpi_task_build() and
  424. starpu_mpi_task_post_build()
  425. - New flag STARPU_NODE_SELECTION_POLICY to specify a policy for
  426. selecting a node to execute the codelet when several nodes
  427. own data in W mode.
  428. - New selection node policies can be un/registered with the
  429. functions starpu_mpi_node_selection_register_policy() and
  430. starpu_mpi_node_selection_unregister_policy()
  431. - New environment variable STARPU_MPI_COMM which enables
  432. basic tracing of communications.
  433. - New function starpu_mpi_init_comm() which allows to specify
  434. a MPI communicator.
  435. * New STARPU_COMMUTE flag which can be passed along STARPU_W or STARPU_RW to
  436. let starpu commute write accesses.
  437. * Out-of-core support, through registration of disk areas as additional memory
  438. nodes. It can be enabled programmatically or through the STARPU_DISK_SWAP*
  439. environment variables.
  440. * Reclaiming is now periodically done before memory becomes full. This can
  441. be controlled through the STARPU_*_AVAILABLE_MEM environment variables.
  442. * New hierarchical schedulers which allow the user to easily build
  443. its own scheduler, by coding itself each "box" it wants, or by
  444. combining existing boxes in StarPU to build it. Hierarchical
  445. schedulers have very interesting scalability properties.
  446. * Add STARPU_CUDA_ASYNC and STARPU_OPENCL_ASYNC flags to allow asynchronous
  447. CUDA and OpenCL kernel execution.
  448. * Add STARPU_CUDA_PIPELINE and STARPU_OPENCL_PIPELINE to specify how
  449. many asynchronous tasks are submitted in advance on CUDA and
  450. OpenCL devices. Setting the value to 0 forces a synchronous
  451. execution of all tasks.
  452. * Add CUDA concurrent kernel execution support through
  453. the STARPU_NWORKER_PER_CUDA environment variable.
  454. * Add CUDA and OpenCL kernel submission pipelining, to overlap costs and allow
  455. concurrent kernel execution on Fermi cards.
  456. * New locality work stealing scheduler (lws).
  457. * Add STARPU_VARIABLE_NBUFFERS to be set in cl.nbuffers, and nbuffers and
  458. modes field to the task structure, which permit to define codelets taking a
  459. variable number of data.
  460. * Add support for implementing OpenMP runtimes on top of StarPU
  461. * New performance model format to better represent parallel tasks.
  462. Used to provide estimations for the execution times of the
  463. parallel tasks on scheduling contexts or combined workers.
  464. * starpu_data_idle_prefetch_on_node and
  465. starpu_idle_prefetch_task_input_on_node allow to queue prefetches to be done
  466. only when the bus is idle.
  467. * Make starpu_data_prefetch_on_node not forcibly flush data out, introduce
  468. starpu_data_fetch_on_node for that.
  469. * Add data access arbiters, to improve parallelism of concurrent data
  470. accesses, notably with STARPU_COMMUTE.
  471. * Anticipative writeback, to flush dirty data asynchronously before the
  472. GPU device is full. Disabled by default. Use STARPU_MINIMUM_CLEAN_BUFFERS
  473. and STARPU_TARGET_CLEAN_BUFFERS to enable it.
  474. * Add starpu_data_wont_use to advise that a piece of data will not be used
  475. in the close future.
  476. * Enable anticipative writeback by default.
  477. * New scheduler 'dmdasd' that considers priority when deciding on
  478. which worker to schedule
  479. * Add the capability to define specific MPI datatypes for
  480. StarPU user-defined interfaces.
  481. * Add tasks.rec trace output to make scheduling analysis easier.
  482. * Add Fortran 90 module and example using it
  483. * New StarPU-MPI gdb debug functions
  484. * Generate animated html trace of modular schedulers.
  485. * Add asynchronous partition planning. It only supports coherency through
  486. the home node of data for now.
  487. * Add STARPU_MALLOC_SIMULATION_FOLDED flag to save memory when simulating.
  488. * Include application threads in the trace.
  489. * Add starpu_task_get_task_scheduled_succs to get successors of a task.
  490. * Add graph inspection facility for schedulers.
  491. * New STARPU_LOCALITY flag to mark data which should be taken into account
  492. by schedulers for improving locality.
  493. * Experimental support for data locality in ws and lws.
  494. * Add a preliminary framework for native Fortran support for StarPU
  495. Small features:
  496. * Tasks can now have a name (via the field const char *name of
  497. struct starpu_task)
  498. * New functions starpu_data_acquire_cb_sequential_consistency() and
  499. starpu_data_acquire_on_node_cb_sequential_consistency() which allows
  500. to enable or disable sequential consistency
  501. * New configure option --enable-fxt-lock which enables additional
  502. trace events focused on locks behaviour during the execution
  503. * Functions starpu_insert_task and starpu_mpi_insert_task are
  504. renamed in starpu_task_insert and starpu_mpi_task_insert. Old
  505. names are kept to avoid breaking old codes.
  506. * New configure option --enable-calibration-heuristic which allows
  507. the user to set the maximum authorized deviation of the
  508. history-based calibrator.
  509. * Allow application to provide the task footprint itself.
  510. * New function starpu_sched_ctx_display_workers() to display worker
  511. information belonging to a given scheduler context
  512. * The option --enable-verbose can be called with
  513. --enable-verbose=extra to increase the verbosity
  514. * Add codelet size, footprint and tag id in the paje trace.
  515. * Add STARPU_TAG_ONLY, to specify a tag for traces without making StarPU
  516. manage the tag.
  517. * On Linux x86, spinlocks now block after a hundred tries. This avoids
  518. typical 10ms pauses when the application thread tries to submit tasks.
  519. * New function char *starpu_worker_get_type_as_string(enum starpu_worker_archtype type)
  520. * Improve static scheduling by adding support for specifying the task
  521. execution order.
  522. * Add starpu_worker_can_execute_task_impl and
  523. starpu_worker_can_execute_task_first_impl to optimize getting the
  524. working implementations
  525. * Add STARPU_MALLOC_NORECLAIM flag to allocate without running a reclaim if
  526. the node is out of memory.
  527. * New flag STARPU_DATA_MODE_ARRAY for the function family
  528. starpu_task_insert to allow to define a array of data handles
  529. along with their access modes.
  530. * New configure option --enable-new-check to enable new testcases
  531. which are known to fail
  532. * Add starpu_memory_allocate and _deallocate to let the application declare
  533. its own allocation to the reclaiming engine.
  534. * Add STARPU_SIMGRID_CUDA_MALLOC_COST and STARPU_SIMGRID_CUDA_QUEUE_COST to
  535. disable CUDA costs simulation in simgrid mode.
  536. * Add starpu_task_get_task_succs to get the list of children of a given
  537. task.
  538. * Add starpu_malloc_on_node_flags, starpu_free_on_node_flags, and
  539. starpu_malloc_on_node_set_default_flags to control the allocation flags
  540. used for allocations done by starpu.
  541. * Ranges can be provided in STARPU_WORKERS_CPUID
  542. * Add starpu_fxt_autostart_profiling to be able to avoid autostart.
  543. * Add arch_cost_function perfmodel function field.
  544. * Add STARPU_TASK_BREAK_ON_SCHED, STARPU_TASK_BREAK_ON_PUSH, and
  545. STARPU_TASK_BREAK_ON_POP environment variables to debug schedulers.
  546. * Add starpu_sched_display tool.
  547. * Add starpu_memory_pin and starpu_memory_unpin to pin memory allocated
  548. another way than starpu_malloc.
  549. * Add STARPU_NOWHERE to create synchronization tasks with data.
  550. * Document how to switch between differents views of the same data.
  551. * Add STARPU_NAME to specify a task name from a starpu_task_insert call.
  552. * Add configure option to disable fortran --disable-fortran
  553. * Add configure option to give path for smpirun executable --with-smpirun
  554. * Add configure option to disable the build of tests --disable-build-tests
  555. * Add starpu-all-tasks debugging support
  556. * New function
  557. void starpu_opencl_load_program_source_malloc(const char *source_file_name, char **located_file_name, char **located_dir_name, char **opencl_program_source)
  558. which allocates the pointers located_file_name, located_dir_name
  559. and opencl_program_source.
  560. * Add submit_hook and do_schedule scheduler methods.
  561. * Add starpu_sleep.
  562. * Add starpu_task_list_ismember.
  563. * Add _starpu_fifo_pop_this_task.
  564. * Add STARPU_MAX_MEMORY_USE environment variable.
  565. * Add starpu_worker_get_id_check().
  566. * New function starpu_mpi_wait_for_all(MPI_Comm comm) that allows to
  567. wait until all StarPU tasks and communications for the given
  568. communicator are completed.
  569. * New function starpu_codelet_unpack_args_and_copyleft() which
  570. allows to copy in a new buffer values which have not been unpacked by
  571. the current call
  572. * Add STARPU_CODELET_SIMGRID_EXECUTE flag.
  573. * Add STARPU_CODELET_SIMGRID_EXECUTE_AND_INJECT flag.
  574. * Add STARPU_CL_ARGS flag to starpu_task_insert() and
  575. starpu_mpi_task_insert() functions call
  576. Changes:
  577. * Data interfaces (variable, vector, matrix and block) now define
  578. pack und unpack functions
  579. * StarPU-MPI: Fix for being able to receive data which have not yet
  580. been registered by the application (i.e it did not call
  581. starpu_data_set_tag(), data are received as a raw memory)
  582. * StarPU-MPI: Fix for being able to receive data with the same tag
  583. from several nodes (see mpi/tests/gather.c)
  584. * Remove the long-deprecated cost_model fields and task->buffers field.
  585. * Fix complexity of implicit task/data dependency, from quadratic to linear.
  586. Small changes:
  587. * Rename function starpu_trace_user_event() as
  588. starpu_fxt_trace_user_event()
  589. * "power" is renamed into "energy" wherever it applies, notably energy
  590. consumption performance models
  591. * Update starpu_task_build() to set starpu_task::cl_arg_free to 1 if
  592. some arguments of type ::STARPU_VALUE are given.
  593. * Simplify performance model loading API
  594. * Better semantic for environment variables STARPU_NMIC and
  595. STARPU_NMICDEVS, the number of devices and the number of cores.
  596. STARPU_NMIC will be the number of devices, and STARPU_NMICCORES
  597. will be the number of cores per device.
  598. StarPU 1.1.8 (git revision f7b7abe9f86361cbc96f2b51c6ad7336b7d1d628)
  599. ====================================================================
  600. The scheduling context release
  601. Small changes:
  602. * Fix compatibility with simgrid 3.14
  603. * Fix lock ordering for memory reclaiming
  604. StarPU 1.1.7 (git revision 341044b67809892cf4a388e482766beb50256907)
  605. ====================================================================
  606. The scheduling context release
  607. Small changes:
  608. * Fix type of data home node to allow users to pass -1 to define
  609. temporary data
  610. StarPU 1.1.6 (git revision cdffbd5f5447e4d076d659232b3deb14f3c20da6)
  611. ====================================================================
  612. The scheduling context release
  613. Small features:
  614. * Add starpu_task_get_task_succs to get the list of children of a given
  615. task.
  616. * Ranges can be provided in STARPU_WORKERS_CPUID
  617. Small changes:
  618. * Various fixes for MacOS and windows systems
  619. StarPU 1.1.5 (git revision 20469c6f3e7ecd6c0568c8e4e4b5b652598308d8xxx)
  620. =======================================================================
  621. The scheduling context release
  622. New features:
  623. * Add starpu_memory_pin and starpu_memory_unpin to pin memory allocated
  624. another way than starpu_malloc.
  625. * Add starpu_task_wait_for_n_submitted() and
  626. STARPU_LIMIT_MAX_NSUBMITTED_TASKS/STARPU_LIMIT_MIN_NSUBMITTED_TASKS to
  627. easily control the number of submitted tasks by making task submission
  628. block.
  629. * Add STARPU_NOWHERE to create synchronization tasks with data.
  630. * Document how to switch between differents views of the same data.
  631. * Add Fortran 90 module and example using it
  632. StarPU 1.1.4 (git revision 2a3d30b28d6d099d271134a786335acdbb3931a3)
  633. ====================================================================
  634. The scheduling context release
  635. New features:
  636. * Fix and actually enable the cache allocation.
  637. * Enable allocation cache in main RAM when STARPU_LIMIT_CPU_MEM is set by
  638. the user.
  639. * New MPI functions starpu_mpi_issend and starpu_mpi_issend_detached
  640. to send data using a synchronous and non-blocking mode (internally
  641. uses MPI_Issend)
  642. * New data access mode flag STARPU_SSEND to be set when calling
  643. starpu_mpi_insert_task to specify the data has to be sent using a
  644. synchronous and non-blocking mode
  645. * New environment variable STARPU_PERF_MODEL_DIR which can be set to
  646. specify a directory where to store performance model files in.
  647. When unset, the files are stored in $STARPU_HOME/.starpu/sampling
  648. * MPI:
  649. - New function starpu_mpi_data_register_comm to register a data
  650. with another communicator than MPI_COMM_WORLD
  651. - New functions starpu_mpi_data_set_rank() and starpu_mpi_data_set_tag()
  652. which call starpu_mpi_data_register_comm()
  653. Small features:
  654. * Add starpu_memory_wait_available() to wait for a given size to become
  655. available on a given node.
  656. * New environment variable STARPU_RAND_SEED to set the seed used for random
  657. numbers.
  658. * New function starpu_mpi_cache_set() to enable or disable the
  659. communication cache at runtime
  660. * Add starpu_paje_sort which sorts Pajé traces.
  661. Changes:
  662. * Fix complexity of implicit task/data dependency, from quadratic to linear.
  663. StarPU 1.1.3 (git revision 11afc5b007fe1ab1c729b55b47a5a98ef7f3cfad)
  664. ====================================================================
  665. The scheduling context release
  666. New features:
  667. * One can register an existing on-GPU buffer to be used by a handle.
  668. * Add the starpu_paje_summary statistics tool.
  669. * Enable gpu-gpu transfers for matrices.
  670. * Let interfaces declare which transfers they allow with the can_copy
  671. methode.
  672. Small changes:
  673. * Lock performance model files while writing and reading them to avoid
  674. issues on parallel launches, MPI runs notably.
  675. * Lots of build fixes for icc on Windows.
  676. StarPU 1.1.2 (git revision d14c550798630bbc4f3da2b07d793c47e3018f02)
  677. ====================================================================
  678. The scheduling context release
  679. New features:
  680. * The reduction init codelet is automatically used to initialize temporary
  681. buffers.
  682. * Traces now include a "scheduling" state, to show the overhead of the
  683. scheduler.
  684. * Add STARPU_CALIBRATE_MINIMUM environment variable to specify the minimum
  685. number of calibration measurements.
  686. * Add STARPU_TRACE_BUFFER_SIZE environment variable to specify the size of
  687. the trace buffer.
  688. StarPU 1.1.1 (git revision dab2e51117fac5bef767f3a6b7677abb2147d2f2)
  689. ====================================================================
  690. The scheduling context release
  691. New features:
  692. * MPI:
  693. - New variable STARPU_MPI_CACHE_STATS to print statistics on
  694. cache holding received data.
  695. - New function starpu_mpi_data_register() which sets the rank
  696. and tag of a data, and also allows to automatically clear
  697. the MPI communication cache when unregistering the data. It
  698. should be called instead of both calling
  699. starpu_data_set_tag() and starpu_data_set_rank()
  700. * Use streams for all CUDA transfers, even initiated by CPUs.
  701. * Add paje traces statistics tools.
  702. * Use streams for GPUA->GPUB and GPUB->GPUA transfers.
  703. Small features:
  704. * New STARPU_EXECUTE_ON_WORKER flag to specify the worker on which
  705. to execute the task.
  706. * New STARPU_DISABLE_PINNING environment variable to disable host memory
  707. pinning.
  708. * New STARPU_DISABLE_KERNELS environment variable to disable actual kernel
  709. execution.
  710. * New starpu_memory_get_total function to get the size of a memory node.
  711. * New starpu_parallel_task_barrier_init_n function to let a scheduler decide
  712. a set of workers without going through combined workers.
  713. Changes:
  714. * Fix simgrid execution.
  715. * Rename starpu_get_nready_tasks_of_sched_ctx to starpu_sched_ctx_get_nready_tasks
  716. * Rename starpu_get_nready_flops_of_sched_ctx to starpu_sched_ctx_get_nready_flops
  717. * New functions starpu_pause() and starpu_resume()
  718. * New codelet specific_nodes field to specify explicit target nodes for data.
  719. * StarPU-MPI: Fix overzealous allocation of memory.
  720. * Interfaces: Allow interface implementation to change pointers at will, in
  721. unpack notably.
  722. Small changes:
  723. * Use big fat abortions when one tries to make a task or callback
  724. sleep, instead of just returning EDEADLCK which few people will test
  725. * By default, StarPU FFT examples are not compiled and checked, the
  726. configure option --enable-starpufft-examples needs to be specified
  727. to change this behaviour.
  728. StarPU 1.1.0 (git revision 3c4bc72ccef30e767680cad3d749c4e9010d4476)
  729. ====================================================================
  730. The scheduling context release
  731. New features:
  732. * OpenGL interoperability support.
  733. * Capability to store compiled OpenCL kernels on the file system
  734. * Capability to load compiled OpenCL kernels
  735. * Performance models measurements can now be provided explicitly by
  736. applications.
  737. * Capability to emit communication statistics when running MPI code
  738. * Add starpu_data_unregister_submit, starpu_data_acquire_on_node and
  739. starpu_data_invalidate_submit
  740. * New functionnality to wrapper starpu_insert_task to pass a array of
  741. data_handles via the parameter STARPU_DATA_ARRAY
  742. * Enable GPU-GPU direct transfers.
  743. * GCC plug-in
  744. - Add `registered' attribute
  745. - A new pass was added that warns about the use of possibly
  746. unregistered memory buffers.
  747. * SOCL
  748. - Manual mapping of commands on specific devices is now
  749. possible
  750. - SOCL does not require StarPU CPU tasks anymore. CPU workers
  751. are automatically disabled to enhance performance of OpenCL
  752. CPU devices
  753. * New interface: COO matrix.
  754. * Data interfaces: The pack operation of user-defined data interface
  755. defines a new parameter count which should be set to the size of
  756. the buffer created by the packing of the data.
  757. * MPI:
  758. - Communication statistics for MPI can only be enabled at
  759. execution time by defining the environment variable
  760. STARPU_COMM_STATS
  761. - Communication cache mechanism is enabled by default, and can
  762. only be disabled at execution time by setting the
  763. environment variable STARPU_MPI_CACHE to 0.
  764. - Initialisation functions starpu_mpi_initialize_extended()
  765. and starpu_mpi_initialize() have been made deprecated. One
  766. should now use starpu_mpi_init(int *, char ***, int). The
  767. last parameter indicates if MPI should be initialised.
  768. - Collective detached operations have new parameters, a
  769. callback function and a argument. This is to be consistent
  770. with the detached point-to-point communications.
  771. - When exchanging user-defined data interfaces, the size of
  772. the data is the size returned by the pack operation, i.e
  773. data with dynamic size can now be exchanged with StarPU-MPI.
  774. * Add experimental simgrid support, to simulate execution with various
  775. number of CPUs, GPUs, amount of memory, etc.
  776. * Add support for OpenCL simulators (which provide simulated execution time)
  777. * Add support for Temanejo, a task graph debugger
  778. * Theoretical bound lp output now includes data transfer time.
  779. * Update OpenCL driver to only enable CPU devices (the environment
  780. variable STARPU_OPENCL_ONLY_ON_CPUS must be set to a positive
  781. value when executing an application)
  782. * Add Scheduling contexts to separate computation resources
  783. - Scheduling policies take into account the set of resources corresponding
  784. to the context it belongs to
  785. - Add support to dynamically change scheduling contexts
  786. (Create and Delete a context, Add Workers to a context, Remove workers from a context)
  787. - Add support to indicate to which contexts the tasks are submitted
  788. * Add the Hypervisor to manage the Scheduling Contexts automatically
  789. - The Contexts can be registered to the Hypervisor
  790. - Only the registered contexts are managed by the Hypervisor
  791. - The Hypervisor can detect the initial distribution of resources of
  792. a context and constructs it consequently (the cost of execution is required)
  793. - Several policies can adapt dynamically the distribution of resources
  794. in contexts if the initial one was not appropriate
  795. - Add a platform to implement new policies of redistribution
  796. of resources
  797. * Implement a memory manager which checks the global amount of
  798. memory available on devices, and checks there is enough memory
  799. before doing an allocation on the device.
  800. * Discard environment variable STARPU_LIMIT_GPU_MEM and define
  801. instead STARPU_LIMIT_CUDA_MEM and STARPU_LIMIT_OPENCL_MEM
  802. * Introduce new variables STARPU_LIMIT_CUDA_devid_MEM and
  803. STARPU_LIMIT_OPENCL_devid_MEM to limit memory per specific device
  804. * Introduce new variable STARPU_LIMIT_CPU_MEM to limit memory for
  805. the CPU devices
  806. * New function starpu_malloc_flags to define a memory allocation with
  807. constraints based on the following values:
  808. - STARPU_MALLOC_PINNED specifies memory should be pinned
  809. - STARPU_MALLOC_COUNT specifies the memory allocation should be in
  810. the limits defined by the environment variables STARPU_LIMIT_xxx
  811. (see above). When no memory is left, starpu_malloc_flag tries
  812. to reclaim memory from StarPU and returns -ENOMEM on failure.
  813. * starpu_malloc calls starpu_malloc_flags with a value of flag set
  814. to STARPU_MALLOC_PINNED
  815. * Define new function starpu_free_flags similarly to starpu_malloc_flags
  816. * Define new public API starpu_pthread which is similar to the
  817. pthread API. It is provided with 2 implementations: a pthread one
  818. and a Simgrid one. Applications using StarPU and wishing to use
  819. the Simgrid StarPU features should use it.
  820. * Allow to have a dynamically allocated number of buffers per task,
  821. and so overwrite the value defined --enable-maxbuffers=XXX
  822. * Performance models files are now stored in a directory whose name
  823. include the version of the performance model format. The version
  824. number is also written in the file itself.
  825. When updating the format, the internal variable
  826. _STARPU_PERFMODEL_VERSION should be updated. It is then possible
  827. to switch easily between differents versions of StarPU having
  828. different performance model formats.
  829. * Tasks can now define a optional prologue callback which is executed
  830. on the host when the task becomes ready for execution, before getting
  831. scheduled.
  832. * Small CUDA allocations (<= 4MiB) are now batched to avoid the huge
  833. cudaMalloc overhead.
  834. * Prefetching is now done for all schedulers when it can be done whatever
  835. the scheduling decision.
  836. * Add a watchdog which permits to easily trigger a crash when StarPU gets
  837. stuck.
  838. * Document how to migrate data over MPI.
  839. * New function starpu_wakeup_worker() to be used by schedulers to
  840. wake up a single worker (instead of all workers) when submitting a
  841. single task.
  842. * The functions starpu_sched_set/get_min/max_priority set/get the
  843. priorities of the current scheduling context, i.e the one which
  844. was set by a call to starpu_sched_ctx_set_context() or the initial
  845. context if the function has not been called yet.
  846. * Fix for properly dealing with NAN on windows systems
  847. Small features:
  848. * Add starpu_worker_get_by_type and starpu_worker_get_by_devid
  849. * Add starpu_fxt_stop_profiling/starpu_fxt_start_profiling which permits to
  850. pause trace recording.
  851. * Add trace_buffer_size configuration field to permit to specify the tracing
  852. buffer size.
  853. * Add starpu_codelet_profile and starpu_codelet_histo_profile, tools which draw
  854. the profile of a codelet.
  855. * File STARPU-REVISION --- containing the SVN revision number from which
  856. StarPU was compiled --- is installed in the share/doc/starpu directory
  857. * starpu_perfmodel_plot can now directly draw GFlops curves.
  858. * New configure option --enable-mpi-progression-hook to enable the
  859. activity polling method for StarPU-MPI.
  860. * Permit to disable sequential consistency for a given task.
  861. * New macro STARPU_RELEASE_VERSION
  862. * New function starpu_get_version() to return as 3 integers the
  863. release version of StarPU.
  864. * Enable by default data allocation cache
  865. * New function starpu_perfmodel_directory() to print directory
  866. storing performance models. Available through the new option -d of
  867. the tool starpu_perfmodel_display
  868. * New batch files to execute StarPU applications under Microsoft
  869. Visual Studio (They are installed in path_to_starpu/bin/msvc)/
  870. * Add cl_arg_free, callback_arg_free, prologue_callback_arg_free fields to
  871. enable automatic free(cl_arg); free(callback_arg);
  872. free(prologue_callback_arg) on task destroy.
  873. * New function starpu_task_build
  874. * New configure options --with-simgrid-dir
  875. --with-simgrid-include-dir and --with-simgrid-lib-dir to specify
  876. the location of the SimGrid library
  877. Changes:
  878. * Rename all filter functions to follow the pattern
  879. starpu_DATATYPE_filter_FILTERTYPE. The script
  880. tools/dev/rename_filter.sh is provided to update your existing
  881. applications to use new filters function names.
  882. * Renaming of diverse functions and datatypes. The script
  883. tools/dev/rename.sh is provided to update your existing
  884. applications to use the new names. It is also possible to compile
  885. with the pkg-config package starpu-1.0 to keep using the old
  886. names. It is however recommended to update your code and to use
  887. the package starpu-1.1.
  888. * Fix the block filter functions.
  889. * Fix StarPU-MPI on Darwin.
  890. * The FxT code can now be used on systems other than Linux.
  891. * Keep only one hashtable implementation common/uthash.h
  892. * The cache of starpu_mpi_insert_task is fixed and thus now enabled by
  893. default.
  894. * Improve starpu_machine_display output.
  895. * Standardize objects name in the performance model API
  896. * SOCL
  897. - Virtual SOCL device has been removed
  898. - Automatic scheduling still available with command queues not
  899. assigned to any device
  900. - Remove modified OpenCL headers. ICD is now the only supported
  901. way to use SOCL.
  902. - SOCL test suite is only run when environment variable
  903. SOCL_OCL_LIB_OPENCL is defined. It should contain the location
  904. of the libOpenCL.so file of the OCL ICD implementation.
  905. * Fix main memory leak on multiple unregister/re-register.
  906. * Improve hwloc detection by configure
  907. * Cell:
  908. - It is no longer possible to enable the cell support via the
  909. gordon driver
  910. - Data interfaces no longer define functions to copy to and from
  911. SPU devices
  912. - Codelet no longer define pointer for Gordon implementations
  913. - Gordon workers are no longer enabled
  914. - Gordon performance models are no longer enabled
  915. * Fix data transfer arrows in paje traces
  916. * The "heft" scheduler no longer exists. Users should now pick "dmda"
  917. instead.
  918. * StarPU can now use poti to generate paje traces.
  919. * Rename scheduling policy "parallel greedy" to "parallel eager"
  920. * starpu_scheduler.h is no longer automatically included by
  921. starpu.h, it has to be manually included when needed
  922. * New batch files to run StarPU applications with Microsoft Visual C
  923. * Add examples/release/Makefile to test StarPU examples against an
  924. installed version of StarPU. That can also be used to test
  925. examples using a previous API.
  926. * Tutorial is installed in ${docdir}/tutorial
  927. * Schedulers eager_central_policy, dm and dmda no longer erroneously respect
  928. priorities. dmdas has to be used to respect priorities.
  929. * StarPU-MPI: Fix potential bug for user-defined datatypes. As MPI
  930. can reorder messages, we need to make sure the sending of the size
  931. of the data has been completed.
  932. * Documentation is now generated through doxygen.
  933. * Modification of perfmodels output format for future improvements.
  934. * Fix for properly dealing with NAN on windows systems
  935. * Function starpu_sched_ctx_create() now takes a variable argument
  936. list to define the scheduler to be used, and the minimum and
  937. maximum priority values
  938. * The functions starpu_sched_set/get_min/max_priority set/get the
  939. priorities of the current scheduling context, i.e the one which
  940. was set by a call to starpu_sched_ctx_set_context() or the initial
  941. context if the function was not called yet.
  942. * MPI: Fix of the livelock issue discovered while executing applications
  943. on a CPU+GPU cluster of machines by adding a maximum trylock
  944. threshold before a blocking lock.
  945. Small changes:
  946. * STARPU_NCPU should now be used instead of STARPU_NCPUS. STARPU_NCPUS is
  947. still available for compatibility reasons.
  948. * include/starpu.h includes all include/starpu_*.h files, applications
  949. therefore only need to have #include <starpu.h>
  950. * Active task wait is now included in blocked time.
  951. * Fix GCC plugin linking issues starting with GCC 4.7.
  952. * Fix forcing calibration of never-calibrated archs.
  953. * CUDA applications are no longer compiled with the "-arch sm_13"
  954. option. It is specifically added to applications which need it.
  955. * Explicitly name the non-sleeping-non-running time "Overhead", and use
  956. another color in vite traces.
  957. * Use C99 variadic macro support, not GNU.
  958. * Fix performance regression: dmda queues were inadvertently made
  959. LIFOs in r9611.
  960. StarPU 1.0.3 (git revision 25f8b3a7b13050e99bf1725ca6f52cfd62e7a861)
  961. ====================================================================
  962. Changes:
  963. * Several bug fixes in the build system
  964. * Bug fixes in source code for non-Linux systems
  965. * Fix generating FXT traces bigger than 64MiB.
  966. * Improve ENODEV error detections in StarPU FFT
  967. StarPU 1.0.2 (git revision 6f95de279d6d796a39debe8d6c5493b3bdbe0c37)
  968. ====================================================================
  969. Changes:
  970. * Add starpu_block_shadow_filter_func_vector and an example.
  971. * Add tag dependency in trace-generated DAG.
  972. * Fix CPU binding for optimized CPU-GPU transfers.
  973. * Fix parallel tasks CPU binding and combined worker generation.
  974. * Fix generating FXT traces bigger than 64MiB.
  975. StarPU 1.0.1 (git revision 97ea6e15a273e23e4ddabf491b0f9481373ca01a)
  976. ====================================================================
  977. Changes:
  978. * hwloc support. Warn users when hwloc is not found on the system and
  979. produce error when not explicitely disabled.
  980. * Several bug fixes
  981. * GCC plug-in
  982. - Add `#pragma starpu release'
  983. - Fix bug when using `acquire' pragma with function parameters
  984. - Slightly improve test suite coverage
  985. - Relax the GCC version check
  986. * Update SOCL to use new API
  987. * Documentation improvement.
  988. StarPU 1.0.0 (git revision d3ad9ca318ec9acfeaf8eb7d8a018b09e4722292)
  989. ====================================================================
  990. The extensions-again release
  991. New features:
  992. * Add SOCL, an OpenCL interface on top of StarPU.
  993. * Add a gcc plugin to extend the C interface with pragmas which allows to
  994. easily define codelets and issue tasks.
  995. * Add reduction mode to starpu_mpi_insert_task.
  996. * A new multi-format interface permits to use different binary formats
  997. on CPUs & GPUs, the conversion functions being provided by the
  998. application and called by StarPU as needed (and as less as
  999. possible).
  1000. * Deprecate cost_model, and introduce cost_function, which is provided
  1001. with the whole task structure, the target arch and implementation
  1002. number.
  1003. * Permit the application to provide its own size base for performance
  1004. models.
  1005. * Applications can provide several implementations of a codelet for the
  1006. same architecture.
  1007. * Add a StarPU-Top feedback and steering interface.
  1008. * Permit to specify MPI tags for more efficient starpu_mpi_insert_task
  1009. Changes:
  1010. * Fix several memory leaks and race conditions
  1011. * Make environment variables take precedence over the configuration
  1012. passed to starpu_init()
  1013. * Libtool interface versioning has been included in libraries names
  1014. (libstarpu-1.0.so, libstarpumpi-1.0.so,
  1015. libstarpufft-1.0.so, libsocl-1.0.so)
  1016. * Install headers under $includedir/starpu/1.0.
  1017. * Make where field for struct starpu_codelet optional. When unset, its
  1018. value will be automatically set based on the availability of the
  1019. different XXX_funcs fields of the codelet.
  1020. * Define access modes for data handles into starpu_codelet and no longer
  1021. in starpu_task. Hence mark (struct starpu_task).buffers as
  1022. deprecated, and add (struct starpu_task).handles and (struct
  1023. starpu_codelet).modes
  1024. * Fields xxx_func of struct starpu_codelet are made deprecated. One
  1025. should use fields xxx_funcs instead.
  1026. * Some types were renamed for consistency. when using pkg-config libstarpu,
  1027. starpu_deprecated_api.h is automatically included (after starpu.h) to
  1028. keep compatibility with existing software. Other changes are mentioned
  1029. below, compatibility is also preserved for them.
  1030. To port code to use new names (this is not mandatory), the
  1031. tools/dev/rename.sh script can be used, and pkg-config starpu-1.0 should
  1032. be used.
  1033. * The communication cost in the heft and dmda scheduling strategies now
  1034. take into account the contention brought by the number of GPUs. This
  1035. changes the meaning of the beta factor, whose default 1.0 value should
  1036. now be good enough in most case.
  1037. Small features:
  1038. * Allow users to disable asynchronous data transfers between CPUs and
  1039. GPUs.
  1040. * Update OpenCL driver to enable CPU devices (the environment variable
  1041. STARPU_OPENCL_ON_CPUS must be set to a positive value when
  1042. executing an application)
  1043. * struct starpu_data_interface_ops --- operations on a data
  1044. interface --- define a new function pointer allocate_new_data
  1045. which creates a new data interface of the given type based on
  1046. an existing handle
  1047. * Add a field named magic to struct starpu_task which is set when
  1048. initialising the task. starpu_task_submit will fail if the
  1049. field does not have the right value. This will hence avoid
  1050. submitting tasks which have not been properly initialised.
  1051. * Add a hook function pre_exec_hook in struct starpu_sched_policy.
  1052. The function is meant to be called in drivers. Schedulers
  1053. can use it to be notified when a task is about being computed.
  1054. * Add codelet execution time statistics plot.
  1055. * Add bus speed in starpu_machine_display.
  1056. * Add a STARPU_DATA_ACQUIRE_CB which permits to inline the code to be
  1057. done.
  1058. * Add gdb functions.
  1059. * Add complex support to LU example.
  1060. * Permit to use the same data several times in write mode in the
  1061. parameters of the same task.
  1062. Small changes:
  1063. * Increase default value for STARPU_MAXCPUS -- Maximum number of
  1064. CPUs supported -- to 64.
  1065. * Add man pages for some of the tools
  1066. * Add C++ application example in examples/cpp/
  1067. * Add an OpenMP fork-join example.
  1068. * Documentation improvement.
  1069. StarPU 0.9 (git revision 12bba8528fc0d85367d885cddc383ba54efca464)
  1070. ==================================================================
  1071. The extensions release
  1072. * Provide the STARPU_REDUX data access mode
  1073. * Externalize the scheduler API.
  1074. * Add theoretical bound computation
  1075. * Add the void interface
  1076. * Add power consumption optimization
  1077. * Add parallel task support
  1078. * Add starpu_mpi_insert_task
  1079. * Add profiling information interface.
  1080. * Add STARPU_LIMIT_GPU_MEM environment variable.
  1081. * OpenCL fixes
  1082. * MPI fixes
  1083. * Improve optimization documentation
  1084. * Upgrade to hwloc 1.1 interface
  1085. * Add fortran example
  1086. * Add mandelbrot OpenCL example
  1087. * Add cg example
  1088. * Add stencil MPI example
  1089. * Initial support for CUDA4
  1090. StarPU 0.4 (git revision ad8d8be3619f211f228c141282d7d504646fc2a6)
  1091. ==================================================================
  1092. The API strengthening release
  1093. * Major API improvements
  1094. - Provide the STARPU_SCRATCH data access mode
  1095. - Rework data filter interface
  1096. - Rework data interface structure
  1097. - A script that automatically renames old functions to accomodate with the new
  1098. API is available from https://scm.gforge.inria.fr/svn/starpu/scripts/renaming
  1099. (login: anonsvn, password: anonsvn)
  1100. * Implement dependencies between task directly (eg. without tags)
  1101. * Implicit data-driven task dependencies simplifies the design of
  1102. data-parallel algorithms
  1103. * Add dynamic profiling capabilities
  1104. - Provide per-task feedback
  1105. - Provide per-worker feedback
  1106. - Provide feedback about memory transfers
  1107. * Provide a library to help accelerating MPI applications
  1108. * Improve data transfers overhead prediction
  1109. - Transparently benchmark buses to generate performance models
  1110. - Bind accelerator-controlling threads with respect to NUMA locality
  1111. * Improve StarPU's portability
  1112. - Add OpenCL support
  1113. - Add support for Windows
  1114. StarPU 0.2.901 aka 0.3-rc1 (git revision 991f2abb772c17c3d45bbcf27f46197652e6a3ef)
  1115. ==================================================================================
  1116. The asynchronous heterogeneous multi-accelerator release
  1117. * Many API changes and code cleanups
  1118. - Implement starpu_worker_get_id
  1119. - Implement starpu_worker_get_name
  1120. - Implement starpu_worker_get_type
  1121. - Implement starpu_worker_get_count
  1122. - Implement starpu_display_codelet_stats
  1123. - Implement starpu_data_prefetch_on_node
  1124. - Expose the starpu_data_set_wt_mask function
  1125. * Support nvidia (heterogeneous) multi-GPU
  1126. * Add the data request mechanism
  1127. - All data transfers use data requests now
  1128. - Implement asynchronous data transfers
  1129. - Implement prefetch mechanism
  1130. - Chain data requests to support GPU->RAM->GPU transfers
  1131. * Make it possible to bypass the scheduler and to assign a task to a specific
  1132. worker
  1133. * Support restartable tasks to reinstanciate dependencies task graphs
  1134. * Improve performance prediction
  1135. - Model data transfer overhead
  1136. - One model is created for each accelerator
  1137. * Support for CUDA's driver API is deprecated
  1138. * The STARPU_WORKERS_CUDAID and STARPU_WORKERS_CPUID env. variables make it possible to
  1139. specify where to bind the workers
  1140. * Use the hwloc library to detect the actual number of cores
  1141. StarPU 0.2.0 (git revision 73e989f0783e10815aff394f80242760c4ed098c)
  1142. ====================================================================
  1143. The Stabilizing-the-Basics release
  1144. * Various API cleanups
  1145. * Mac OS X is supported now
  1146. * Add dynamic code loading facilities onto Cell's SPUs
  1147. * Improve performance analysis/feedback tools
  1148. * Application can interact with StarPU tasks
  1149. - The application may access/modify data managed by the DSM
  1150. - The application may wait for the termination of a (set of) task(s)
  1151. * An initial documentation is added
  1152. * More examples are supplied
  1153. StarPU 0.1.0 (git revision 911869a96b40c74eb92b30a43d3e08bf445d8078)
  1154. ====================================================================
  1155. First release.
  1156. Status:
  1157. * Only supports Linux platforms yet
  1158. * Supported architectures
  1159. - multicore CPUs
  1160. - NVIDIA GPUs (with CUDA 2.x)
  1161. - experimental Cell/BE support
  1162. Changes:
  1163. * Scheduling facilities
  1164. - run-time selection of the scheduling policy
  1165. - basic auto-tuning facilities
  1166. * Software-based DSM
  1167. - transparent data coherency management
  1168. - High-level expressive interface
  1169. # Local Variables:
  1170. # mode: text
  1171. # coding: utf-8
  1172. # ispell-local-dictionary: "american"
  1173. # End: