Merge pull request #71 from GPUEngineering/feature/streams

Streams

Author: alphaville

CHANGELOG.md

@@ -5,6 +5,16 @@ All notable changes to this project will be documented in this file.
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+<!-- ---------------------
+      v1.9.0
+     --------------------- -->
+## v1.9.0 - 28-03-2025
+
+### Added
+
+- Multiple streams supported
+
+
 <!-- ---------------------
       v1.8.0
      --------------------- -->

README.md

@@ -403,6 +403,18 @@ size_t allocatedBytes =
     Session::getInstance().totalAllocatedBytes();
 ```
 
-
+GPUtils supports multiple streams. By default a single stream is created, 
+but you can set the number of streams you need with 
+```c++
+/* This needs to be the first line in your code */
+Session::setStreams(4); // create 4 strems
+```
+Then, you can use `setStreamIdx` to select a stream to go with your instance of `DTensor`
+```c++
+auto a = DTensor<double>::createRandomTensor(3, 6, 4, -1, 1).setStreamIdx(0);
+auto b = DTensor<double>::createRandomTensor(3, 6, 4, -1, 1).setStreamIdx(1);
+// do stuff...
+Session::getInstance().synchronizeAllStreams();
+```
 
 ## Happy number crunching!