Skip to content

Use special memory for batch copy_to function only for CPU batches

Sebastian Ohlmann requested to merge add_comment_special_memory into develop

Description

Using pinned memory for temporary batches leads to severe performance degradation in GPU runs. However, using aligned memory for CPU batches improves performance (because of better vectorization). Thus, use the special memory only for CPU batches if the calling batch also used special memory.

Checklist

Edited by Sebastian Ohlmann

Merge request reports

Loading