ML Science: Multiple Recommendations and Code Completion
We can provide code recommendations when users type comments. This action can be used to trigger the model for code block generation with additional filters. E.g., instead of stopping after 16 tokens, we stop generation after seeing the end of the block. How to generate several recommendations? We can provide different values of the temperature to the model for getting different code completions.
Edited by Mon Ray