Skip to content

Update model io to match the FauxPilot requirements

Alexander Chueshev requested to merge update-model-io into main

This MR updates the model io data after focusing on FauxPilot as the main model for CS. Please, find the input required by the model:

  • prompt
  • request_output_len
  • temperature (optional)
  • repetition_penalty (optional)
  • runtime_top_k (optional)
  • runtime_top_p (optional)
  • start_id (optional)
  • end_id (optional)
  • random_seed (optional)
  • is_return_log_probs (should be True always)

Output:

  • completions
  • sequence_length
  • output_log_probs
  • cum_log_probs
  • output_ids

Ref #11 (closed)

Merge request reports