Description
To streamline the process of adding and managing models, it is proposed to centralize the model configurations into a single YAML file. This will prevent the need to edit multiple locations, reducing the risk of errors.
The suggested YAML structure is as follows:
```yaml
models:
- name: 'gpt-4'
max_tokens: 8000
cost:
prompt: { price: 0.0, unit: 1000 }
completion: { price: 0.0, unit: 1000 }
- name: 'gpt-4-turbo'
max_tokens: 128000
cost:
prompt: { price: 0.0, unit: 1000 }
completion: { price: 0.0, unit: 1000 }
- name: 'gpt-4o'
max_tokens: 128000
cost:
prompt: { price: 0.005, unit: 1000 }
completion: { price: 0.015, unit: 1000 }
```
Adopting this approach will enhance maintainability and ensure consistency across the application.