Skip to content

[Chore] Omit model name check#714

Merged
JQGoh merged 4 commits intomainfrom
feat/add_model_names
Dec 5, 2025
Merged

[Chore] Omit model name check#714
JQGoh merged 4 commits intomainfrom
feat/add_model_names

Conversation

@JQGoh
Copy link
Copy Markdown
Collaborator

@JQGoh JQGoh commented Dec 4, 2025

Remove the redundant model name checks since we have this check at server side

@elessar-for-github
Copy link
Copy Markdown

Changes made by this pull request:

nixtla/init.py
[Error processing diff]

nixtla/nixtla_client.py
[Error processing diff]

nixtla_tests/nixtla_client/test_nixtla_client.py
[Error processing diff]

nixtla_tests/utils/test_utils.py
[Error processing diff]

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Dec 5, 2025

Experiment Results

Experiment 1: air-passengers

Description:

variable experiment
h 12
season_length 12
freq MS
level None
n_windows 1

Results:

metric timegpt-1 timegpt-1-long-horizon SeasonalNaive Naive
mae 12.6793 11.0623 47.8333 76
mape 0.027 0.0232 0.0999 0.1425
mse 213.936 199.132 2571.33 10604.2
total_time 13.4281 1.5883 0.0043 0.0031

Plot:

Experiment 2: air-passengers

Description:

variable experiment
h 24
season_length 12
freq MS
level None
n_windows 1

Results:

metric timegpt-1 timegpt-1-long-horizon SeasonalNaive Naive
mae 58.1031 58.4587 71.25 115.25
mape 0.1257 0.1267 0.1552 0.2358
mse 4040.21 4110.79 5928.17 18859.2
total_time 1.0615 0.9913 0.0034 0.0031

Plot:

Experiment 3: electricity-multiple-series

Description:

variable experiment
h 24
season_length 24
freq H
level None
n_windows 1

Results:

metric timegpt-1 timegpt-1-long-horizon SeasonalNaive Naive
mae 178.296 268.137 269.23 1331.02
mape 0.0234 0.0311 0.0304 0.1692
mse 121588 219496 213677 4.68961e+06
total_time 2.305 1.78 0.0042 0.0038

Plot:

Experiment 4: electricity-multiple-series

Description:

variable experiment
h 168
season_length 24
freq H
level None
n_windows 1

Results:

metric timegpt-1 timegpt-1-long-horizon SeasonalNaive Naive
mae 465.497 346.978 398.956 1119.26
mape 0.062 0.0436 0.0512 0.1583
mse 835021 403769 656723 3.17316e+06
total_time 2.7887 1.584 0.0053 0.0042

Plot:

Experiment 5: electricity-multiple-series

Description:

variable experiment
h 336
season_length 24
freq H
level None
n_windows 1

Results:

metric timegpt-1 timegpt-1-long-horizon SeasonalNaive Naive
mae 558.673 459.769 602.926 1340.95
mape 0.0697 0.0565 0.0787 0.17
mse 1.22723e+06 739162 1.61572e+06 6.04619e+06
total_time 1.0972 1.1533 0.0046 0.0041

Plot:

Comment thread nixtla/__init__.py
@@ -1,3 +1,3 @@
__version__ = "0.7.1"
__version__ = "0.7.2.dev0"
Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will make another PR for formal release and revise this to 0.7.2

@JQGoh JQGoh merged commit 77db2d2 into main Dec 5, 2025
23 checks passed
@JQGoh JQGoh deleted the feat/add_model_names branch December 5, 2025 00:49
@JQGoh JQGoh changed the title [FEAT] Omit model name check [Chore] Omit model name check Dec 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants