rename module to nixtla #298

jmoralez · 2024-04-23T16:44:50Z

Renames the python module to nixtla.
Updates the python-publish action to also publish the nixtlats package, which will issue a warning on import.
Removes the action_files folder in the setup, since it was being included in the project.
Adds an action (test-publish.yml) that can be triggered manually to release the package to Test PyPI to test the release process.
pins the dask version to prevent some tests from failing, will try to fix in a separate PR.

review-notebook-app · 2024-04-23T16:44:55Z

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

github-actions · 2024-04-23T16:47:39Z

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	3.9299	5.485	0.0092	0.005

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	6.932	7.306	0.0058	0.0049

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.7	123119	213677	4.68961e+06
total_time	5.6879	4.3681	0.0077	0.0069

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966294	422332	656723	3.17316e+06
total_time	5.2986	5.5956	0.0075	0.007

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805039	441118	1.61572e+06	6.04619e+06
total_time	7.0379	4.6367	0.0075	0.0071

Plot:

github-actions · 2024-04-23T17:39:24Z

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.935	199.132	2571.33	10604.2
total_time	3.3663	5.5715	0.0096	0.0047

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	7.5514	6.1784	0.006	0.005

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.7	123119	213677	4.68961e+06
total_time	7.1448	11.065	0.008	0.0071

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966294	422332	656723	3.17316e+06
total_time	8.363	10.1838	0.0075	0.0071

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805038	441118	1.61572e+06	6.04619e+06
total_time	11.4432	9.5713	0.008	0.0074

Plot:

github-actions · 2024-04-23T20:23:23Z

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	8.0905	7.8039	0.0084	0.0046

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.22	4110.79	5928.17	18859.2
total_time	6.6592	11.2858	0.0055	0.0048

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.8	123119	213677	4.68961e+06
total_time	13.5896	12.2744	0.0077	0.0069

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966295	422332	656723	3.17316e+06
total_time	13.2831	12.7141	0.0074	0.0069

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805039	441118	1.61572e+06	6.04619e+06
total_time	16.1117	9.5659	0.0075	0.0069

Plot:

This reverts commit 468b797.

github-actions · 2024-04-23T21:06:58Z

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.935	199.132	2571.33	10604.2
total_time	9.0174	4.3779	0.0093	0.0051

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.22	4110.79	5928.17	18859.2
total_time	3.2357	3.6122	0.006	0.0047

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.8	123119	213677	4.68961e+06
total_time	16.4979	6.8986	0.0079	0.0069

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966295	422332	656723	3.17316e+06
total_time	13.0606	6.6079	0.0076	0.0069

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805038	441118	1.61572e+06	6.04619e+06
total_time	12.4753	11.1516	0.0077	0.0081

Plot:

github-actions · 2024-04-23T21:22:57Z

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.935	199.132	2571.33	10604.2
total_time	3.8388	5.3754	0.0089	0.0047

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.22	4110.79	5928.17	18859.2
total_time	3.5625	3.8001	0.0056	0.0048

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.7	123119	213677	4.68961e+06
total_time	8.6394	8.9461	0.0077	0.0068

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966294	422332	656723	3.17316e+06
total_time	14.0607	10.4075	0.0077	0.0069

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805038	441118	1.61572e+06	6.04619e+06
total_time	15.1627	15.6564	0.0078	0.0074

Plot:

github-actions · 2024-04-24T03:33:30Z

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	3.0762	4.1987	0.0085	0.0047

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	6.0846	5.7006	0.0056	0.0047

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.7	123119	213677	4.68961e+06
total_time	6.1213	6.7459	0.0079	0.0069

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966294	422332	656723	3.17316e+06
total_time	12.8783	6.4568	0.0075	0.0069

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805039	441118	1.61572e+06	6.04619e+06
total_time	13.3269	11.1653	0.0076	0.007

Plot:

github-actions · 2024-04-24T04:01:25Z

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	3.2159	2.7859	0.0088	0.005

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	3.7601	2.9023	0.0057	0.0049

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.7	123119	213677	4.68961e+06
total_time	4.0428	3.3859	0.008	0.007

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966294	422332	656723	3.17316e+06
total_time	4.2901	3.119	0.0077	0.0073

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805039	441118	1.61572e+06	6.04619e+06
total_time	5.2636	3.3561	0.0076	0.007

Plot:

AzulGarza

awesome @jmoralez! 🥳🎊🫶

rename module to nixtla

6a91b99

jmoralez added 2 commits April 23, 2024 10:48

fixes

65e8265

add plotting extra in models performance

0fdf5b4

jmoralez added 2 commits April 23, 2024 14:18

ensure imports are relative

7d353ad

publish to test pypi

3231ce4

jmoralez added 7 commits April 23, 2024 14:34

remove action_files init

8d01dfe

interpret linebreak

8602db8

disable other checks

468b797

bump version for test pypi

e646bd6

Revert "disable other checks"

c241050

This reverts commit 468b797.

update python-publish and enable trusted publish for test pypi

60eb85d

exclude action_files in setup and restore version

0479037

fix import

89c3034

jmoralez marked this pull request as ready for review April 23, 2024 22:03

jmoralez requested a review from AzulGarza April 23, 2024 22:22

pin dask-expr

9dfead8

pin dask

e3557c3

AzulGarza approved these changes Apr 24, 2024

View reviewed changes

jmoralez merged commit d72acd6 into main Apr 24, 2024

jmoralez deleted the rename branch April 24, 2024 14:37

jmoralez mentioned this pull request Apr 25, 2024

v0.4.0 #309

Merged

rename module to nixtla #298

rename module to nixtla #298

Uh oh!

Conversation

jmoralez commented Apr 23, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

review-notebook-app bot commented Apr 23, 2024

Uh oh!

github-actions bot commented Apr 23, 2024

Experiment 1: air-passengers

Description:

Results:

Plot:

Experiment 2: air-passengers

Description:

Results:

Plot:

Experiment 3: electricity-multiple-series

Description:

Results:

Plot:

Experiment 4: electricity-multiple-series

Description:

Results:

Plot:

Experiment 5: electricity-multiple-series

Description:

Results:

Plot:

Uh oh!

github-actions bot commented Apr 23, 2024

Experiment 1: air-passengers

Description:

Results:

Plot:

Experiment 2: air-passengers

Description:

Results:

Plot:

Experiment 3: electricity-multiple-series

Description:

Results:

Plot:

Experiment 4: electricity-multiple-series

Description:

Results:

Plot:

Experiment 5: electricity-multiple-series

Description:

Results:

Plot:

Uh oh!

github-actions bot commented Apr 23, 2024

Experiment 1: air-passengers

Description:

Results:

Plot:

Experiment 2: air-passengers

Description:

Results:

Plot:

Experiment 3: electricity-multiple-series

Description:

Results:

Plot:

Experiment 4: electricity-multiple-series

Description:

Results:

Plot:

Experiment 5: electricity-multiple-series

Description:

Results:

Plot:

Uh oh!

github-actions bot commented Apr 23, 2024

Experiment 1: air-passengers

Description:

Results:

Plot:

jmoralez commented Apr 23, 2024 •

edited

Loading