Add more unit tests for models

[roedoejet]

see test_model.py for some examples. We should add unittests for inference using dummy checkpoints.

[roedoejet]

Tried to address this in #252, but was foiled. See #258