Skip to content

Conversation

@liangchenye
Copy link
Member

Signed-off-by: Liang Chenye [email protected]

Based on previous PR (mrunalp/ocitools#10).

  1. correct rootfs reading problem
    way to try it:
    make a bundle 'testbundle for example' by ocitools generate & tar xzvf rootfs.tar.gz
    ocitools bvalidate --path=testbundle
  2. add 'reflect' to check 'omitempty' in spec/*go file
    open it once spec version in Godeps updated with opencontainer/specs

bvalidate.go Outdated
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

s/support/supported/

@liangchenye
Copy link
Member Author

Replace original validate.go with new one (bvalidate.go).

@mrunalp @zenlinTechnofreak
so runtimevalidate will not be a sub-command but a test framework, right?

@zenlint
Copy link
Contributor

zenlint commented Jan 25, 2016

@liangchenye @mrunalp I think if we named bundle validation tool as validateCommand of ocitool, the only way to push runtime validation tool into the repo is to create a seperate main programme from ocitool, no matter it is a framework or not.

If in that way, I should rebase my PR 'Add initial version of runtimetest command: #9' to a seperate tool, but not a sub command.

What is your design in the ocitools repo? It should be nice if you can let me know. Thanks very much.

@liangchenye
Copy link
Member Author

@zenlinTechnofreak my opinion is we should provides three official sub-command in ocitools.

  1. generate
    -- generate bundle according to user's input
  2. bundle validate
    -- validate if a bundle is valid
    once the 'layered' bundle released, more validating codes will needed.
  3. runtime validate
    -- validate if a runtime is valid
    pass all the test cases you provided.
    it is very similar to test_runtime.sh, the original requirement is Convert test_runtime.sh into a go program mrunalp/ocitools#8

Other command/program/script like get-stage3.sh is important, but maybe suitable to put into a 'contrib' directory. @wking

@wking
Copy link
Contributor

wking commented Jan 26, 2016

On Tue, Jan 26, 2016 at 02:23:16AM -0800, 梁辰晔 (Liang Chenye) wrote:

Other command/program/script like get-stage3.sh is important, but
maybe suitable to put into a 'contrib' directory. @wking

get-stage3.sh is certainly internal tooling and not part of this
package's public interface. Feel free to put it wherever you like ;).

@mrunalp
Copy link
Contributor

mrunalp commented Jan 26, 2016

@liangchenye Yes, having these 3 commands makes sense.

@ChengTiesheng
Copy link
Contributor

@liangchenye @zenlinTechnofreak @mrunalp @wking, a more command maybe needed: oci convert, which converts oci bundle to other container images(e.g. docker image or ACI image), any thoughts?

@wking
Copy link
Contributor

wking commented Jan 27, 2016

On Tue, Jan 26, 2016 at 05:53:44PM -0800, Tiesheng wrote:

oci convert, which converts oci bundle to other container
images(e.g. docker image or ACI image), any thoughts?

Conversions like that are going to be complicated and lossy (at least
in one direction, it seems unlikely that the feature sets are
identical for two tools). I'd rather keep conversion tools like that
in different repositories to cut down on noise in the
conformance-testing tool. But I agree that those tools will be
useful, so +1 to putting them under opencontainers/ if you can attract
enough OCI-member support for them.

@liangchenye
Copy link
Member Author

@ChengTiesheng I'll create a new PR to add 'contrib' directory.
The convert tools could be add to that directory.

@liangchenye
Copy link
Member Author

Use bundleValidateCommand (bvalidate) as the sub-command.

@zenlinTechnofreak maybe you can use
runtimeValidateCommand(rvalidate) as another sub-command to do the runtime test.

Signed-off-by: liangchenye <[email protected]>
Mrunal Patel and others added 2 commits February 5, 2016 10:54
add contrib directory and mv get-stage3 to that
@liangchenye liangchenye closed this Feb 5, 2016
@liangchenye liangchenye deleted the bundle branch February 5, 2016 09:40
fmuyassarov pushed a commit to fmuyassarov/runtime-tools that referenced this pull request May 4, 2023
To verify the changes in opencontainers#4, I intentionally broke Diagnostic() by
prefixing lines with "!" instead of "#" but the tests still passed.
The spec[1] allows a test harness to silently ignore lines it doesn't
understand, so that behavior makes sense.

Red light green light testing[2] requires that our test be capable of
failing if something is broken.  This commit adds that by comparing
the actual output against our expected output.

Hat tip to @wking for suggesting to compare output[3].

1: http://testanything.org/tap-version-13-specification.html#anything-else
2: http://stackoverflow.com/a/404860/174463
3: mndrix/tap-go#4 (comment)
fmuyassarov pushed a commit to fmuyassarov/runtime-tools that referenced this pull request May 4, 2023
Now that we have a function to generate diagnostic output, we don't
have to construct it manually.

See opencontainers#4
fmuyassarov pushed a commit to fmuyassarov/runtime-tools that referenced this pull request May 4, 2023
Now that we have a function to generate diagnostic output, we don't
have to construct it manually.

See opencontainers#4
fmuyassarov pushed a commit to fmuyassarov/runtime-tools that referenced this pull request May 6, 2023
To verify the changes in opencontainers#4, I intentionally broke Diagnostic() by
prefixing lines with "!" instead of "#" but the tests still passed.
The spec[1] allows a test harness to silently ignore lines it doesn't
understand, so that behavior makes sense.

Red light green light testing[2] requires that our test be capable of
failing if something is broken.  This commit adds that by comparing
the actual output against our expected output.

Hat tip to @wking for suggesting to compare output[3].

1: http://testanything.org/tap-version-13-specification.html#anything-else
2: http://stackoverflow.com/a/404860/174463
3: mndrix/tap-go#4 (comment)
fmuyassarov pushed a commit to fmuyassarov/runtime-tools that referenced this pull request May 6, 2023
Now that we have a function to generate diagnostic output, we don't
have to construct it manually.

See opencontainers#4
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants