Skip to content

Conversation

@zlsh80826
Copy link
Collaborator

@zlsh80826 zlsh80826 commented Jun 18, 2021

PR types

Others

PR changes

Others

Describe

Some usage of TensorRT is deprecated in TensorRT6, and those deprecation will be removed from TensorRT8. This PR intend to use the latest APIs which are compatible with TensorRT6-8.

  1. DimsCHW -> Dims3 (Reference)
  2. DimsNCHW -> Dims4 (Reference)
  3. createNetwork is equal to createNetworkV2(0U) (Reference)
  4. IBuilder::allowGPUFallback, IBuilder::setDLACore, IBuilder::setFp16Mode, IBuilder::setInt8Mode, IBuilder::setMaxWorkspaceSize, IBuilder::setStrictTypeConstraints are deprecated. Those configurations should be set by IBuilderConfig. (Reference)
  5. Remove duplicated int8/fp16 configurations for dynamic shape
  6. buildCudaEngine is deprecated and it is replaced by buildEngineWithConfig (See 4.)
  7. deserializeCudaEngine with 3 arguments is used for v1 plugins, and v1 plugins will be exclude from TensorRT8.

@paddle-bot-old
Copy link

Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

Copy link
Member

@shangzhizhou shangzhizhou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link

@cryoco cryoco left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@shangzhizhou shangzhizhou merged commit b6e9498 into PaddlePaddle:develop Jun 24, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants